Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Web-GIS portal for multisource geographic data of Nordic Sea Name :Phalguni Pal Supervisor: Dhayalan. Velauthapillai Nansen Environmental and Remote Sensing Center Outline of the talk Introduction Problem definition Objectives Software and tools Database (ODB) Initial work Challanges Discussion Conclusion Introduction Nansen Ceneter(NERSC) : an independent non-profit research institute affiliated with the University of Bergen. Basically work on applied environmental research. Introduction 2 This master thesis is combination of two projects running at Nansen Center called DISPRO and INTAS. DISPRO: European research project. Currently running on Nansen Center. Web-base GIS system. Monitoring oil spills and harmful algal blooms using satellite images. Indroduction3 • INTAS: EU project running at NERSC. Oceanographic data (OD) collected from Nordic sea. Huge number of unorganized data. Make a well managed ODB. Problem definition Prepare oceanographic data for a suitable & well organized way Display the informations in the browser with user friendly manner To avoid use of expansive GIS tools e.g. ArcExlporer, Problem definition Prepare oceanographic data for a suitable & well organized way Display the informations in the browser with user friendly manner To avoid use of expansive GIS tools e.g. ArcExlporer, Idealware, ArcMap etc. ODB of INTAS : Huge numbers of data collected during the period 1882-2007 from North Atlantic with the NS sub area. Three different databases and data processing: Initial data with chance of duplicity. Observed and interpolated data. Objective analyzed monthly fields data with errors estimates. Data Processing: Initial data with chance of duplicity: Error estimation process: 1.Download data (more than 20 converters) from initial sources to separate databases. 2.Quality control for all initial databases (9 procedures). 3.Standard deviation flags. 4.Interpolation at the standard levels. 5.Objective analysis of the monthly fields (with kriging errors estimates). Quality-duplicate controlled, merged initial database Observed and interpolated data. Objectively analyzed databases for requested grid net Objective analyzed monthly fields data with errors estimates. Mean and anomalies fields at standard levels, in layers and on density surfaces NS database content: reference period for anomalies computing Year 0 1 2 3 4 5 6 8 9 1900 267 481 551 378 459 280 285 89 182 130 1910 221 76 172 306 62 0 7 0 69 15 1920 45 84 96 387 894 687 1458 824 457 942 1930 790 886 922 1568 1330 1776 1584 1940 1088 559 869 2024 1578 1950 2238 2629 3954 2987 4158 4382 4652 5528 7796 9335 1960 7530 6699 6037 7084 5761 5489 5481 5852 5326 6815 1970 1990 6703 5635 6147 7946 4950 5751 8317 8115 7064 6261 1001 1522 1343 1079 1275 15524 8675 8062 8503 0 2 3 6 6 8780 8 1499 4 6312 6070 6660 6556 5280 4342 5730 5454 5209 2000 4268 5178 4135 1722 1980 986 1298 1226 450 1280 857 1032 867 688 7 901 36 NS database content: countries Country Stations # 1 USSR/RUSSIA 132,081 2 NORWAY 123,740 3 UNKNOWN 68,678 4 UNITED KINDOM 20,408 5 ICELAND 19,808 6 UNITED STATES 15,946 7 GERMANY 11,157 8 DENMARK 5,125 9 POLAND 2,268 10 JAPAN 1,560 11 NETHERLAND 1,416 12 CANADA 1,203 NS database content: station sources source->stations 16000 15000 14000 Number of stations by source 13000 12000 11000 10000 9000 8000 7000 6000 5000 4000 3000 2000 1000 0 1900 1910 1920 1930 1940 1950 1960 1970 1980 1990 2000 2010 YEARS ODB_CA [154488] WOD2001 [83830] IMR9002 [34730] AARIod [27634] OBNINSK [27614] ODB_ICES [16727] VEINS_H [14919] MIKE2006 [11123] AARI_TGM [7375] WOD2005 [7233] AARIcr [5215] NPICD [3100] Cearex [2825] NNDCD [2416] ARGO [2414] PNSEC [756] AWI_CD [731] MMBI [386] TRACTOR [313] OVERFLOW [304] ESOP [215] GSP [181] MAIA [150] VEINS [113] NANSEN [10] CriuseReport [6] Initial data for this project Working on the selected data of 2006. Two different source of data, PF (Profiling floats) and RV (Research Vessels). PF is approx 2980 data and RV is approx 2404 data. Station position 1.01-31.12.2006 ODB-> Profiling floats (st: 2908) 1.01-31.12.2006 ODB-> Research Vessels (st: 2404) Station position Objectives An oceanographic Database (ODB). Develop a web-based application (Web-GIS) to display all different parameters in the ODB system in a browser as a station graph, section graph or section map without using any software/tools. The system will also display satellite images and forecasts from numerical models on the same map as ODB data. What is GIS? Geographical Information System. GIS is a computer system for capturing, storing, checking, integrating, manipulating, analyzing and displaying data related to positions on the Earth's surface. GIS is used for handling maps. Projection of Nordic sea: Selection of development method and why? Agile development methods XP- eXtreme Programming Selection of technoligies and why? Database: MySQL Other possibilities: Oracle, DB2, SQL Server, PostgreSQL UMN Mapserver 5.x (GDAL, OGR ). Apache Tomcat, Java. HTML, XML. Python. Full package : MS4W for Windows. Pictorial view of the project: Request for data(.ovf) Request Client/ Browser Response MySQL MapServer Map file Response data Application Server DB DISPRO database Tables: STATION P_SALINITY P_TEMPERETURE STATION_INFO Details of table’s columns: STATION ABSNUM STLAT STLON STDATE STTIME STSOURCE STVERSION STCOUNTRYNAME STVESSELNAME STDEPTHSOURCE STLEVEL STDEPTHGRID STDEPTHGRIDMIN STDEPTHGRIDMAX P_SALINITY Columns: ABSNUM LEVEL VALUE FLAG P_TEMPERATURE Columns: ABSNUM LEVEL VALUE FLAG STATION_INFO Columns: ABSNUM COUNTRYCODE VESSELCODE STNUMINCRUISE PROJECTCODE INSTITUTECODE INSTRUMENT SOURCEUNIQUEID SOURCEDATAORIGIN VESSELCRUISEID Relationship: ∞ 1 STATION_INFO ABSNUM COUNTRYCODE VESSELCODE STNUMINCRUISE PROJECTCODE INSTITUTECODE INSTRUMENT SOURCEUNIQUEID SOURCEDATAORIGIN VESSELCRUISEID 1 LEVEL ABSNUM VALUE FLAG STATION ABSNUM STLAT STLON STDATE STTIME STSOURCE STVERSION STCOUNTRYNAME STVESSELNAME STDEPTHSOURCE STLEVEL STDEPTHGRID STDEPTHGRIDMIN STDEPTHGRIDMAX P_SALINITY 1 1 P_TEMPERATURE ∞ ∞ LEVEL ABSNUM VALUE FLAG HTML request form MAPFILE REQUEST SERVICE VERSION LAYERS STYLES SRS BBOX WIDTH HEIGHT FORMAT Submit Result: position located on the map Expected display on browser (Section Map): Time series length (years) for latitude-longitude grid net for salinity. 75 80 70 78 65 76 60 55 74 67 50 45 72 40 68 70 35 30 68 25 66 60 20 64 15 10 62 60 -40 74 5 0 -30 -20 -10 0 10 YearAmount Database: CLIMATE_v2.IB Computer:ALEX File: _1_VInd_6 20 30 40 50 60 Challenges : New types of work. Work with maps. Initial problems with software versions and tool drivers Time consuming during upgrading softwares in server Changing of database many times. Changing of Platform(Linux -> Windows) Shortage of literature and web help in this field Discussion XP method realy fits with the project All new types of tools Selection of database was crucial Spatially enabled MySQL Problems in GUI & took lots of time to fix it Version problems & working with existing software Started late and working just 6 months Conclusion Still have some future work. Will have opportunity to future enhancement of the system. Welcome Questions?