Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Entity–attribute–value model wikipedia , lookup
Data Protection Act, 2012 wikipedia , lookup
Semantic Web wikipedia , lookup
Data center wikipedia , lookup
Clusterpoint wikipedia , lookup
Data analysis wikipedia , lookup
Forecasting wikipedia , lookup
3D optical data storage wikipedia , lookup
Data vault modeling wikipedia , lookup
Information privacy law wikipedia , lookup
Technological Aspects April 27-28, 2011 Fairbanks, Alaska Design Strategy • • • • • Top Down Approach Identify requirements Develop specific science questions to be answered and analyses to be conducted based on requirements Determine data required for analyses Approach ensures that focus is on realizing tools for ice road planning Requirements and science questions drove development of NSDSS architectural design: • Cyber infrastructure (CI) • NSDSS.net Information Solution North Slope DSS Web Portal Cyber Infrastructure Data, Tools, Reports Catalog Service GIS-based Metadata for all Databases Model Data: Publish Field Data: WERC, Publish (ODM-based) Local Cache Combination of new and Existing Databases, owned by data partners GIS Data (WMS, WFS) Climate Forecasts ReAnalysis (NetCDF) An example of how it will Work? 1 Intent is to Evaluate Potential Ice Road NorthSlopeDSS Route(s) 3 2 DecideWorkbench to do Ice Road GIS-based Planning Study; select Desktop Tool start and end point Ask Catalog Service for Data Nodes that contain suitable data (Terrain, GIS Data, Tools, Reports – Lakes, Sensitive Areas) CyberInfrastructure Catalog Service 4 Catalog Service provides names and call methods and parameters for Nodes Workbench 5 Requests Data 7 User Conducts Analysis and documents findings 8 Local User Completes Cache Evaluation Report 6 Metadata for all information Field Data GINA GIS Node Node Serves Data 9 User saves findings and brings into decision process. Climate Data NSDSS Data Sources CyberInfrastructure NorthSlopeDSS Workbench Catalog Service Metadata for all Databases GIS-based Desktop Tool WERC Field Data (ODM-based) Local Cache Data Models NSDSS NetCDF -GCM Climate Scenarios -Re-Analysis NSDSS ArcGIS -Lakes DB -Transportation -Hydrography -DEM Read-Only ESRI World Map (ODM-based) NSDSS Publish Database (ODM-based) NSDSS Model Database (xml-based model descriptions) Publishable NSF Data Conservancy/ EOL Endangered Species Service External Federated Databases WERC (UAF) ODM: Environmental, meteorological, and hydrologic data MS SQL-Server database using the CUASHI standard for storage of field observations, ODM NSDSS NetCDF Database: Standard data file format for storing geospatial time series information in the atmospheric science world Forecasting water availability - General Circulation Models (GCMs) data: scenarios for how green house gases may be controlled in the coming century. NSDSS ODM Publish Database: Publishing new field observations or through re-analysis of existing field observations Web methods added for publishing the data to the ODM database A NetCDF Data Service • In Atmospheric Research Field, data is stored in binary files (netCDF), not relational databases (ODM). • Historical data is Re-Analyzed into gridded formats too. CyberInfrastructure Data, Tools, Reports Catalog Service • Net CDF Data Service Metadata for all information • Stores gridded data files, • Ask for GeoWindow and Variable, • Catalog Service Mediates, • Provides back stream of data in XML, or spawns mini netcdf file. Historical Field Measurements GIS Data NetCDF Data Service Federated Databases NSDSS Model Publish Database: Facilitate sharing of ice road plans, water budget models, and water quality models for the review process MS SQL Server Database for storing models. Web service created for searching, serving, and publishing the models NSDSS ArcGIS Server: Geographic data which serves road networks, watersheds, and a North Slope-wide digital elevation model Primarily products of the North Slope Science Initiative North Slope lakes database created as part of a joint NSDSS-Alaska DOT project. ArcGIS Server is an ArcGIS Server 10.0 installation Federated Databases - Existing ESRI Base Map Used in the NSDSS.net web portal GINA Map Services Geographic Information Network of Alaska, provides multiple OGCstandard map services for remotely sensed data across the North Slope. Includes digital elevation models (Satellite and LIDAR based), aerial imagery, MODIS-based infrared imagery, among others. NSDSS is working with GINA to create web feature services for hydrographic elements and sufficiently detailed DEM data. Tying It All Together Metadata Catalog Service Created to facilitate searching for data within NSDSS’s multiple databases Stores information on each time series in the various ODM databases, the NetCDF Database, and each publish database Consumer asks for data, the catalog leads the consumer to the various databases that contain the data. Semantic Mediation Process used by the metadata catalog service to equate data of different variable names Example: IPCC-standard for temperature is termed “tas” WERC ODM database observations of temperature “WERC_tmp” Time series named differently, but contain data of the same variable Semantic mediation maps one name to the other to ensure that a search for temperature results in finding both sets of data Tying It All Together Unit Mediation Web service allows data consumers to request data with their desired unit Service automatically converts the data in the database from its raw unit to the requested unit before providing it back to the consumer Accomplished by providing a central conversion coefficient service Keeping the conversion service central ensure that the conversion coefficients only have to be stored in one place Automated Time Series Processing Each database’s web service allows the data consumer to request data with a desired interval (annual, monthly, daily, hourly, raw) and statistic (min, max, average, sum, count, raw) Web service converts the time series to the desired interval and statistic prior to providing it to the data consumer. Authentication • Big Question relates to who can see the data, • Added Authentication, so consumers of web services must have valid username and password before data is provided back. • User Base Maintained in Catalog Service. CyberInfrastructure Workbench Data, Tools, Reports GIS-based Desktop Tool Catalog Service Metadata for all information Historical Data Local Cache GIS Data Climate Projections NSDSS Web Portal nsdss.net • MS Silverlight-based web application • Enables exploration of data, analysis, and publication of findings • Data stored in statewide cyber infrastructure, and is accessed directly through the web portal through web services • Map-based application containing four modules that interact with map: • • • • Data Exploration Data Publishing Environmental Analysis Ice Road Planning NSDSS Software Layout Search for all data within the NSDSS Cyberinfrastructure Uses Semantic Mediation