Download Technical Overview

Technological Aspects
April 27-28, 2011
Fairbanks, Alaska
Design Strategy
•
•
•
•
•
Top Down Approach
Identify requirements
Develop specific science questions to be answered
and analyses to be conducted based on
requirements
Determine data required for analyses
Approach ensures that focus is on realizing tools for
ice road planning
Requirements and science questions drove
development of NSDSS architectural design:
• Cyber infrastructure (CI)
• NSDSS.net
Information Solution
North Slope DSS
Web Portal
Cyber Infrastructure
Data, Tools, Reports
Catalog
Service
GIS-based
Metadata for all
Databases
Model Data:
Publish
Field Data:
WERC, Publish
(ODM-based)
Local
Cache
Combination of
new and Existing
Databases, owned
by data partners
GIS Data
(WMS, WFS)
Climate Forecasts
ReAnalysis
(NetCDF)
An example of how it will Work?
1
Intent is to Evaluate
Potential Ice Road
NorthSlopeDSS
Route(s)
3
2 DecideWorkbench
to do Ice Road
GIS-based
Planning
Study; select
Desktop
Tool
start and end point
Ask Catalog Service for
Data Nodes that contain
suitable data (Terrain, GIS
Data, Tools, Reports
– Lakes, Sensitive Areas)
CyberInfrastructure
Catalog
Service
4
Catalog Service provides
names and call methods
and parameters for Nodes
Workbench
5 Requests
Data
7
User Conducts Analysis
and documents findings
8
Local
User Completes
Cache
Evaluation Report
6
Metadata for all
information
Field
Data
GINA
GIS Node
Node Serves
Data
9 User saves findings and
brings into decision process.
Climate Data
NSDSS Data Sources
CyberInfrastructure
NorthSlopeDSS
Workbench
Catalog Service
Metadata for all
Databases
GIS-based
Desktop Tool
WERC Field Data
(ODM-based)
Local
Cache
Data
Models
NSDSS NetCDF
-GCM Climate Scenarios
-Re-Analysis
NSDSS ArcGIS
-Lakes DB
-Transportation
-Hydrography
-DEM
Read-Only
ESRI World Map
(ODM-based)
NSDSS Publish
Database
(ODM-based)
NSDSS Model
Database
(xml-based model
descriptions)
Publishable
NSF Data
Conservancy/ EOL
Endangered
Species Service
External
Federated Databases
WERC (UAF) ODM:
Environmental, meteorological, and hydrologic data
MS SQL-Server database using the CUASHI standard for storage of field
observations, ODM
NSDSS NetCDF Database:
Standard data file format for storing geospatial time series information in
the atmospheric science world
Forecasting water availability - General Circulation Models (GCMs) data:
scenarios for how green house gases may be controlled in the coming
century.
NSDSS ODM Publish Database:
Publishing new field observations or through re-analysis of existing field
observations
Web methods added for publishing the data to the ODM database
A NetCDF Data Service
• In Atmospheric Research Field,
data is stored in binary files
(netCDF), not relational databases
(ODM).
• Historical data is Re-Analyzed into
gridded formats too.
CyberInfrastructure
Data, Tools, Reports
Catalog
Service
• Net CDF Data Service
Metadata for all
information
• Stores gridded data files,
• Ask for GeoWindow and
Variable,
• Catalog Service Mediates,
• Provides back stream of data
in XML, or spawns mini netcdf
file.
Historical Field
Measurements
GIS Data
NetCDF Data
Service
Federated Databases
NSDSS Model Publish Database:
Facilitate sharing of ice road plans, water budget models, and water quality
models for the review process
MS SQL Server Database for storing models.
Web service created for searching, serving, and publishing the models
NSDSS ArcGIS Server:
Geographic data which serves road networks, watersheds, and a North
Slope-wide digital elevation model
Primarily products of the North Slope Science Initiative
North Slope lakes database created as part of a joint NSDSS-Alaska DOT
project.
ArcGIS Server is an ArcGIS Server 10.0 installation
Federated Databases - Existing
ESRI Base Map
Used in the NSDSS.net web portal
GINA Map Services
Geographic Information Network of Alaska, provides multiple OGCstandard map services for remotely sensed data across the North Slope.
Includes digital elevation models (Satellite and LIDAR based), aerial
imagery, MODIS-based infrared imagery, among others.
NSDSS is working with GINA to create web feature services for
hydrographic elements and sufficiently detailed DEM data.
Tying It All Together
Metadata Catalog Service
Created to facilitate searching for data within NSDSS’s multiple databases
Stores information on each time series in the various ODM databases, the
NetCDF Database, and each publish database
Consumer asks for data, the catalog leads the consumer to the various
databases that contain the data.
Semantic Mediation
Process used by the metadata catalog service to equate data of different
variable names
Example:
IPCC-standard for temperature is termed “tas”
WERC ODM database observations of temperature “WERC_tmp”
Time series named differently, but contain data of the same variable
Semantic mediation maps one name to the other to ensure that a search for
temperature results in finding both sets of data
Tying It All Together
Unit Mediation
Web service allows data consumers to request data with their desired unit
Service automatically converts the data in the database from its raw unit to
the requested unit before providing it back to the consumer
Accomplished by providing a central conversion coefficient service
Keeping the conversion service central ensure that the conversion
coefficients only have to be stored in one place
Automated Time Series Processing
Each database’s web service allows the data consumer to request data
with a desired interval (annual, monthly, daily, hourly, raw) and statistic
(min, max, average, sum, count, raw)
Web service converts the time series to the desired interval and statistic
prior to providing it to the data consumer.
Authentication
• Big Question relates to
who can see the data,
• Added Authentication, so
consumers of web
services must have valid
username and password
before data is provided
back.
• User Base Maintained in
Catalog Service.
CyberInfrastructure
Workbench
Data, Tools, Reports
GIS-based
Desktop Tool
Catalog
Service
Metadata for
all
information
Historical
Data
Local
Cache
GIS Data
Climate
Projections
NSDSS Web Portal
nsdss.net
• MS Silverlight-based web application
• Enables exploration of data, analysis, and
publication of findings
• Data stored in statewide cyber infrastructure, and is
accessed directly through the web portal through
web services
• Map-based application containing four modules that
interact with map:
•
•
•
•
Data Exploration
Data Publishing
Environmental Analysis
Ice Road Planning
NSDSS Software Layout
Search for all data within the
NSDSS Cyberinfrastructure
Uses Semantic Mediation