Download PowerPoint Presentation - VIEWS - Visibility Information Exchange

Survey
yes no Was this document useful for you?
   Thank you for your participation!

* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project

Document related concepts

SQL wikipedia , lookup

Data analysis wikipedia , lookup

Entity–attribute–value model wikipedia , lookup

Expense and cost recovery system (ECRS) wikipedia , lookup

Data model wikipedia , lookup

Information privacy law wikipedia , lookup

Database wikipedia , lookup

Versant Object Database wikipedia , lookup

Semantic Web wikipedia , lookup

Open data in the United Kingdom wikipedia , lookup

Business intelligence wikipedia , lookup

Data vault modeling wikipedia , lookup

Relational model wikipedia , lookup

Microsoft SQL Server wikipedia , lookup

Clusterpoint wikipedia , lookup

Database model wikipedia , lookup

Transcript
Intermountain West Data Warehouse Western Air Quality Study
(IWDW-WAQS)
Online Tools Overview
IWDW MPE Tools Review March 2, 2017
Background
• Intermountain West Data Warehouse - Western Air Quality Study (IWDW-WAQS)
• CAMx and CMAQ modeling to accommodate the needs of the Cooperators for air
quality planning
• Cooperators include representatives from state and federal agencies
• Modeling platforms have applications to:
•
National Environmental Protection Act (NEPA) modeling studies
•
State Implementation Plan (SIP) modeling for ozone, particulate matter, and haze
planning
Research studies that require comprehensive and up-to-date emissions inventories
and air quality modeling platforms
•
IWDW MPE Tools Review March 2, 2017
Overview
IWDW-WAQS activities include:
• Monitoring: ozone and PM
•
Monitoring network assessment for expanded WAQS region
• Modeling: emissions, meteorology and air quality modeling
•
Base year and future projections
• Data Warehouse: maintenance and operation
•
•
•
Modeling studies include 2008, 2011, preliminary 2014; external modeling studies
Data request and inventory tracking
IWDW website wiki and user forum
• Interaction with Cooperators on modeling activities, online tool development,
modeling and monitoring analyses
Benefits to users:
• Cost savings
• Centralized platform to store and share data
• Tools and data products for MPE
• High quality emissions and AQ modeling
IWDW MPE Tools Review March 2, 2017
Tool System Overview
Modeling Team
Monitoring Systems
Modeling
Systems
Monitoring
Systems
SMOKE Reports imported to SQL Server DB
IWDW
Combine and Site Compare outputs
Site Compare output loaded to database
Environ Develops Platform specific Web
Application and Database
AMET Generates Static Plots
Database and Web Code Delivered to IWDW
AMET Plots Uploaded to IWDW File Server
Files named with appropriate format
Web Application and Database loaded to
IWDW servers
NCF Files are Generated
And Uploaded to file server
Basic Metadata for NCF files defined in JSON
Monitoring Data imported to relational
database
MS SQL Server
Linux File Server
IIS Web Server
Query Wizard
Summary
Tools
Emissions
Review Map
Emissions
Review Charts
Model To Obs
Source
Apportionment
IWDW MPE Tools Review March 2, 2017
MPE Plot
Browser
Grid Browser
Emissions Review Tool
• Purpose: Provide breakdown of emissions by
Emissions Review Tool
state, county and source category
• Tech:
• Data:
• Microsoft SQL Server
• Server Side:
• IIS web hosting
• ASP.net Web services
• ChartFX charting library
• Client Side:
• jQuery
• Process:
• Modeling Team generates appropriate SMOKE reports
• Modeling Team uploads reports to SQL Server
Database
• IWDW Team preforms minimal database QA
http://views.cira.colostate.edu/TSDW/Emissions/ReviewTool.aspx
• Features:
• Displays bar chart of emissions contributions at the
state or county level
• Source category contributions represented as
portions of each bar
• Chart data downloadable.
IWDW MPE Tools Review March 2, 2017
Emissions Review Map
• Purpose: Provide breakdown of emissions by
Emissions Review Tool
state, county and source category on a map
• Tech:
• Data:
• Microsoft SQL Server
• Server Side:
• IIS web hosting
• ASP.net Web services
• Client Side:
• jQuery
• Highcharts.js
• Highmaps.js
• Process:
• Modeling Team generates appropriate SMOKE reports
• Modeling Team uploads reports to SQL Server
Database
• IWDW Team preforms minimal database QA
• Features:
• Map displays county level emissions for a specified
parameter and source categories
• Chart displays source category breakdown for
selected state or county
http://views.cira.colostate.edu/TSDW/Maps/EmissionsMap.aspx
• Chart slices support drill down to SCC codes
• All configuration embedded in URL for quick
reference
IWDW MPE Tools Review March 2, 2017
Source Apportionment
• Purpose: Display source attribution for modeled ozone on
Emissions Review Tool
specific days.
• Tech
• Data:
• Microsoft SQL Server
• Server Side:
• IIS web hosting
• ASP.Net web services
• Telerik Platform
• Client Side:
• Kendo UI
• Process:
• Environ Processes Modeling output
• Environ Develops web application
• Database and Web application Delivered to IWDW
• IWDW deploy Database and web application
http://views.cira.colostate.edu/TSDW/Data/SourceApportionment.aspx
IWDW MPE Tools Review March 2, 2017
Model To Observation
• Purpose: Provide Site specific time series plots of
Emissions Review Tool
modeled and observed parameters.
• Tech
• Data
• Microsoft SQL Server Database
• Server Side:
• IIS web hosting
• ASP.Net web services
• ChartFX Charting Library
• Client Side:
• jQuery
• Process:
• Modeling team performs post processing to align
model to monitoring
• Modeling team delivers model to observation data to
IWDW team
• IWDW team imports data to relational database
• Features:
• Chart data visible in browser
• Chart data downloadable
• Mouse over to get specific values
• Network wide and Site specific plots available
http://views.cira.colostate.edu/TSDW/Modeling/ModelObsComparison_IWDW.aspx
IWDW MPE Tools Review March 2, 2017
Plot Browser
• Purpose: Index and deliver modeling-team generated static plots.
Emissions Review Tool
• Tech:
• Data:
• Static Images on Linux Server delivered via FTP
• Server Side:
• IIS Web Hosting
• SSH.Net
• ASP.Net Web Services
• Client Side:
• HTML/CSS/JavaScript
• jQuery
• Process
• Modeling Team Generates Static Plots
• Modeling Team Renames image files per convention
• Modeling Team Uploads plots to Linux file server
• IWDW Performs minimal QA on image files
• Features:
• Images downloadable
• Image directories open for browsing
http://views.cira.colostate.edu/TSDW/Tools/ImageBrowser.aspx?fscmdid=TsdwPlotsRoot_CmdInfo
IWDW MPE Tools Review March 2, 2017
Grid Browser
• Purpose: Provide interactive display of gridded
Emissions Review Tool
data and grid cell time series.
• Data:
• NetCDF files stored on Linux Server
• Server Side:
• Apache Web Hosting (For Web Services)
• Python Flask Web Services
• IIS Web Hosting (For static html/css/js)
• Client Side:
• Highcharts.js
• Highmaps.js
• Moments.js
• Chroma.js
• PNGLib.js
• Process:
• Modeling team generates NetCDF Files
• Modeling team loads NetCDF to Linux File Server
• IWDW team records basic meta data in json file
http://views.cira.colostate.edu/DEMO2/Maps/GridBrowser.aspx
• Features:
• Rendering performed in browser
• User specified coloring
• All configuration embedded in URL for quick
reference
IWDW MPE Tools Review March 2, 2017
Query Wizard
• Purpose: Retrieve raw and derived monitoring data products.
Emissions Review Tool
• Data:
• Microsoft SQL Server Database
• Server Side:
• IIS Web Hosting
• ASP.NET, Visual Basic .NET
• ChartFX Charting library
• Client Side:
• Javascript, HTML5, CSS3, JSON, jQuery, AJAX
• Process:
• Source data is obtained from data providers
• Source data is extracted, transformed, and loaded
into the FED relational database
• Report templates that query the database and
present the result in tables, graphs, and charts are
added as “plug ins” to the Query Wizard
• The end user makes selections from the Query
Wizard to select a report and then filter and format
the resulting view
• Features:
• Bulk data download
• Data visualization
• Filtering, sub-setting, transforming, and formatting
http://views.cira.colostate.edu/TSDW/DataWizard/Default.aspx
IWDW MPE Tools Review March 2, 2017
Monitoring Summary Tools
• Purpose: Present visual summaries of monitoring data
Emissions Review Tool
• Data:
• Microsoft SQL Server Database
• Server Side:
• IIS Web Hosting
• ASP.NET, Visual Basic .NET
• ChartFX Charting library
• Client Side:
• Javascript, HTML5, CSS3, JSON, jQuery, AJAX
• Process:
• Source data is obtained from data providers
• Source data is extracted, transformed, and loaded
into the FED relational database
• Report templates that query the database and
present the result in tables, graphs, and charts are
added as “plug ins” to the Query Wizard
• The end user selects a monitoring site from the map
and a summary report, and the report for that site is
displayed below the map
• Features:
• Data aggregation and analysis
• Map-based selection of monitoring sites
• High-level interpretations of the data
http://views.cira.colostate.edu/TSDW/SiteBrowser/Default.aspx?...
IWDW MPE Tools Review March 2, 2017
An Integrated System of Systems
NPS Air Quality
Conditions & Trends Tools
Federal Land Manager
Environmental Database
(nps.gov)
(FED)
Partners: NPS/ARD
Intermountain West
Data Warehouse
Partners: NPS, USFS
Databases
Websites
Hardware
Software
(IWDW)
Partners: NPS, BLM, USFS, EPA, CO, WY,
UT, NM
Southeastern
Modeling, Analysis, and
Planning
(SEMAP)
Partners: EPA, AL, FL, GA, KY, MS,
NC, SC, TN