* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Download PowerPoint Presentation - VIEWS - Visibility Information Exchange
Survey
Document related concepts
Data analysis wikipedia , lookup
Entity–attribute–value model wikipedia , lookup
Expense and cost recovery system (ECRS) wikipedia , lookup
Information privacy law wikipedia , lookup
Versant Object Database wikipedia , lookup
Semantic Web wikipedia , lookup
Open data in the United Kingdom wikipedia , lookup
Business intelligence wikipedia , lookup
Data vault modeling wikipedia , lookup
Relational model wikipedia , lookup
Microsoft SQL Server wikipedia , lookup
Transcript
Intermountain West Data Warehouse Western Air Quality Study (IWDW-WAQS) Online Tools Overview IWDW MPE Tools Review March 2, 2017 Background • Intermountain West Data Warehouse - Western Air Quality Study (IWDW-WAQS) • CAMx and CMAQ modeling to accommodate the needs of the Cooperators for air quality planning • Cooperators include representatives from state and federal agencies • Modeling platforms have applications to: • National Environmental Protection Act (NEPA) modeling studies • State Implementation Plan (SIP) modeling for ozone, particulate matter, and haze planning Research studies that require comprehensive and up-to-date emissions inventories and air quality modeling platforms • IWDW MPE Tools Review March 2, 2017 Overview IWDW-WAQS activities include: • Monitoring: ozone and PM • Monitoring network assessment for expanded WAQS region • Modeling: emissions, meteorology and air quality modeling • Base year and future projections • Data Warehouse: maintenance and operation • • • Modeling studies include 2008, 2011, preliminary 2014; external modeling studies Data request and inventory tracking IWDW website wiki and user forum • Interaction with Cooperators on modeling activities, online tool development, modeling and monitoring analyses Benefits to users: • Cost savings • Centralized platform to store and share data • Tools and data products for MPE • High quality emissions and AQ modeling IWDW MPE Tools Review March 2, 2017 Tool System Overview Modeling Team Monitoring Systems Modeling Systems Monitoring Systems SMOKE Reports imported to SQL Server DB IWDW Combine and Site Compare outputs Site Compare output loaded to database Environ Develops Platform specific Web Application and Database AMET Generates Static Plots Database and Web Code Delivered to IWDW AMET Plots Uploaded to IWDW File Server Files named with appropriate format Web Application and Database loaded to IWDW servers NCF Files are Generated And Uploaded to file server Basic Metadata for NCF files defined in JSON Monitoring Data imported to relational database MS SQL Server Linux File Server IIS Web Server Query Wizard Summary Tools Emissions Review Map Emissions Review Charts Model To Obs Source Apportionment IWDW MPE Tools Review March 2, 2017 MPE Plot Browser Grid Browser Emissions Review Tool • Purpose: Provide breakdown of emissions by Emissions Review Tool state, county and source category • Tech: • Data: • Microsoft SQL Server • Server Side: • IIS web hosting • ASP.net Web services • ChartFX charting library • Client Side: • jQuery • Process: • Modeling Team generates appropriate SMOKE reports • Modeling Team uploads reports to SQL Server Database • IWDW Team preforms minimal database QA http://views.cira.colostate.edu/TSDW/Emissions/ReviewTool.aspx • Features: • Displays bar chart of emissions contributions at the state or county level • Source category contributions represented as portions of each bar • Chart data downloadable. IWDW MPE Tools Review March 2, 2017 Emissions Review Map • Purpose: Provide breakdown of emissions by Emissions Review Tool state, county and source category on a map • Tech: • Data: • Microsoft SQL Server • Server Side: • IIS web hosting • ASP.net Web services • Client Side: • jQuery • Highcharts.js • Highmaps.js • Process: • Modeling Team generates appropriate SMOKE reports • Modeling Team uploads reports to SQL Server Database • IWDW Team preforms minimal database QA • Features: • Map displays county level emissions for a specified parameter and source categories • Chart displays source category breakdown for selected state or county http://views.cira.colostate.edu/TSDW/Maps/EmissionsMap.aspx • Chart slices support drill down to SCC codes • All configuration embedded in URL for quick reference IWDW MPE Tools Review March 2, 2017 Source Apportionment • Purpose: Display source attribution for modeled ozone on Emissions Review Tool specific days. • Tech • Data: • Microsoft SQL Server • Server Side: • IIS web hosting • ASP.Net web services • Telerik Platform • Client Side: • Kendo UI • Process: • Environ Processes Modeling output • Environ Develops web application • Database and Web application Delivered to IWDW • IWDW deploy Database and web application http://views.cira.colostate.edu/TSDW/Data/SourceApportionment.aspx IWDW MPE Tools Review March 2, 2017 Model To Observation • Purpose: Provide Site specific time series plots of Emissions Review Tool modeled and observed parameters. • Tech • Data • Microsoft SQL Server Database • Server Side: • IIS web hosting • ASP.Net web services • ChartFX Charting Library • Client Side: • jQuery • Process: • Modeling team performs post processing to align model to monitoring • Modeling team delivers model to observation data to IWDW team • IWDW team imports data to relational database • Features: • Chart data visible in browser • Chart data downloadable • Mouse over to get specific values • Network wide and Site specific plots available http://views.cira.colostate.edu/TSDW/Modeling/ModelObsComparison_IWDW.aspx IWDW MPE Tools Review March 2, 2017 Plot Browser • Purpose: Index and deliver modeling-team generated static plots. Emissions Review Tool • Tech: • Data: • Static Images on Linux Server delivered via FTP • Server Side: • IIS Web Hosting • SSH.Net • ASP.Net Web Services • Client Side: • HTML/CSS/JavaScript • jQuery • Process • Modeling Team Generates Static Plots • Modeling Team Renames image files per convention • Modeling Team Uploads plots to Linux file server • IWDW Performs minimal QA on image files • Features: • Images downloadable • Image directories open for browsing http://views.cira.colostate.edu/TSDW/Tools/ImageBrowser.aspx?fscmdid=TsdwPlotsRoot_CmdInfo IWDW MPE Tools Review March 2, 2017 Grid Browser • Purpose: Provide interactive display of gridded Emissions Review Tool data and grid cell time series. • Data: • NetCDF files stored on Linux Server • Server Side: • Apache Web Hosting (For Web Services) • Python Flask Web Services • IIS Web Hosting (For static html/css/js) • Client Side: • Highcharts.js • Highmaps.js • Moments.js • Chroma.js • PNGLib.js • Process: • Modeling team generates NetCDF Files • Modeling team loads NetCDF to Linux File Server • IWDW team records basic meta data in json file http://views.cira.colostate.edu/DEMO2/Maps/GridBrowser.aspx • Features: • Rendering performed in browser • User specified coloring • All configuration embedded in URL for quick reference IWDW MPE Tools Review March 2, 2017 Query Wizard • Purpose: Retrieve raw and derived monitoring data products. Emissions Review Tool • Data: • Microsoft SQL Server Database • Server Side: • IIS Web Hosting • ASP.NET, Visual Basic .NET • ChartFX Charting library • Client Side: • Javascript, HTML5, CSS3, JSON, jQuery, AJAX • Process: • Source data is obtained from data providers • Source data is extracted, transformed, and loaded into the FED relational database • Report templates that query the database and present the result in tables, graphs, and charts are added as “plug ins” to the Query Wizard • The end user makes selections from the Query Wizard to select a report and then filter and format the resulting view • Features: • Bulk data download • Data visualization • Filtering, sub-setting, transforming, and formatting http://views.cira.colostate.edu/TSDW/DataWizard/Default.aspx IWDW MPE Tools Review March 2, 2017 Monitoring Summary Tools • Purpose: Present visual summaries of monitoring data Emissions Review Tool • Data: • Microsoft SQL Server Database • Server Side: • IIS Web Hosting • ASP.NET, Visual Basic .NET • ChartFX Charting library • Client Side: • Javascript, HTML5, CSS3, JSON, jQuery, AJAX • Process: • Source data is obtained from data providers • Source data is extracted, transformed, and loaded into the FED relational database • Report templates that query the database and present the result in tables, graphs, and charts are added as “plug ins” to the Query Wizard • The end user selects a monitoring site from the map and a summary report, and the report for that site is displayed below the map • Features: • Data aggregation and analysis • Map-based selection of monitoring sites • High-level interpretations of the data http://views.cira.colostate.edu/TSDW/SiteBrowser/Default.aspx?... IWDW MPE Tools Review March 2, 2017 An Integrated System of Systems NPS Air Quality Conditions & Trends Tools Federal Land Manager Environmental Database (nps.gov) (FED) Partners: NPS/ARD Intermountain West Data Warehouse Partners: NPS, USFS Databases Websites Hardware Software (IWDW) Partners: NPS, BLM, USFS, EPA, CO, WY, UT, NM Southeastern Modeling, Analysis, and Planning (SEMAP) Partners: EPA, AL, FL, GA, KY, MS, NC, SC, TN