Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Data Protection Act, 2012 wikipedia , lookup
Data center wikipedia , lookup
Clusterpoint wikipedia , lookup
Forecasting wikipedia , lookup
Data analysis wikipedia , lookup
3D optical data storage wikipedia , lookup
Data vault modeling wikipedia , lookup
Information privacy law wikipedia , lookup
CUAHSI Hydrologic Information System Project co-PI Collaborator Meeting Agenda • Monday – 8:30 to 10 Project Overview – 10:30 – noon Project PIs – Lunch provided here – 1-3 Live HIS demos – 3:30 – 5PM Discussion and feedback, User Assessment • Tuesday – 8:30 – 10AM Summary of User Assessment – 10:30 – noon Related programs – 1-3 National data sets – 3:30 – 5PM Other projects related to HIS • Wednesday --Training – Hydrologic Digital Library – Digital Watershed CUAHSI Hydrologic Information Systems Hydrologic Synthesis Additional Hypotheses Multi-Disciplinary Teams Data Hypotheses Community Support Needs Measurement Technology Technological Advances Hydrologic Observatories Tools Models Data Community Support Hydrologic Information Systems Exogenous Data Environmental Cyberinfrastructure • Part of NSF Cyberinfrastructure program • Special emphasis on environmental sciences fostered by Margaret Leinen (Asst Dir for GeoSciences) • CUAHSI Hydrologic Information Systems is one of several pilot projects • Contains documents, datasets, tools, presentations, tutorials • More data at ftp sites linked to CD • http:// links to project websites at individual universities Link to CD Hydrologic Information System 1. Hydrologic Observations Database Sensing Hydrologic System Sampling Recording Transmission Transmission Laboratory Analysis Editing On-Site Measurement Storage Recording Retrieval Off-Site Measurement Hydrologic Observations Database • A relational database stored in Access, PostgreSQL, SQL/Server, …. • Stores observation data made at points • Access data through web interfaces • Fill using automated data harvesting Streamflow Precipitation & Climate Water Quality Groundwater levels Soil moisture data Flux tower data Data Cube Time, T D Space, L Variables, V Data Cube in Arc Hydro Time, TSDateTime TSValue Space, FeatureID Variables, TSTypeID Geospatial Time Series Time Series Properties (Type) Value A Value-Time array Time Shape A time series that knows what geographic feature it describes and what type of time series it is ArcIMS Website for hydrologic observational data Thanks to ESRI San Antonio Neuse basin Output from the ArcIMS website Data open directly in Excel Database Design Relationships Automated Data Harvesting • Begin with a site file showing where data are available • Develop automated harvesting tools to ingest observations from agency websites • John Helly has done this for the NWIS data NWIS Surface Water Sites (Ken Lanfear) ACIS Climate Stations (Bill Noon) Hydrologic Statistics Upmanu Lall is our expert in this area Time Series Analysis D Geostatistics Multivariate analysis How do we understand space-time correlation fields of many variables? Aquatic Ecology • What kind of ecological observation data should we be collecting? • What kind of HIS does an aquatic ecologist need? • LeRoy Poff is our expert in this area Hydrology Ecology Geomorphology Some Conclusions • Hydrologic Observations Database design works and is ready for independent review and testing • Automated data harvesting may produce a “one stop shop” for observational data • There will never be enough database fields to describe all we want to know about data • We need a hybrid database—files solution – This is what the San Diego Supercomputer Center is doing for us Relational database “Pile of files” Hydrologic Information System Sensor Network Interfaces to Digital Library John Helly is our expert in this subject! Example is for wireless network in Santa Margarita watershed, San Diego HydroViewer Provides Access to… http://cuahsi.sdsc.edu Neuse Watershed Collection Santa Margarita Watershed Collection + your Hydrologic Observatory Data Collection 21 CUAHSILink enables ArcMap to read files directly from the Digital Library through an application programming interface New Concept of Publication Normal Method + Hydrologic Digital Library 23 Page 3 The Demands Numerical Models Prediction Air-Q Sensor Arrays HSPF MM5 NCDC METADATA USGS NWIS NCEP NWS Data Centers Drexel University, College of Engineering NGDC Individual Samples Page 10 Ontologies for Metadata Profile Hydrologic Metadata A consistent suite of geographic information schemata that will allow Geographic information to be integrated with information technology. ISO norm 19115. Semantic WEB Hydrologic Ontology www.isotc211.org Definition: The Semantic Web is the representation of data on the World Wide Web. It is based on the Resource Description Framework (RDF), which integrates a variety of applications using XML for syntax and URIs for naming. http://www.w3.org/2001/sw/ Prepare the CUAHSI Metadata Profile for the Future! Drexel University, College of Engineering "The Semantic Web is an extension of the current web in which information is given well-defined meaning, better enabling computers and people to work in cooperation." Page 21 More Ontologies Upper Hydrologic Ontology We currently What we need have is Many More ISO 19108 Temporal Objects ARCHydro Many More ISO 19115 Geospatial ISO 19103 Units/Conversion USGS Hydrologic Unit Code Hydrologic Processes Sedimentation Many More Michael Piasecki is our expert in this subject! Drexel University, College of Engineering Many More Ontology Examples Hydrologic Information System 2. Hydrologic Representation Hydrologic Observation Data (Relational database or delimited ascii) Geospatial Data (GIS) Digital Watershed Remote Sensing Data Weather and Climate Data (EOS-HDF) (NetCDF) Hydrologic Data Model Hydrologic Fluxes and Flows Digital Watershed (Atmospheric, surface and subsurface water) We need to represent the physical environment and water flowing through it Digital Watershed: An implementation of the CUAHSI Hydrologic Data Model for a particular region Created first for the Neuse basin Neuse Atmospheric Water • Daily precipitation data from NCDC gages • Nexrad daily rainfall rasters • Land surface – atmosphere fluxes from North American Regional Reanalysis of climate Neuse Surface Water • Streamflow, water quality hydrologic observational data • GIS: River network, water bodies, watersheds, monitoring points • Land cover, soils, • MODIS remote sensing (Praveen Kumar) MODIS Terrain and Land Cover http://neuse.crwr.utexas.edu/ ArcIMS Web Server displaying data compiled in Neuse HO Planning Study Neuse Basin: Coastal aquifer system Section line Beaufort Aquifer * From USGS, Water Resources Data Report of North Carolina for WY 2002 Neuse Groundwater Geovolumes of hydrogeologic units from US Geological survey (GMS) Create a 3 dimensional representation Geovolume Each cell in the 2D representation is transformed into a 3D object Geovolume with model cells HIS-USA • Base map information for building digital watersheds anywhere in the US • Hydrologic Observatory regions • Monitoring site files • National river network connected to HUC watersheds • Hydrologic landscape regions Hydrologic Information System 3.Hydrologic Analysis Hydrologic Process Modeling Statistics and Hypothesis Testing Digital Watershed Visualization Data Mining and Knowledge Discovery Data Driven Discovery Tools Praveen Kumar is our expert on this subject! Time Series Analysis D Geostatistics Data to Knowledge Multivariate analysis Jan Feb 4-D Data Model Time, T Image to Knowledge D Space, L Variables, V Data Files Hydrologic Flux Coupler Hydrologic Fluxes and Flows Digital Watershed (Atmospheric, surface and subsurface water) We want to do water, mass, energy and water balances Neuse Observatory Prototype Study HydroVolumes Take a watershed and extrude it vertically into the atmosphere and subsurface A hydrovolume is “a volume in space through which water, energy and mass flow, are stored internally, and transformed” Watershed Hydrovolumes Hydrovolume Geovolume is the portion of a hydrovolume that contains solid earth materials USGS Gaging stations Stream channel Hydrovolumes Continuous Space Data Model -NetCDF Time, T Coordinate dimensions {X} D Space, L Variables, V Variable dimensions {Y} Discrete Space-Time Data Model Time, TSDateTime TSValue Space, FeatureID Variables, TSTypeID Flux Coupling Table Coupling table links all features that have flux and flow data needed for the water balance All Hydrofeatures have a unique HydroID 9748 9614 9623 9749 Flux and flow data Flows and Fluxes Q P, E, R Net Inflow and Cumulative Storage Monthly water balance for one watershed hydrovolume for 2001 Storage Net Inflow This water balance does not close very well – we need better data! Hydrologic Information System A combination of geospatial and temporal hydrologic information which supports analysis, modeling and decision making Modeling Connecting Arc Hydro and Hydrologic Models Interface data models GIS HMS Geo Database Arc Hydro data model This requires time series data bridges between geodatabase and binary files for hydrologic models RAS Modflow Conclusions • Hydrologic Observations Database and Hydrologic Digital Library are functional and reading for testing • Digital Watershed for Neuse has been built and can be expanded – we’d be pleased to work with other Observatory teams to help them build a Digital Watershed • Work on hydrologic flux coupler is developing