Download Working in the GEON Portal

GEON Developments for
Searching, Accessing,
Integrating, and
Visualizing Distributed
Data
Charles Meertens
UNAVCO
Dogan Seber,
Chaitan Baru
San Diego
Supercomputing Center
Mike Wright
DLESE Program Center
Image source credits:
Mantle Tomography - Shapiro and Ritzwoller; Megnin and Romanowicz
Geodynamics Model - McNamara and Zhong
Global Strain Rate Map and Plate motions -Kreemer and Holt
Fall AGU Meeting, December, 2005
Outline
GEON Overview
GEON Best Practices
GEON Portal:
Search
Data Retrieval
Resource Registration
Integration
UNAVCO/GEON Distributed Data
Serving example
Visualization with the IDV
Fall AGU Meeting, December, 2005
GEON “GEOsciences Network” Activities
NSF Large Scale Information Technology Research (ITR)
• Develop a distributed,
services-based system that
enables geoscientists to
publish, share, integrate,
analyze, and visualize their
data, ontologies, tools,
workflows, applications, and
models
• Conduct integrated
scientific studies on targets
of opportunities in the test
beds, in concert with
geosciences community
Website: www.geongrid.org
Fall AGU Meeting, December, 2005
GEON PIs and Partner Institutions
NSF ITR Supported
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Partners
Members
Arizona State University
Bryn Mawr College
Penn State University
Rice University
San Diego State University
San Diego Supercomputer
Center / University of
California, San Diego
University of Arizona
University of Idaho
University of Missouri,
Columbia
University of Texas at El Paso
University of Utah
Virginia Tech
UNAVCO, Inc.
Digital Library for Earth System
Education (DLESE)
•
Partners
•
California Institute for
Telecommunications and Information
Technology (Cal-(IT)2)
Chronos
CUAHSI
ESRI
Geological Survey of Canada
Georeference Online
IBM
Kansas Geological Survey
Lawrence Livermore National
Laboratory
U.S. Geological Survey (USGS)
HP
Other Affiliates
Southern California Earthquake Center
(SCEC), EarthScope, IRIS, NASA
•
•
•
•
•
•
•
•
•
•
•
•
Fall AGU Meeting, December, 2005
GEON Cyberinfrastructure (CI) Principles
GEON is based on a service-oriented
architecture (SOA) with support for
“intelligent” search, semantic data
integration, visualization of 4D scientific
datasets, and access to high performance
computing platforms for data analysis and
model execution -- via the GEON Portal.
While focused on Earth Sciences, GEON
cyberinfrastructure is generic and broadly
applicable to a variety of other sciences and
other application domains.
Fall AGU Meeting, December, 2005
GEON Cyberinfrastructure Principles Cont.
•
•
•
•
•
CI: Support the “day to day” conduct of science (e-science), in addition to
“hero” computations
The “two-tier” approach
– Use best practices, including use of commercial tools and open
standards, where applicable…
– …while developing advanced technology, and doing CS research
An equal partnership
– IT works in close conjunction with science to help create data sharing
frameworks, best practices, and useful and usable capabilities and tools
Create shared “science infrastructure”
– Integrated online databases, with advanced search and query engines
– Online models, robust tools and applications
Leverage from other intersecting projects
– Much commonality in the technologies, regardless of science
disciplines, e.g. BIRN, SEEK, and many others
Fall AGU Meeting, December, 2005
GEON Overall Architecture
Data
Physical model
Portal (login, myGEON)
Registration
GEONsearch
Data
Registration
Integration
Services
Services
Indexing
Services
GEONworkbench
Community Modeling
Environment
Workflow Visualization
& Mapping
Services
Services
Modeling
Environment
Core Grid Services
Authentication, monitoring, scheduling, catalog, data transfer,
Replication, collection management, databases
Physical Grid
RedHat Linux, ROCKS, Internet, I2, OptIPuter (planned)
Model results
HPCC
Fall AGU Meeting, December, 2005
The GEONgrid
Common Systems Development
Geological
Survey of
Canada
Chronos
UNAVCO
KGS
USGS
ESRI
SCEC
CUAHSI
PoP node
Partner Projects
PoP + Compute
PoP + Data
Fall AGU Meeting, December, 2005
Partner services
Working in the GEON Portal:
GEON Search
Search for Resources
Current Types:
ASCII
CUAHSI Data
GMT Raster
GeoTiff
Relational Database
Shapefile
Tool
WMS Service
Web Service
Search Constraints:
Metadata Relation,
Type, Subject, Keyword
Spatial Coverage
Temporal Coverage
Ontology/Concept
Relation
Example of unconstrained search response
Fall AGU Meeting, December, 2005
Working in the GEON Portal:
GEON Search with constraints
Search for Resources
Current Types:
ASCII
CUAHSI Data
GMT Raster
GeoTiff
Relational Database
Shapefile
Tool
WMS Service
Web Service
Search Constraints:
Metadata Relation,
Type, Subject, Keyword
Spatial Coverage
Temporal Coverage
Ontology/Concept
Relation
Sample search for:
Resource Type - “Relational Database”
Keyword - “GPS”
Fall AGU Meeting, December, 2005
Working in the GEON Portal:
GEON Ontology-based Query Search - a
stepping stone to intelligent search
Search can be constrained
using selected ontologies
and concepts. New
ontologies are being
developed by the science
team through workshops
and mechanisms exist at
the GEON portal to register
ongologies and resources to
ontologies.
Example: User selects an
ontology (in this case the
NASA “Earth Realm” with
IceCore concept
Fall AGU Meeting, December, 2005
The Future: Scientific Data Integration
or: … from Queries to Questions can be resolved through
cyberinfrastructure
To be able to “GEONSearch”: What is the distribution and U/Pb zircon ages of
high chrome spinel kimberlites in the Appalachian Geologic Province? How
does it relate to the thickness of the sub-cratonal lithospheric mantle?
Quantitative Numerical Integration
Information Integration
Ontologies
Database
Mediation
Geologic
knowledge
A.K.Sinha, Virginia
Tech, 2005
Raw Data
Geologic map
Lithosphere
thickness
Geochronology
Bulk chemistry
Fall AGU Meeting, December, 2005
Mineral chemistry
GEON Resource Access
•
•
•
•
Access Resources
View Metadata
Download files
Query Databases
Example: GEON Portal
Query generation
tool and sample
response from the
GPS Seamless
Archive Centers
(GSAC) database
located remotely on
UNAVCO/GEON
PoP Node
Fall AGU Meeting, December, 2005
GEON Resource Registration
• Register Resources
• Submit metadata about
resource (follows ADN
Schema)
• Register to Ontology.
- Discovery of data
resources (e.g., gravity,
geologic maps, etc) requires
registration through use of
high level index terms (a
type of ontology)
Fall AGU Meeting, December, 2005
GEON Portal Resource Integration
• Gather SearchSelected Resources
into your workbench
• Make integrated maps
(shapefiles, WMS)
• Integrate Database
• Integrate Workflows
• “Integration Cart”
Example: Integration of
two external WMS
services into new
GEON WMS Web
Browser Map Viewer
(OGC-supplied)
Fall AGU Meeting, December, 2005
GEON 4D Data Access and Visualization
An ongoing GEON effort is to address 4D (xyzt) representation of earth
science datasets and models in a grid computing environment.
Current desires and approaches include:
•
•
•
•
•
Capable volume-time Integrative Visualization tools: Enhancing the
Unidata IDV Java Application for earth science data
4D (and multi-parameter) Data Model: Adopting netCDF (used by IDV
and soon by ESRI). Extensive Common Data Model effort at Unidata
Data Discovery: GeonSearch at the GEON Portal
Data delivery: html, OPeNDAP, OGC (WMS), Interoperable
Automated Data/metadata registration: currently exploring OAI/ADN,
DLESE Data Collection System and webservice, THREDDS (Unidata)
Basically give me the specific types of data I want, for only the specific
time and volume I specify, and in a way that I can find it quickly and
easily use it with any application I desire!
Fall AGU Meeting, December, 2005
UNAVCO/GEON PoP Data Services and Visualization
Example Below: Geodynamic and
Tomographic models on OPeNDAP
Server. Visualization with IDV.
Fall AGU Meeting, December, 2005
UNAVCO/GEON PoP Server Details:
Data, Models, Catalogs, Metadata
Data Access
http
srb
ftp
gridftp
OGC*
UNAVCO/GEON
PoP Data Server
1D/2D/3D/4D
OPeNDAP
Thredds
-Catalog elements
Digital Library
Metadata elements
Thredds
Catalog
OPeNDAP
Data
Servers
-netCDF
-Freeform
(via OAI or DLESE
Webservice)
WMS Catalog
*OGC=WMS/WFS/WCS
Dataset Catalogs and Metadata Access
*OGC: WMS/WCS/WFS Fall AGU Meeting, December, 2005
-Tomography
-GPS data/vectors
-Earthquakes
-Focal Mechanisms
-Strain rate
-Topography
-Image maps
-Geodynamics
-Faults
-Paleogeography
Plus IDV visualization
“Bundles” (.xidv files)
UNAVCO/ GEON Data Server
and Visualization Access
UNAVCO/GEON
Data Node
THREDDS/OPeNDAP
Catalog
OPeNDAP Server
Example: Seismic
Tomography in NetCDF
format
WMS Server
Example: GPS
Seamless Archive
Postgres/PostGIS
Database
Integrative Data Viewer
WMS Catalog
HTML File
Still under development: registration of netCDF
files and OPeNDAP servers into the GEON
Other
distributed data
servers
Portal; embedded GEONSearch within the IDV
Fall AGU Meeting, December, 2005
Local File
Summary
• Using a best practices approach, GEON has been developing
data sharing frameworks, a registry for distributed databases,
concept-based search mechanisms, advanced visualization
software, and grid-computing resources for earth science and
education applications.
• GEON Cyberinfrastructure will enable new interdisciplinary
research in the geosciences, while extending the access to
data and complex modeling tools from the hands of a few
researchers to a much broader set of scientific and educational
users.
• We invite you to try out the tools on the GEON Portal and to
Submit or Use Resources of any type. Come and see GEON
demos at the GEON Booth!
Website: www.geongrid.org
Fall AGU Meeting, December, 2005