Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
AstroGrid-D and (GA)VO 2006-11-15, Garching Overview • VObs/IVOA • GAVO I + II • Synergy with AstroGrid-D ? 2006-11-15, Garching Virtual Observatory I • Broad goal – Make results of astronomical research, data and applications, more readily available to larger community, and create value-adding services. • Facilitate results– communication – checking – (re)use – comparison – combination 2006-11-15, Garching Combination: a multi-wavelength view of a galaxy merger Radio Optical X-Ray John Hibbard http://www.cv.nrao.edu/~jhibbard/n4038/n4038.html NASA/CXC/SAO/G. Fabbiano et al. 2006-11-15, Garching the problem FIRST ROSAT 2MASS 2006-11-15, Garching GAIA SDSS work on a solution FIRST ROSAT 2MASS 2006-11-15, Garching GAIA SDSS Virtual Observatory II • Approach: – online availability of datasets and applications – standardized publication and discovery mechanisms – standardized description through common (meta-)data models – standardized selection mechanisms – standardized formats for transmitted data – value added services – introduce new technologies – find clever algorithms • Organized in International VO Alliance (IVOA) 2006-11-15, Garching 2006-11-15, Garching Some Results • Data formats: – VOTable • Data models for – – – – – Resource metadata (registry) Space-time events: STC Characterisation Spectral data model VOEvent • Protocols – – – – Simple cone search (not a standard!) Simple image access simple spectral access VOQL (ADQL/SkyNode) • Applications: – Aladin, VOPlot, TOPCAT, SpecView, Plastic 2006-11-15, Garching Grid activities in VObs • IVOA Grid and web services working group (html) – Authentication – Universal Worker Service – VOSpace • Astro-RG in GGF (Nic Walton) • Euro VO DCA WP 5 • GAVO I (Gadget simulation, cluster finder) 2006-11-15, Garching GAVO II • Since July 2007 • Organisation (5 FTEs) – AIP – ARI (PI) – MPE – Tübingen – TUM-Informatik 2006-11-15, Garching GAVO (I + II) projects • Archives: – ROSAT All Sky Survey • cone search: photons, sources • SIAP: fields – – – – RAVE web site SSA on CDFS optical follow up spectroscopy Heidelberg catalogues and GAVO archive ROSAT pointed observations: SIAP • • • • standardised approach to publish FITS images under SIAP uses FITS metadata repository (SQLServer) SQL based mapping and SIAP implementation easily generalised to other datasets and protocols (SSA) • Data mining – Cross-matcher (also on Grid, TUM) – SED classifier – Cluster finder 2006-11-15, Garching GAVO (I + II) projects ctd. • Grid – evaluation Globus – Gadget 2 on Globus MPI (AIP + MPE) – cluster finder • VOQL/SkyNode – VOQL tiger team (Benjamin Gufler) – HiSbase peer-to-peer approach – Mock catalogues for testing • Theory – IVOA: • • • • Initialised Theory Interest Group (chair) SNAP Data models Semantics – Millennium database – Virtual telescopes (planck, MoMaF2, Dolag) 2006-11-15, Garching GAVO + AstroGrid-D I • Groups involved in both projects: AIP, ARI, MPE, TUM • Different kind of use cases: – VObs aims to enable external users to use resources – Heterogeneous world: Interoperate with resources outside of AstroGrid-D (but within IVOA standards) 2006-11-15, Garching GAVO + AstroGrid-D II • Possible projects – Virtual telescopes – VOEvent and Robotic Telesopes ? – IVOA Registry vs Information Services – Input welcome ! • Definitely – SNAP implementation – OGSA-DAI access to Millennium DB 2006-11-15, Garching SNAP using grid services • Simple Numerical Access Protocol – – – – Project of IVOA theory interest group Based on simulation data model (input welcome !) Query interesting simulations Select and retrieve subset • Implementation: SNAP on Millennium snapshots – Custom access code deployed near large datasets – Authenticated access – Standardised publication for use in Grid workflows (ProC? Streaming?) – Data staging and movement 2006-11-15, Garching Globus container SNAP web service Grid Service getBox() C-module Information Service IS aware Workflow Engine 2006-11-15, Garching Millennium snaphots Millennium website and OGSA-DAI • SQLServer database – – – – – halo/galaxy catalogues density fields (environment queries) efficient retrieval merger tree histories spatial indexing MyDB • TOMCAT web server – http://www.g-vo.org/MyMillennium – authentication using RDB – wget based access, IDL+R modules • Synchronous queries – JDBC, streaming – 7 min time limit – I/O problems 2006-11-15, Garching 2006-11-15, Garching Why Grid interesting? • Need – Asynchronous access • Queuing • Improve result management, data delivery – Bulk uploading into MyDB – More generic authentication (X.509) • Will try CAS jobs (SDSS/JHU) • Investigate OGSA-DAI – Map portal to OGSA-DAI functionality – Monitoring ? Logging ? Performance ? 2006-11-15, Garching 2006-11-15, Garching Conclusion • VObs and Grid complementary • Plenty points of contact • Useful synergies easy to find 2006-11-15, Garching