Download Palermo

INAF experience in Grid
projects
F. Pasian
INAF
GRID.IT Project
• The GRID.IT Project
– Application 1
• Accessing Databases through the GRID
• Processing Data extracted from Databases
• Ingesting results of Data Processing in Databases
– Application 2
• Porting in GRID the VST Pipelines
– Application 3
• Monitoring of Astronomical Instrumentation through the
GRID
Wed 17 May 2006
2
GRID.IT / Future evolution
• G-DSE + QE
– G-DSE prototype engineering
– Design, implementation and test of the QE
– G-DSE + QE in production
• G-ICS + IE
– Design, implementation and test of the G-ICS
and of the IE
– G-ICS + IE in production
Wed 17 May 2006
3
In production…but where ?
• G-DSE + QE
– All INAF Databases in GRID with G-DSE
– Other scientific communities are testing it : INFN,
Bioinformatics, Archaeologists, …
– Supporting Planck simulations in future releases
– Projects in preparation to port it on EGEE and DEISA
• G-ICS + IE
– Close contacts with GridCC
– Strong interest for instruments and sensors in Grid
• ICTP and INAF Naples : monitoring and controlling networks
of sensors via Grid
Wed 17 May 2006
4
DRACO
• A Grid portal thought and designed for astrophysical
•
applications
Porting astrophysical applications in GRID
– Definition of astronomical data analysis workflow on a serviceoriented Grid architecture using BPEL (Manna et al.)
– Data Mining and Massive computing for GRID at Naples-Salerno
Unit
– Astronomical Data Reduction in Data Grid
– Various kinds of evolutionary models
– ACME for GRID
• The INAF VO is now growing
Wed 17 May 2006
5
Planck simulations in EGEE
• Planck simulations (whole mission, two
complete sky surveys, 74 detectors)
• Officially supported pilot EGEE application
since November 2004
• Planck application also in EGEE-2
• A Planck VO, led by INAF Trieste, is in
place. It groups together Grid sites located
in six European countries
Wed 17 May 2006
6
Planck simulations in EGEE
• Planck simulations didn’t make use of databases
until now, but…
– They could be profitably integrated and used in the
near future
– Ground based test and calibrations of the spacecraft
and of the instruments are now in progress
– Data collected in this phase must be saved
somewhere and used during the operative phase of
the mission
• …therefore this is a new test-bed for G-DSE
Wed 17 May 2006
7
TriGrid Virtual Laboratory
Wed 17 May 2006
8
TriGrid Virtual Laboratory
• Catania Pole:
– ~100 machines dual CPU 32/64 bit. Aggregated power of 300
kSpecInt2000.
– 30 TB of storage EIDE-to-SCSI or FC-to-SATA in RAID 0,1,5
– 20 working stations for development/porting of applications
• Messina Pole:
– ~80 machines dual CPU 32/64 bit. Aggregated power of ~240
kSpecInt2000.
– 20 TB of storage EIDE-to-SCSI or FC-to-SATA in RAID 0,1,5
• Palermo Pole:
– ~30 machines dual CPU 32/64 bit. Aggregated power of ~100
kSpecInt2000.
– 10 TB of storage EIDE-to-SCSI or FC-to-SATA in RAID 0,1,5
Wed 17 May 2006
9
Training and dissemination
• How to train ?
– Meetings and workshops both at national and
European level
• Theoretical lessons
• Practical training
– Astronomers bring applications of interest and try to gridify
them with our help
– On site dedicated workshops
– Grid schools
– Coordination with Working Groups having the same
objectives (the Planck Working Group 8)
Wed 17 May 2006
10
INAF and Astro-RG (1)
• There is a community of astrophysicists (mainly
•
theoreticians) already having “native” access to the
“production Grid” facilities
Need to foster Grid-VObs interoperability in the
broader sense:
– usage within VObs of de-facto Grid standards (besides
monitoring GGF evolution)
– allow access to the VObs “from the Grid side” (two-way
street): e.g. interconnection between Grid and (IVOAcompliant) data resources; VObs accessibility from Grid
workflows (BPEL)
• Training/dissemination activity for Grid-VObs users
Wed 17 May 2006
11
INAF and Astro-RG (2)
• We propose the formal participation of INAF in
IVOA Astro-RG IG on these topics (already
investigating interactions between Euro-VO and
EGEE within the VO-DCA project)
Wed 17 May 2006
12