Download GRID.it

National Research Programme 2001 – 2003
Strategic Projects on “Enabling Technolgies for Information Society”
FIRB
Project coordinated by the National Research Council (CNR)
Grid.it
Enabling Platforms for High-Performance Computational Grids
Oriented to Scalable Virtual Organizations
Marco Vanneschi
Dipartimento di Informatica, Università di Pisa
Meeting on Grids for Complex Problem Solving
MIUR, Rome, March 20th, 2003
1
National Coordination on Large-scale Platforms and Grids
MILANO
TORINO
PADOVA
PAVIA
BOLOGNA
GENOVA
PISA
CNR and University
HPC, Parallel Programming, Grid computing,
Scientific libraries, Data base and knowledge discovery,
Earth Observation, Computational chemistry,
Image processing, …
INFN and University
PERUGIA
Grid (INFN-Grid, DataGrid, DataTag) ,
e-science applications: Astrophysics,
ROMA
Bioinformatics, Geophysics, …
BARI
ASI
NAPOLI
MATERA
LECCE
Applications of Earth
Observation
CAGLIARI
COSENZA
CNIT
PALERMO
Grid.it cost = 11.1 M€ (8.1 M€ funded, of which 1.1 M€
for young researchers)
+ other synergies
Technologies and HW-SW
infrastructures for
high-performance communication,
Optical technologies, …
2
FIRB / Grid.it
• A Research Project in ICT.
• Advances and innovations in methodologies and
technologies for the realization and utilization of Largescale platforms and Grids.
• Coordination with the European Community strategies for
Next Generation Grid.
• Advances and innovations are evaluated in terms of their
capability to solve very critical, real problems in the
medium-long term.
• Current standards in ICT are assumed as the technological
starting point (e.g. Objects, Web services, Globus), over
which new technologies are studied and built.
3
Where innovation is required
(1)
• Covering the gap between a set of, even powerful,
ICT technologies (Web, Databases, Objects, etc)
and their effective integration into a system
(Grid) for multidisciplinary applications and
virtual organizations.
• All the system levels need new solutions or
advancements in current solutions.
• Security mechanisms and policies must be applied
to all levels.
4
Integration of technologies for seemless HPC
applications development
e-science, e-business, … applications
Next Generation Grid Software Technology
MPP / SMP
Cluster /
Beowulf
2100
CORBA, Java,
components …
2100
2100
2100
2100
2100
2100
2100
2100
Grid
5
Where innovation is required
(2)
• Architecture and basic software technology (compute and
storage layer):
– Basic middleware services and data management, Programming
environments and tools, Capability to exploit advances in highperformance networking
• Information management and control (information layer):
– Seemless access and management of heterogeneous resources and
information
• Knowledge management (knowledge layer):
– Knowledge discovery, decision support (for applications and for
the system itself)
6
Objectives of FIRB / Grid.it project
 Grid hardware-software platforms for high-performance largescale processing

including high-performance nodes and networks
 New Software Technology for Grid application development:

High-performance Component-based Programming Environment

Middleware Tools and Grid Portals

Information and Knowledge Services

Security
 Applications of scientific and technological high interest, able to
stress, and to act as feedback to, all the features of the Grid
technology
7
Research activities and system levels
• Astrophysics
• Geophysics
• Bio-informatics
• Comp. Chemistry
• Earth Observation
• High-perf. Components
• Cost models
• Scientific Libraries
• Resource Management
Knowledge
Services
Security
Resource
Brokers
• Problem
Solving
Environments
Applications for
E-Science&Engineering
Programming Tools
and Environment
Grid
Portals
Middleware
Data Intensive
core services
Scheduling
GARR
Monitoring
Commmunic.
Large-bandwidth Optical Net High-perf. Networks
8
Structure of FIRB/Grid.it Project
Research Units:
Technical Board:
1. CNR, ISTI
Coordinated by Domenico
LAFORENZA
Domenico Laforenza
2.
CNR, ISTM
Marzio Rosi
3.
CNR, ICAR
Almerico Murli
4.
Research
strategies
to
integrate the results of the various
Workpackages (14).
INFN
Mirco Mazzucato
5.
CNIT
Giancarlo Prati
6. ASI
Giovanni Milillo
9
Workpackages
WP1.
WP2.
WP3.
WP4.
WP5.
WP6.
WP7.
WP8.
WP9.
WP10.
WP11.
WP12.
WP13.
WP14.
Grid Oriented Optical Switching Paradigms
(Castoldi, CNIT)
High Performance Photonic Testbed
(Giordano, CNIT)
Grid Deployment
(Mazzucato, INFN)
Security
(Talamo, Univ. Roma Tor Vergata)
Data Intensive Core Services
(Mazzucato, INFN)
Knowledge Services
(Turini, Univ. Pisa)
Grid Portals
(Aloisio, Univ. Lecce, ISUFI)
High-performance Component-based Programming Environment
(Danelutto, Univ. Pisa)
Grid-enabled Scientific Libraries
(Murli, Univ. Napoli & ICAR)
Grid Applications for Astrophysics
(Benacchio, INAF)
Grid Applications for Earth Observation Systems Application (Milillo, ASI)
Grid Applications for Biology
(Apostolico, Univ. Padova)
Grid Applications for Molecular Virtual Reality
(Laganà, Univ. Perugia & ISTM)
Grid Applications for Geophysics
(Navarra, INGV)
10
Expected Results & Research Products
Applications and Demonstrators
CNR
INFN
ASI
(WP10, WP11, WP12, WP13, WP14)
 4100 K€
Component-based Programming Environment (WP8),
e-science Components (WP9)
Knowledge Services (WP6), Grid Portals (WP7),
Security (WP4)
CNR
Photonic, highbandwidth
networks
Basic Grid Infrastructure
 2000 K€
INFN
and Data Core Services
(WP3, WP5)
(WP1, WP2)
CNIT
 4500 K€
 500 K€
11
FIRB / Grid.it : synergies
• INFN: European projects, Data Grid, …
• CNR: Agenzia 2000, MIUR Strategic Projects 449/97
(“ex-5%”) 1999 and 2000, PQE2000
• CNIT: projects in advanced networking technology
• ASI: ASI-PQE2000, National Space Program (PSN), …
Other national inititives:
• SPACI (PON): Grid infrastructure
UniLe ISUFI, ICAR-CNR Na, UniCal
12
Coordination of national competences
INFN
CNR
Grid projects,
EC projects,
DataGrid, …
projects in HPC and Grid
CNIT
projects on
networking
(Agenzia 2000, 449/97, …),
PQE2000
FIRB / Grid.it
Other initiatives
ASI
projects in EOS and
HPC,
PSN (National Space
Program),
ASI-PQE2000
e.g. PON-SPACI
13
FIRB / Grid.it: international cooperations
• Global Grid Forum (GGF): Domenico Laforenza in
GGF Steering Committee, Area Director of Information Systems
and Performance
• Several Europen Community projects and US
cooperations
• Europen Community proposals for Next
Generation Grid:
–
CoreGrid coordinated proposal for NoE - DG INFSO/F2
–
EGEE coordination (CERN) - IP
14
Research activities and system levels
• Astrophysics
• Geophysics
• Bio-informatics
• Comp. Chemistry
• Earth Observation
• High-perf. Components
• Cost models
• Scientific Libraries
• Resource Management
Knowledge
Services
Security
Resource
Brokers
• Problem
Solving
Environments
Applications for
E-Science&Engineering
Programming Tools
and Environment
Grid
Portals
Middleware
Data Intensive
core services
Scheduling
GARR
Monitoring
Commmunic.
Large-bandwidth Optical Net High-perf. Networks
15
Software Technology of Grid.it
Applications
Specialized components and services
scientific, image processing, data mining, knowledge services, …
High-performance component-based
programming model and tools
Next Generation Grid Middleware
Distributed + HPC HW-SW platforms
16
Software Technology of GRID.IT
General Issues
• Improvements in programmability, easy software
development, software reuse and performance
portability in a heterogeneous, dynamic
application context
• Software adaptability
• High-level services and knowledge management
• Fault tolerance and security
• Coordination with standardization entities (GGF,
CCA, …)
• Open source technology
17
Software Technology of GRID.IT - CNR
• Programming Environment
• Resource management and Brokers
• Knowledge Services
• Security at all levels
18
Research activities and system levels
• Astrophysics
• Geophysics
• Bio-informatics
• Comp. Chemistry
• Earth Observation
• High-perf. Components
• Cost models
• Scientific Libraries
• Resource Management
Knowledge
Services
Security
Resource
Brokers
• Problem
Solving
Environments
Applications for
E-Science&Engineering
Programming Tools
and Environment
Grid
Portals
Middleware
Data Intensive
core services
Scheduling
GARR
Monitoring
Commmunic.
Large-bandwidth Optical Net High-perf. Networks
19
High-performance networks - CNIT
• Very large bandwidth optical
fibers (DWDM 10Gb x 32
channels)
• MAN ring
• High-performance “Node” of
GARR Network
• Cell (IP/ATM) and packet
(IP/Gigabit Ethernet)
connections
• A collection of LANs/clusters
is seen as a same highperformance machine
• Cost models to be exploited by
the Grid.it software
technology
20
Research activities and system levels
• Astrophysics
• Geophysics
• Bio-informatics
• Comp. Chemistry
• Earth Observation
• High-perf. Components
• Cost models
• Scientific Libraries
• Resource Management
Knowledge
Services
Security
Resource
Brokers
• Problem
Solving
Environments
Applications for
E-Science&Engineering
Programming Tools
and Environment
Grid
Portals
Middleware
Data Intensive
core services
Scheduling
GARR
Monitoring
Commmunic.
Large-bandwidth Optical Net High-perf. Networks
21
Grid enabled applications
INFN – CNR – ASI
• Mainly scientific applications in FIRB/Grid.it.
• However, issues of Knowledge Discovery and
Data Mining are intensively investigated and
applied in Grid contexts; e.g. finance and PA
applications.
• Fundamental feedback for the new Grid.it
technology.
22
Conclusion
• FIRB/Grid.it: a research project on innovative
methodologies and technologies for Grid
computing and their effective utilizations and
developments
• Large, qualified national participation and
synergies
• Creating the conditions for the strong coordination
of the national project with the European initiatives
for Next Generation Grid
23
Thanks for attention
24