Download eInfrastructures

eInfrastructures in Italy
(and their EU and
International integration)
Roma – 9 December 2003
Mirco Mazzucato
INFN-Padova
[email protected]
last update: 12/08/2017 19:59
Mirco Mazzucato Infn -Padova 1
Grids: origin and foundation
 Italy started to develop the Grid technology and
related eInfrastructures at the end of ’90s (INFN
Condor, Grid project, ISUFI Lecce). Main motivations:
 Modern fundamental Science, HEP in particular, but also
Life sciences, Earth Observation, Economics, … have
been evolving fast during the ’90s from local well
consolidated laboratory practices towards:
 global collaboration (eScience), involving real time working
relations between distributed teams with top level expertise
 Intensive usage, in the daily work, of IT resources including
access and sharing of distributed data
 Effective use of modelling practices for the steering of the
research and innovation processes
 ,,,boosted by the decreasing costs of commodity IT
resources: desktop, disks, networks.. and Open Source
last update 12/08/2017 19:59
Mirco Mazzucato INFN-Padova-3
The “Data” Issue

The modern scientific world and society are characterized by the
large development of digital instruments which produces a large
amount of distributed raw data
 High Energy Physics detectors (LHC): 10 PByte/year in 2007
 Earth Observation satellites: Envisat 500 TByte/year now
 Mammography screening of the population in Italy: 200TB/year
 Genomic and proteinomic databases quickly growing to PByte
 WEB, Digital Libraries,Virtual Reality, CADS: now at TB
 Distributed sensors……..: Millions, quickly growing

The economical and social progress of modern digital societies
depend strongly on their capacity and efficiency in transforming
these Raw Data into precious piece of knowledge:
 Laws of nature, new drug discoveries, innovative technologies, early
cancer diagnosis, early alarm for a new catastrophic event ….
last update 12/08/2017 19:59
Mirco Mazzucato INFN-Padova-5
The “modelling” issue
 Progress in modern Sciences but also the Innovation processes in
modern Industries, Business and Governments relies on the cycle:





Theoretical modelling of the problem
Simulation/Calculations of different options and input parameters
Selection of best solution
Virtual and practical realization of prototypes
Comparison, iteration or mass production
 In all domains the extensive professional exploitation of the past
accumulated knowledge through the systematic usage of modelling
practices should steer the innovation process
 To be confronted with current practices of systematic laboratory
tests of all different hypothesis and parameters
 This points towards the pervasive introduction and systematic
usage of IT resources (CPU, Archives, networks..) in the daily
work of all people involved in the production of new knowledge and
beyond in all society
last update 12/08/2017 19:59
Mirco Mazzucato INFN-Padova-6
eInfrastructures:
the new general enabling factor

The conbination of Internet with the new WEB and Grid
Services on top of the modern fastly developing physical layer
of networks, CPU farms, storage space.., can provide the general
infrastructure (eInfrastructure) which enable all the above
tasks:







last update 12/08/2017 19:59
Collaborative work in distributed VO
large volume data sharing
intensive usage of distributed CPU and Storage resources
General access to knowledge in the society
The Grid middleware can provide those additional common
services that applications in all domains from Science to
Industry and Business can use to access exactly those IT
resource that they need at the most effective cost
As the TCP/IP protocol and the WEB daemons have provided in the
past uniforn access to information to Science, Industry and all other
domains
eInfrastructures becomes in this way one of the key enabling
factors for the social and economical progress of modern
knowledge based society
Mirco Mazzucato INFN-Padova-7
The INFN Grid project and the
national eInfrastructure
1.
Condor on WAN (started 1996, operational in 1998)
 Integrate ~ 20 sites CPU resources into a national pool
2.
3.
National testbed to evaluate Globus services in 1999
INFN-GRID, INFN special project, (February 2000-…)
 National Grid infrastructure driven by INFN experiments
4.
DATAGRID , EU Project, 3 years duration (2001-2003)
 European integration and new M/W services for HEP, Biology, EO
5.
DataTAG, EU project, 2 years duration (2002-2003)
 Optical networking and Interoperability with US Grid, GLUE, HICB, JTB..
6.
Grid.IT, National project 3 years (2003-2005) MIUR special funds
 Towards a national production eInfrastructure
7.
eBusiness, eIndustry, eGovernment, EScience and, Technology -->
(BIGEST) Italian Grid Initiative
 Coordination of all national eInfrastructure activities
8.
FP6: Italian grid infrastructure in EGEE.....
 The new production EU eInfrastructure for all Sciences and beyond
last update 12/08/2017 19:59
Mirco Mazzucato INFN-Padova-8
The SPACI Consortium:
a flexible, robust, secure and scalable IT infrastructure
Southern Partnership for Advanced
Computational Infrastructure
3 MEuro startup funds by MIUR
1.4 Tflops

SPACI infrastructure part
of the EGEE production Grid
DMA/ICAR
Center for Advanced Computing
Technologies
University of Lecce
Director: Prof. Giovanni Aloisio
MIUR/HPCC
Dept. of Mathematics and Applications
University of Naples “Federico II” & ICAR
(Section of Naples)
Director: Prof. Almerico Murli
last update 12/08/2017 19:59
ISUFI/CACT
Mirco Mazzucato INFN-Padova-9
Center of Excellence for
High Perfomance Computing
University of Calabria
Director: Prof. Lucio Grandinetti
SPACI – The Mission
To put the computing resources of the partecipating institutions into
a grid
To integrate the research activity of the three main sites and to
estabilish a real collaboration in Italy between the Italian Public and
Industrial Research
To exchange experiences both in High Technology and Scientific
Research among the researchers & students of the three main sites
and other Universities & Research Centers in Europe and the USA
last update 12/08/2017 19:59
Mirco Mazzucato INFN-Padova-10
GEANT
boquad.frascati.enea.it
ENEA infrastructure
will be part of EGEE
dafne.casaccia.enea.it
power3.frascati.enea.it
grid0007
infocal.trisia.enea.it
CNR
Tor Vergata
DataGrid
at
Citrix
Nfuse
ESA\ESRIN
WEB(ICA)
Citrix
Metafram
e
ICA
last update 12/08/2017 19:59
Mirco Mazzucato INFN-Padova-11
The Grid.it National Project
CNR & University
MILANO
TORINO
PAVIA
HPC, Parallel Programming, Grid computing,
Scientific libraries, Data base and knowledge discovery,
Earth Observation, Computational chemistry,
Image processing, …
R&D on next generation tools
PADOVA
BOLOGNA
GENOVA
PISA
PERUGIA
INFN & University
Grid infratsructure(INFN-Grid, DataGrid, DataTag) ,
e-science applications: Astrophysics,
Funding: €8.1 M
3-Year Project
Start-up: November 2002
UR INFN : €1.58M
ROMA
Bioinformatics, Geophysics, …
BARI
National eInfrastructure
NAPOLI
MATERA
LECCE
CAGLIARI
COSENZA
PALERMO
last update 12/08/2017 19:59
Mirco Mazzucato INFN-Padova-13
ASI
Applications of Earth
Observation
CNIT
R&D on optical
networking
The national Grid.it eInfrastructure

In Grid.it INFN is responsible for the R&D and creation of a
national Grid Infrastructure and for studying and prototyping a
national Grid Operation Service (GOS)
 The generalization of the infrastructure support to other Sciences
from INFN is a model successfully established in the past with the
research network (INFNET -> GARR)


The GOS support several Italian Sciences applications and the
operation of the Italian infrastructure also in the context of the
new European Infrastructure project EGEE
The Italian eScience Grid.it infrastructure currently support:






Astrophysics
Biology
Computational Chemistry
Geophysics
Earth Observation
but other sciences are joining thanks to new MIUR funds (e.g. new SPACI and other PON projects)
last update 12/08/2017 19:59
Mirco Mazzucato INFN-Padova-14
The Grid.it support site
 Web site: http://grid-it.cnaf.infn.it
last update 12/08/2017 19:59
Mirco Mazzucato INFN-Padova-16
The Italian Grid for Business, Industry,
Government, EScience&Technology
(IG-BIGEST)


It is a national initiative aiming at coordinating all Italian
efforts in Grids development or exploitation and at
promoting the participation to EU FP6 and international grid
projects
IG-BIGEST main objectives are
 To support the creation of a general Italian and EU grid
infrastructure for eScience integrating available EU national
infrastructures and open to industry early test
-> EGEE project
 To promote R&D on open Grid issues
->New FP6 proposals
 To support the development of specific grid environments on
top of basic services enabling usage of Grid by major
applications in e-Science, eIndustry and eGovernment
->New FP6 and national application projects



last update 12/08/2017 19:59
Mirco Mazzucato INFN-Padova-17
Current achievements for the
Italian and EU eInfrastructure

The national Grid infrastructure is now a reality costantly developed by
a series of coordinated national projects
 Garr (NREN) for the underline broadband Research Networking
 INFN Grid, S-PACI, ENEA-Grid FIRB Grid.it for Grids and eInfrastructure




Integration at EU and international level is efficiently carried through a
series of EU projects DataGrid, DataTAG, EGEE , international HEP
LCG...
Grid infrastructures are now seen by many governments as a Science
and society development enabling factor and large funds are made
available in Europe, US (Cyber-infrastructure), Japan and other
countries so technological development will continue fast
EGEE will make the Grid M/W adhering to standard spec. (OGSI-OGSA)
robust and reliable and will provide a production eInfrastructure in
Europe on top of the Geant nework
EGEE will provide also:
 Support to the development of some research eInfrastrcture user
communities
 Coordination of national and regional technical operational structures
last update 12/08/2017 19:59
Mirco Mazzucato INFN-Padova-18
eInfrastuctures: the challenges

The general European structure at managerial and policy administrative level to support the eInfrastructure developments
in Europe is still very weak
 Projects like EGEE have definite technical goals, are focused and ends
 Cannot provide effective long term foundation for an EU
eInfrastructure
 Cannot provide longterm EU wide roadmaps integrated with national
programs
 Cannot guarantee long term support of M/W

This is even more true at international level
 GGF can provide long term international standards but is not following
the urgent policy agreements needed to integrate EU
eInfrastructures, with US Cyber-Infratruscture, Japan and world
wide Grids

last update 12/08/2017 19:59
Policies for resource sharing within comunities having common
objectives (VO), security issues, accounting, business and cost
models etc need now to be actively generally addressed in Europe
and internationally
Mirco Mazzucato INFN-Padova-19
The new event
“eInfrastructures (Internet and Grids) –
The new foundation for knowledge-based Societies”


It offers an opportunity to start to discuss a framework of
administrative- and policy-level mechanisms and rules to break down
barriers related to deployment and use of eInfrastructures in
Europe and world-wide
Some of the issues that need to be addressed include:
 The harmonization of national, EU and International eInfrastructures
dvelopment programs
 The general long term support and coordinated world-wide evolution of
the basic eInfrastructure services in order to guarantee continuous
world-wide interoperability and usage
Existing GLUE schema, Intergrid Coordination Board,
JointTechnical Board, are International Bodies which may provide
input and feedback to eIRG
 Security EU structures and shared EU and International sec. policies
 Authorization, Accounting, Cost sharing and Business models for EU
wide and international resource access and sharing
 Bringing in all Research user communities
 Bringing in general Industry, Business and Society applications

last update 12/08/2017 19:59
Mirco Mazzucato INFN-Padova-20
Conclusions








EU eInfrastructures are a key element for the establishment of the
European Research Area and for boosting in Europe the Scientific Research
and Industrial/Commercial outreach, allowing the building up of critical mass
in all domains
With the constitution of eIRG Europe can address the issue of putting in
place a solid structural foundation at adminstrative and policy level for the
eInfrastructure development and involve all Research comunities, Industries
and the Society
eInfrastructures can enalarge access to knowledge creating a new market of
IT resources and applications as the WEB did in the past
The EU eInfrastructure Reflection Group has been formed with delegates of
Ministries of all EU countries following the recommendations of the previous
workshop organized by the Greek Presidency.
It can provide harmonization of the adopted policies and input to the EU
governments and EU commission for the development of the EU
eInfrastructure together with international coordination
The White Paper that has been circulated as a first draft to stimulate
discussions is now in the hands of this group
It will evolve according to the input and suggestions provided during the
today workshop.
The eIRG will meet tomorrow to plan the next steps
last update 12/08/2017 19:59
Mirco Mazzucato INFN-Padova-21