Download acgrid-chen

The Grid in China
ACGRID Symposium
Hanoi, 16/Nov./2007
Gang CHEN
Institute of High Energy Physics
Chinese Academy of Sciences
Agenda
• CNGrid
(China National Grid)
• ChinaGrid
(China Education and Research Grid)
• CROWN
(China Research and development
environment Over Wide-area Network )
• HEP Grid/WLCG
Gang Chen/CC/IHEP 11-16-2007 - 2
Major Grid Projects in China
• China National Grid
• Supported by the National High-tech R&D Program
• ChinaGrid
• Supported by the Ministry of Education
• CROWN
• Supported by the National Science Foundation of
China
Gang Chen/CC/IHEP 11-16-2007 - 3
China National Grid (CNGrid)
Gang Chen/CC/IHEP 11-16-2007 - 4
Overview of CNGrid
• Key project supported by the
National High-Tech R&D Program
• 4-year effort
• May 2002 to Dec. 2005
• 100 million RMB government funding from the
MoST
• More than 2Χ associated funds from local
government, application organizations, and
industry
Gang Chen/CC/IHEP 11-16-2007 - 5
Major tasks of the project
• Developing a test-bed for the new information
infrastructure—China National Grid (CNGrid)
• Developing a 4TFlops high performance computer for
the grid
• Developing a set of grid software to support grid
applications and grid operation and management
• Developing several application grids
• Productive systems
• Demonstration of the future grid applications
Gang Chen/CC/IHEP 11-16-2007 - 6
CNGrid infrastructure
• Major nodes:
• CNIC, CAS, Beijing
• Shanghai Supercomputer Center, Shanghai
• Standard nodes:
• Tsinghua University, Beijing
• Institute of Applied Physics and computational Mathematics,
Beijing
• University of Science and Technology of China, Hefei
• Xi’an Jiaotong University, Xi’an
• NUDT, Changsha
• Hong Kong University, Hongkong
• CNGrid Operation Center
• The CNGrid Operation Center, CNIC, CAS
Gang Chen/CC/IHEP 11-16-2007 - 7
CNGrid nodes locations
Beijing
Xi’an
Shanghai
Hefei
Changsha
Hong Kong
Gang Chen/CC/IHEP 11-16-2007 - 8
CNGrid GOS architecture
Application Logic by Web Pages
Grid Apps
Grid
Portal
Build-in Utility Collection
User Customized
Applications
Extended Utilities
Servlet Based Scalable Grid Portal Engine
User APIs
System and Application Libraries(Core Based Functional APIs and Exception Handling)
App Level
Services
Batch Service
System
Level
Services
GIS Service
Information(MetaX) Services
MetaFile Service
MetaDB
Meta Info
Service
Naming
Replica
Mgmt.
Mgmt.
Quota
Mgmt.
MetaSys
Service
File AC Mgmt.
Core APIs
Core
Level
Services
etc.
etc.
Base Services
System
Monitoring
Service
Logging&
Auditing
Service
CA&
Certificates
Mgmt. Service
File
Database
Messaging
Service
Service
Service
Dymaic Deploy Service
Extended
System
Services
Core Libraries(Grip, Agora, Router, AC Handling, Core Exception Handling)
Agora Service
User Mgmt. Engine
Resource Mgmt. Engine
Profile
Service Addr. Service
Acct.
and PortType
Info
Proxy
Authentication
Cert.
Mapping
Mgmt.
Role Based
Acct. Mgmt.
Tomcat
(Apache)
Grip Service
Grip Container
Agora
AA
Multi-Grained
Resource AC Policy Mgmt.
Authorization Engine
Service Info. Mgmt. (Local)
OMII
GT4
(Globus)
WebSphere
(IBM)
Result
Caching
User
Interaction
Grip State Mgmt.
Grip Ctrl. Structure
Acct.
Approve
Router Service
GOS
Hosting
Env.
Workflow Service
Addr. Core Exceptions
Trans. Service Invocation
Service Locating(Global)
WebLogic
(BEA)
Java J2SE, J2EE/Microsoft Windows
.NET
(Microsoft)
Gang Chen/CC/IHEP 11-16-2007 - 9
Support applications
Bioinformatics
Geosurvey
Manufacture
& Simulation
Weather
forecast
Gang Chen/CC/IHEP 11-16-2007 - 10
CNGrid Applications
• Applications from selected areas
• Resource and Environment
NGG: National Geological Survey Grid
 DFG: Digital Forestry Grid
 SeisGrid: Petroleum Seismic Exploration

• Research
SDG: Scientific Data Grid
 BAGrid: Bioinformatics Applied Grid
 DDG: Drug Discovery Grid

• Services
CMAG: China Meteorological Application Grid
 TIG: Traffic Information Grid

• Manufacturing
AviGrid: Aviation Grid
 SimGrid

Gang Chen/CC/IHEP 11-16-2007 - 11
NGG
• Undertaken by China National Geological
Survey Bureau
• Nation-wide productive grid
• Data exchange and sharing by services
• Grid-enabled resource evaluation
• Shorten the evaluation time from 3
years to 3 months
• Achievements
• North China ground water resources evaluation
• Mineral resources evaluation
Gang Chen/CC/IHEP 11-16-2007 - 12
NGG
Gang Chen/CC/IHEP 11-16-2007 - 13
Drug Discovery Grid
• Undertaken by Shanghai Institute of Materia
Medica of CAS
• Compound screening for new drug discovery
• Speed up the process by computer simulation
• Higher accuracy
• Using HPC in P2P mode
• New drug for diabetes developed and entered
clinic testing by the end of 2005
Gang Chen/CC/IHEP 11-16-2007 - 14
Aviation Grid: AviGrid
• Developed by AVIC II Group
of China
• Supporting distributed design,
simulation, and manufacturing
• CAD software sharing
• Data exchange and sharing
• Computing resource sharing
Gang Chen/CC/IHEP 11-16-2007 - 15
Aviation Grid: AviGrid
before optimization
Added skin
After optimization
Reduced skin
Gang Chen/CC/IHEP 11-16-2007 - 16
The new project
• Period: 2006-2010, launched in Oct. 2006
• 640 million (RMB) from the MoST and at
least equal amount of matching funding from
different organizations
• Major efforts:
•
•
•
•
High productivity Computer development
CNGrid development
CNGrid GOS continuous development
12-15 Grid applications
Gang Chen/CC/IHEP 11-16-2007 - 17
CNGrid (2006-2010)
• HPC Systems
• 100 Tflop/s by 2008,
• Pflop/s by 2010
• Grid Software: CNGrid
GOS
• Merge with international efforts
• Emphasize matureness
• CNGrid Environment
• Nodes, Centers, mgt
• Applications
•
•
•
•
Research
Resource & Environment
Manufacturing
Services
Gang Chen/CC/IHEP 11-16-2007 - 18
China Education and Research
Grid
(ChinaGrid)
Gang Chen/CC/IHEP 11-16-2007 - 19
ChinaGrid
• Funded by Ministry of Education
• Based on CERNET (China Education and
Research Network)
• First Phase
•
•
•
•
2003-2005
12 key universities as initiative
More than 6Tflops w/60TB
20 key universities by the end of 2004
Gang Chen/CC/IHEP 11-16-2007 - 20
ChinaGrid (The First Phase)
Gang Chen/CC/IHEP 11-16-2007 - 21
ChinaGrid Supporting Platform
Gang Chen/CC/IHEP 11-16-2007 - 22
Main Research Tasks
• Campus grid platform
• Common platform for ChinaGrid
• Grid application platform and
representative
• Grid applications
•
•
•
•
•
Image processing grid
Bioinformatics grid
Course on-line grid
Computational fluid dynamic grid
Large scale information processing grid
Gang Chen/CC/IHEP 11-16-2007 - 23
Bio-info Grid
• To provide the bio-information
data resources (such as gene
databases and Chinese medicine
components databases,) and
bio-information analysis tools
to grid users
• To develop computing grid aided
drug design systems based on
the integration of the
techniques of assembled biology,
assembled chemistry, and
computer aided filter, sequence
analysis and structure
Gang Chen/CC/IHEP 11-16-2007 - 24
Image Processing Grid
Gang Chen/CC/IHEP 11-16-2007 - 25
CFD Grid
Gang Chen/CC/IHEP 11-16-2007 - 26
Course On-line Grid
Gang Chen/CC/IHEP 11-16-2007 - 27
China Research and
development environment Over
Wide-area Network
(CROWN)
Gang Chen/CC/IHEP 11-16-2007 - 28
The Research Program
• NSFC_Grid: (3yrs, 2004-2006)
Network-based R&D Environment (E-Science Project in China)
 Beihang U., & ICT,CAS

• CROWN: China Research and Development
Environment Over Wide-area Network
• 2004 – 2006, National Science Foundation of China (NSFC)
• By top 5 universities and institutes in China
• Beihang U. is the team leader.
• Goal: Providing Grid-enabled research
environment for scientists
Provide a middleware suit for Service-based Grid computing
 Build a testbed for Grid technologies and Grid researcher
 Provide an easy-to-use Service Repository for E-Science community in
China

Gang Chen/CC/IHEP 11-16-2007 - 29
Basic Idea of CROWN
Quality of Service
Service Overlay Network
Service
Applications
Service
Resource
Service
Resource
Service
Resource
Service
CROWN
Portal
Applications
Service
Applications
Service
Security Architecture
Gang Chen/CC/IHEP 11-16-2007 - 30
Basic Idea of CROWN
Quality of Service
QoS-enabling technology
(Reservation and Agreement-based mngt)
Service Overlay Network
Service
Service Provision
& Resource Mngt.
Resource
Service
JobApplications
Mngt, Matchmaking
& Scheduling
Service
CROWN
Applications
Portal
Programming modal
Overlay-based
Service Management
Service
Resource
& application integration
Service
Service Composition
Applications
& Workflow
Service
Resource
Service
Trustworthy computing
For distributed env.
Security Architecture
Gang Chen/CC/IHEP 11-16-2007 - 31
CROWN Portal
• Portal: A JSP-based Web Interface
• User Registration
• Application Integration & User Job Submission
Gang Chen/CC/IHEP 11-16-2007 - 32
CROWN Testbed (2005)
Testbed
8 Sites, 4 Cities are connected using existing network
infrastructure
Beihang University
CNIC, CAS
Peking University
Tsinghua University
LASG, CAS
Beijing
Chongqing University
Chongqing
Changsha
National University of
Defense Technology
HKUST: Hong Kong
University of Science &
Technology
Hong Kong
Gang Chen/CC/IHEP 11-16-2007 - 33
CROWN Testbed (2006)
Testbed
Deploy CROWN onto CNGRID Nation wide Testbed
Beihang University
CNIC, CAS
Peking University
Tsinghua University
LASG, CAS
Xi’an Jiaotong
University
Beijing
Chongqing University
China University of
Science & Technology
Shanghai Shanghai Super
Xi’an
Hefei
Chongqing
Changsha
Computing Centre
Shanghai Jiaotong
University
National University of
Defense Technology
HKUST: Hong Kong
University of Science &
Technology
Hong Kong
Gang Chen/CC/IHEP 11-16-2007 - 34
Pilot Applications
• Bioinformatics:
• BLAST: Basic Local Alignment Search Tool
• Cap3: A DNA sequence assembly program
• Genscan: Identification of complete gene
structures in genomic DNA.
• …
• Atmospheric applications
• Climate simulation for past 1000 years
• AREM
Regional Eta-coordinate numerical prediction model
 Rain or storm predication

Gang Chen/CC/IHEP 11-16-2007 - 35
Gang Chen/CC/IHEP 11-16-2007 - 36
Pilot Applications
• SDG: Scientific Data Grid
• Share scientific data from all institutes of
CAS with China or even world scientists
• UDMGrid: University Digital Museum
Grid
• Provide an integrated UDM data sharing
environment using grid technologies
• Currently 4 UDMs are integrated
Beihang university
Yunnan University
Nanjing University
 Shandong University



Gang Chen/CC/IHEP 11-16-2007 - 37
HEP Grid in China
Gang Chen/CC/IHEP 11-16-2007 - 38
BEPCII/BESIII
BEPC: Beijing Electron
Positron Collider
• Started in 1989
• 2~5GeV/C
• Being upgraded to
Dual-Ring,
(3~10)×1032 cm-2s-1
• 27 Universities and
Institutes from
Korea, US, UK,
Japan, and China.
Gang Chen/CC/IHEP 11-16-2007 - 39
YBJ-ARGO/AS
• Italy,Japan-China
cosmic ray
observatories in
Tibet.
• 200TB raw data per
year.
• Data transferred to
IHEP and processed
with 400 CPUs.
• Rec. data accessible
by collaborators.
Gang Chen/CC/IHEP 11-16-2007 - 40
LHC
• China is involved in all four LHC experiments,
• IHEP in CMS and ATLAS.
Gang Chen/CC/IHEP 11-16-2007 - 41
More Applications
Members of International Collaborations:
Huge computing demands.
Gang Chen/CC/IHEP 11-16-2007 - 42
LCG sites in China
UI
CE_torque
PEK VO: CMS
UI
SDU VO: ATLAS
SE_dcache
BDII
PX
UI
CSTNET\CERNET
SE_classicl
CE_torque
RB
LFC_mysql
UI
MON
SE_classicl
WN1
WN1
WN2
CE_torque
WN2
WN1
WN2
PC farm
PC farm
PC farm
IHEP
CNIC
Gang Chen/CC/IHEP 11-16-2007 - 43
VPN for USTC
Gang Chen/CC/IHEP 11-16-2007 - 44
Networking - Gloriad
Gang Chen/CC/IHEP 11-16-2007 - 45
Networking – ORIENT/TEIN2
2.5Gbps
ORIENT
/TEIN2
connectivity
upgrade
Gang Chen/CC/IHEP 11-16-2007 - 46
Network Performance
Gang Chen/CC/IHEP 11-16-2007 - 47
Network Performance
Gridftp Test Result Between IHEP to IN2P3
Throughput(MB/s)
25
20
15
10
5
0
1
2
4
8
16
Streams
IHEP->IN2P3 Average
IN2P3N->IHEP Average
32
64
80
IHEP->IN2P3 Instant
IN2P3->IHEP Instant
Gang Chen/CC/IHEP 11-16-2007 - 48
LCG applications
• LHC, BESIII are running
• Deploying ARGO to LCG
Gang Chen/CC/IHEP 11-16-2007 - 49
Cooperation with EU FP6
• EUChinaGrid
• Interoperability between CNGrid GOS and gLite
• IPv6 support
• Application in HEP, Biology and bioinformatics
• OMII-Europe
• Grid standardization effort
• Interoperbility between main stream grid middleware
• EchoGrid
• Grid roadmap
• Coordination between EU and Chinese grid researchers
• BRIDGE
• Interoperability between CNGrid GOS and GRIA
• Grid applications: Aerospace, Phama, Meteo
• XtreemOS
• Network centric OS
Gang Chen/CC/IHEP 11-16-2007 - 50
EUChinaGRid at a glance
•
•
•
•
Funded by the EU 6th Framework Programme (FP6)
1 Jan 2006 ~ 31 Dec 2007, 24 months
10 project partners (EU 6, CN 4 )
2 main objectives
• By dissemination and training activities to promote the
creation of a human network in the area of Grids, e-Science
and e-Infrastructures between Europe and China
• To support the interoperability of existing European and
Chinese Grid infrastructures, EGEE and CNGrid, towards a
creation of a “virtual Grid-based research space” for eScience, in an integrated multi-protocol (IPv4/IPv6)
environment
Gang Chen/CC/IHEP 11-16-2007 - 51
WP3 – achievements
Gang Chen/CC/IHEP 11-16-2007 - 52
Conclusion
• Many grid projects - may be too many!
• Invited to merge by government
• Many applications
• HEP, Astrophysics, Biology, Industry,…
Gang Chen/CC/IHEP 11-16-2007 - 53
Thank you!
Gang Chen/CC/IHEP 11-16-2007 - 54