Download ppt - Grid@Asia

Recent Advances in
ChinaGrid Project
Hai Jin
Huazhong University of Science and Technology
Wuhan, China
[email protected]
Nation-wide Grid Projects in China
• China National Grid – CNGrid (Ministry of
Science and Technology )
• China Education and Research Grid
ChinaGrid (Ministry of Education)
–
• China Science Grid Project (National Science
Foundation)
Two group efforts working on the grid middleware
platform
 Group 1: ICT/CAS, HUST, Peking U., Tsinghua U., Xi’an Jiaotong U.,
and Shanghai Supercomputer Center (CSGrid project)
 Group 2: Beihang U., Peking U., Tsinghua U., NIC/ CAS, NUDT
(China Research and Development Environment Over Wide-area
Network, CROWN)
2
2
ChinaGrid in a Nutshell
• China Education and Research Grid
• Funded by Ministry of Education
• As the pilot grid application supported by National
863 Hi-Tech R&D program
• Based on CERNET (China Education and Research
Network)
• First Phase
 From 2003-2005
 12 key universities as initiative
 More than 6Tflops w/60TB
 20 key universities now
3
3
About CERNET
• Second largest IP backboned network in China
 36 PoPs cover all the province capitals
 The network backbone is 2.5-10Gbps DWDM
• Cover more than 1,500 universities/colleges
in about 200 cities
 About 20 million users
 Many universities have their own campus network in
China
4
4
State-of-the-art of CERNET-1
To England
To Germany
To Canada
ShenYang
BeiJing
To America
To Japan
Xi An
ChengDu
External Export
NanJin
WuHan
ShangHai
GuangZhou
Trunk Network
Regional Network
5
5
ChinaGrid (The First Phase)
6
6
ChinaGrid (till now)
7
7
ChinaGrid Mission
• Campus grid platform
• Common platform for ChinaGrid
• Grid application platform and
representative grid applications
Image processing grid
Bioinformatics grid
Course on-line grid
Computational fluid dynamic grid
Large scale information processing grid
8
8
•
Campus Grids and their
Computing Power and Storage
Capacity
HUST：0.8Tflops, 5TB
• ZSU：1.3Tflops, 10TB
• THU：1.3Tflops, 20TB
• PKU：1.5Tflops, 10TB
• BUAA：0.7Tflops, 10TB
• SCUT：0.9Tflops, 20TB
• SJTU：0.5Tflops, 9TB
• SEU：1.0Tflops, 19TB
• XJTU：0.1Tflops, 2.5TB
• NUDT：0.2Tflops, 5TB
• NEU：0.8Tflops, 5TB
• SDU：1.3Tflops, 18TB
• NWPU：0.4Tflops, 2TB
• ZJU：0.6Tflops, 3TB
• FUDAN：1.8Tflops, 6TB
• TONGJI：0.2Tflops, 1TB
• USTC：1.2Tflops, 5TB
• UESTC：0.3Tflops, 2TB
• RUC：0.1Tflops, 0.5TB
• LZU：0.3Tflops, 1TB
ChinaGrid：>15Tflops, >150TB
9
9
Layered Infrastructure of ChinaGrid
ZSU
PKU
SJTU
XJTU
NEU
HUST
SCUT
BUAA
NUDT
Remote
Image
education
processing
grid
grid
THU
Fluid
dynamics
grid
Bioinformatics
grid
SEU
SDU
Massive
information
processing grid
ChinaGrid Supporting Platform (CGSP)
High performance computing environment
(campus grid)
10
10
What’s CGSP?
• ChinaGrid Supporting Platform, a grid middleware
for ChinaGrid
• Follow the WS-Resource Framework (WSRF) and
Open Grid Service Architecture (OGSA)
• Beta version was announced last October at
GCC’04 in Wuhan
• CGSP 1.0 was released Jan. 10, 2005
• Developed by the joint working group from HUST,
THU, PKU, BUAA and SJTU
11
11
Status of CGSP 1.0
• CGSP download more than 300 times
• Support three major grid applications of ChinaGrid
• Installed in 12 universities as campus grid
environment
12
12
ChinaGrid Supporting Platform
Portal
Security Module
Grid Developing
Environment
Information Center
Uniform Management
Computing Nodes
Portal: Grid entry for submitting &
monitoring job, querying resources’ info, user
management and accounting etc.
Grid Developing Environment: a set of
toolkits including portal development tools,
resource encapsulation tools, programming
tools and job generation tools etc.
Information Center: the manager of resource
& service information
Uniform Management: a set of managers
including job manager, data center, domain
manager and service container
Security: Identity authentication and
mapping, service and resource
authorization, secure transferring etc.
13
13
GT3.9 and CGSP
Proxy
(CGSP)
GSI
WS-Security
Data Center
(CGSP)
New
GridFTP
MetaData-Man
(CGSP)
RFT
Job Manager
Pre-WS
(CGSP)
GRAM
WorkFlow
(CGSP)
WS-GRAM
CSF
(contribution)
CAS
RLS
SimpleCA
OGSI-DAI
Portal SDK
(CGSP)
Authz
Framework
XIO
Programming
Toolkits
(CGSP)
Security
Data
Management
Resource
Management
Resource-Index
(CGSP)
MDS2
HyperService
WS-Index
(CGSP)
InterDomain
(CGSP)
Topologic
(CGSP)
pyGlobus
(contributed)
Information
Services
JAVA
WS Core
(WSRF)
C WS Core
(WSRF)
Python Bindings
(contributed)
RemoteDeploy
(CGSP)
HotDeploy
(CGSP)
WS
Core
14
14
CGSP in Detail
Portal
Portal
development tools
Resource
encapsulation tools
Programming tools
(GridRPC/GridPPI)
Job generation
tools
Management
tools
Installation
tools
Grid Developing Environment
Service
management
Resource
management
Fault-tolerance
mechanism
Domain info
management
User
management
Identity
mapping
Service
matching
Topology
management
Quality of service
management
Metadata
description
Status
monitor
Negotiation
policy
Information Center
Job submission
Job monitoring
Domain Manager
Job remote-deploy
Certification authority
Uniform access entry
Work flow management
Job scheduling
Service support
Identity certification
Job Manager
Metadata manager
Proxy management
Remote&hot deploy
Service monitor
Node resource monitor
Batch job service
Storage resource manager
Single sign-on
Replica catalog
Life cycle
Base fault
Service group
GT3.9.1 core
Notification
Resource property
Service Container
Security management of
service and container
Storage agent
Resource access control
Data Manager
Security
15
15
Working Flow of CGSP
CA
Global
Local
J1
Web App
2
Request for J1
1
J2
5 Request for S2
Job manager
Portal
Container
3
Job information
Domain
manager
Resource
information
Available
services
Container
7
S1
CMD
S2
Legacy
Program
S3
Remote
resources
Container
4
S2
6
Information
Center
Retrieve
input data
Container
S4
Retrieve data
Data Management
Tool set
Management
GUI
Administrators
Resource wrapping
tools
Resource
providers
Job Definition tools
Portal tools
Developers
and
Grid Constructors
Storage
Programming
models
Installation
tools
programmers
16
16
17
17
AG4ChinaGrid：GridAsia 2005
18
18
http://www.chinagrid.edu.cn
19
19
Bioinformatics Grid
20
20
BioGrid Applications
• Protein target selection for rice genome
• Multi-sequence alignment for ganoderma
family
• Gene joint for white mice
• Cardiovascular disease research
21
21
Image Processing Grid
22
22
ImageGrid Applications
• Three-dimension reconstruction of digital
virtual human being (HUST)
• Medical image diagnosis (ZSU)
• Remote sensing image processing（NUDT）
23
23
CFD Grid
24
24
Pilot Applications based on CFD
Grid
• Shanhai JiaoTong University: Aircraft genetic
optimization design system
• Xi’an JiaoTong University: Parallel algorithm for
molecular dynamics
• Southern China University of Technology: Simulation
and optimization techniques for metal powder
figuration process
• Northeast University: Large scale geological disaster
forecasting system
• Southeast University: Computational
electromagnetism applications in airplane and
automobile design
25
25
Course On-line Grid
26
26
Course Resource
Contribution
500 474
450
400
332
332
350
283
300
251
250
213
205
202
200
117
150
113
100
32
12
50
0
0
PK TS XJ SJ DB SD HN HZ DN HK DZ BH ZS
• Number of courses: 233；Number of hours: 2566
27
27
Usage Survey
User IP distribution（2004/08/27-2005/01/16）
Server
Independent Total number of
IP number
HTTP GET
Server
Independent Total number of
IP number
HTTP GET
PK1
15359
5868376
SD
1110
128816
PK2
264
10970
UST
9513
1093657
BY
2922
640255
XJ
3981
697464
BH
121
10383
SJ
528
265055
TS
818
125083
XB
1318
160240
DB
LD
5101
618136
DN
1358 At least848936
so
696 many people
71957
HZ
598
64299
ZS
9370 use course1260541
HN
387 Total number
705687
online grid
of access
Numbers of independent IPs：25,807；Total number of HTTP GET：12,569,855
28
28
Massive Information Processing Grid
29
29
University Digital Museum Grid
(UDMGrid)
30
30
International Collaboration (1)
31
31
International Collaboration (2)
• GPE from D-Grid with CGSP
• Access Grid with USA and Singapore
• Trusted Computing for Grid Security with HP
• Global Grid Monitoring with HP
• Also collaboration with IBM, Sun, etc
• More collaboration with EU
32
32
Thanks!
33
33