Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
The Grid in China ACGRID Symposium Hanoi, 16/Nov./2007 Gang CHEN Institute of High Energy Physics Chinese Academy of Sciences Agenda • CNGrid (China National Grid) • ChinaGrid (China Education and Research Grid) • CROWN (China Research and development environment Over Wide-area Network ) • HEP Grid/WLCG Gang Chen/CC/IHEP 11-16-2007 - 2 Major Grid Projects in China • China National Grid • Supported by the National High-tech R&D Program • ChinaGrid • Supported by the Ministry of Education • CROWN • Supported by the National Science Foundation of China Gang Chen/CC/IHEP 11-16-2007 - 3 China National Grid (CNGrid) Gang Chen/CC/IHEP 11-16-2007 - 4 Overview of CNGrid • Key project supported by the National High-Tech R&D Program • 4-year effort • May 2002 to Dec. 2005 • 100 million RMB government funding from the MoST • More than 2Χ associated funds from local government, application organizations, and industry Gang Chen/CC/IHEP 11-16-2007 - 5 Major tasks of the project • Developing a test-bed for the new information infrastructure—China National Grid (CNGrid) • Developing a 4TFlops high performance computer for the grid • Developing a set of grid software to support grid applications and grid operation and management • Developing several application grids • Productive systems • Demonstration of the future grid applications Gang Chen/CC/IHEP 11-16-2007 - 6 CNGrid infrastructure • Major nodes: • CNIC, CAS, Beijing • Shanghai Supercomputer Center, Shanghai • Standard nodes: • Tsinghua University, Beijing • Institute of Applied Physics and computational Mathematics, Beijing • University of Science and Technology of China, Hefei • Xi’an Jiaotong University, Xi’an • NUDT, Changsha • Hong Kong University, Hongkong • CNGrid Operation Center • The CNGrid Operation Center, CNIC, CAS Gang Chen/CC/IHEP 11-16-2007 - 7 CNGrid nodes locations Beijing Xi’an Shanghai Hefei Changsha Hong Kong Gang Chen/CC/IHEP 11-16-2007 - 8 CNGrid GOS architecture Application Logic by Web Pages Grid Apps Grid Portal Build-in Utility Collection User Customized Applications Extended Utilities Servlet Based Scalable Grid Portal Engine User APIs System and Application Libraries(Core Based Functional APIs and Exception Handling) App Level Services Batch Service System Level Services GIS Service Information(MetaX) Services MetaFile Service MetaDB Meta Info Service Naming Replica Mgmt. Mgmt. Quota Mgmt. MetaSys Service File AC Mgmt. Core APIs Core Level Services etc. etc. Base Services System Monitoring Service Logging& Auditing Service CA& Certificates Mgmt. Service File Database Messaging Service Service Service Dymaic Deploy Service Extended System Services Core Libraries(Grip, Agora, Router, AC Handling, Core Exception Handling) Agora Service User Mgmt. Engine Resource Mgmt. Engine Profile Service Addr. Service Acct. and PortType Info Proxy Authentication Cert. Mapping Mgmt. Role Based Acct. Mgmt. Tomcat (Apache) Grip Service Grip Container Agora AA Multi-Grained Resource AC Policy Mgmt. Authorization Engine Service Info. Mgmt. (Local) OMII GT4 (Globus) WebSphere (IBM) Result Caching User Interaction Grip State Mgmt. Grip Ctrl. Structure Acct. Approve Router Service GOS Hosting Env. Workflow Service Addr. Core Exceptions Trans. Service Invocation Service Locating(Global) WebLogic (BEA) Java J2SE, J2EE/Microsoft Windows .NET (Microsoft) Gang Chen/CC/IHEP 11-16-2007 - 9 Support applications Bioinformatics Geosurvey Manufacture & Simulation Weather forecast Gang Chen/CC/IHEP 11-16-2007 - 10 CNGrid Applications • Applications from selected areas • Resource and Environment NGG: National Geological Survey Grid DFG: Digital Forestry Grid SeisGrid: Petroleum Seismic Exploration • Research SDG: Scientific Data Grid BAGrid: Bioinformatics Applied Grid DDG: Drug Discovery Grid • Services CMAG: China Meteorological Application Grid TIG: Traffic Information Grid • Manufacturing AviGrid: Aviation Grid SimGrid Gang Chen/CC/IHEP 11-16-2007 - 11 NGG • Undertaken by China National Geological Survey Bureau • Nation-wide productive grid • Data exchange and sharing by services • Grid-enabled resource evaluation • Shorten the evaluation time from 3 years to 3 months • Achievements • North China ground water resources evaluation • Mineral resources evaluation Gang Chen/CC/IHEP 11-16-2007 - 12 NGG Gang Chen/CC/IHEP 11-16-2007 - 13 Drug Discovery Grid • Undertaken by Shanghai Institute of Materia Medica of CAS • Compound screening for new drug discovery • Speed up the process by computer simulation • Higher accuracy • Using HPC in P2P mode • New drug for diabetes developed and entered clinic testing by the end of 2005 Gang Chen/CC/IHEP 11-16-2007 - 14 Aviation Grid: AviGrid • Developed by AVIC II Group of China • Supporting distributed design, simulation, and manufacturing • CAD software sharing • Data exchange and sharing • Computing resource sharing Gang Chen/CC/IHEP 11-16-2007 - 15 Aviation Grid: AviGrid before optimization Added skin After optimization Reduced skin Gang Chen/CC/IHEP 11-16-2007 - 16 The new project • Period: 2006-2010, launched in Oct. 2006 • 640 million (RMB) from the MoST and at least equal amount of matching funding from different organizations • Major efforts: • • • • High productivity Computer development CNGrid development CNGrid GOS continuous development 12-15 Grid applications Gang Chen/CC/IHEP 11-16-2007 - 17 CNGrid (2006-2010) • HPC Systems • 100 Tflop/s by 2008, • Pflop/s by 2010 • Grid Software: CNGrid GOS • Merge with international efforts • Emphasize matureness • CNGrid Environment • Nodes, Centers, mgt • Applications • • • • Research Resource & Environment Manufacturing Services Gang Chen/CC/IHEP 11-16-2007 - 18 China Education and Research Grid (ChinaGrid) Gang Chen/CC/IHEP 11-16-2007 - 19 ChinaGrid • Funded by Ministry of Education • Based on CERNET (China Education and Research Network) • First Phase • • • • 2003-2005 12 key universities as initiative More than 6Tflops w/60TB 20 key universities by the end of 2004 Gang Chen/CC/IHEP 11-16-2007 - 20 ChinaGrid (The First Phase) Gang Chen/CC/IHEP 11-16-2007 - 21 ChinaGrid Supporting Platform Gang Chen/CC/IHEP 11-16-2007 - 22 Main Research Tasks • Campus grid platform • Common platform for ChinaGrid • Grid application platform and representative • Grid applications • • • • • Image processing grid Bioinformatics grid Course on-line grid Computational fluid dynamic grid Large scale information processing grid Gang Chen/CC/IHEP 11-16-2007 - 23 Bio-info Grid • To provide the bio-information data resources (such as gene databases and Chinese medicine components databases,) and bio-information analysis tools to grid users • To develop computing grid aided drug design systems based on the integration of the techniques of assembled biology, assembled chemistry, and computer aided filter, sequence analysis and structure Gang Chen/CC/IHEP 11-16-2007 - 24 Image Processing Grid Gang Chen/CC/IHEP 11-16-2007 - 25 CFD Grid Gang Chen/CC/IHEP 11-16-2007 - 26 Course On-line Grid Gang Chen/CC/IHEP 11-16-2007 - 27 China Research and development environment Over Wide-area Network (CROWN) Gang Chen/CC/IHEP 11-16-2007 - 28 The Research Program • NSFC_Grid: (3yrs, 2004-2006) Network-based R&D Environment (E-Science Project in China) Beihang U., & ICT,CAS • CROWN: China Research and Development Environment Over Wide-area Network • 2004 – 2006, National Science Foundation of China (NSFC) • By top 5 universities and institutes in China • Beihang U. is the team leader. • Goal: Providing Grid-enabled research environment for scientists Provide a middleware suit for Service-based Grid computing Build a testbed for Grid technologies and Grid researcher Provide an easy-to-use Service Repository for E-Science community in China Gang Chen/CC/IHEP 11-16-2007 - 29 Basic Idea of CROWN Quality of Service Service Overlay Network Service Applications Service Resource Service Resource Service Resource Service CROWN Portal Applications Service Applications Service Security Architecture Gang Chen/CC/IHEP 11-16-2007 - 30 Basic Idea of CROWN Quality of Service QoS-enabling technology (Reservation and Agreement-based mngt) Service Overlay Network Service Service Provision & Resource Mngt. Resource Service JobApplications Mngt, Matchmaking & Scheduling Service CROWN Applications Portal Programming modal Overlay-based Service Management Service Resource & application integration Service Service Composition Applications & Workflow Service Resource Service Trustworthy computing For distributed env. Security Architecture Gang Chen/CC/IHEP 11-16-2007 - 31 CROWN Portal • Portal: A JSP-based Web Interface • User Registration • Application Integration & User Job Submission Gang Chen/CC/IHEP 11-16-2007 - 32 CROWN Testbed (2005) Testbed 8 Sites, 4 Cities are connected using existing network infrastructure Beihang University CNIC, CAS Peking University Tsinghua University LASG, CAS Beijing Chongqing University Chongqing Changsha National University of Defense Technology HKUST: Hong Kong University of Science & Technology Hong Kong Gang Chen/CC/IHEP 11-16-2007 - 33 CROWN Testbed (2006) Testbed Deploy CROWN onto CNGRID Nation wide Testbed Beihang University CNIC, CAS Peking University Tsinghua University LASG, CAS Xi’an Jiaotong University Beijing Chongqing University China University of Science & Technology Shanghai Shanghai Super Xi’an Hefei Chongqing Changsha Computing Centre Shanghai Jiaotong University National University of Defense Technology HKUST: Hong Kong University of Science & Technology Hong Kong Gang Chen/CC/IHEP 11-16-2007 - 34 Pilot Applications • Bioinformatics: • BLAST: Basic Local Alignment Search Tool • Cap3: A DNA sequence assembly program • Genscan: Identification of complete gene structures in genomic DNA. • … • Atmospheric applications • Climate simulation for past 1000 years • AREM Regional Eta-coordinate numerical prediction model Rain or storm predication Gang Chen/CC/IHEP 11-16-2007 - 35 Gang Chen/CC/IHEP 11-16-2007 - 36 Pilot Applications • SDG: Scientific Data Grid • Share scientific data from all institutes of CAS with China or even world scientists • UDMGrid: University Digital Museum Grid • Provide an integrated UDM data sharing environment using grid technologies • Currently 4 UDMs are integrated Beihang university Yunnan University Nanjing University Shandong University Gang Chen/CC/IHEP 11-16-2007 - 37 HEP Grid in China Gang Chen/CC/IHEP 11-16-2007 - 38 BEPCII/BESIII BEPC: Beijing Electron Positron Collider • Started in 1989 • 2~5GeV/C • Being upgraded to Dual-Ring, (3~10)×1032 cm-2s-1 • 27 Universities and Institutes from Korea, US, UK, Japan, and China. Gang Chen/CC/IHEP 11-16-2007 - 39 YBJ-ARGO/AS • Italy,Japan-China cosmic ray observatories in Tibet. • 200TB raw data per year. • Data transferred to IHEP and processed with 400 CPUs. • Rec. data accessible by collaborators. Gang Chen/CC/IHEP 11-16-2007 - 40 LHC • China is involved in all four LHC experiments, • IHEP in CMS and ATLAS. Gang Chen/CC/IHEP 11-16-2007 - 41 More Applications Members of International Collaborations: Huge computing demands. Gang Chen/CC/IHEP 11-16-2007 - 42 LCG sites in China UI CE_torque PEK VO: CMS UI SDU VO: ATLAS SE_dcache BDII PX UI CSTNET\CERNET SE_classicl CE_torque RB LFC_mysql UI MON SE_classicl WN1 WN1 WN2 CE_torque WN2 WN1 WN2 PC farm PC farm PC farm IHEP CNIC Gang Chen/CC/IHEP 11-16-2007 - 43 VPN for USTC Gang Chen/CC/IHEP 11-16-2007 - 44 Networking - Gloriad Gang Chen/CC/IHEP 11-16-2007 - 45 Networking – ORIENT/TEIN2 2.5Gbps ORIENT /TEIN2 connectivity upgrade Gang Chen/CC/IHEP 11-16-2007 - 46 Network Performance Gang Chen/CC/IHEP 11-16-2007 - 47 Network Performance Gridftp Test Result Between IHEP to IN2P3 Throughput(MB/s) 25 20 15 10 5 0 1 2 4 8 16 Streams IHEP->IN2P3 Average IN2P3N->IHEP Average 32 64 80 IHEP->IN2P3 Instant IN2P3->IHEP Instant Gang Chen/CC/IHEP 11-16-2007 - 48 LCG applications • LHC, BESIII are running • Deploying ARGO to LCG Gang Chen/CC/IHEP 11-16-2007 - 49 Cooperation with EU FP6 • EUChinaGrid • Interoperability between CNGrid GOS and gLite • IPv6 support • Application in HEP, Biology and bioinformatics • OMII-Europe • Grid standardization effort • Interoperbility between main stream grid middleware • EchoGrid • Grid roadmap • Coordination between EU and Chinese grid researchers • BRIDGE • Interoperability between CNGrid GOS and GRIA • Grid applications: Aerospace, Phama, Meteo • XtreemOS • Network centric OS Gang Chen/CC/IHEP 11-16-2007 - 50 EUChinaGRid at a glance • • • • Funded by the EU 6th Framework Programme (FP6) 1 Jan 2006 ~ 31 Dec 2007, 24 months 10 project partners (EU 6, CN 4 ) 2 main objectives • By dissemination and training activities to promote the creation of a human network in the area of Grids, e-Science and e-Infrastructures between Europe and China • To support the interoperability of existing European and Chinese Grid infrastructures, EGEE and CNGrid, towards a creation of a “virtual Grid-based research space” for eScience, in an integrated multi-protocol (IPv4/IPv6) environment Gang Chen/CC/IHEP 11-16-2007 - 51 WP3 – achievements Gang Chen/CC/IHEP 11-16-2007 - 52 Conclusion • Many grid projects - may be too many! • Invited to merge by government • Many applications • HEP, Astrophysics, Biology, Industry,… Gang Chen/CC/IHEP 11-16-2007 - 53 Thank you! Gang Chen/CC/IHEP 11-16-2007 - 54