Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Download Switch - DataTAG
Document related concepts
Computer network wikipedia , lookup
Distributed firewall wikipedia , lookup
Zero-configuration networking wikipedia , lookup
Cracking of wireless networks wikipedia , lookup
Network tap wikipedia , lookup
Piggybacking (Internet access) wikipedia , lookup
Recursive InterNetwork Architecture (RINA) wikipedia , lookup
Transcript
DataTAG overview 23 January 2003 SWITCH-cc meeting Paolo Moroni (Slide 1) Summary Why DataTAG? DataTAG project General information Test-bed extensions Network map Research topics Issues Acknowledgements 23 January 2003 SWITCH-cc meeting Paolo Moroni (Slide 2) Background for DataTAG CERN is building the LHC (start-up in 2007?): an unprecedented amount of data will have to be analyzed and CERN alone will not have enough computing resources to process it The planned computing model is distributed geographically (GRID) The EU-DataGrid project is addressing the middleware problem Reliable, advanced networking is needed underneath Traffic will not look like any IP commodity traffic now A lot of bandwidth is necessary, but it won’t be enough 23 January 2003 SWITCH-cc meeting Paolo Moroni (Slide 3) Addressing the problem Buy a lot of bandwidth Buy (expensive) network equipment Address security issues without compromising performance (firewalls) Tune some more or less obvious TCP parameter Design the network for reliability and performance Plan for interconnection with key research networks 23 January 2003 SWITCH-cc meeting Paolo Moroni (Slide 4) Why network research? Need to enhance data transport protocols (TCP) Need to measure the perceived application performance Need to try the GRID software in a WAN environment and at high speed: what is actually going wrong if things go wrong in the network? Need to test the compatibility between EU and US GRIDs (middleware integration) Need to test network technology with enough speed and enough features to support the planned GRID workload (end-to-end inter-domain QoS) 23 January 2003 SWITCH-cc meeting Paolo Moroni (Slide 5) DataTAG project “Research and technological development for a transatlantic GRID” (project full title) IST project (EU funded), supported by the NSF and the DoE (Caltech) Partners: PPARC (UK), INRIA (FR), University of Amsterdam (NL), INFN (IT) and CERN (CH) Researchers from Caltech, SLAC and Canada Test-bed kernel: a transatlantic STM-16 (Tsystems) between Geneva (CERN) and Chicago (StarLight), with interconnected workstations 23 January 2003 SWITCH-cc meeting Paolo Moroni (Slide 6) General information 2-years project: 2002 and 2003 Dedicated staff (recruited on project budget) Part-time staff, shared with other activities Open to cooperate with other projects: EUDataGrid, GEANT, Abilene, TeraGrid, NetherLight, etc. Typical EU work package structure: quarterly reports, deliverables at fixed deadlines, periodic reviews by external inspectors. Very formal and structured framework, but effective to avoid project drifting, delays and wastes 23 January 2003 SWITCH-cc meeting Paolo Moroni (Slide 7) DataTAG Network map R06chi-Alcatel7770 W01chi w02chi w03chi w04chi w05chi w06chi ONS15454 SURFNET 2x1GE R06gva-Alcatel7770 V10chi v11chi v12chi v13chi 4x1GE 8x1GE Alcatel 1670 ONS15454 R05chi-JuniperM10 ABILENE Stm64(L3) 2x1GE 2x1GE VTHD/INRIA 1GE Stm16 (FranceTelecom) 1GE 2x1GE Stm16(DTag) Extreme Summit5i 10GE Stm16(GC) 4x1GE 2x1GE SUNNYVALE 2x1GE Alcatel 1670 10x1GE 1GE SURFNET W03gva w04gva 1GE CANARIE 2x1GE ONS15454 W01gva w02gva w05gva w06gva R04chi-Cisco7609 R04gva-Cisco7606 1GE R05gva-JuniperM10 Extreme Summit1i 1GE 2x1GE 10GE Cisco5505-management Chicago Geneva CERN External Network 1GE Vlan4 Vlan5 1GE Vlan7 DataTAG 1GE Teragrid JuniperT640 1GE Stm4(DTag) 1GE Stm16(Swisscom) Cisco2950-management ar3-chicago -Cisco7606 Cernh4-Cisco7609 SWITCH Cernh7-Cisco7609 GEANT Stm16(Colt) backup+projects GARR/CNAF [email protected] - last update: 20021204 Management addresses and path to reach them from the interne Datatag testbed addresses Path of the CCC tunnel from CNAF Path between the OC farms in Chicago and Geneva Path between Sunnyvale and the PC farm in Geneva DataTAG Routing map W01chi w02chi w03chi w04chi w05chi w06chi SURFNET R06gva R06chi V10chi v11chi v12chi v13chi W01gva w02gva w05gva w06gva SURFNET W03gva w04gva CANARIE VTHD/INRIA R05gva R05chi R04gva R04chi SUNNYVALE ABILENE 192.91.236.0/23 192.91.238.0/23 Cisco5505-management Teragrid JuniperT640 Chicago Geneva 192.91.246.192/26 192.91.244.0/27 DataTAG CERN External Network SWITCH Cisco2950-management ar3-chicago Cernh4 Cernh7 GEANT GARR/CNAF [email protected] - last update: 20021204 (some) Research topics (I) Linux kernel tuning for high performance: for example, 8 Terabytes in 24 hours, memory-tomemory (achieved by S .Ravot, Caltech) Bulk file transfer (Terabyte disk-to-disk, at 2 Gbps, achieved by Canadian researchers between TRIUMF and CERN) TCP stack improvements (things get worse with longer RTT) Application-level performance measurement GRID middleware interoperability between EU and US 23 January 2003 SWITCH-cc meeting Paolo Moroni (Slide 10) (some) Research topics (II) 10 Gb tests (10GbE and transatlantic link upgrade, tentatively in September 2003) at layer 2 and layer 3 Multi-vendor equipment (Alcatel 1670 and 7770, Cisco 760x, Juniper M10, Extreme Summit switches) QoS tests, advanced reservation Optical networking: validation of equipment 23 January 2003 SWITCH-cc meeting Paolo Moroni (Slide 11) Issues (I) Electrical power in Chicago (!!!) Broken network hardware (mainly 10 GbE cards, but not only) Broken PCs Hung routers Never enough workstations available for testing Reservation system: it will never be sophisticated enough Network topology: each research group has different requirements Alcatel 1670: needs STM-16 reconfiguration 23 January 2003 SWITCH-cc meeting Paolo Moroni (Slide 12) Issues (II) Cisco 760x components (un)availability Demo workshops (iGRID2002, SC2002, …): nice to see, but organizational nightmares KPNQwest collapse (re-procurement via Tsystems) Routing: interconnections with CERN production network, with external production networks, with external test networks, even with commodity Internet; furthermore, routing is open for experiments Management access to devices OOB access (Chicago) 23 January 2003 SWITCH-cc meeting Paolo Moroni (Slide 13) Issues (III) A lot of enthusiasm and interest, not always supported by adequate planning When adequate planning is there, it is ignored (because of the enthusiasm, of course) Partners coordination is not straightforward: mix of shared and private resources DNS, security, access control, management servers, VLANs, WWW site, IP addressing (>100 addresses assigned), etc.: all need planning, work and maintenance PoP management (run out of rack space) + installation issues (mainly, but not only, Alcatel) 23 January 2003 SWITCH-cc meeting Paolo Moroni (Slide 14) Acknowledgements DataTAG is for what you would have always liked to do and you never dared to do because it was too risky, or too expensive, or too complicated, or because you could not afford a test laboratory Many thanks to DANTE/GEANT and DoE/Caltech, who are actively supporting the project http://www.datatag.org 23 January 2003 SWITCH-cc meeting Paolo Moroni (Slide 15)
