Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Experiments with Grid-enabled Network Control Plane in the PHOSPHORUS test-bed Bartosz Belter [email protected] Poznan Supercomputing and Networking Center TERENA Networking Conference 2009 Malaga, Spain AGENDA From GMPLS to G2MPLS: • The GMPLS protocol stack • Introduction to G2MPLS The PHOSPHORUS test-bed Validation of the G2MPLS protocol stack • The TNC 2009 demonstrations Summary TERENA Networking Conference 2009, Malaga, Spain 1 FROM GMPLS… TO G2MPLS TERENA Networking Conference 2009, Malaga, Spain 2 The GMPLS protocol stack Based on Quagga The prototype released in the form of a XEN virtual machine • Includes also all the needed system packages (libs and apps) • a “plug – configure – play” approach for the user • Available at the PHOSPHORUS web-site: http://www.ist-phosphorus.eu/files/deliverables/g2mpls_controller_prototype_v02.tar.gz Four different kinds of controllers can be run depending just on the node configuration • • • • GMPLS border controller GMPLS edge controller GMPLS core controller GMPLS UNI-C controller TERENA Networking Conference 2009, Malaga, Spain The PHOSPHORUS GMPLS w.r.t standards ASON architecture OIF Network Interfaces (UNI and E-NNI) PHOSPHORUS GMPLS TERENA Networking Conference 2009, Malaga, Spain IETF (CCAMP) Protocol Controllers + some architectural aspects FROM GMPLS… TO G2MPLS TERENA Networking Conference 2009, Malaga, Spain 5 What is G2MPLS? uniform interface for the Grid-user to trigger Grid & network resource actions single-step provisioning of Grid and network resources (w.r.t. the dual approach Grid brokers + NRPS-es) adoption of well-established procedures for traffic engineering, resiliency and crankback Grid site A G.O-UNI G2 G2 G2 G.I-NNI exposes interfaces specific for Grid services made of a set of extensions to the standard GMPLS • JSDL schema v1.3 (GMPLS signalling) • GLUE schema v1.3 (GMPLS routing) G2 G.E-NNI G2MPLS NRPS G.O-UNI Grid site B TERENA Networking Conference 2009, Malaga, Spain Grid site C THE PHOSPHORUS TEST-BED • Transport Plane • Control Plane • Middleware and Applications TERENA Networking Conference 2009, Malaga, Spain 7 G2MPLS test-bed – Transport Plane [1] ADVA FSP 3000RE-II (Lambda Switch) • 15 pass through ports • 6 local ports • 3 physical units Calient Diamond Wave (Fibre Switch) • 60 ports • 1 physical unit / 4 logical units (switch virtualization) TERENA Networking Conference 2009, Malaga, Spain G2MPLS test-bed – Transport Plane [2] Foundry XMR NetIron 8000 (Ethernet Switch) • 2 x 4-port 10GE modules (XFP) • 1 x 24-port 1GE module (SFP) • 3 physical units Allied Telesis AT-8000/S (Fast Ethernet Switch) • Low-cost managed stackable Fast Ethernet switch • PoE connectivity at the edge for VoIP phones and wireless access points • 10/100 TX x 24 ports Allied Telesis AT-9424T (Gigabit Ethernet Switch) • 10/100/1000T x 24 ports • 2 SFP bays TERENA Networking Conference 2009, Malaga, Spain G2MPLS test-bed – Transport Plane [4] The PHOSPHORUS test-bed in PSNC Grid site Allied Telesis AT-8000S Allied Telesis AT-9424T Foundry XMR The Ethernet domain Foundry XMR ADVA FSP 3000 ADVA FSP 3000 Grid site GÉANT2 network Foundry XMR CALIENT Diamond Wave CALIENT Diamond Wave CALIENT Diamond Wave CALIENT Diamond Wave ROADM ADVA FSP 3000 The LSC domain The FSC domain ROADM Grid site Grid site TERENA Networking Conference 2009, Malaga, Spain G2MPLS test-bed – Transport Plane [4] The PHOSPHORUS test-bed in UESSEX CALIENT Diamond Wave CALIENT Diamond Wave CALIENT Diamond Wave CALIENT Diamond Wave VLAN 602 The FSC domain GÉANT2 network TERENA Networking Conference 2009, Malaga, Spain THE PHOSPHORUS TEST-BED • Transport Plane • Control Plane • Middleware and Applications TERENA Networking Conference 2009, Malaga, Spain 12 G2MPLS test-bed – Control Plane [1] The Control Plane implemented by a set of G2MPLS node controlers • Each of them operates exclusively on a Transport Network element (real or derived from partitioning) • Each controller is interfaced to the Transport Network equipment (Southbound Interface) through TL1 (ADVA, CALIENT), CLI (Allied Telesis) and SNMP (Foundry XMR) • Node controllers run on i386 32-bit platform with Gentoo Linux distribution Signaling Control Network (SCN) • To transport signaling messages between the CP components • Each G2MPLS exposes at least an interface on the Signaling Communication Network (SCN) over which the G2MPLS protocol messages flow • SCN is IP-based with addresses from the private scope. IP tunnelling is used for out of band connectivity between controllers. TERENA Networking Conference 2009, Malaga, Spain G2MPLS test-bed – Control Plane [2] The configuration of the G2MPLS CP requires mapping of actual physical topology into the configuration files associated with each of the G2MPLS processes TERENA Networking Conference 2009, Malaga, Spain THE PHOSPHORUS TEST-BED • Transport Plane • Control Plane • Middleware and Applications TERENA Networking Conference 2009, Malaga, Spain 15 G2MPLS test-bed – GRID Middleware: UNICORE6 UNiform Interface to COmputing REsources seamless, secure, and intuitive Initial development started in two German projects funded by the German ministry of education and research (BMBF) Continuous development since 2002 in several European projects Core developers today from Europe: CINECA, ICM, Intel, FLE, FZJ TERENA Networking Conference 2009, Malaga, Spain G2MPLS test-bed – Applications [1] KoDaVis: Making Atmospheric Processes visible WISDOM: Wide In Silicio Docking on Malaria TOPS:Technology for Optical Pixel Streaming SAGE: Scalable Adaptive Graphics Environment DDSS: Backup/archive copies with TSM (Tivoli Storage Manager) TERENA Networking Conference 2009, Malaga, Spain G2MPLS test-bed – Applications [2] KoDaVis: Making Atmospheric Processes visible simulations of physical and chemical processes in the atmosphere help to understand the effect of human activities on the climate: data sets ~ 1000 GigaByte visualization of data provides insight into processes TERENA Networking Conference 2009, Malaga, Spain G2MPLS test-bed – Applications [3] KoDaVIS in Phosphorus: • Adapt application to Phosphorus environment to make scheduled synchronous reservations of its resources via the UNICORE middleware • Deploy at FZJ, FHG, PSNC to evaluate new Phosphorus services Communication requirements: • At visualisation sites: 700 Mbit/s, 10 msec latency • At data-server site(s): n x 700 Mbit/s • Traffic characteristics: 30 Mbit/s video (continuous) + bursty transfer of 3.3 MB data-slices CAVE, WorkBench HoloBench, (3D-Wall) Client Site B Client Site A ~ 700 Mbit/s Data & collaboration server (FZJ) TERENA Networking Conference 2009, Malaga, Spain Client Site C EXPERIMENTS WITH THE G2MPLS PROTOCOL STACK • The TNC09 demo: Integration of KoDaVIS with G2MPLS • The TNC09 demo: DDSS Backup TERENA Networking Conference 2009, Malaga, Spain 20 Experiments with KoDaVIS, UNICORE and G2MPLS Main building blocks: • Application: KoDaVIS • Grid Middleware: UNICORE • Grid-aware Network Control Plane: G2MPLS KoDaVIS Client KoDaVIS Server UNICORE6 G2MPLS TERENA Networking Conference 2009, Malaga, Spain KoDaVIS Server The TNC2009 KoDaVIS demo – Transport Plane Allied Telesis AT-8000S Allied Telesis AT-8000S KoDaVIS Server UNICORE6 KoDaVIS Server UNICORE6 Allied Telesis AT-8000S Allied Telesis AT-9424T KoDaVIS Client UNICORE6 TERENA Networking Conference 2009, Malaga, Spain The TNC2009 KoDaVIS demo – Control Plane G.UNI ClientCtrl RID: 192.168.156.20 TEL 2.20.1.2/30 CCID TNA 0x220 20.20.20.1/24 TEL 2.20.1.1/30 2 CCID TEM RID: 192.168.102.2 RID: 192.168.102.3 0 10 x 13 0 1. 3. 1. 2/ 3 L TE 3. 1. 1/ 30 1. TE L G2MPLS CoreCtrl RID: 192.168.102.1 G.UNI ClientCtrl RID: 192.168.156.30 TEL 3.30.1.1/30 CCID TEM 0x34 500 30 2/ 1. 4. 2. TEL 1.2.1.1/30 0x330 30.30.30.1/24 C TE CID M TE L 30 1/ 1. 4 4. 2 2. 0x 000 1 0x12 100 CCID TNA TEL 3.4.1.1/30 0 L TE ID C C EM T CCID TEM 0x23 100 TEL 2.3.1.2/30 TEL 1.2.1.2/30 TEL 3.30.1.2/30 G2MPLS EdgeCtrl TEL 2.3.1.1/30 G MPLS EdgeCtrl TEL 3.4.1.2/30 TEL 1.4.1.1/30 CCID 0x14 TEM 100 TEL 1.4.1.2/30 G2MPLS EdgeCtrl RID: 192.168.102.4 TEL 4.40.1.2/30 CCID TNA 0x440 40.40.40.1/24 G.UNI ClientCtrl RID: 192.168.156.40 TEL 4.40.1.1/30 TERENA Networking Conference 2009, Malaga, Spain The TNC2009 demo – application scenarios [1] Scenario 1: „Reduced” overlay mode Scenario 2: Overlay mode Scenario 3: Integrated mode TERENA Networking Conference 2009, Malaga, Spain The TNC2009 demo – application scenarios [2] Scenario 1: „Reduced” overlay mode No routing information about the network layer in Grid Middleware The scheduler just asks for a network path from the application client to server UNICORE client G.OUNI gateway MSS Request for network QoS from client to server KoDaVIS Session Manager KoDaVIS client Network Reservation Request Activity endpoint Create Network SLA Monitor SLA Create new session Load the visualisation connect TERENA Networking Conference 2009, Malaga, Spain KoDaVIS Data server The TNC2009 demo – application scenarios [3] Scenario 2: Overlay mode Grid Layer has both, Grid and network routing knowledge Grid scheduler responsible for initiation and coordination of the reservation process through the participating Grid sites and the network G2MPLS acts as an e2e information bearer for network and Grid resources information TERENA Networking Conference 2009, Malaga, Spain The TNC2009 demo – application scenarios [4] Scenario 2: Overlay mode (cont.) UNICORE client G.OUNI gateway MSS Request for network QoS from client to any server KoDaVIS Session Manager KoDaVIS client Request for routing information Routing information Selection of data server Network Reservation Request Activity endpoint Create Network SLA Monitor SLA Create new session Load the visualisation connect TERENA Networking Conference 2009, Malaga, Spain KoDaVIS Data server The TNC2009 demo – application scenarios [5] Scenario 3: Integrated mode Most of the functionalities for resource advance reservation and coallocation are moved to the Network Control Plane G2MPLS acts as an e2e information bearer for network and Grid resources information TERENA Networking Conference 2009, Malaga, Spain The TNC2009 demo – application scenarios [6] Scenario 3: Integrated mode (cont.) UNICORE client G.OUNI gateway MSS G2MPLS CP KoDaVIS Session Manager KoDaVIS client Request for network QoS from client to any server Network Reservation Request to any server Select a server and reserve the network QoS Activity endpoint Publish the server address Create Network SLA Monitor SLA Create new session Load the visualisation connect TERENA Networking Conference 2009, Malaga, Spain KoDaVIS Data server The TNC2009 KoDaVIS demo TERENA Networking Conference 2009, Malaga, Spain EXPERIMENTS WITH THE G2MPLS PROTOCOL STACK • The TNC09 demo: Integration of KoDaVIS with G2MPLS • The TNC09 demo: DDSS Backup TERENA Networking Conference 2009, Malaga, Spain 31 The TNC2009 DDSS demo (1) Main building blocks: • Application: DDSS - GridFTP • Grid Middleware: none • Grid-aware Network Control Plane: G2MPLS DDSS Client DDSS Server G2MPLS TERENA Networking Conference 2009, Malaga, Spain DDSS Server The TNC2009 DDSS demo (2) The G2MPLS Control Plane handling requests of the Distributed Data Storage System (DDSS) application: • The multi-domain and multi-technology test-bed • Two network domains: – LSC domain (3 x ROADM ADVA FSP 3000RE-II) – PSNC – FSC doman (4 virtualized nodes based on Calient DiamondWave FiberConnect) – UESSEX – Domains interconnected with the 1 Gbit/s GÉANT2 data plane link The DDSS application offers the large files backup service using GridFTP (part of the Globus toolkit) The DDSS client application is located in PSNC and remotely connected to the TNC09 booth DDSS uses the anycast feature of G2MPLS (Integrated mode) TERENA Networking Conference 2009, Malaga, Spain The TNC2009 DDSS demo (3) TERENA Networking Conference 2009, Malaga, Spain ACKNOWLEDGMENTS AND CONCLUSIONS TERENA Networking Conference 2009, Malaga, Spain 35 Acknowledgments G2MPLS development team • Nicola Ciulli, Gino Carrozzo, Giacomo Bernini, Francesco Salvestrini, Giodi Giogi, Giada Landi for their hard work on the G2MPLS control plane design and development • Damian Parniewicz, Kuba Gutkowski, Łukasz Łopatowski, Krzysztof Dombek, Artur Juszczyk for their significant input to design and development and all testbed-related activities • Eduard Escalona, Reza Nejabati for their support and the gateways development Grid Middleware and Application team • Bjorn Hagemeier and Karl Catewicz for their support with the UNICORE6 and KoDaVIS integration • Adam Zawada for his involvement and hard work on the DDSS demonstration TERENA Networking Conference 2009, Malaga, Spain Summary Currently, the Open Source G2MPLS protocol stack supports the representatives from three main technology areas: LSC, FSC and Ethernet • The stack is extendable: quick and simple development of the extensions in support of different vendors and equipment • Extensions for low-cost Ethernet switches has just been developed and tested PHOSPHORUS G2MPLS is backward compatible with ASON/GMPLS • Provides „legacy” ASON/GMPLS transport services and procedures • This compliance fosters the possible integration of Grids in operational and/or commercial networks G2MPLS allows to run any kind of applications, even not bridged by Grid Middleware. It is possible to connect the application directly to the network through G.OUNI, bypassing existing gateways developed for UNICORE • Corba interfaces allow easy plug&play of external applications in the G2MPLS framework TERENA Networking Conference 2009, Malaga, Spain Thank you. Questions? Bartosz Belter [email protected] TERENA Networking Conference 2009 Malaga, Spain, June 8th – 11th 2009