Download Experiments with Grid-enabled Network Control Plane in the

Experiments with Grid-enabled Network
Control Plane in the PHOSPHORUS test-bed
Bartosz Belter [email protected]
Poznan Supercomputing and Networking Center
TERENA Networking Conference 2009
Malaga, Spain
AGENDA
 From GMPLS to G2MPLS:
• The GMPLS protocol stack
• Introduction to G2MPLS
 The PHOSPHORUS test-bed
 Validation of the G2MPLS protocol stack
• The TNC 2009 demonstrations
 Summary
TERENA Networking Conference 2009, Malaga, Spain
1
FROM GMPLS… TO G2MPLS
TERENA Networking Conference 2009, Malaga, Spain
2
The GMPLS protocol stack
 Based on Quagga
 The prototype released in the form of a XEN virtual machine
• Includes also all the needed system packages (libs and apps)
• a “plug – configure – play” approach for the user
• Available at the PHOSPHORUS web-site:
http://www.ist-phosphorus.eu/files/deliverables/g2mpls_controller_prototype_v02.tar.gz
 Four different kinds of controllers can be run depending just on the node
configuration
•
•
•
•
GMPLS border controller
GMPLS edge controller
GMPLS core controller
GMPLS UNI-C controller
TERENA Networking Conference 2009, Malaga, Spain
The PHOSPHORUS GMPLS w.r.t standards
ASON architecture
OIF Network
Interfaces
(UNI and E-NNI)
PHOSPHORUS GMPLS
TERENA Networking Conference 2009, Malaga, Spain
IETF (CCAMP)
Protocol Controllers
+ some architectural
aspects
FROM GMPLS… TO G2MPLS
TERENA Networking Conference 2009, Malaga, Spain
5
What is G2MPLS?





uniform interface for the Grid-user to
trigger Grid & network resource actions
single-step provisioning of Grid and
network resources (w.r.t. the dual
approach Grid brokers + NRPS-es)
adoption of well-established
procedures for traffic engineering,
resiliency and crankback
Grid site A
G.O-UNI
G2
G2
G2
G.I-NNI
exposes interfaces specific for Grid
services
made of a set of extensions to the
standard GMPLS
• JSDL schema v1.3 (GMPLS
signalling)
• GLUE schema v1.3 (GMPLS
routing)
G2
G.E-NNI
G2MPLS
NRPS
G.O-UNI
Grid site B
TERENA Networking Conference 2009, Malaga, Spain
Grid site C
THE PHOSPHORUS TEST-BED
• Transport Plane
• Control Plane
• Middleware and Applications
TERENA Networking Conference 2009, Malaga, Spain
7
G2MPLS test-bed – Transport Plane [1]
 ADVA FSP 3000RE-II (Lambda Switch)
• 15 pass through ports
• 6 local ports
• 3 physical units
 Calient Diamond Wave (Fibre Switch)
• 60 ports
• 1 physical unit / 4 logical units (switch virtualization)
TERENA Networking Conference 2009, Malaga, Spain
G2MPLS test-bed – Transport Plane [2]
 Foundry XMR NetIron 8000 (Ethernet Switch)
• 2 x 4-port 10GE modules (XFP)
• 1 x 24-port 1GE module (SFP)
• 3 physical units
 Allied Telesis AT-8000/S (Fast Ethernet Switch)
• Low-cost managed stackable Fast Ethernet switch
• PoE connectivity at the edge for VoIP phones and
wireless access points
• 10/100 TX x 24 ports
 Allied Telesis AT-9424T (Gigabit Ethernet Switch)
• 10/100/1000T x 24 ports
• 2 SFP bays
TERENA Networking Conference 2009, Malaga, Spain
G2MPLS test-bed – Transport Plane [4]
The PHOSPHORUS test-bed in PSNC
Grid site
Allied Telesis
AT-8000S
Allied Telesis
AT-9424T
Foundry
XMR
The Ethernet
domain
Foundry
XMR
ADVA FSP 3000
ADVA FSP 3000
Grid site
GÉANT2
network
Foundry
XMR
CALIENT
Diamond Wave
CALIENT
Diamond Wave
CALIENT
Diamond Wave
CALIENT
Diamond Wave
ROADM
ADVA FSP 3000
The LSC
domain
The FSC
domain
ROADM
Grid site
Grid site
TERENA Networking Conference 2009, Malaga, Spain
G2MPLS test-bed – Transport Plane [4]
The PHOSPHORUS test-bed in UESSEX
CALIENT
Diamond Wave
CALIENT
Diamond Wave
CALIENT
Diamond Wave
CALIENT
Diamond Wave
VLAN 602
The FSC
domain
GÉANT2
network
TERENA Networking Conference 2009, Malaga, Spain
THE PHOSPHORUS TEST-BED
• Transport Plane
• Control Plane
• Middleware and Applications
TERENA Networking Conference 2009, Malaga, Spain
12
G2MPLS test-bed – Control Plane [1]
 The Control Plane implemented by a set of G2MPLS node controlers
• Each of them operates exclusively on a Transport Network element (real or
derived from partitioning)
• Each controller is interfaced to the Transport Network equipment (Southbound
Interface) through TL1 (ADVA, CALIENT), CLI (Allied Telesis) and SNMP
(Foundry XMR)
• Node controllers run on i386 32-bit platform with Gentoo Linux distribution
 Signaling Control Network (SCN)
• To transport signaling messages between the CP components
• Each G2MPLS exposes at least an interface on the Signaling Communication
Network (SCN) over which the G2MPLS protocol messages flow
• SCN is IP-based with addresses from the private scope. IP tunnelling is used
for out of band connectivity between controllers.
TERENA Networking Conference 2009, Malaga, Spain
G2MPLS test-bed – Control Plane [2]

The configuration of the G2MPLS CP requires mapping of actual physical
topology into the configuration files associated with each of the G2MPLS
processes
TERENA Networking Conference 2009, Malaga, Spain
THE PHOSPHORUS TEST-BED
• Transport Plane
• Control Plane
• Middleware and Applications
TERENA Networking Conference 2009, Malaga, Spain
15
G2MPLS test-bed – GRID Middleware: UNICORE6
 UNiform Interface to COmputing REsources
 seamless, secure, and intuitive

Initial development started in two German projects funded by the German ministry
of education and research (BMBF)

Continuous development since 2002 in several European projects
 Core developers today from Europe: CINECA, ICM, Intel, FLE, FZJ
TERENA Networking Conference 2009, Malaga, Spain
G2MPLS test-bed – Applications [1]





KoDaVis: Making Atmospheric Processes visible
WISDOM: Wide In Silicio Docking on Malaria
TOPS:Technology for Optical Pixel Streaming
SAGE: Scalable Adaptive Graphics Environment
DDSS: Backup/archive copies with TSM (Tivoli Storage Manager)
TERENA Networking Conference 2009, Malaga, Spain
G2MPLS test-bed – Applications [2]
KoDaVis: Making Atmospheric Processes visible
 simulations of physical and chemical processes in the atmosphere help to
understand the effect of human activities on the climate: data sets ~ 1000
GigaByte
 visualization of data provides insight into processes
TERENA Networking Conference 2009, Malaga, Spain
G2MPLS test-bed – Applications [3]
 KoDaVIS in Phosphorus:
• Adapt application to Phosphorus environment to make scheduled
synchronous reservations of its resources via the UNICORE middleware
• Deploy at FZJ, FHG, PSNC to evaluate new Phosphorus services
 Communication requirements:
• At visualisation sites: 700 Mbit/s, 10 msec latency
• At data-server site(s): n x 700 Mbit/s
• Traffic characteristics: 30 Mbit/s video (continuous) + bursty transfer of 3.3
MB data-slices
CAVE,
WorkBench
HoloBench,
(3D-Wall)
Client Site B
Client Site A
~ 700 Mbit/s
Data & collaboration server (FZJ)
TERENA Networking Conference 2009, Malaga, Spain
Client Site C
EXPERIMENTS WITH THE
G2MPLS PROTOCOL STACK
• The TNC09 demo: Integration of KoDaVIS with G2MPLS
• The TNC09 demo: DDSS Backup
TERENA Networking Conference 2009, Malaga, Spain
20
Experiments with KoDaVIS, UNICORE and G2MPLS
 Main building blocks:
• Application: KoDaVIS
• Grid Middleware: UNICORE
• Grid-aware Network Control Plane: G2MPLS
KoDaVIS
Client
KoDaVIS
Server
UNICORE6
G2MPLS
TERENA Networking Conference 2009, Malaga, Spain
KoDaVIS
Server
The TNC2009 KoDaVIS demo – Transport Plane
Allied Telesis
AT-8000S
Allied Telesis
AT-8000S
KoDaVIS Server
UNICORE6
KoDaVIS Server
UNICORE6
Allied Telesis
AT-8000S
Allied Telesis
AT-9424T
KoDaVIS Client
UNICORE6
TERENA Networking Conference 2009, Malaga, Spain
The TNC2009 KoDaVIS demo – Control Plane
G.UNI
ClientCtrl
RID: 192.168.156.20
TEL 2.20.1.2/30
CCID
TNA
0x220
20.20.20.1/24
TEL 2.20.1.1/30
2
CCID
TEM
RID: 192.168.102.2
RID: 192.168.102.3
0
10 x 13
0
1.
3.
1.
2/
3
L
TE
3.
1.
1/
30
1.
TE
L
G2MPLS
CoreCtrl
RID: 192.168.102.1
G.UNI
ClientCtrl
RID: 192.168.156.30
TEL 3.30.1.1/30
CCID
TEM
0x34
500
30
2/
1.
4.
2.
TEL 1.2.1.1/30
0x330
30.30.30.1/24
C
TE CID
M
TE
L
30
1/
1.
4
4.
2
2.
0x 000
1
0x12
100
CCID
TNA
TEL 3.4.1.1/30
0
L
TE
ID
C
C EM
T
CCID
TEM
0x23
100
TEL 2.3.1.2/30
TEL 1.2.1.2/30
TEL 3.30.1.2/30
G2MPLS
EdgeCtrl
TEL 2.3.1.1/30
G MPLS
EdgeCtrl
TEL 3.4.1.2/30
TEL 1.4.1.1/30
CCID
0x14
TEM
100
TEL 1.4.1.2/30
G2MPLS
EdgeCtrl
RID: 192.168.102.4
TEL 4.40.1.2/30
CCID
TNA
0x440
40.40.40.1/24
G.UNI
ClientCtrl
RID: 192.168.156.40
TEL 4.40.1.1/30
TERENA Networking Conference 2009, Malaga, Spain
The TNC2009 demo – application scenarios [1]
 Scenario 1: „Reduced” overlay mode
 Scenario 2: Overlay mode
 Scenario 3: Integrated mode
TERENA Networking Conference 2009, Malaga, Spain
The TNC2009 demo – application scenarios [2]
Scenario 1: „Reduced” overlay mode
 No routing information about the network layer in Grid Middleware
 The scheduler just asks for a network path from the application client to
server
UNICORE
client
G.OUNI
gateway
MSS
Request
for network QoS
from client to server
KoDaVIS
Session Manager
KoDaVIS
client
Network Reservation
Request
Activity endpoint
Create Network SLA
Monitor
SLA
Create new session
Load the visualisation
connect
TERENA Networking Conference 2009, Malaga, Spain
KoDaVIS
Data server
The TNC2009 demo – application scenarios [3]
Scenario 2: Overlay mode
 Grid Layer has both, Grid and network routing knowledge
 Grid scheduler responsible for initiation and coordination of the
reservation process through the participating Grid sites and the network
 G2MPLS acts as an e2e information bearer for network and Grid
resources information
TERENA Networking Conference 2009, Malaga, Spain
The TNC2009 demo – application scenarios [4]
Scenario 2: Overlay mode (cont.)
UNICORE
client
G.OUNI
gateway
MSS
Request
for network QoS from
client to any server
KoDaVIS
Session Manager
KoDaVIS
client
Request for routing
information
Routing information
Selection of
data server
Network Reservation
Request
Activity endpoint
Create Network SLA
Monitor
SLA
Create new session
Load the visualisation
connect
TERENA Networking Conference 2009, Malaga, Spain
KoDaVIS
Data server
The TNC2009 demo – application scenarios [5]
Scenario 3: Integrated mode
 Most of the functionalities for resource advance reservation and coallocation are moved to the Network Control Plane
 G2MPLS acts as an e2e information bearer for network and Grid
resources information
TERENA Networking Conference 2009, Malaga, Spain
The TNC2009 demo – application scenarios [6]
Scenario 3: Integrated mode (cont.)
UNICORE
client
G.OUNI
gateway
MSS
G2MPLS
CP
KoDaVIS
Session Manager
KoDaVIS
client
Request
for network QoS from
client to any server
Network Reservation
Request to any server
Select a
server and
reserve the
network QoS
Activity endpoint
Publish the server address
Create Network SLA
Monitor
SLA
Create new session
Load the visualisation
connect
TERENA Networking Conference 2009, Malaga, Spain
KoDaVIS
Data server
The TNC2009 KoDaVIS demo
TERENA Networking Conference 2009, Malaga, Spain
EXPERIMENTS WITH THE
G2MPLS PROTOCOL STACK
• The TNC09 demo: Integration of KoDaVIS with G2MPLS
• The TNC09 demo: DDSS Backup
TERENA Networking Conference 2009, Malaga, Spain
31
The TNC2009 DDSS demo (1)
 Main building blocks:
• Application: DDSS - GridFTP
• Grid Middleware: none
• Grid-aware Network Control Plane: G2MPLS
DDSS
Client
DDSS
Server
G2MPLS
TERENA Networking Conference 2009, Malaga, Spain
DDSS
Server
The TNC2009 DDSS demo (2)
 The G2MPLS Control Plane handling requests of the Distributed Data
Storage System (DDSS) application:
• The multi-domain and multi-technology test-bed
• Two network domains:
– LSC domain (3 x ROADM ADVA FSP 3000RE-II) – PSNC
– FSC doman (4 virtualized nodes based on Calient DiamondWave FiberConnect) –
UESSEX
– Domains interconnected with the 1 Gbit/s GÉANT2 data plane link
 The DDSS application offers the large files backup service using GridFTP (part of the Globus toolkit)
 The DDSS client application is located in PSNC and remotely connected
to the TNC09 booth
 DDSS uses the anycast feature of G2MPLS (Integrated mode)
TERENA Networking Conference 2009, Malaga, Spain
The TNC2009 DDSS demo (3)
TERENA Networking Conference 2009, Malaga, Spain
ACKNOWLEDGMENTS AND
CONCLUSIONS
TERENA Networking Conference 2009, Malaga, Spain
35
Acknowledgments
 G2MPLS development team
• Nicola Ciulli, Gino Carrozzo, Giacomo Bernini, Francesco Salvestrini,
Giodi Giogi, Giada Landi for their hard work on the G2MPLS control plane
design and development
• Damian Parniewicz, Kuba Gutkowski, Łukasz Łopatowski, Krzysztof
Dombek, Artur Juszczyk for their significant input to design and
development and all testbed-related activities
• Eduard Escalona, Reza Nejabati for their support and the gateways
development
 Grid Middleware and Application team
• Bjorn Hagemeier and Karl Catewicz for their support with the UNICORE6
and KoDaVIS integration
• Adam Zawada for his involvement and hard work on the DDSS
demonstration
TERENA Networking Conference 2009, Malaga, Spain
Summary
 Currently, the Open Source G2MPLS protocol stack supports the
representatives from three main technology areas: LSC, FSC and
Ethernet
• The stack is extendable: quick and simple development of the extensions in
support of different vendors and equipment
• Extensions for low-cost Ethernet switches has just been developed and
tested
 PHOSPHORUS G2MPLS is backward compatible with ASON/GMPLS
• Provides „legacy” ASON/GMPLS transport services and procedures
• This compliance fosters the possible integration of Grids in operational and/or
commercial networks
 G2MPLS allows to run any kind of applications, even not bridged by Grid
Middleware. It is possible to connect the application directly to the
network through G.OUNI, bypassing existing gateways developed for
UNICORE
• Corba interfaces allow easy plug&play of external applications in the
G2MPLS framework
TERENA Networking Conference 2009, Malaga, Spain
Thank you.
Questions?
Bartosz Belter [email protected]
TERENA Networking Conference 2009
Malaga, Spain, June 8th – 11th 2009