Download APAN-SINET3

MIddleware, 27th APAN Meeting
March 3rd, 2009
SINET3 L1-Ondemand
Service Interface
Motonori Nakamura, Shigeo Urushidani
National Institute of Informatics (NII)
1
SINET3: Science Information Network 3
 SINET3 is the new Japanese academic backbone network launched in April 2007
for more than 700 universities and research institutions.
 It has 63 edge and 12 core nodes and deploys Japan’s first 40 Gbps lines between
Tokyo, Nagoya, and Osaka.
Los Angeles
New York
Nagoya
Osaka
Tokyo
: 40 Gbps
: 10 to 20 Gbps
: 1 to 20 Gbps
: Core Node
: Edge Node
Japan’s first 40 Gbps (STM256) lines
2
Service Features in SINET3
 SINET3 emphasizes four service aspects: transfer layer, virtual private network
(VPN), quality-of-service (QoS), and bandwidth on demand.
 It provides all services on a single network platform, and users can freely
choose the best transfer layer services for their applications.
Services
Examples
★ Multiple Layer Services
• L3 (IP), L2 (Ethernet), & L1 (dedicated line)
★ Enriched VPN Services
• Support for collaborative research among distant
sites with closed user group environment
★ Enhanced QoS Services
• Support for performance-sensitive applications
★ Bandwidth-on-demand
(BoD) Services
• Support for data-intensive applications
3
Bandwidth on Demand (BoD) Services
 SINET3 provides bandwidth-on-demand (BoD) services as part of layer-1 services.
 Users can specify the destinations, duration, bandwidth with granularity of about
150Mbps, and route option, via simple Web pages.
 BoD server receives path setup requests from users, calculates the appropriate
routes, schedules accepted reservations, and triggers layer-1 path setup.
Hokkaido
Web-based Interface
(Destination, Duration, Bandwidth, & Route option)
User
1 Gbps
(13:00-14:00)
Fukuoka
Layer-1
BoD Server
Layer-1 path setup trigger
Osaka
On-demand layer-1 path
Tokyo
SINET3
4
Architecture for BoD Services
 BoD server receives reservation requests, performs path calculation, schedules
accepted requests, and triggers layer-1 path setup to source layer-1 switch.
 Source layer-1 switch sets up layer-1 path toward destination using GMPLS.
 BoD server changes path bandwidth for L2/L3 traffic by LCAS via L1-OPS as needed.
Front-end
Destinations, Duration, Bandwidth, & Route Option
Layer-1
BoD Server
User
Scheduling
Route
calculation
Path control
Resource
management
Path setup trigger
L1-OPS
Path setup request
GMPLS control and management plane
On-demand
Ethernet
IP
L1SW
GMPLS
L1SW
L1SW
L2
MUX
L2
MUX
Hitless bandwidth
change by LCAS
L1SW
IP Router
IP Router
5
Service Parameters of L1 BoD Services
 BoD server allows users to specify connection style + destinations, duration,
bandwidth, & route option via Web-based interface.
Connection Style + Destinations
- Start Time
&
- Finish Time
(in 15 minute
intervals)
Extranet
Bandwidth
Public
VC-4 Granularity (approx. 150 Mbps)
GE
GE
STM-64
STM-16
Lambda (Full bandwidth)
Duration
: Non-VPN
Pre-configured
interfaces
VPN
: VPN-A
: VPN-B
STM-64
10GE
1≤A≤ 7
1 ≤ B ≤ 64
Route Option
- “Minimum Delay”
or
- “Unspecified”
Bandwidth-specified
6
Considerations on Path Calculation
 BoD server selects path (route and links) by taking into account following conditions.
(1) Each link has different available bandwidth for L1 services which varies over time.
(2) Each link has different delay which is a fixed value.
(3) There are parallel links between core nodes.
(4) There are multiple routes between source and destination nodes
(1) Available bandwidth for L1
(2) Delay
Link Bandwidth
Available bandwidth for L1 services
Kanazawa
12ms
Sapporo
7ms
Tokyo2
1ms
3ms
L2/L3 Traffic Pattern
Mon
Tue
Wed
Tokyo1
Thu
Fri
Sat
5ms
Tsukuba
Sendai
Sun
(4) Multiple Routes
1.05 Gbps (VC-4-7v)
(3) Parallel Links
Router
7ms
Link Aggregation
& Load Balancing
Router
Fukuoka
Hiroshima
Kanazawa
Kyoto
0.6 Gbps (VC-4-4v)
VCAT
Tokyo2
L1 Path
0.45 Gbps (VC-4-3v)
VCAT
L1SW
L1SW
Matsuyama
Osaka
Nagoya
Tokyo1
7
Backbone Topology and Current BoD User Sites
• SINET3 has 16 core layer-1 switches and 63 edge layer-1 switches, and has multiple routes
and parallel links between core layer-1 switches
Kyushu
Univ.
L1SW
Yamaguchi
Doshisha
Univ.
L1SW
Univ.
L1SW
Hokkaido
Univ.
L1SW
: Edge L1SW
: Core L1SW
Fukuoka
L1SW
Hiroshima
L1SW
Kyoto
L1SW
Sapporo
L1SW
Kanazawa
L1SW
Tokyo2
L1SW
Tokyo1
L1SW-3
Matsuyama
L1SW
Osaka
L1SW-2
Osaka
L1SW-1
Osaka
Univ.
L1SW
Nagoya
L1SW-1
Nagoya
L1SW-2
NIFS
L1SW
Tokyo1
L1SW-1
NAOJ
L1SW
Tokyo1
L1SW-2
Tsukuba
L1SW
NII
L1SW
KEK
L1SW
Sendai
L1SW
8
Sample Reservation Screen
9
Interface Between BoD Server and L1-OPS
L1-BoD
Server
CORBA
(TMF-814)
L1-OPS
createSNC REQ
TL1
L1SW
Path registration REQ
Path registration RESP
Path setup REQ
createSNC RESP
Path setup RESP
Path setup CMPLD
Path info retrieving REQ
Notification (create CMPLD)
getSNC REQ
getSNC RESP
Path info retrieving RESP
Path info retrieving REQ
Layer-1
BoD Server
Path info retrieving RESP
L1-OPS
deleteSNC REQ
GMPLS control and management plane
Path release REQ
L1SW
deleteSNC RESP
L1SW
L1SW
L1SW
Path release RESP
Path release CMPLD
Path deregistration REQ
Notification (delete CMPLD)
GMPLS
L2
MUX
L2
MUX
IP Router
IP Router
Path deregistration RESP
10
Current Projects using L1 BoD Services (1)
 Three projects (eVLBI, high-quality remote backup, and new video communication)
are using L1 BoD services.
* VLBI: Very Long Baseline Interferometory
eVLBI project
High-quality remote backup project
Detected Fringe (June 12th )
Tomakomai
Hokkaido Univ.
: 2.4 Gbps
: L1 Switch
: 0.15G to 1 Gbps
: L1 Switch
Gifu
Yamaguchi
Tsukuba
NII&NTT (Tokyo)
NAOJ (Tokyo)
NAOJ: National Astronomical Observatory of Japan
Osaka Univ.
Kyushu Univ.
11
Current Projects using L1 BoD Services (2)
 t-Room --- a room-sharing video system that allows people to simultaneously experience
"distant space" and "remote time“. Users feel as if they are in the same room.
 Folding the spaces of Kyoto, Atsugi, present, past onto the space where you are
overlapping spaces (rooms) and overcoming time and space constraints.
Room 1
“Monolith” Building Module:
Room 2 Present
Local
Room 3
Past
Kyoto
Present
Atsugi
side view (left) and
front view (right).
HDV Camera
195 cm
PC
s
142 cm
65’’ LCD Panel
Effective Screen
Size:
142 cm x 80 cm
47 cm
Pathway
Monolith
3.0 m
65’’ LCD Panel
HDV
Camera
12
Examples of Path Setup/Release Time
 Setup(release) time was defined as the difference between the time at that BoD server sends
“create(delete)SNC REQ” and the time at that it receives “notification (create(delete) CMPLD)”.
 We first created each path in series after receiving “notification (create CMPLD)” but we
refined the mechanism to create paths in parallel right after receiving “createSNC RESP.”
Setup (in series)
Setup (in parallel)
10
9
8
7
6
5
4
3
2
1
0
(17)
[min] 6
1.05 Gbps (release)
600 Mbps (release)
150 Mbps (release)
Kyushu Univ. – Hokkaido Univ.
Osaka Univ. – Hokkaido Univ.
Yamaguchi - NAOJ
(17)
Gifu - NAOJ
(17)
Tsukuba - NAOJ
(17)
(17)
Path setup/release time
Path setup/release time
[min] 11
1.05 Gbps (setup)
600 Mbps (setup)
150 Mbps (setup)
Release (in series)
Release (in parallel)
5
(7)
4
3
2
(4)
NII – Hokkaido Univ.
The number of transit switches
(a) e-VLBI project
(4)
(2)
(2)
1
(1)
1 2 3 4 5 6 7 8 9 10 11 12 13 14
(7)
0
(1)
(1)
1 2 3 4 5 6 7 8 9 10 11 12 13 14
The number of transit switches
(b) High-quality remote backup project
13
More General Architecture for BoD Services
 We are planning to provide GMPLS-UNI-based services in addition to reservation-based
services. Forwarding adjacency (FA) paths are preliminary established to manage the services.
 BoD server receives the information of GMPLS-UNI paths via L1-OPS. If GMPLS-UNI paths are
established on unexpected routes, BoD server forcibly tears down them.
Reservation-based Service
(Destinations, Duration, Bandwidth, & Route Option)
HTTP(S)
Front-end
BoD
Users
Layer-1
BoD Server
PC
CORBA
Signalling-based Service
(Destination and Bandwidth)
Admission control,
Scheduling
Path
calculation
Path and
bandwidth control
Resource
management
L1-OPS
GMPLS Control and Management Plane
GMPLS-UNI
L1SW
GMPLS
L1SW
L1SW
L1SW
Server
Ethernet
L2
MUX
Path for L2/L3
Path for L2/L3
Path for L2/L3
L2
MUX
IP
Hitless Bandwidth
Change by LCAS
Router
Router
14
Open Issues
 Admission control toward full-scale operations
•
•
If the total requested bandwidth exceeds the available bandwidth of a link, we try to rearrange preassigned paths for “unspecified” routes to accommodate as many paths as possible.
If the rearrangement fails, the BoD server informs the network operators about the situation. We
seek negotiated solutions whereby network operators change the bandwidth and duration among
users while we limit the number of users of the BoD services. We need an effective admission
control algorithm that fairly selects from among the requests.
 Improvement of layer-1 path setup/release times
•
We would like to improve the path setup/release times but this depends on the specifications of
vendor products.
 Dissemination of BoD services to new scientific research areas
•
We would like to explore new scientific research areas which effectively utilize the properties (low
delay, no delay variance, and no packet losses ) of on-demand layer-1 paths.
15
References
1. S. Urushidani, J. Matsukata, K. Fukuda, S. Abe, Y. Ji, M. Koibuchi, S. Yamada, K. Shimizu, T. Takeda, I.
Inoue, and K. Shiomoto, “Layer-1 bandwidth on demand services in SINET3,” IEEE Globecom 2007, Dec.
2007.
2. S. Urushidani, K. Fukuda, Y. Ji, S. Abe, M. Koibuchi, M. Nakamura, S. Yamada, K. Shimizu, R. Hayashi, I.
Inoue, and K. Shiomoto, “Resource allocation and provision for bandwidth/networks on demand in
SINET3,” 2nd IEEE International Workshop on Bandwidth on Demand, April 2008.
3. S. Urushidani, S. Abe, Y. Ji, K. Fukuda, M. Koibuchi, M. Nakamura, S. Yamada, R. Hayashi, I. Inoue, and
K. Shiomoto, “Design of versatile academic infrastructure for multilayer network services,” IEEE Journal
on Selected Areas in Communications, April 2009 (to appear).
4. S. Urushidani. K. Shimizu, R. Hayashi, H. Tanuma, K. Fukuda, Y. Ji, M. Koibuchi, S. Abe, M. Nakamura,
S. Yamada, I. Inoue, and K. Shiomoto, “Implementation and evaluation of layer-1 bandwidth-on-demand
capabilities in SINET3,” IEEE ICC2009, Jun. 2009 (to appear).
16