Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
MIddleware, 27th APAN Meeting March 3rd, 2009 SINET3 L1-Ondemand Service Interface Motonori Nakamura, Shigeo Urushidani National Institute of Informatics (NII) 1 SINET3: Science Information Network 3 SINET3 is the new Japanese academic backbone network launched in April 2007 for more than 700 universities and research institutions. It has 63 edge and 12 core nodes and deploys Japan’s first 40 Gbps lines between Tokyo, Nagoya, and Osaka. Los Angeles New York Nagoya Osaka Tokyo : 40 Gbps : 10 to 20 Gbps : 1 to 20 Gbps : Core Node : Edge Node Japan’s first 40 Gbps (STM256) lines 2 Service Features in SINET3 SINET3 emphasizes four service aspects: transfer layer, virtual private network (VPN), quality-of-service (QoS), and bandwidth on demand. It provides all services on a single network platform, and users can freely choose the best transfer layer services for their applications. Services Examples ★ Multiple Layer Services • L3 (IP), L2 (Ethernet), & L1 (dedicated line) ★ Enriched VPN Services • Support for collaborative research among distant sites with closed user group environment ★ Enhanced QoS Services • Support for performance-sensitive applications ★ Bandwidth-on-demand (BoD) Services • Support for data-intensive applications 3 Bandwidth on Demand (BoD) Services SINET3 provides bandwidth-on-demand (BoD) services as part of layer-1 services. Users can specify the destinations, duration, bandwidth with granularity of about 150Mbps, and route option, via simple Web pages. BoD server receives path setup requests from users, calculates the appropriate routes, schedules accepted reservations, and triggers layer-1 path setup. Hokkaido Web-based Interface (Destination, Duration, Bandwidth, & Route option) User 1 Gbps (13:00-14:00) Fukuoka Layer-1 BoD Server Layer-1 path setup trigger Osaka On-demand layer-1 path Tokyo SINET3 4 Architecture for BoD Services BoD server receives reservation requests, performs path calculation, schedules accepted requests, and triggers layer-1 path setup to source layer-1 switch. Source layer-1 switch sets up layer-1 path toward destination using GMPLS. BoD server changes path bandwidth for L2/L3 traffic by LCAS via L1-OPS as needed. Front-end Destinations, Duration, Bandwidth, & Route Option Layer-1 BoD Server User Scheduling Route calculation Path control Resource management Path setup trigger L1-OPS Path setup request GMPLS control and management plane On-demand Ethernet IP L1SW GMPLS L1SW L1SW L2 MUX L2 MUX Hitless bandwidth change by LCAS L1SW IP Router IP Router 5 Service Parameters of L1 BoD Services BoD server allows users to specify connection style + destinations, duration, bandwidth, & route option via Web-based interface. Connection Style + Destinations - Start Time & - Finish Time (in 15 minute intervals) Extranet Bandwidth Public VC-4 Granularity (approx. 150 Mbps) GE GE STM-64 STM-16 Lambda (Full bandwidth) Duration : Non-VPN Pre-configured interfaces VPN : VPN-A : VPN-B STM-64 10GE 1≤A≤ 7 1 ≤ B ≤ 64 Route Option - “Minimum Delay” or - “Unspecified” Bandwidth-specified 6 Considerations on Path Calculation BoD server selects path (route and links) by taking into account following conditions. (1) Each link has different available bandwidth for L1 services which varies over time. (2) Each link has different delay which is a fixed value. (3) There are parallel links between core nodes. (4) There are multiple routes between source and destination nodes (1) Available bandwidth for L1 (2) Delay Link Bandwidth Available bandwidth for L1 services Kanazawa 12ms Sapporo 7ms Tokyo2 1ms 3ms L2/L3 Traffic Pattern Mon Tue Wed Tokyo1 Thu Fri Sat 5ms Tsukuba Sendai Sun (4) Multiple Routes 1.05 Gbps (VC-4-7v) (3) Parallel Links Router 7ms Link Aggregation & Load Balancing Router Fukuoka Hiroshima Kanazawa Kyoto 0.6 Gbps (VC-4-4v) VCAT Tokyo2 L1 Path 0.45 Gbps (VC-4-3v) VCAT L1SW L1SW Matsuyama Osaka Nagoya Tokyo1 7 Backbone Topology and Current BoD User Sites • SINET3 has 16 core layer-1 switches and 63 edge layer-1 switches, and has multiple routes and parallel links between core layer-1 switches Kyushu Univ. L1SW Yamaguchi Doshisha Univ. L1SW Univ. L1SW Hokkaido Univ. L1SW : Edge L1SW : Core L1SW Fukuoka L1SW Hiroshima L1SW Kyoto L1SW Sapporo L1SW Kanazawa L1SW Tokyo2 L1SW Tokyo1 L1SW-3 Matsuyama L1SW Osaka L1SW-2 Osaka L1SW-1 Osaka Univ. L1SW Nagoya L1SW-1 Nagoya L1SW-2 NIFS L1SW Tokyo1 L1SW-1 NAOJ L1SW Tokyo1 L1SW-2 Tsukuba L1SW NII L1SW KEK L1SW Sendai L1SW 8 Sample Reservation Screen 9 Interface Between BoD Server and L1-OPS L1-BoD Server CORBA (TMF-814) L1-OPS createSNC REQ TL1 L1SW Path registration REQ Path registration RESP Path setup REQ createSNC RESP Path setup RESP Path setup CMPLD Path info retrieving REQ Notification (create CMPLD) getSNC REQ getSNC RESP Path info retrieving RESP Path info retrieving REQ Layer-1 BoD Server Path info retrieving RESP L1-OPS deleteSNC REQ GMPLS control and management plane Path release REQ L1SW deleteSNC RESP L1SW L1SW L1SW Path release RESP Path release CMPLD Path deregistration REQ Notification (delete CMPLD) GMPLS L2 MUX L2 MUX IP Router IP Router Path deregistration RESP 10 Current Projects using L1 BoD Services (1) Three projects (eVLBI, high-quality remote backup, and new video communication) are using L1 BoD services. * VLBI: Very Long Baseline Interferometory eVLBI project High-quality remote backup project Detected Fringe (June 12th ) Tomakomai Hokkaido Univ. : 2.4 Gbps : L1 Switch : 0.15G to 1 Gbps : L1 Switch Gifu Yamaguchi Tsukuba NII&NTT (Tokyo) NAOJ (Tokyo) NAOJ: National Astronomical Observatory of Japan Osaka Univ. Kyushu Univ. 11 Current Projects using L1 BoD Services (2) t-Room --- a room-sharing video system that allows people to simultaneously experience "distant space" and "remote time“. Users feel as if they are in the same room. Folding the spaces of Kyoto, Atsugi, present, past onto the space where you are overlapping spaces (rooms) and overcoming time and space constraints. Room 1 “Monolith” Building Module: Room 2 Present Local Room 3 Past Kyoto Present Atsugi side view (left) and front view (right). HDV Camera 195 cm PC s 142 cm 65’’ LCD Panel Effective Screen Size: 142 cm x 80 cm 47 cm Pathway Monolith 3.0 m 65’’ LCD Panel HDV Camera 12 Examples of Path Setup/Release Time Setup(release) time was defined as the difference between the time at that BoD server sends “create(delete)SNC REQ” and the time at that it receives “notification (create(delete) CMPLD)”. We first created each path in series after receiving “notification (create CMPLD)” but we refined the mechanism to create paths in parallel right after receiving “createSNC RESP.” Setup (in series) Setup (in parallel) 10 9 8 7 6 5 4 3 2 1 0 (17) [min] 6 1.05 Gbps (release) 600 Mbps (release) 150 Mbps (release) Kyushu Univ. – Hokkaido Univ. Osaka Univ. – Hokkaido Univ. Yamaguchi - NAOJ (17) Gifu - NAOJ (17) Tsukuba - NAOJ (17) (17) Path setup/release time Path setup/release time [min] 11 1.05 Gbps (setup) 600 Mbps (setup) 150 Mbps (setup) Release (in series) Release (in parallel) 5 (7) 4 3 2 (4) NII – Hokkaido Univ. The number of transit switches (a) e-VLBI project (4) (2) (2) 1 (1) 1 2 3 4 5 6 7 8 9 10 11 12 13 14 (7) 0 (1) (1) 1 2 3 4 5 6 7 8 9 10 11 12 13 14 The number of transit switches (b) High-quality remote backup project 13 More General Architecture for BoD Services We are planning to provide GMPLS-UNI-based services in addition to reservation-based services. Forwarding adjacency (FA) paths are preliminary established to manage the services. BoD server receives the information of GMPLS-UNI paths via L1-OPS. If GMPLS-UNI paths are established on unexpected routes, BoD server forcibly tears down them. Reservation-based Service (Destinations, Duration, Bandwidth, & Route Option) HTTP(S) Front-end BoD Users Layer-1 BoD Server PC CORBA Signalling-based Service (Destination and Bandwidth) Admission control, Scheduling Path calculation Path and bandwidth control Resource management L1-OPS GMPLS Control and Management Plane GMPLS-UNI L1SW GMPLS L1SW L1SW L1SW Server Ethernet L2 MUX Path for L2/L3 Path for L2/L3 Path for L2/L3 L2 MUX IP Hitless Bandwidth Change by LCAS Router Router 14 Open Issues Admission control toward full-scale operations • • If the total requested bandwidth exceeds the available bandwidth of a link, we try to rearrange preassigned paths for “unspecified” routes to accommodate as many paths as possible. If the rearrangement fails, the BoD server informs the network operators about the situation. We seek negotiated solutions whereby network operators change the bandwidth and duration among users while we limit the number of users of the BoD services. We need an effective admission control algorithm that fairly selects from among the requests. Improvement of layer-1 path setup/release times • We would like to improve the path setup/release times but this depends on the specifications of vendor products. Dissemination of BoD services to new scientific research areas • We would like to explore new scientific research areas which effectively utilize the properties (low delay, no delay variance, and no packet losses ) of on-demand layer-1 paths. 15 References 1. S. Urushidani, J. Matsukata, K. Fukuda, S. Abe, Y. Ji, M. Koibuchi, S. Yamada, K. Shimizu, T. Takeda, I. Inoue, and K. Shiomoto, “Layer-1 bandwidth on demand services in SINET3,” IEEE Globecom 2007, Dec. 2007. 2. S. Urushidani, K. Fukuda, Y. Ji, S. Abe, M. Koibuchi, M. Nakamura, S. Yamada, K. Shimizu, R. Hayashi, I. Inoue, and K. Shiomoto, “Resource allocation and provision for bandwidth/networks on demand in SINET3,” 2nd IEEE International Workshop on Bandwidth on Demand, April 2008. 3. S. Urushidani, S. Abe, Y. Ji, K. Fukuda, M. Koibuchi, M. Nakamura, S. Yamada, R. Hayashi, I. Inoue, and K. Shiomoto, “Design of versatile academic infrastructure for multilayer network services,” IEEE Journal on Selected Areas in Communications, April 2009 (to appear). 4. S. Urushidani. K. Shimizu, R. Hayashi, H. Tanuma, K. Fukuda, Y. Ji, M. Koibuchi, S. Abe, M. Nakamura, S. Yamada, I. Inoue, and K. Shiomoto, “Implementation and evaluation of layer-1 bandwidth-on-demand capabilities in SINET3,” IEEE ICC2009, Jun. 2009 (to appear). 16