Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Entering the Next Era in Internet2 Transport: Bandwidth and Latency Issues Solved Today, and Solved Tomorrow Stephen Smith [email protected] Product and Technology Marketing Fujitsu Network Communications April 2012 Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. Problem Statement All of the communication’s pundits are projecting exponential growth in data services. This likely applies to Academia as well general commercial growth SONET is not sufficient to support higher bitrate wavelengths beyond 10G If SONET is being capped, what is the next generation network? Is it a pure packet network? Is it a pure next generation TDM network like OTN? Is it a combination of both? What are some of the strengths and weaknesses of these networks? What is the most cost effective Network Solution that will scale for the future? Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 1 Content + Mobility + Cloud = Big Bandwidth Bandwidth Predictions 14,000 12,000 Gbps / year 10,000 8,000 6,000 4,000 2,000 2008 Traditional Phone 2009 2010 3G Smart Phone 2011 2012 4G Smart Phone 2013 2014 2015 Aircard/Hostspots 2016 Tablets Source : UBS 1Q11 – N. America Wireless Demand by device It would take over 5 years to watch the amount of video that will cross global IP networks every second in 2015. Internet video is now 40 percent of consumer Internet traffic, and will reach 61 percent by the end of 2015. Globally, mobile data traffic will increase 26 times between 2010 and 2015. The number of devices connected to IP networks will be twice as high as the global population in 2015. Sources + Cisco VNI, 2011. Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 2 Requirements for the Network (On Campus and Transport between Campuses) Full Transparency Options Minimum Latency Minimum Jitter 1:1 and Mesh Redundancy Full network visibility and remote trouble isolation capabilities Maintaining SLAs across multiple domains Security (separation between customer and management planes) Minimum First Cost, minimum Operational Costs Scalable from a 1X, 10X, and 100X Support of Legacy Services Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 3 Today’s IP/MPLS Services VPLS Private IP Likely has an OTN/Photonics layer underneath the routers that can be utilized to expedite traffic Public IP L3 – VPN Telepresence CPA CPA-EVPL EVPL VPLS VPLS OTN ROADM PIP PIP OTN ROADM OTN vBNS+ vBNS+ ROADM OTN ROADM OTN Public Public IP IP ROADM Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 4 Effects of Latency and Delay Some services have very strict latency and delay requirements VM Migration Financial Services – Stock trading Gaming Two Way Video applications Remote Health services Strict SLA (QoS) across multiple Domains General TCP throughput degradation with Latency These applications can be severely hindered or even denied if latency and/or jitter become large Want a network where latency is deterministic and known under a standard working condition and under a fault condition Latency Inflation (where latency can vary between 20 and >100ms within a day’s time) can be problematic for some services Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 5 Cloud Based Virtual Machine Migration Being able to migrate Virtual Machines to optimize performance or minimize power usage without the customer realizing the move occurred Requires Very low latency so that customer’s experience is unchanged with the migration Migration Virtual Machine A Synchronous Replication Round Trip Delay - Less than 10ms Jitter - less than 2.5ms Source: IBM/Cisco SAN Multiprotocol Routing IBM Redbook SG247543-01 Virtual Machine B Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 6 Financial Transactions Low latency is a feature directly tied to the core business process of trading, says Steve Kammerer, IPC VP. “And that means low latency is the priority.” “Missing the transaction by just a nano-second could cost the financial institution money”, says Optimum Lightpath VP Glenn Calafati. Latency for Trading Round Trip Delay - Less than 10ms Chicago Stock Exchange Low latency is critically important in the options market, and in the coming years it will only become more so. Latency is already being reduced at each stage of the trading process but at increments and levels of priority that vary by firm. Options pricing and analytics will be shaved from minutes to seconds, market data will be disseminated in single- rather than double-digit milliseconds, and trading opportunities will be identified and acted upon within microseconds. The timelines to reaching these goals, too, are constantly being shortened. Source: http://www.tabbgroup.com/PublicationDetail.aspx?PublicationID=401&MenuID=14&Par entMenuID=2&PageID=9 Los Angeles Stock Exchange Transport Network Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. NY Stock Exchange 7 Gaming Latency Can Kill: Precision and Deadline in Online Games, Mark Claypool, et.al Avatar: First Person (Players shoot directly at each other) Round Trip (<100ms) Round Trip (60ms) - has shown to affect player's accuracy "An evaluation of Problems and Solution of Latency in Online Games", Gert Scholten, January 31, 2008. Gamers in Dallas Gamers in Austin Transport Network Gamers in Houston Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 8 Two Way Video applications Latency Two-way interactive communication is sensitive to delays in the network. 300ms of lag causes users to resort to one-at-a-time, walkie-talkie-style conferencing to communicate. Jitter Causes irregularities in the flow and delivery of data. Even 100ms of jitter causes conferencing quality to suffer Source: Optimizing Video Performance Across the Distributed Enterprisesuffer, Blue Coat Whitepaper Two Way Video (includes encoding/decoding/transport) One Way Delay <400ms with Echo suppressor <150ms (preferred) with Echo suppressor <80ms with Lip Synchronization Source: ITU G.1010 Transport Network Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 9 Remote Health services Tele-surgery Delay in sensor feedback can distract the surgeon and cause serious safety hazard Varying latency significantly reduces the operators’ performance both with robotic telesurgery and virtual reality (VR) applications (Thomson et al., 1999). Source: Extreme Telesurgery, Tamás Haidegger and Zoltán Benyó, Budapest University of Technology and Economics, Hungary Tele-diagnostic Interactive video communication requires low delay of 200 to 300 ms round-trip and an average jitter that is not more than 30 ms Speech latency should be less than 200-300 ms and jitter must be limited to 50ms (Cisco Systems, 2002; Sze et al., 2002; Hassan et al., 2005; Tobagi, 2005). QoS in Telemedicine, Phumzile Malindi, Walter Sisulu University, South Africa Telepresence (Remote Surgery (Video) One Way Delay < 120ms Source: MEF, Implementation Agreement MEF 23.1, Carrier Ethernet Class of Service - Phase 2, January 2012. Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 10 TCP Throughput Degradation with Latency 1GE Client Port TCP Throughput TCP Throughput (Kbps) 900,000 TCP Window size is 65536 Bytes 800,000 700,000 600,000 500,000 400,000 300,000 200,000 100,000 0 0 100 200 300 400 Round Trip Latency (ms) 500 600 TCP Throughput TCP Throughput 800,000 TCP Throughput (Kbps) TCP Throughput (Kbps) 900,000 700,000 600,000 500,000 400,000 300,000 200,000 100,000 0 0 2 4 6 8 Round Trip Latency (ms) Source: http://www.babinszki.com/Networki ng/Max-Ethernet-and-TCPThroughput.html 10 12 20,000 18,000 16,000 14,000 12,000 10,000 8,000 6,000 4,000 2,000 0 0 50 100 150 Round Trip Latency (ms) Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 200 11 250 Latency Fluctuation with MPLS-base TE IP/MPLS utilizes Traffic Engineered (TE) based tunnels Most of these tunnels are dynamic in nature Algorithms are dynamically run to optimize the tunnels for Shortest Path The tunnels can carry any traffic that is being demanded and can change the size of their tunnels according to the bandwidth demand This dynamic aspect causes variances in latency and jitter When the tunnels adjust to the bandwidth demands, they can incur radical latency fluctuations which can cause large step functions in their latency (on the order of 50ms or more). This can occur at any time. Source: Latency Inflation with MPLSbased Traffic Engineering, Abhinav Pathak, Purdue University Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 12 Jitter in General As traffic traverses different tunnels, jitter is incurred: Anytime queuing occurs which happens at different speed interfaces To have a low jitter network, need to minimize the number of queues traversed or increase the latency with jitter buffers Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 13 Local Aggregation with Packet and OTN Nursing OTN Tunnels headed to different destinations Building 1 Building 2 Building 3 Administration Building 4 Non Ethernet Private Line Engineering OTN Mux Non Ethernet Private Line Building 5 Non Ethernet Private Line Campus Aggregation Area Building 6 Building 8 Non-Ethernet based Private Line Traffic Building 7 Ethernet Links between Packet Devices Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 14 Transport with OTN/Photonics layer Carrier Aggregation Area (CAA) CAA OTN NE OTN NE Hospital Network CAA OTN CAA NE OTN OTN NE ROADM OTN CAA OTN Off Campus Research Data base ROADM NE CAA OTN OTN ROADM ROADM OTN NE CAA OTN NE OTN ROADM CAA OTN NE Internet PoP CAA OTN NE ROADM with OTN Switching Network Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 15 Advantages of Two Architectures Item Pure IP/MPLS Latency Delay Variation Aggregation (Highest Aggregated Advantage Pipes) Ability to backhaul non-Ethernet based traffic Transparency Redundancy (Ability to switch within 50ms) Segmentation for purposes of Advantage Troubleshooting (Allows for nonintrusive loopbacks in all nodes of network) Security Cost (L1/L2 is more cost effective than L2.5/L3) Scalability (Ability to economically address growing market) COE/OTN Advantage Advantage Support of Legacy Services (Ability to transport SONET/SDH, FC, Etc.) Advantage Advantage Advantage Advantage Advantage Advantage Advantage Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 16 Applications Item VM Migration MPLS Financial Services (Stock Trading) Gaming Multi-way Video Remote Health Services Strict SLA across Multiple Domains Ability to offload OTT video traffic Need for high Throughput with TCP traffic Public IP / Private IP services L3 – VPN / VPLS Telepresence COE/OTN Bypass with COE/OTN due to low latency requirements Bypass with COE/OTN due to low latency requirements Bypass with COE/OTN due to low latency requirements Bypass with COE/OTN due to low latency requirements Bypass with COE/OTN due to low latency requirements Use OTN to maintain SLA’s through third party Domain Bypass with COE/OTN due to high capacity and scalability concerns Bypass with COE/OTN due to latency concerns No need to Bypass unless have strict latency requirements No need to Bypass unless have strict latency requirements Bypass with COE/OTN due to low latency requirements Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 17 Summary Universities today are utilizing an IP/MPLS network for campus services IP/MPLS networks have an OTN/Photonics layer underneath Some services are difficult to transport over a Packet network Use the OTN/Photonics layer to transport these services Video will be increase 6 fold (from 2010 to 2015), dominating Internet traffic This could cause scaling issues within the network Can use the OTN/Photonics layer to bypass the MPLS network for the OTT video A COE/OTN network will efficiently aggregate and transport traffic COE to sufficiently aggregate “same destined” traffic together OTN to transport to the core. Once at the core, further aggregate as needed Exploit the lower layers as much as possible (Layer 0/1/2) to save power, capital, and operations costs Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 18 Recommendation As campuses builds out their IP/MPLS network and move towards the Internet2, ensure that there is a COE/OTN/Photonics layer underneath to aggregate, bypass and expedite traffic, while providing the needed scale at the lowest costs Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc. 19 2010 FUJITSU LIMITED Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 FujitsuCopyright Network Communications Inc. 20