Download Fujitsu Standard Tool

Entering the Next Era in Internet2
Transport: Bandwidth and Latency Issues Solved Today, and Solved Tomorrow
Stephen Smith
[email protected]
Product and Technology Marketing
Fujitsu Network Communications
April 2012
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
Problem Statement
 All of the communication’s pundits are projecting exponential growth in data
services. This likely applies to Academia as well general commercial growth
 SONET is not sufficient to support higher bitrate wavelengths beyond 10G
 If SONET is being capped, what is the next generation network?
 Is it a pure packet network?
 Is it a pure next generation TDM network like OTN?
 Is it a combination of both?
 What are some of the strengths and weaknesses of these networks?
 What is the most cost effective Network Solution that will scale for the future?
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
1
Content + Mobility + Cloud = Big Bandwidth
Bandwidth Predictions
14,000
12,000
Gbps / year
10,000
8,000
6,000
4,000
2,000
2008
Traditional Phone
2009
2010
3G Smart Phone
2011
2012
4G Smart Phone
2013
2014
2015
Aircard/Hostspots
2016
Tablets
Source : UBS 1Q11 – N. America Wireless Demand by device
It would take over 5 years to watch the amount
of video that will cross global IP networks
every second in 2015.
Internet video is now 40 percent of consumer
Internet traffic, and will reach 61 percent
by the end of 2015.
Globally, mobile data traffic will increase 26
times between 2010 and 2015.
The number of devices connected to IP
networks will be twice as high as the global
population in 2015.
Sources + Cisco VNI, 2011.
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
2
Requirements for the Network
(On Campus and Transport between Campuses)
 Full Transparency Options
 Minimum Latency
 Minimum Jitter
 1:1 and Mesh Redundancy
 Full network visibility and remote trouble isolation
capabilities
 Maintaining SLAs across multiple domains
 Security (separation between customer and management
planes)
 Minimum First Cost, minimum Operational Costs
 Scalable from a 1X, 10X, and 100X
 Support of Legacy Services
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
3
Today’s IP/MPLS Services
 VPLS
 Private IP

Likely has an OTN/Photonics layer underneath the
routers that can be utilized to expedite traffic
 Public IP
 L3 – VPN
 Telepresence
CPA
CPA-EVPL
EVPL
VPLS
VPLS
OTN
ROADM
PIP
PIP
OTN
ROADM
OTN
vBNS+
vBNS+
ROADM
OTN
ROADM
OTN
Public
Public
IP
IP
ROADM
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
4
Effects of Latency and Delay
 Some services have very strict latency and delay requirements
 VM Migration
 Financial Services – Stock trading
 Gaming
 Two Way Video applications
 Remote Health services
 Strict SLA (QoS) across multiple Domains
 General TCP throughput degradation with Latency
 These applications can be severely hindered or even denied if latency
and/or jitter become large
 Want a network where latency is deterministic and known under a standard
working condition and under a fault condition
 Latency Inflation (where latency can vary between 20 and >100ms within a
day’s time) can be problematic for some services
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
5
Cloud Based Virtual Machine
Migration
 Being able to migrate Virtual Machines to optimize performance or
minimize power usage without the customer realizing the move occurred
 Requires Very low latency so that customer’s experience is unchanged
with the migration
Migration
Virtual Machine
A
Synchronous Replication
Round Trip Delay - Less than 10ms
Jitter - less than 2.5ms
Source: IBM/Cisco SAN
Multiprotocol Routing
IBM Redbook SG247543-01
Virtual Machine
B
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
6
Financial Transactions
 Low latency is a feature directly tied to the core business process of trading,
says Steve Kammerer, IPC VP. “And that means low latency is the priority.”
 “Missing the transaction by just a nano-second could cost the financial
institution money”, says Optimum Lightpath VP Glenn Calafati.
Latency for Trading
Round Trip Delay - Less than 10ms
Chicago Stock
Exchange
Low latency is critically important in the options market, and in the coming years it will only become more
so. Latency is already being reduced at each stage of the trading process but at increments and levels of
priority that vary by firm. Options pricing and analytics will be shaved from minutes to seconds, market data
will be disseminated in single- rather than double-digit milliseconds, and trading opportunities will be
identified and acted upon within microseconds. The timelines to reaching these goals, too, are constantly
being shortened.
Source:
http://www.tabbgroup.com/PublicationDetail.aspx?PublicationID=401&MenuID=14&Par
entMenuID=2&PageID=9
Los Angeles
Stock
Exchange
Transport
Network
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
NY Stock
Exchange
7
Gaming
Latency Can Kill: Precision and Deadline in Online Games,
Mark Claypool, et.al
Avatar: First Person (Players shoot directly at each other)
Round Trip (<100ms)
Round Trip (60ms) - has shown to affect player's accuracy
"An evaluation of Problems and Solution of Latency in Online Games",
Gert Scholten, January 31, 2008.
Gamers in Dallas
Gamers in
Austin
Transport
Network
Gamers in
Houston
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
8
Two Way Video applications
 Latency
 Two-way interactive communication is sensitive to delays in the network.
 300ms of lag causes users to resort to one-at-a-time, walkie-talkie-style conferencing to
communicate.
 Jitter
 Causes irregularities in the flow and delivery of data.
 Even 100ms of jitter causes conferencing quality to suffer
Source: Optimizing Video Performance Across the Distributed Enterprisesuffer, Blue Coat Whitepaper
Two Way Video (includes encoding/decoding/transport)
One Way Delay
<400ms with Echo suppressor
<150ms (preferred) with Echo suppressor
<80ms with Lip Synchronization
Source: ITU G.1010
Transport
Network
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
9
Remote Health services
 Tele-surgery
 Delay in sensor feedback can distract the surgeon and cause serious safety hazard
 Varying latency significantly reduces the operators’ performance both with robotic
telesurgery and virtual reality (VR) applications (Thomson et al., 1999).
Source: Extreme Telesurgery, Tamás Haidegger and Zoltán Benyó,
Budapest University of Technology and Economics, Hungary
 Tele-diagnostic
 Interactive video communication requires low delay of 200 to 300 ms round-trip and an
average jitter that is not more than 30 ms
 Speech latency should be less than 200-300 ms and jitter must be limited to 50ms (Cisco
Systems, 2002; Sze et al., 2002; Hassan et al., 2005; Tobagi, 2005).
QoS in Telemedicine, Phumzile Malindi, Walter Sisulu University, South
Africa
Telepresence (Remote Surgery (Video)
One Way Delay < 120ms
Source: MEF, Implementation Agreement MEF 23.1, Carrier
Ethernet Class of Service - Phase 2, January 2012.
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
10
TCP Throughput Degradation with
Latency
 1GE Client Port
TCP Throughput
TCP Throughput (Kbps)
900,000
 TCP Window size is
65536 Bytes
800,000
700,000
600,000
500,000
400,000

300,000
200,000
100,000
0
0
100
200
300
400
Round Trip Latency (ms)
500
600
TCP Throughput
TCP Throughput
800,000
TCP Throughput (Kbps)
TCP Throughput (Kbps)
900,000
700,000
600,000
500,000
400,000
300,000
200,000
100,000
0
0
2
4
6
8
Round Trip Latency (ms)
Source:
http://www.babinszki.com/Networki
ng/Max-Ethernet-and-TCPThroughput.html
10
12
20,000
18,000
16,000
14,000
12,000
10,000
8,000
6,000
4,000
2,000
0
0
50
100
150
Round Trip Latency (ms)
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
200
11
250
Latency Fluctuation with MPLS-base TE
 IP/MPLS utilizes Traffic Engineered (TE) based tunnels
 Most of these tunnels are dynamic in nature
 Algorithms are dynamically run to optimize the tunnels for Shortest Path
 The tunnels can carry any traffic that is being demanded and can change the size of
their tunnels according to the bandwidth demand
 This dynamic aspect causes variances in latency and jitter
 When the tunnels adjust to the bandwidth demands, they can incur radical latency
fluctuations which can cause large step functions in their latency (on the order of 50ms
or more). This can occur at any time.
Source: Latency Inflation with MPLSbased Traffic Engineering, Abhinav Pathak,
Purdue University
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
12
Jitter in General
 As traffic traverses different tunnels, jitter is incurred:
 Anytime queuing occurs which happens at different speed
interfaces
 To have a low jitter network, need to minimize the
number of queues traversed or increase the latency with
jitter buffers
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
13
Local Aggregation with Packet and OTN
Nursing
OTN Tunnels headed to
different destinations
Building 1
Building 2
Building 3
Administration
Building 4
Non
Ethernet
Private Line
Engineering
OTN
Mux
Non
Ethernet
Private Line
Building 5
Non
Ethernet
Private Line
Campus
Aggregation
Area
Building 6
Building 8
Non-Ethernet based Private Line
Traffic
Building 7
Ethernet Links between
Packet Devices
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
14
Transport with OTN/Photonics layer
Carrier
Aggregation
Area (CAA)
CAA
OTN
NE
OTN NE
Hospital
Network
CAA
OTN
CAA
NE
OTN
OTN
NE
ROADM
OTN
CAA
OTN
Off Campus
Research Data
base
ROADM
NE
CAA
OTN
OTN
ROADM
ROADM
OTN
NE
CAA
OTN
NE
OTN
ROADM
CAA
OTN
NE
Internet
PoP
CAA
OTN
NE
ROADM with OTN Switching
Network
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
15
Advantages of Two Architectures
Item
Pure IP/MPLS
Latency
Delay Variation
Aggregation (Highest Aggregated
Advantage
Pipes)
Ability to backhaul non-Ethernet
based traffic
Transparency
Redundancy (Ability to switch within
50ms)
Segmentation for purposes of
Advantage
Troubleshooting (Allows for nonintrusive loopbacks in all nodes of
network)
Security
Cost (L1/L2 is more cost effective than
L2.5/L3)
Scalability (Ability to economically
address growing market)
COE/OTN
Advantage
Advantage
Support of Legacy Services (Ability to
transport SONET/SDH, FC, Etc.)
Advantage
Advantage
Advantage
Advantage
Advantage
Advantage
Advantage
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
16
Applications
Item
VM Migration
MPLS
Financial Services (Stock Trading)
Gaming
Multi-way Video
Remote Health Services
Strict SLA across Multiple Domains
Ability to offload OTT video traffic
Need for high Throughput with TCP traffic
Public IP / Private IP services
L3 – VPN / VPLS
Telepresence
COE/OTN
Bypass with COE/OTN due to low latency
requirements
Bypass with COE/OTN due to low latency
requirements
Bypass with COE/OTN due to low latency
requirements
Bypass with COE/OTN due to low latency
requirements
Bypass with COE/OTN due to low latency
requirements
Use OTN to maintain SLA’s through third
party Domain
Bypass with COE/OTN due to high capacity
and scalability concerns
Bypass with COE/OTN due to latency
concerns
No need to Bypass unless have strict latency
requirements
No need to Bypass unless have strict latency
requirements
Bypass with COE/OTN due to low latency
requirements
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
17
Summary
 Universities today are utilizing an IP/MPLS network for campus services
 IP/MPLS networks have an OTN/Photonics layer underneath
 Some services are difficult to transport over a Packet network
 Use the OTN/Photonics layer to transport these services
 Video will be increase 6 fold (from 2010 to 2015), dominating Internet
traffic
 This could cause scaling issues within the network
 Can use the OTN/Photonics layer to bypass the MPLS network for the OTT
video
 A COE/OTN network will efficiently aggregate and transport traffic
 COE to sufficiently aggregate “same destined” traffic together
 OTN to transport to the core. Once at the core, further aggregate as needed
 Exploit the lower layers as much as possible (Layer 0/1/2) to save power,
capital, and operations costs
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
18
Recommendation
 As campuses builds out their IP/MPLS
network and move towards the Internet2,
ensure that there is a COE/OTN/Photonics
layer underneath to aggregate, bypass and
expedite traffic, while providing the needed
scale at the lowest costs
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 Fujitsu Network Communications Inc.
19
2010 FUJITSU LIMITED
Fujitsu Proprietary and Confidential All Rights Reserved, ©2012 FujitsuCopyright
Network Communications
Inc.
20