Download CORD: Central Office Re-architected as a Datacenter and ONOS

CORD:CentralOfficeRe-architected
asaDatacenter
LarryPeterson
OpenNetworkingLab
#OpenCORD
TelcoCentralOffice(CO)
•
COisaserviceprovider’s
“gateway”toitscustomers
•
Thereare1000sofCOs
•
OneCOmaysupport
Residential
CentralOffice
– 10K+residentialsubscribers
Enterprise
– 10K+mobilesubscribers
– 1K+enterprisecustomers
•
Mobile
COprovidesagreatvantage
pointforserviceproviders
– Enablesnewservices
1CentralOfficecanbesmallorlargeandhasdifferentnamesindifferentcontexts.
Challenges
SourceofhighCAPEXandOPEX
300+Typesof
equipment
ClosedProprietary
Lackofprogrammabilityinhibitsinnovation
Limitsabilitytocreatenewservicesandnewrevenue
CORDVision
Economiesofadatacenter
Infrastructurebuiltwithafewcommoditybuildingblocks
usingopensourcesoftwareandwhite-boxswitches
Agilityofacloudprovider
Softwareplatformsthatenablerapidcreationofnewservices
FromAccess-as-a-ServicetoSoftware-as-a-Service
CORDVision
Open Source Software
Commodity Hardware
Proprietary / Closed
CORDArchitecture
Cloud
XaaS
SDN
NFV
XaaS – Everything-as-a-Service
CORDArchitecture
Cloud
Extends the agility of micro-services to the access network
XaaS
SDN
Interconnects VNFs and is
a source of innovative new VNFs
NFV
Supports legacy VNFs and
pushes the limits of disaggregation
CORDArchitecture– Hardware
AT&T Open GPON
48-port, 1RU, I/O Box
PON
OLT
MAC
s
PON
OLT
MAC
s
Commodity Servers, Storage, Switches, and I/O
ROADM
(Core)
GPON
(Access)
Leaf-SpineFabricBuiltfrom
White-boxSwitches
CORDArchitecture– Software
CORD Controller
Residential
Subscribers
Controller
Controller
Controller
vOLT
vSG
vRouter
Controller
Controller
Controller
Controller
OpenStack
ONOS
Monitoring
vCDN
Everything-as-a-Service (XaaS)
CORDArchitecture– Software
Access-
Subscriber-
Internet-
as-a-Service
as-a-Service
as-a-Service
CDN
Monitoringas-a-Service
XOS
Ceilometer
vSG
vCDN
OpenStack / Docker
VTN
Fabric
Control
Multicast
Control
ONOS
vOLT
vRouter
CORDReferenceImplementation
HardwareBlueprint
BillofMaterials
– OCPServers
– OCPSwitches
– OCPAccessBlades
AssemblyInstructions
–…
TestingInfrastructure
CORDPOD
Anopenvirtualizedservicedelivery
platform thatprovidescloud
economiesandagility.
FromAccess-as-a-Service
toSoftware-as-a-Service.
–…
Ciena and Radisys
to provide turnkey
CORD PODS
Configured for Different Domains:
Residential, Enterprise, Mobile
OpenSourceSoftware
CoreComponents
– OpenStack
– Docker
– ONOS
– XOS
AccessServices
– R:vOLT,vSG,vRouter
– E:vOAM,vCE,…
– M:vBBU,vPGW,…
–…
OtherServices
– Monitoring
– …
CORDReferenceImplementation
Spine-1
Home
Router
Spine-2
Leaf-1
Leaf-2
Leaf-3
Leaf-4
Compute-1
Compute-2
Compute-3
Compute-4
OLT-1
OLT-2
40Gbps
3x40Gbps
1Gbps
Management Network
Internet
Router
CORDFieldTrial
Operator
Portal
Customer Care
Portal
CORD Controller
Residential
Subscribers
Access the Internet
Stream (Cached) Video
Watch TV
Controller
Controller
Controller
vOLT
vSG
vRouter
Controller
Controller
Controller
Controller
OpenStack
ONOS
Monitoring
vCDN
Spine-1
Spine-2
AT&T U-verse
GPON
ONT
Laptop
NetGear
Leaf-1
Leaf-2
Leaf-3
Leaf-4
Compute-1
Compute-2
Compute-3
Compute-4
OLT-1
OLT-2
DomainsofUse
Residential
Mobile
vOLT,vSG,
vRouter,vCDN
vBBU.vMME,
vSGW,vPGW,
vCDN
Enterprise
vCarrierEthernet,
vOAM,vWanEx,
vIDS
CORD Controller
BBUs
PON
OLTs
ROADM
(Core)
Metro
Ethernet
CORDInternals
Disaggregation
Assembly into a Unified Whole
LegacyCentralOffice
Residence
CPE
ONU
Central Office
OLT
ETH
AGG
BNG
CPE – Customer Premises Equipment
OLT – Optical Line Termination
BNG – Broadband Network Gateway
Backbone
Network
Disaggregation
Residence
Central Office
vSG
vRouter
vOLT
CPE
ONU
OLT
ETH
AGG
BNG
CPE – Customer Premises Equipment
OLT – Optical Line Termination
BNG – Broadband Network Gateway
Backbone
Network
Disaggregation
Residence
Central Office
vSG
vRouter
vOLT
CPE
ONU
OLT
ETH
AGG
BNG
Switching Fabric
CPE – Customer Premises Equipment
OLT – Optical Line Termination
BNG – Broadband Network Gateway
Backbone
Network
End-to-EndPath
Controller
Controller
vBNG
vBNG
vOLT
vRouter
vRouter
vRouter
Controller
LAN-Side
vSG
vSG
vSG
vSG
WAN-Side
Controller
vBNG
vBNG
vCDN
End-to-EndPath
Controller
Controller
vBNG
vBNG
vOLT
vRouter
vRouter
vRouter
Controller
ONU
vSG
vSG
vSG
vSG
Controller
vBNG
vBNG
vCDN
CORDController– UnifiedInterface
REST API (TOSCA, YANG)
– On-Board Services
– Runtime Control
CORD Controller
Residential
Subscribers
Controller
Controller
Controller
vOLT
vSG
vRouter
Controller
Controller
Controller
Controller
OpenStack
ONOS
Monitoring
vCDN
ONOSBasedServicesforR-CORD
– vOLTandvRouter –
AliAl-Shabibi
OpenNetworkingLab
#OpenCORD
Outline
• Hardware and Software involved
• CPE, OLT
• vOLT OpenFlow agent
• Walkthroughs
• CPE to OLT to vSG
• vRouter
AccessHardware– CPE
• Simple commodity NetGear device
• Flashed with OpenWrt
• Runs OVS as dataplane switch
• OpenFlow capable
• Runs 802.1X authentication
• Several design options available here
• OpenFlow enabled
• Runs a DHCP server
AccessHardware– OLT
• One rack unit GPON OLT MAC
• 48 PON ports (arranged as 12 OLT chips)
• 6 40Gbps Ethernet ports
• NetConf to configure power settings, fan speed, etc.
• OpenFlow Controllable
• via external OF agent
• External software bootstraps firmware
Software– PMCvOLT
• Runs either in a container or VM
• Exposes an OpenFlow interface north to
ONOS
• Manages/Provisions the OLT via L2
protocol
• Manages the ONU via OMCI
• Converts OpenFlow messages into OMCI
to provision the ONU
• Enables the OLT to pass 802.1X and IGMP
packets to ONOS
- to implement client/ONU authentication; and
- to implement IGMP snooping
PMC vOLT
L2/OMCI
Software– XOS,ONOS,andOpenStack
• XOS orchestrates both ONOS and
OpenStack
• OpenStack is used to spawn VMs
and containers
• ONOS (via neutron) creates virtual
networks and connects them
together achieving service
chaining
CPEBootandAuthentication
vOLT ONOS App
CORDSoftwareStack=XOS+ONOS+OpenStack
CPE (re)boots
Control
Spine
Switches
Leaf
Switches
SimpleCPE
ONT
GPON
Access
Link
IO
IO
Metro
Core
Link
PON
OLT
IO
MACs
RADIUS
Commodityhardware
Data
Dataplane Configuration
Home
Network
CPE
No VLAN
?
OLT
Default VLAN (0)
Q-in-Q
• OLT double tags packets from customer
• C-tag identifies the customer
• S-tag identifies the OLT the customer is connect to
• OLT also meters customer connections
• OLT maintains group information to handle multicast
traffic
Putting it all together
I/O
Fabric
OLT
Leaf
PW Label
Dst OVS
MAC DA
vCPE
MAC SA
Subscr.
PON STag
Cust CTag
Payload
MAC DA
leaf
MAC SA
spine
PW Label
Dst OVS
MAC DA
vCPE
MAC SA
Subscr.
PON STag
Cust CTag
Payload
OVS
MAC DA
vCPE
MAC SA
Subscr.
PON STag
Cust CTag
Payload
Tag lookup, pop & fwd
to vCPE
Payload
MAC DA
spine
MAC SA
leaf
SR Label
Dst leaf
Leaf
Pseudowire label lookup,
pop
Cust C-Tag
0x8100
Spine
SR Label lookup, and pop
PON S-Tag
0x88a8
Double-tag lookup, & SR
label-push & load balancing
to spines
Push Tag(s) to identify
customer & localtion
MAC DA
vCPE
MAC SA
Subscr.
Server
vCPE
MAC DA
vCPE
MAC SA
Subscr.
Payload
SpinningUpavSG
vOLT
Authentication has been
successful. A vSG is now
needed.
CORDSoftwareStack=XOS+ONOS+OpenStack
Control
Spine
Switches
Leaf
Switches
SimpleCPE
ONT
GPON
Access
Link
IO
PON
OLT
IO
MACs
vSG
Commodityhardware
IO
Metro
Core
Link
Data
IGMP Snooping @ OLT
3a
OF Group
ChannelX
OFGroup
ChannelY
- OuttoRG1
- OuttoRG2
- OuttoRG3
3
RG1
RG2
RG
2
1
Joinch. X
ONOS
3
OLT
Joinch. Y
1. IGMPsentfromSTBatsubscriber
2. IGMPpacketsenttocontroller
3. Controllerdeterminesifmulticastgroup
isalreadyjoinedto
a. Ifjoined,controllerupdatesOF
groupatOLT
b. IfnotjoinedcontrollersendsPIM
messageupstreamandupdatesthe
appropriategrouptable
3b
Uplinktofabric
PIMforch. Y
mcgroup
vRouterServiceinCORD
• vRouter interfacesbetweenaCORDPODandtheupstream
network
• Communicateswithupstreamroutersandprovisions
connectivitybetweenCORDandupstreamnetwork
• Requirementsvaryfordifferentdeployments
• ImplementedasanONOSnetworkcontrolfunction
vRouter
§ YoumighthavethoughtaboutVNFlikethis…
Management
(CLI,SNMP,NETCONF)
ControlPlane
(OSPF,BGP..)
DataPlane
Management
(CLI,SNMP,NETCONF)
ControlPlane
(OSPF,BGP..)
DataPlane
VNFM
(VNFManager)
VNF=vRouterVM
34
vRouter
§ Problem
Hairpinning
Embeddedcontrolplanecomplexityforscale-out
CP
DP
DP
VNF
VNF
DP
VNF
CP
DP
vRouter
VM
DP
DP
35
vRouter
§ ThisishowweimplementvRouter…
XOS(Orchestrator)
vOLT
Control
Multicast
Control
Overlay
Control
vRouter
Control
Underlay
Control
Quagga
ONOSControllerCluster
WhiteBox
WhiteBox
WhiteBox
WhiteBox
BGP/OSPF
WhiteBox
WhiteBox
WhiteBox
WhiteBox
WhiteBox
WhiteBox
WhiteBox
WhiteBox
WhiteBox
WhiteBox
WhiteBox
R,E,MAccess
OVS
OVS
OVS
OVS
OVS
vSG
VNF
VNF
VNF
VNF
vSG
VNF
VNF
VNF
VNF
Metro
Router
WhiteBox
CORD vRouter à ImplementedVNF
as a big distributed
router
VNF
VNF
VNF
vSG
à Presents entire CORD infrastructure as a single router to outside world
36
Multicast
§ Thisishowweimplementmulticast…
XOS(Orchestrator)
vOLT
Control
Multicast
Control
Overlay
Control
vRouter
Control
Underlay
Control
Quagga
ONOSControllerCluster
WhiteBox
WhiteBox
WhiteBox
WhiteBox
IGMPSnooping
PIM-SSM
WhiteBox
WhiteBox
WhiteBox
WhiteBox
WhiteBox
WhiteBox
WhiteBox
WhiteBox
WhiteBox
WhiteBox
WhiteBox
R,E,MAccess
OVS
OVS
OVS
OVS
OVS
vSG
VNF
VNF
VNF
VNF
vSG
VNF
VNF
VNF
VNF
Metro
Router
WhiteBox
VNF
VNF
VNF
VNF
vSG
CORD Multicast
video streams
never need
to go through
any software
switch or VNF
37
Conclusion
• Understandingofthehardwarecomponents
• Understandingoftheendtoendtrafficflow
• CORDisreallyonequitelargeintegrationproject
MoreInformation
http://opencord.org
https://wiki.opencord.org