Download Philip Schoene, PBS

Video Over IP at the PBS
DDMS
Philip Schoene
Sr. Dir. Engineering & Tech Maintenance
PBS
1
In this Presentation
 Overview of the PBS DDMS
 Use of open internet for transport stream
delivery for PBS Diversity site
 Comparison to dedicated EPL connection for
Disaster Recovery site
 Use of Video over IP and software on COTS
hardware solution for program origination
2
Overview of PBS DDMS
• Disaster Recovery – Duplicates the
capabilities of the PBS NOC
• Diversity – Uplink diversity for rain fade
protection of Ku Band services
• Maintenance – Allow for continuation of
services during high risk maintenance
3
DDMS Progression
• Phased buildout
– Evergreen content playout
– Diversity uplink capability added in 2012
– Non-Real time file delivery added in 2014
– Commissioning of playout system 2014-2015
• Full transmission test on satellite
conducted December, 2015
• PBS Broadcast DR Online!
4
Why a new Diversity Site?
PBS SOC –Alex.,VA
Previous Diversity Site
40 miles from SOC
Diversity Uplink –Independent Hill, VA
DDMS Uplink
DDMS Uplink Site
1650 miles from SOC
5
PBS SOC
Diversity System
PBS NOC - ALEXANDRIA,VA
AUTOMATION
&
PLAYOUT
SDI
MPEG4
ENCODING
ASI
DVB-S2
MODULATION
IF
TSoIP
PBS SOC
TRANSMISSION
INTERNET
TSoIP TO ASI
CONVERTER
DIVERSITY SITE - LINCOLN, NE
6
ASI
DVB-S2
MODULATION
IF
DIVERSITY SITE
TRANSMISSION
Broadcast signal over open
internet service
• TSoIP signals to DDMS:
66 Mbps multiple channel per carrier (MCPC)
• East coast, West coast, HD soft feed, SD soft feed
• Four 24x7 pass thru services
2 -13.5 Mbps single channel per carrier
(SCPC) services
• TSoIP signals back from DDMS:
10 Mbps multiviewer of DDMS downlinks
7
What could go wrong?
TSoIP
MPEG4
ENCODING
RECEIVED PACKETS
TSoIP to ASI
CONVERTER
EXPECTED PACKETS
8
What could go wrong?
RECEIVED PACKETS
P6 P5
P3 P2
t4
P6
t3
P5
P4
P1
t2
t1
P3
P2
TSoIP to ASI
CONVERTER
P1
EXPECTED PACKETS
Dropped P4
tAVG = Inter Packet Arrival Time
Dt = Jitter
9
What could go wrong?
MPEG4
ENCODING
RECEIVED PACKETS
TSoIP to ASI
CONVERTER
EXPECTED PACKETS
10
What could go wrong?
• Dropped packets due to congestion at
oversubscribed interfaces
• Jitter – changes in Inter-packet arrival time
• Indeterminate link latency
• Packets arrive out of order (reordered)
11
Solution: Managed Service
• LTN Global operates a managed
backbone of connected datacenters
• Appliances operated by LTN manage
access to the backbone
• Buffers in the appliances allow for:
– Deterministic latency – PBS uses 200 ms
– Smooths out IPAT
– Allows for resend for missed packets
– Packets can be reordered
12
LTN Appliance and Managed
Backbone
LTN
APPLIANCE
#1
LTN
APPLIANCE
#2
Data Center connections
on LTN managed backbone
Managed on backbone
13
Managed by Appliances
Bandwidth Headroom
• TSoIP signals to DDMS:
66 Mbps (MCPC) + 2 x 13.5 Mbps SCPC = 93
Mbps
Add 25% overhead in case of resend
 125 Mbps max send
• TSoIP signals back from DDMS:
10 Mbps multiviewer of DDMS downlinks
Add 25% overhead in case of resend
 12.5 Mbps max return
14
Internet Access Topology
MUX A
PROGRAM TS
100 Mbps
D/L RETURN
10 Mbps
Multi
viewer
MUX B
LTN
APPLIANCE
A
LTN
APPLIANCE
B
15
LTN
ETH
SW
FIRE
WALL
&
DMZ
ETH
SW
ISP 1
ISP 2
PBS experience
• Issue #1 – PBS Intrusion Detection
System was causing intermittent disruption
of the signal as it inspected traffic
Resolution – Bypass IDS
LTN is responsible for security of the
appliances
• Only outbound connections allowed
• Traffic restricted to specific ports
16
Internet AccessTopology
MUX A
PROGRAM TS
100 Mbps
VLAN
10
D/L RETURN
10 Mbps
Multi
viewer
MUX B
LTN
APPLIANCE
A
LTN
APPLIANCE
B
LTN
ETH
SW
ISP 1
VLAN
10 & 20
DMZ
ETH
SW
VLAN 10 – MULTICAST
VLAN 20 - INTERNET
17
ISP 2
VLAN
20
PBS experience
• Issue # 2 - Noticed issue with how we
manage “first mile” redundancy
• PBS Networking uses Boundary Gateway
Protocol (BGP) to manage switching
between redundant first mile lSP links
– Only switches on loss of service
– No protection for excessive packet drops
– No protection for excessive delay
18
Internet Access Topology
MUX A
PROGRAM TS
100 Mbps
VLAN
10
D/L RETURN
10 Mbps
Multi
viewer
MUX B
LTN
APPLIANCE
A
LTN
APPLIANCE
B
LTN
ETH
SW
ISP selection controlled
via BGP on
PBS Internet Routers
ISP 1
VLAN
10 & 20
DMZ
ETH
SW
VLAN 10 – MULTICAST
VLAN 20 - INTERNET
19
ISP 2
VLAN
20
PBS Experience
• Resolution: LTN given access to both ISPs
simultaneously
20
Dual Access Topology
MUX A
PROGRAM TS
100 Mbps
D/L RETURN
10 Mbps
Multi
viewer
LTN
ETH
SW 1
LTN
APPLIANCE
A
IRF LINK
LTN
APPLIANCE
B
MUX B
21
ISP selection controlled
By LTN
ISP 1
LTN
ETH
SW 2
ISP 2
DISASTER RECOVERY SITE
PBS NOC - ALEXANDRIA,VA
AUTOMATION
&
PLAYOUT
SDI
MPEG4
ENCODING
ASI
DVB-S2
MODULATION
IF
TSoIP
PBS SOC
TRANSMISSION
INTERNET
TSoIP TO ASI
CONVERTER
DIVERSITY SITE - LINCOLN, NE
22
ASI
DVB-S2
MODULATION
IF
DIVERSITY SITE
TRANSMISSION
DISASTER RECOVERY SITE
PBS MEDIA OPERATIONS CENTER,
ARLINGTON, VA
CONTENT
PREPARATION
FILE
TRANSFER
CONTENT
STORAGE
ETHERNET PRIVATE LINE (EPL)
AS03
& BXF
CONTENT
STORAGE
FILE
TRANSFER
NRT FILE
DELIVERY
ASI
AUTOMATION
&
PLAYOUT
MPEG4
ENCODING
DISASTER RECOVERY SITE LINCOLN, NE
23
ASI
DVB-S2
MODULATION
IF
DDMS
TRANSMISSION
EPL vs. Open Internet
• Disaster Recovery site connectivity serves
many more functions:
– File transfer
– Monitoring via multicast streams PIM network
– Remote access and control of site
24
EPL ROUTING
EPL POP
ROUTER
DDMS
ROUTER
200 Mbps
EPL
GigE on
LEASED
FIBER
GigE on
LEASED
FIBER
MOC
TRAFFIC FOR:
- OPERATIONS
(FILE
TRANSFER)
ADMINISTERED
BY EIGRP
DIV
MULTICAST
FACs
ILO
DDMS
SWITCHES
25
SOC
OPs
ADMINISTERED
BY OSPF
TRAFFIC FOR:
OPERATIONS
M&C
INBOUND MULTICAST
EPL ROUTING
DDMS
ROUTER
RP
EPL
PIM SPARSE
EPL POP
ROUTER
ARLINGTON, VA
MOC
RP
PIM SPARSE
LINCOLN, NE
PIM SPARSE
DIV
PIM SPARSE
OPs
MULTICAST
SOC
SPRINGFIELD, VA
FILE
STORAGE
MULTICAST
SOURCES
26
MULTICAST
RECIEVERS
Global Design Concepts
Use standards based solutions
General Release software based systems
built on COTS hardware
Independently redundant components
27
Specific Design Concepts
Diversity system is independent of the DR
System (ingest, playout, encoding)
No PBS specific custom software
Separate redundant ethernet infrastructure
for control, multicast, diversity, facilities,
and ILO
Wherever possible, video remains in the
IP domain
28
Use of Video over IP
Contribution via LTN passed to multiplexer
as multicast streams
Playout servers produce multicast for
monitoring
IRDs produce multicast streams for
monitoring
Software based multiviewers aggregate
multicast streams and produce 1920x1080
multicast for display anywhere
29
Potential Future Use
of Video over IP
Contribution feeds direct as video over IP
to playout
TSoIP replacement of ASI to modulators
or
Playout servers produce TSoIP ready for
multiplexing
30
Conclusions:
Network origination on COTS hardware
using IP video is feasible and economical
Such systems can provide benefits such
as flexibility in signal transport
Managed services over open internet can
provide reliable transport of critical signals
31
Questions?
Philip Schoene – [email protected]
32