Download Document

Private & Confidential
PPLive
—A Practical P2P Live System with Huge Amount of Users
Gale Huang
P2P Software Architect
[email protected]
Shanghai Synacast Media-Tech Corp.
Sept. 2007
Private & Confidential
Agenda
What is PPLive?
– An online video broadcasting and advertising network
– An efficient P2P technique platform and test bench in the world
Common & Special characters
Continuous self-adjustment procedure
Key points PPLive most concerns for
Private & Confidential
1. What is PPLive?
Introduction of PPLive
Private & Confidential
What is PPLive?
– An online video broadcasting and advertising network
Provides an online viewing experience comparable to that of traditional TV broadcasting
75 million global installed base and 20 million monthly active users
600+ channels on PPLive with content ranging from news, music, sports, movies, games, live
video and other interactive services to a global audience
– An efficient P2P technique platform and test bench
History of PPLive:
Bill’s story
– Inventor of PPLive core technology
– Dropped out of post-graduate program to start PPLive in dorm and grew the user
significantly in the first two years.
Estimated global installed base
75 million
Monthly active users*
20 million
Daily active users
3.5 million
Peak concurrent users
2.2 million
Monthly average concurrent users
1.5 million
Weekly average usage time
11 hours
Industry Trends
Private & Confidential
PPLive is well positioned to exploit the next explosive growth
Video Streaming
Advanced
Applications
VOIP
PPLive
Skype
Downloading
BitTorrent
File Sharing
Basic
Applications
Napster
2001
2003
2004
2005
Introduction of PPLive ——Focus on P2P Streaming
Private & Confidential
Encoding &
Decoding
Streaming technology
MPEG-4
H.264
P2P file share
P2P Download
Accelerator
P2P Streaming
P2P-Voip
P2P-Magzine
Napster/ Kazza
eMule/ Poco
Bit Torrent/ Thunder
Dudu Accelerate
PPLive
Skype
Headcall
xPlus/ ZCom/
Poco MagBox
P2P technology
Digital Rights
DRM
Digital Watermark
Introduction of PPLive——distribution view
Private & Confidential
PPLive is a P2P Live System
–
–
–
–
–
Media Publish System
P2P content delivery network
End users’ PPLive player
Multi-media formats Supported
DRM Supported
Movie
Entertainment
Online Show
Sports
Private & Confidential
Common and Different Characters
Common characters
Private & Confidential
Common points
– what topology of p2p architecture to be chosen
Tree based (multi-tree based)
Mesh based
Unstructured
Other DHT based…
– How to organize peer nodes?
– How to make peer nodes know and communicate with each other ?
Find the partners
Make use of the partners
– How to manage the resource?
– Most concern about the metric of the P2P System
Different points
Private & Confidential
Most different points
– Viewing experiences is the most important metric
– Much more practical
– Feedback from the PPLive test bench itself
75m end users
Consider their viewing experience
Take responsibility of all users
Part of users have updated version which is under control ,
before spreading to all of users
Ideas
PPLive test bench
Theory
Improvement
Feedback
Feedback network—— Test network Feedback ( Global)
Private & Confidential
PPLive software Architecture
Private & Confidential
Source Server
Classical C/S or P2P
Network
Adapter Server
Acess Server
Server
One Channel, One P2P Group
SN
SN
One P2P Group, One P2P Strategy
SN
SN
Overlay Network
SN
SN
SNList
PeerList
Smart routing Algorithm
SSN
VSN
C
SNCandadite
Resourse List
SNList
PeerList
Global Distribution
C
C
C
C
PPLive has centralized servers taking charge of
registering, providing the source and bridging with
other applications
DHT based Super Node consists of stable SN and
virtual SN
Each SN takes charge some Channels in Live system ;
while in VOD system, each SN takes charge of a
certain area
In each P2P group , we can assign a special p2p
algorithm different with other groups
Peer node architecture
Private & Confidential
Live Streaming
VOD
File Sharing
File Storage
APP
Media Service
Storage Service
Resource Management
File Management
P2P
P2P
Route Management
Data Transmission
TCP/UDP/Control
Disk Driver
Net
IP
PPLive Peer node architecture
Peer node
–
–
–
–
Key point of the whole P2P System
Implementer of the smart routing algorithm
Hierarchical design
A unified interface provided to the high level
applications
PPLive Software Architecture
Private & Confidential
C
server
C
C
Public Network
SN
Peer
C
SN
Peer
C
SN
C
C
Peer
Peer
C
C
Peer
Peer
SN
Peer
C
Peer
Peer
Peer
Network layer view
Peer
Peer
Peer
Peer
Peer
Peer
Peer
Peer
Peer
Peer
Peer
Peer
Peer
Peer
Peer
P2P layer view
Global view
Peer
Peer
PPLive Common Overlay
Private & Confidential
A Common overlay network contains
Live Streaming
– Query queue(P2P orders)
File Storage
Storage Service
Resource Management
File Management
Route Management
Data Transmission
Disk Driver
IP
Application independent
Ability of uploading and downloading
Query Queue
Ping-pong layer
R1
PP1 **
R4
R7 R10
...
R2
PP2 ****
R1
R3
R6
...
R3
PP3 ***
R2
R5
R8
...
R4
PP4*
R9 R16
...
R5
...
R1：QueryQueue
PP1*：pingpong
layer（*represents
capacity）
P2P
TCP/UDP/Control
– Download from the query queue (How to
execute the orders)
...
File Sharing
Media Service
Application related
– Real streaming
– VOD
– File sharing
R6
VOD
Private & Confidential
Continuous self-adjustment procedure
Continuous self-adjustment
1st Misunderstanding
– For most P2P System, it is
commonly thought: The more
users look simultaneously the
better view experience the
users will have.
Conclusion
Unit: Thousands
2500
2200
1800
2000
1100
1500
650
1000
– For most p2p system, especially
for streaming applications
(bandwidth wasted and real
time requested application ), it is
not necessarily the truth.
– User scale greatly influences the
architecture;
•Initial PPLive core with
Single Global Index
450
500
May 2005
250
70
150
0
Jun 2005
• Chord based DHT is
used for all Index Servers
• Distributed Index
Server supported
Nov. 2004
Private & Confidential
Dec
2005
Mar 2006 Jun 2006
Dec
2006
Mar 2007 Jun 2007
• Smart SN introduced to
corporate with peers
• Gossip based Peer
communication mingled with DHT
Oct. 2006
Sep
2006
Dec. 2006
• Unified p2p platform
proposed to support
multi-applications
May. 2007
Jun. 2007
Private & Confidential
2nd Misunderstanding
– Theoretical model can lead to the real performance evaluation
Conclusion
– Modeling the system has a big help to design and optimize the P2P application
– P2P System’s capacity can just be proved by the fact of real operation
Over 250K peak simultaneous users to watch the “Super Girl” Live, China, Q3，
2005
• 1 PC server
• 10Mb distribution bandwidth
• 500kbps video
• 250,000 audiences
• 50,000 audiences from abroad
Source: PPLive database
A NBA play-off game with Huston Rocket, Live, China,
Q2,2007
• 1 PC server
• 10Mb distribution bandwidth
• 400kbps video
• 1,480,000 audiences
Source: PPLive database
3rd Misunderstanding
Private & Confidential
– Experimental environment can represent the real network environment.
Conclusion
– PPLive was also born from the CERNET, which is specially for educational use
and very idealistic for P2P experiment
– PPLive encountered many difficulties while walking out from CERNET
Heterogeneous network
Unpredictable user pattern
Asymmetric network
Poor network condition, half of them are 512kbps bandwidth, while we run 400kbps
video on it
– Stronger and smarter algorithm should be used
Private & Confidential
Key points PPLive most concerns for
PPLive Platform Strategy
Private & Confidential
Content Provider
Live System
Advertiser
VOD System
Services Provider
Distributed
Storage
File Sharing
P2P Content Deliver Network
Broadband Network Infrastructure
End Users
Others…
Continuous self-adjustment (cont)
Private & Confidential
Deeply improve the users’ viewing experience
– Based on the P2P streaming technology
– Adapting for Chinese complicated network environment
Integrate the multi high level applications into this platform
Open the part of the platform interface to public
– Let others join in this platform
Private & Confidential
PPLive—P2P changes our lives
Thank you!
Question Time