Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Remote Desktop Services wikipedia , lookup
Piggybacking (Internet access) wikipedia , lookup
Distributed firewall wikipedia , lookup
Recursive InterNetwork Architecture (RINA) wikipedia , lookup
TV Everywhere wikipedia , lookup
Deep packet inspection wikipedia , lookup
Airborne Networking wikipedia , lookup
Private & Confidential PPLive —A Practical P2P Live System with Huge Amount of Users Gale Huang P2P Software Architect [email protected] Shanghai Synacast Media-Tech Corp. Sept. 2007 Private & Confidential Agenda What is PPLive? – An online video broadcasting and advertising network – An efficient P2P technique platform and test bench in the world Common & Special characters Continuous self-adjustment procedure Key points PPLive most concerns for Private & Confidential 1. What is PPLive? Introduction of PPLive Private & Confidential What is PPLive? – An online video broadcasting and advertising network Provides an online viewing experience comparable to that of traditional TV broadcasting 75 million global installed base and 20 million monthly active users 600+ channels on PPLive with content ranging from news, music, sports, movies, games, live video and other interactive services to a global audience – An efficient P2P technique platform and test bench History of PPLive: Bill’s story – Inventor of PPLive core technology – Dropped out of post-graduate program to start PPLive in dorm and grew the user significantly in the first two years. Estimated global installed base 75 million Monthly active users* 20 million Daily active users 3.5 million Peak concurrent users 2.2 million Monthly average concurrent users 1.5 million Weekly average usage time 11 hours Industry Trends Private & Confidential PPLive is well positioned to exploit the next explosive growth Video Streaming Advanced Applications VOIP PPLive Skype Downloading BitTorrent File Sharing Basic Applications Napster 2001 2003 2004 2005 Introduction of PPLive ——Focus on P2P Streaming Private & Confidential Encoding & Decoding Streaming technology MPEG-4 H.264 P2P file share P2P Download Accelerator P2P Streaming P2P-Voip P2P-Magzine Napster/ Kazza eMule/ Poco Bit Torrent/ Thunder Dudu Accelerate PPLive Skype Headcall xPlus/ ZCom/ Poco MagBox P2P technology Digital Rights DRM Digital Watermark Introduction of PPLive——distribution view Private & Confidential PPLive is a P2P Live System – – – – – Media Publish System P2P content delivery network End users’ PPLive player Multi-media formats Supported DRM Supported Movie Entertainment Online Show Sports Private & Confidential Common and Different Characters Common characters Private & Confidential Common points – what topology of p2p architecture to be chosen Tree based (multi-tree based) Mesh based Unstructured Other DHT based… – How to organize peer nodes? – How to make peer nodes know and communicate with each other ? Find the partners Make use of the partners – How to manage the resource? – Most concern about the metric of the P2P System Different points Private & Confidential Most different points – Viewing experiences is the most important metric – Much more practical – Feedback from the PPLive test bench itself 75m end users Consider their viewing experience Take responsibility of all users Part of users have updated version which is under control , before spreading to all of users Ideas PPLive test bench Theory Improvement Feedback Feedback network—— Test network Feedback ( Global) Private & Confidential PPLive software Architecture Private & Confidential Source Server Classical C/S or P2P Network Adapter Server Acess Server Server One Channel, One P2P Group SN SN One P2P Group, One P2P Strategy SN SN Overlay Network SN SN SNList PeerList Smart routing Algorithm SSN VSN C SNCandadite Resourse List SNList PeerList Global Distribution C C C C PPLive has centralized servers taking charge of registering, providing the source and bridging with other applications DHT based Super Node consists of stable SN and virtual SN Each SN takes charge some Channels in Live system ; while in VOD system, each SN takes charge of a certain area In each P2P group , we can assign a special p2p algorithm different with other groups Peer node architecture Private & Confidential Live Streaming VOD File Sharing File Storage APP Media Service Storage Service Resource Management File Management P2P P2P Route Management Data Transmission TCP/UDP/Control Disk Driver Net IP PPLive Peer node architecture Peer node – – – – Key point of the whole P2P System Implementer of the smart routing algorithm Hierarchical design A unified interface provided to the high level applications PPLive Software Architecture Private & Confidential C server C C Public Network SN Peer C SN Peer C SN C C Peer Peer C C Peer Peer SN Peer C Peer Peer Peer Network layer view Peer Peer Peer Peer Peer Peer Peer Peer Peer Peer Peer Peer Peer Peer Peer P2P layer view Global view Peer Peer PPLive Common Overlay Private & Confidential A Common overlay network contains Live Streaming – Query queue(P2P orders) File Storage Storage Service Resource Management File Management Route Management Data Transmission Disk Driver IP Application independent Ability of uploading and downloading Query Queue Ping-pong layer R1 PP1 ** R4 R7 R10 ... R2 PP2 **** R1 R3 R6 ... R3 PP3 *** R2 R5 R8 ... R4 PP4* R9 R16 ... R5 ... R1:QueryQueue PP1*:pingpong layer(*represents capacity) P2P TCP/UDP/Control – Download from the query queue (How to execute the orders) ... File Sharing Media Service Application related – Real streaming – VOD – File sharing R6 VOD Private & Confidential Continuous self-adjustment procedure Continuous self-adjustment 1st Misunderstanding – For most P2P System, it is commonly thought: The more users look simultaneously the better view experience the users will have. Conclusion Unit: Thousands 2500 2200 1800 2000 1100 1500 650 1000 – For most p2p system, especially for streaming applications (bandwidth wasted and real time requested application ), it is not necessarily the truth. – User scale greatly influences the architecture; •Initial PPLive core with Single Global Index 450 500 May 2005 250 70 150 0 Jun 2005 • Chord based DHT is used for all Index Servers • Distributed Index Server supported Nov. 2004 Private & Confidential Dec 2005 Mar 2006 Jun 2006 Dec 2006 Mar 2007 Jun 2007 • Smart SN introduced to corporate with peers • Gossip based Peer communication mingled with DHT Oct. 2006 Sep 2006 Dec. 2006 • Unified p2p platform proposed to support multi-applications May. 2007 Jun. 2007 Private & Confidential 2nd Misunderstanding – Theoretical model can lead to the real performance evaluation Conclusion – Modeling the system has a big help to design and optimize the P2P application – P2P System’s capacity can just be proved by the fact of real operation Over 250K peak simultaneous users to watch the “Super Girl” Live, China, Q3, 2005 • 1 PC server • 10Mb distribution bandwidth • 500kbps video • 250,000 audiences • 50,000 audiences from abroad Source: PPLive database A NBA play-off game with Huston Rocket, Live, China, Q2,2007 • 1 PC server • 10Mb distribution bandwidth • 400kbps video • 1,480,000 audiences Source: PPLive database 3rd Misunderstanding Private & Confidential – Experimental environment can represent the real network environment. Conclusion – PPLive was also born from the CERNET, which is specially for educational use and very idealistic for P2P experiment – PPLive encountered many difficulties while walking out from CERNET Heterogeneous network Unpredictable user pattern Asymmetric network Poor network condition, half of them are 512kbps bandwidth, while we run 400kbps video on it – Stronger and smarter algorithm should be used Private & Confidential Key points PPLive most concerns for PPLive Platform Strategy Private & Confidential Content Provider Live System Advertiser VOD System Services Provider Distributed Storage File Sharing P2P Content Deliver Network Broadband Network Infrastructure End Users Others… Continuous self-adjustment (cont) Private & Confidential Deeply improve the users’ viewing experience – Based on the P2P streaming technology – Adapting for Chinese complicated network environment Integrate the multi high level applications into this platform Open the part of the platform interface to public – Let others join in this platform Private & Confidential PPLive—P2P changes our lives Thank you! Question Time