Exploring interest correlation for peer-to-peer socialized video sharing

The last five years have witnessed an explosion of networked video sharing, represented by YouTube, as a new killer Internet application. Their sustainable development however is severely hindered by the intrinsic limit of their client/server architecture. A shift to the peer-to-peer paradigm has been widely suggested with success already shown in live video streaming and movie-on-demand. Unfortunately, our latest measurement demonstrates that short video clips exhibit drastically different statistics, which would simply render these existing solutions suboptimal, if not entirely inapplicable. Our long-term measurement over five million YouTube videos, on the other hand, reveals interesting social networks with strong correlation among the videos, thus opening new opportunities to explore. In this article, we present NetTube, a novel peer-to-peer assisted delivering framework that explores the user interest correlation for short video sharing. We address a series of key design issues to realize the system, including a bi-layer overlay, an efficient indexing scheme, a delay-aware scheduling mechanism, and a prefetching strategy leveraging interest correlation. We evaluate NetTube through both simulations and prototype experiments, which show that it greatly reduces the server workload, improves the playback quality and scales well.

[1]  Jiangchuan Liu,et al.  Statistics and Social Network of YouTube Videos , 2008, 2008 16th Interntional Workshop on Quality of Service.

[2]  Reza Rejaie,et al.  PRIME: Peer-to-Peer Receiver-drIven MEsh-Based Streaming , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[3]  Jiangchuan Liu,et al.  NetTube: Exploring Social Networks for Peer-to-Peer Short Video Sharing , 2009, IEEE INFOCOM 2009.

[4]  Pablo Rodriguez,et al.  I tube, you tube, everybody tubes: analyzing the world's largest user generated content video system , 2007, IMC '07.

[5]  Bo Li,et al.  CoolStreaming/DONet: a data-driven overlay network for peer-to-peer live media streaming , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[6]  Divesh Srivastava,et al.  CPM: Adaptive Video-on-Demand with Cooperative Peer Assists and Multicast , 2009, IEEE INFOCOM 2009.

[7]  Feng Wang,et al.  Stable Peers: Existence, Importance, and Application in Peer-to-Peer Live Video Streaming , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[8]  Ning Xia,et al.  Inside the bird's nest: measurements of large-scale live VoD from the 2008 olympics , 2009, IMC '09.

[9]  Newton Lee,et al.  ACM Transactions on Multimedia Computing, Communications and Applications (ACM TOMCCAP) , 2007, CIE.

[10]  Yin Zhang,et al.  Scalable proximity estimation and link prediction in online social networks , 2009, IMC '09.

[11]  D. Watts,et al.  Small Worlds: The Dynamics of Networks between Order and Randomness , 2001 .

[12]  Tim O'Reilly,et al.  What is Web 2.0: Design Patterns and Business Models for the Next Generation of Software , 2007 .

[13]  Jiangchuan Liu,et al.  Understanding the Characteristics of Internet Short Video Sharing: A YouTube-Based Measurement Study , 2013, IEEE Transactions on Multimedia.

[14]  A. Robert Calderbank,et al.  The effectiveness of intelligent scheduling for multicast video-on-demand , 2009, ACM Multimedia.

[15]  Chuan Wu,et al.  Multi-Channel Live P2P Streaming: Refocusing on Servers , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[16]  Pablo Rodriguez,et al.  Watching television over an IP network , 2008, IMC '08.

[17]  Zongpeng Li,et al.  Youtube traffic characterization: a view from the edge , 2007, IMC '07.

[18]  Keith W. Ross,et al.  View-Upload Decoupling: A Redesign of Multi-Channel P2P Video Systems , 2009, IEEE INFOCOM 2009.

[19]  Dan Wang,et al.  Towards understanding the external links of video sharing sites: measurement and analysis , 2010, NOSSDAV '10.

[20]  Cheng Huang,et al.  Challenges, design and analysis of a large-scale p2p-vod system , 2008, SIGCOMM '08.

[21]  Krishna P. Gummadi,et al.  Measurement and analysis of online social networks , 2007, IMC '07.

[22]  Burton H. Bloom,et al.  Space/time trade-offs in hash coding with allowable errors , 1970, CACM.

[23]  Anja Feldmann,et al.  Understanding online social network usage from a network perspective , 2009, IMC '09.

[24]  Reza Rejaie,et al.  Overlay monitoring and repair in swarm-based peer-to-peer streaming , 2009, NOSSDAV '09.

[25]  Albert-László Barabási,et al.  Internet: Diameter of the World-Wide Web , 1999, Nature.

[26]  Bo Li,et al.  Opportunities and Challenges of Peer-to-Peer Internet Video Broadcast , 2008, Proceedings of the IEEE.

[27]  Cheng Huang,et al.  Can internet video-on-demand be profitable? , 2007, SIGCOMM '07.

[28]  Chuan Wu,et al.  Distilling Superior Peers in Large-Scale P2P Streaming Systems , 2009, IEEE INFOCOM 2009.

[29]  Chao Liang,et al.  Investigating the Scheduling Sensitivity of P2P Video Streaming: An Experimental Study , 2009, IEEE Transactions on Multimedia.

[30]  Virgílio A. F. Almeida,et al.  Characterizing user behavior in online social networks , 2009, IMC '09.

[31]  Sonia Fahmy,et al.  Analyzing video services in Web 2.0: a global perspective , 2008, NOSSDAV.

[32]  Chuan Wu,et al.  InstantLeap: fast neighbor discovery in P2P VoD streaming , 2009, NOSSDAV '09.

[33]  Paul Francis,et al.  Chunkyspread: Heterogeneous Unstructured Tree-Based Peer-to-Peer Multicast , 2006, Proceedings of the 2006 IEEE International Conference on Network Protocols.