Multi-stream 3D video distribution over peer-to-peer networks

The recent advances in stereoscopic video capture, compression, and display have made 3-dimensional (3D) video a visually appealing and costly affordable technology. There have been a series of pioneer works on streaming 3D video over the Internet. Yet the remarkably increased data volume of 3D videos poses great challenges to the conventional client/server design, which has already suffered from supporting 2D videos. In this paper, we present an initial attempt toward efficient streaming of 3D videos over a peer-to-peer network. We show that the inherent multi-stream nature of 3D video makes playback synchronization more difficult, which is particularly acute with the existence of multiple senders in a peer-to-peer overlay. We address this by a novel 2-stream 2-stage buffer design, together with weighted data scheduling and light-weight synchronization. We further discuss a series of key practical issues toward implementing our peer-to-peer 3D video streaming system, including the weight modeling for data segments, the interactions with the RTP/RTCP protocol stack, and the inter-operability with monoscopic video as well as extension to multi-view video. We have evaluated the performance of our system under different end-system and network configurations with typical 3D video streams. The simulation results demonstrate the superiority of our system in terms of both scalability and streaming quality.

[1]  Shun-Yun Hu,et al.  Selection strategies for peer-to-peer 3D streaming , 2008, NOSSDAV.

[2]  Keith W. Ross,et al.  Can internet video-on-demand be profitable? , 2007, SIGCOMM 2007.

[3]  Markus H. Gross,et al.  Real-time streaming of point-based 3D video , 2004, IEEE Virtual Reality 2004.

[4]  Thomas Schierl,et al.  RTP Payload Format for MVC Video , 2010 .

[5]  Bo Li,et al.  On optimal layering and bandwidth allocation for multisession video broadcasting , 2004, IEEE Transactions on Wireless Communications.

[6]  Klara Nahrstedt,et al.  TSync: a new synchronization framework for multi-site 3D tele-immersion , 2010, NOSSDAV '10.

[7]  Ruzena Bajcsy,et al.  A multi-stream adaptation framework for bandwidth management in 3D tele-immersion , 2006, NOSSDAV '06.

[8]  Indranil Gupta,et al.  Towards Multi-Site Collaboration in 3D Tele-Immersive Environments , 2008, ICDCS.

[9]  Bo Li,et al.  Opportunities and Challenges of Peer-to-Peer Internet Video Broadcast , 2008, Proceedings of the IEEE.

[10]  Jiangchuan Liu,et al.  A Dynamic Skip List-Based Overlay for On-Demand Media Streaming with VCR Interactions , 2008, IEEE Transactions on Parallel and Distributed Systems.

[11]  Miguel Garcia,et al.  Multimedia group and inter-stream synchronization techniques: A comparative study , 2009, Inf. Syst..

[12]  Ralf Steinmetz,et al.  Synchronization Properties in Multimedia Systems , 1990, IEEE J. Sel. Areas Commun..

[13]  A. Murat Tekalp,et al.  Client-Driven Selective Streaming of Multiview Video for Interactive 3DTV , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Bobby Bhattacharjee,et al.  Scalable application layer multicast , 2002, SIGCOMM 2002.

[15]  Leslie Smith.  Space Perception and Parallax , 1981 .

[16]  Reza Rejaie,et al.  PRIME: peer-to-peer receiver-driven mesh-based streaming , 2009, TNET.

[17]  Vinod M. Prabhakaran,et al.  On the Role of Helpers in Peer-to-Peer File Download Systems: Design, Analysis and Simulation , 2007, IPTPS.

[18]  Michalis Faloutsos,et al.  A Systematic Framework for Unearthing the Missing Links: Measurements and Impact , 2007, NSDI.

[19]  Yutaka Ishibashi,et al.  Group synchronization control over haptic media in a networked real-time game with collaborative work , 2006, NetGames '06.

[20]  Civanlar M. Reha,et al.  Interactive transport of multi-view videos for 3DTV applications , 2006 .

[21]  Peter H. N. de With,et al.  Near-Future Streaming Framework for 3D-TV Applications , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[22]  Feng Wang,et al.  mTreebone: A Hybrid Tree/Mesh Overlay for Application-Layer Live Video Multicast , 2007, 27th International Conference on Distributed Computing Systems (ICDCS '07).

[23]  Paul Francis,et al.  Chunkyspread: Heterogeneous Unstructured Tree-Based Peer-to-Peer Multicast , 2006, Proceedings of the 2006 IEEE International Conference on Network Protocols.

[24]  Aidong Zhang,et al.  Dynamic playout scheduling algorithms for continuous multimedia streams , 1999, Multimedia Systems.

[25]  Ke Xu,et al.  Collaborative delay-aware scheduling in peer-to-peer UGC video sharing , 2010, NOSSDAV '10.

[26]  Ghassan Al-Regib,et al.  Multistreaming of 3-D Scenes With Optimized Transmission and Rendering Scalability , 2007, IEEE Transactions on Multimedia.

[27]  Shun-Yun Hu,et al.  FLoD: A Framework for Peer-to-Peer 3D Streaming , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[28]  Yutaka Ishibashi,et al.  A synchronization mechanism for continuous media in multimedia communications , 1995, Proceedings of INFOCOM'95.

[29]  Ming Zhou,et al.  Tree-assisted gossiping for overlay video distribution , 2006, Multimedia Tools and Applications.

[30]  Minghua Chen,et al.  Queuing models for peer-to-peer systems , 2009, IPTPS.

[31]  Jens Viggo Clausen.  Parallel Branch and Bound — Principles and Personal Experiences , 1997 .

[32]  Bo Li,et al.  DONet: A Data-Driven Overlay Network For Efficient Live Media Streaming , 2004, INFOCOM 2005.

[33]  T. Sikora,et al.  Feasibility of Multi-View Video Streaming Over P2P Networks , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[34]  Wojciech Matusik,et al.  3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes , 2004, ACM Trans. Graph..

[35]  A. Murat Tekalp,et al.  End-to-end stereoscopic video streaming with content-adaptive rate and format control , 2007, Signal Process. Image Commun..

[36]  Ketan Mayer-Patel,et al.  Coordinated multi-streaming for 3D tele-immersion , 2004, MULTIMEDIA '04.

[37]  Yang Guo,et al.  AQCS: Adaptive Queue-Based Chunk Scheduling for P2P Live Streaming , 2008, Networking.

[38]  Shun-Yun Hu,et al.  Peer-to-Peer 3D Streaming , 2010, IEEE Internet Computing.

[39]  Qian Zhang,et al.  LayerP2P: A New Data Scheduling Approach for Layered Streaming in Heterogeneous Networks , 2009, IEEE INFOCOM 2009.

[40]  Kien A. Hua,et al.  ZIGZAG: an efficient peer-to-peer scheme for media streaming , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[41]  Markus Gross,et al.  Colorplate: Real-Time Streaming of Point-Based 3D Video , 2004, VR.

[42]  Cheng-Hsin Hsu,et al.  Quality-aware segment transmission scheduling in peer-to-peer streaming systems , 2010, MMSys '10.

[43]  Yang Guo,et al.  Is Random Scheduling Sufficient in P2P Video Streaming? , 2008, 2008 The 28th International Conference on Distributed Computing Systems.