Efficient stereo segment scheduling in peer-to-peer 3D/multi-view video streaming

3D (or stereo) video has been a visually appealing and costly affordable technology. More sophisticated multi-view videos have also been demonstrated. Yet their remarkably increased data volume poses greater challenges to the conventional client/server streaming systems, which has already suffered from supporting 2D videos. The stringent multi-stream synchronization further complicate the system design. In this paper, we present an initial attempt toward efficient streaming of stereo/multi-view videos over a peer-to-peer network. We show that the inherent multi-stream nature of stereo video makes segment scheduling more difficult, which is particularly acute with the existence of multiple senders in a peer-to-peer overlay. We formulate the stereo segment scheduling problem as a Binary Quadratic Programming problem and optimally solve it using an MIQP solver. However, given the high peer dynamics and the stringent playback deadline in real-time streaming, the optimal solution is too costly to be obtained. Thus, we develop two efficient algorithms to allow peers frequently compute the scheduling. We show that one of the proposed algorithms can achieve an analytical guarantee in the worst case performance, in particular, the approximation factor is at most 3 comparing with the optimal solution. We implement the proposed algorithms and the optimal in a peer-to-peer simulating system, and show that the proposed algorithms can achieve near-optimal performance efficiently. We further implement two other scheduling algorithms that are used in popular peer-to-peer streaming systems for comparison, and extend our design to support multi-view video with view diversity and dynamics. Under different end-system and network configurations with both stereo and multi-view streaming, the simulation results demonstrate that our algorithms outperform others in terms of streaming quality, stream synchronization/smoothness and scalability.

[1]  Bo Li,et al.  DONet: A Data-Driven Overlay Network For Efficient Live Media Streaming , 2004, INFOCOM 2005.

[2]  Michalis Faloutsos,et al.  A Systematic Framework for Unearthing the Missing Links: Measurements and Impact , 2007, NSDI.

[3]  Yutaka Ishibashi,et al.  Group synchronization control over haptic media in a networked real-time game with collaborative work , 2006, NetGames '06.

[4]  Thomas Schierl,et al.  RTP Payload Format for MVC Video , 2010 .

[5]  Ke Xu,et al.  Collaborative delay-aware scheduling in peer-to-peer UGC video sharing , 2010, NOSSDAV '10.

[6]  Yutaka Ishibashi,et al.  A synchronization mechanism for continuous media in multimedia communications , 1995, Proceedings of INFOCOM'95.

[7]  Ming Zhou,et al.  Tree-assisted gossiping for overlay video distribution , 2006, Multimedia Tools and Applications.

[8]  Yao Wang,et al.  Modeling of transmission-loss-induced distortion in decoded video , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Yang Guo,et al.  Is Random Scheduling Sufficient in P2P Video Streaming? , 2008, 2008 The 28th International Conference on Distributed Computing Systems.

[10]  A. Murat Tekalp,et al.  End-to-end stereoscopic video streaming with content-adaptive rate and format control , 2007, Signal Process. Image Commun..

[11]  Bo Li,et al.  On optimal layering and bandwidth allocation for multisession video broadcasting , 2004, IEEE Transactions on Wireless Communications.

[12]  Mark Handley,et al.  A scalable content-addressable network , 2001, SIGCOMM 2001.

[13]  Ketan Mayer-Patel,et al.  Coordinated multi-streaming for 3D tele-immersion , 2004, MULTIMEDIA '04.

[14]  Li Li,et al.  Real-time synchronization control in multimedia distributed systems , 1992, CCRV.

[15]  Bobby Bhattacharjee,et al.  Scalable application layer multicast , 2002, SIGCOMM '02.

[16]  P. Venkat Rangan,et al.  Feedback Techniques for Intra-Media Continuity and Inter-Media Synchronization in Distributed Multimedia Systems , 1993, Comput. J..

[17]  Klara Nahrstedt,et al.  TSync: a new synchronization framework for multi-site 3D tele-immersion , 2010, NOSSDAV '10.

[18]  Ruzena Bajcsy,et al.  A multi-stream adaptation framework for bandwidth management in 3D tele-immersion , 2006, NOSSDAV '06.

[19]  Paul Francis,et al.  Chunkyspread: Heterogeneous Unstructured Tree-Based Peer-to-Peer Multicast , 2006, Proceedings of the 2006 IEEE International Conference on Network Protocols.

[20]  Aidong Zhang,et al.  Dynamic playout scheduling algorithms for continuous multimedia streams , 1999, Multimedia Systems.

[21]  Helen J. Wang,et al.  LAYERED MULTIPLE DESCRIPTION CODING , 2003 .

[22]  Yang Guo,et al.  AQCS: Adaptive Queue-Based Chunk Scheduling for P2P Live Streaming , 2008, Networking.

[23]  Shun-Yun Hu,et al.  Peer-to-Peer 3D Streaming , 2010, IEEE Internet Computing.

[24]  Cheng-Hsin Hsu,et al.  Quality-aware segment transmission scheduling in peer-to-peer streaming systems , 2010, MMSys '10.

[25]  M. Reha Civanlar,et al.  Interactive transport of multi-view videos for 3DTV applications , 2006 .

[26]  Markus H. Gross,et al.  Real-time streaming of point-based 3D video , 2004, IEEE Virtual Reality 2004.

[27]  Minghua Chen,et al.  Queuing models for peer-to-peer systems , 2009, IPTPS.

[28]  Thomas Sikora,et al.  A standards-based, flexible, end-to-end multi-view video streaming architecture , 2007, Packet Video 2007.

[29]  Indranil Gupta,et al.  Towards Multi-Site Collaboration in 3D Tele-Immersive Environments , 2008, ICDCS.

[30]  Bo Li,et al.  Opportunities and Challenges of Peer-to-Peer Internet Video Broadcast , 2008, Proceedings of the IEEE.

[31]  Cheng Huang,et al.  Can internet video-on-demand be profitable? , 2007, SIGCOMM '07.

[32]  N. Atzpadin,et al.  Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability , 2007, Signal Process. Image Commun..

[33]  T. Sikora,et al.  Feasibility of Multi-View Video Streaming Over P2P Networks , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[34]  Jon Crowcroft,et al.  A survey and comparison of peer-to-peer overlay network schemes , 2005, IEEE Communications Surveys & Tutorials.

[35]  D. T. Lee,et al.  On k-Nearest Neighbor Voronoi Diagrams in the Plane , 1982, IEEE Transactions on Computers.

[36]  Shun-Yun Hu,et al.  FLoD: A Framework for Peer-to-Peer 3D Streaming , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[37]  Jiangchuan Liu,et al.  A Dynamic Skip List-Based Overlay for On-Demand Media Streaming with VCR Interactions , 2008, IEEE Transactions on Parallel and Distributed Systems.

[38]  Miguel Garcia,et al.  Multimedia group and inter-stream synchronization techniques: A comparative study , 2009, Inf. Syst..

[39]  Leslie Smith Space Perception and Parallax , 1981 .

[40]  Ralf Steinmetz,et al.  Synchronization Properties in Multimedia Systems , 1990, IEEE J. Sel. Areas Commun..

[41]  A. Murat Tekalp,et al.  Client-Driven Selective Streaming of Multiview Video for Interactive 3DTV , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[42]  Peter H. N. de With,et al.  Near-Future Streaming Framework for 3D-TV Applications , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[43]  Feng Wang,et al.  mTreebone: A Hybrid Tree/Mesh Overlay for Application-Layer Live Video Multicast , 2007, 27th International Conference on Distributed Computing Systems (ICDCS '07).

[44]  Civanlar M. Reha,et al.  Interactive transport of multi-view videos for 3DTV applications , 2006 .

[45]  Ghassan Al-Regib,et al.  Multistreaming of 3-D Scenes With Optimized Transmission and Rendering Scalability , 2007, IEEE Transactions on Multimedia.

[46]  Wojciech Matusik,et al.  3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes , 2004, ACM Trans. Graph..

[47]  Reza Rejaie,et al.  PRIME: peer-to-peer receiver-driven mesh-based streaming , 2009, TNET.

[48]  Vinod M. Prabhakaran,et al.  On the Role of Helpers in Peer-to-Peer File Download Systems: Design, Analysis and Simulation , 2007, IPTPS.

[49]  Hongbo Jiang,et al.  Peer-to-peer video-on-demand with scalable video coding , 2010, Comput. Commun..

[50]  M. Lukacs,et al.  Predictive coding of multi-viewpoint image sets , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[51]  Mark Handley,et al.  A scalable content-addressable network , 2001, SIGCOMM '01.

[52]  Shun-Yun Hu,et al.  Selection strategies for peer-to-peer 3D streaming , 2008, NOSSDAV.

[53]  Hai Jin,et al.  GridCast: Improving peer sharing for P2P VoD , 2008, TOMCCAP.

[54]  Bo Li,et al.  An Empirical Study of Flash Crowd Dynamics in a P2P-Based Live Video Streaming System , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.

[55]  Yuan Xue,et al.  On Feasibility of P2P On-Demand Streaming via Empirical VoD User Behavior Analysis , 2008, 2008 The 28th International Conference on Distributed Computing Systems Workshops.

[56]  Steven Fortune,et al.  A sweepline algorithm for Voronoi diagrams , 1986, SCG '86.

[57]  Robert Morris,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM 2001.

[58]  Sonia Fahmy,et al.  Analyzing video services in Web 2.0: a global perspective , 2008, NOSSDAV.

[59]  Kengo Katayama,et al.  Performance of simulated annealing-based heuristic for the unconstrained binary quadratic programming problem , 2001, Eur. J. Oper. Res..

[60]  Qian Zhang,et al.  LayerP2P: A New Data Scheduling Approach for Layered Streaming in Heterogeneous Networks , 2009, IEEE INFOCOM 2009.

[61]  Kien A. Hua,et al.  ZIGZAG: an efficient peer-to-peer scheme for media streaming , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).