A user-driven system for multi-view video in successive motion model

Recently, multi-view video that is taken by multiple cameras from different positions and angles to provide the real world experience has attracted more attentions. Its typical applications include Free Viewpoint TV, remote medical surgery, wireless multimedia sensor networks and so on. The size of multi-view video is several times bigger than traditional multimedia, which brings much more increment in the bandwidth requirement. Compression technologies, such as MPEG and MVC, can greatly decrease the size of multi-view video. However, as just one view is displayed at a specific time, even with MVC bit-rate of multi-view video is still high. In this paper, we researched the switch models of the multi-view video applications and proposed a user-driven multi-view video streaming system which can significantly decrease the bandwidth requirement and provide better user experience. In the proposed system, only those frames that are possible to be displayed are encoded and transmitted and the data are transported by different protocols to decrease the effect of the network congestion. In order to support this solution, we also improved the prediction structure as a substitute of the prediction structure in MVC. Evaluation proves that this proposed solution is great helpful to reduce the average bit-rate and the bandwidth requirement for the transmission of multi-view video.

[1]  Chun-Shien Lu,et al.  Multi-View Distributed Video Coding with Low-Complexity Inter-Sensor Communication Over Wireless Video Sensor Networks , 2007, 2007 IEEE International Conference on Image Processing.

[2]  Civanlar M. Reha,et al.  Interactive transport of multi-view videos for 3DTV applications , 2006 .

[3]  Aljoscha Smolic,et al.  Interactive 3-D Video Representation and Coding Technologies , 2005, Proceedings of the IEEE.

[4]  A. Murat Tekalp,et al.  Client-Driven Selective Streaming of Multiview Video for Interactive 3DTV , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Masayuki Tanimoto Overview of free viewpoint television , 2006, Signal Process. Image Commun..

[6]  Jaehwan Kim,et al.  RTP Payload Format for MPEG-4 Audio/Visual Streams , 2011, RFC.

[7]  T. Sikora,et al.  Feasibility of Multi-View Video Streaming Over P2P Networks , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[8]  Klaus Hopf,et al.  Key technologies for an advanced 3D TV system , 2004, SPIE Optics East.

[9]  A. Murat Tekalp,et al.  Transport Methods in 3DTV—A Survey , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Mark Handley,et al.  Datagram Congestion Control Protocol (DCCP) , 2006, RFC.

[11]  M. Reha Civanlar,et al.  Interactive transport of multi-view videos for 3DTV applications , 2006 .