MMVS/COE: mobile multi-view video streaming with constant order encoding

Multi-view video systems are designed to allow users to watch 3D videos or a scene recorded by multiple cameras from multiple viewpoints. They are actually used by crowd sourced journalism services or to cover events using a set of wireless drones/sensors filming the same scene, etc. Multi-view videos are captured by multiple cameras at different positions with significant correlations between neighboring views. Owing to the increased data volume of multi-view video, highly efficient encoding techniques are needed. The common idea for Multi-View Video Coding (MVC) is to further exploit the redundancy between adjacent views. In this paper, we focus on the acquisition phase of the multi-view video system. We propose a Mobile Multi-view Video Streaming scheme with Constant Order Encoding (MMVS/COE). It encodes by exploiting the inter/intra-view dependency to reduce redundancy and optimize the tradeoff between traffic volume (bite rate) and video quality. Evaluations’ results show that MMVS/COE reduces traffic, compared to existing methods, mainly MVC/MC, by decreasing redundancies among video streams while maintaining video quality.

[1]  Martin Reisslein,et al.  Traffic and Statistical Multiplexing Characterization of 3-D Video Representation Formats , 2013, IEEE Transactions on Broadcasting.

[2]  Heiko Schwarz,et al.  3D High-Efficiency Video Coding for Multi-View Video and Depth Data , 2013, IEEE Transactions on Image Processing.

[3]  Masayuki Tanimoto,et al.  Global View and Depth (GVD) format for FTV/3DTV , 2013, Defense, Security, and Sensing.

[4]  Stefan Winkler,et al.  The Evolution of Video Quality Measurement: From PSNR to Hybrid Metrics , 2008, IEEE Transactions on Broadcasting.

[5]  Mark Horowitz,et al.  High performance imaging using arrays of inexpensive cameras , 2004 .

[6]  Zhigang Li,et al.  Real-time streaming and robust streaming H.264/AVC video , 2004, Third International Conference on Image and Graphics (ICIG'04).

[7]  Miska M. Hannuksela,et al.  Standard-Compliant Multiview Video Coding and Streaming for Virtual Reality Applications , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[8]  Sherali Zeadally,et al.  Media Networks: Architectures, Applications, and Standards , 2012 .

[9]  Wen Gao,et al.  Distributed multi-view video coding , 2006, Electronic Imaging.

[10]  Bo Li,et al.  Adaptive Video Multicast over the Internet , 2003, IEEE Multim..

[11]  Jiang Li,et al.  A real-time interactive multi-view video system , 2005, MULTIMEDIA '05.

[12]  Ahmet M. Kondoz,et al.  Dynamic adaptive 3D multi-view video streaming over the internet , 2013, ImmersiveMe '13.

[13]  Wojciech Matusik,et al.  3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes , 2004, ACM Trans. Graph..

[14]  X. Artigas,et al.  Side Information Generation for Multiview Distributed Video Coding Using a Fusion Approach , 2006, Proceedings of the 7th Nordic Signal Processing Symposium - NORSIG 2006.

[15]  Stefano Pantaleoni,et al.  Bone Mineral Density at Diagnosis of Celiac Disease and after 1 Year of Gluten-Free Diet , 2014, TheScientificWorldJournal.

[16]  Ioannis Lambadaris,et al.  A survey of congestion control schemes for multicast video applications , 2003, IEEE Communications Surveys & Tutorials.

[17]  Dingde Jiang,et al.  An energy-efficient cooperative multicast routing in multi-hop wireless networks for smart medical applications , 2017, Neurocomputing.

[18]  Mourad Ouaret,et al.  Recent advances in multiview distributed video coding , 2007, SPIE Defense + Commercial Sensing.

[19]  Mohamed Hefeeda,et al.  Energy-efficient multicasting of multiview 3D videos to mobile devices , 2012, TOMCCAP.

[20]  Martin Reisslein,et al.  Video Traffic Characteristics of Modern Encoding Standards: H.264/AVC with SVC and MVC Extensions and H.265/HEVC , 2014, TheScientificWorldJournal.

[21]  Takashi Watanabe,et al.  Multi-view video streaming with mobile cameras , 2014, 2014 IEEE Global Communications Conference.

[22]  Takashi Watanabe,et al.  Traffic Reduction for Multiple Users in Multi-view Video Streaming , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[23]  Bernd Fröhlich,et al.  Immersive Group-to-Group Telepresence , 2013, IEEE Transactions on Visualization and Computer Graphics.

[24]  Mourad Ouaret,et al.  Fusion-based multiview distributed video coding , 2006, VSSN '06.

[25]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[26]  Mourad Ouaret,et al.  Recent Advances in Multi-view Distributed Video Coding , 2007 .

[27]  Mohammed N. Smadi,et al.  Video frame size modeling for user-generated traffic in an enterprise-like environment , 2017, Comput. Commun..

[28]  Dingde Jiang,et al.  Network coding-based energy-efficient multicast routing algorithm for multi-hop wireless networks , 2015, J. Syst. Softw..

[29]  Aljoscha Smolic,et al.  3DTV: Capture, Transmission, and Display of 3D Video , 2009, EURASIP J. Adv. Signal Process..

[30]  Peng Zhang,et al.  QoS constraints-based energy-efficient model in cloud computing networks for multimedia clinical issues , 2016, Multimedia Tools and Applications.

[31]  Jiangchuan Liu,et al.  Multirate video multicast over the Internet: an overview , 2003 .

[32]  Dingde Jiang,et al.  A novel hybrid prediction algorithm to network traffic , 2015, annals of telecommunications - annales des télécommunications.

[33]  Matthieu Guillaumin,et al.  Combining Image-Level and Segment-Level Models for Automatic Annotation , 2012, MMM.