3D video coding and transmission

The capture, transmission, and display of 3D content has gained a lot of attention in the last few years. 3D multimedia content is no longer confined to cinema theatres but is being transmitted using stereoscopic video over satellite, shared on Blu-Raydisks, or sent over Internet technologies. Stereoscopic displays are needed at the receiving end and the viewer needs to wear special glasses to present the two versions of the video to the human vision system that then generates the 3D illusion. To be more effective and improve the immersive experience, more views are acquired from a larger number of cameras and presented on different displays, such as autostereoscopic and light field displays. These multiple views, combined with depth data, also allow enhanced user experiences and new forms of interaction with the 3D content from virtual viewpoints. This type of audiovisual information is represented by a huge amount of data that needs to be compressed and transmitted over bandwidth-limited channels. Part of the COST Action IC1105 “3D Content Creation, Coding and Transmission over Future Media Networks” (3DConTourNet) focuses on this research challenge.

[1]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Thomas Schierl,et al.  Transport and Storage Systems for 3-D Video Using MPEG-2 Systems, RTP, and ISO File Format , 2011, Proceedings of the IEEE.

[3]  Tommaso Melodia,et al.  Cloud-Assisted Smart Camera Networks for Energy-Efficient 3D Video Streaming , 2014, Computer.

[4]  A. Murat Tekalp,et al.  Peer-to-peer system design for adaptive 3D video streaming , 2013, IEEE Communications Magazine.

[5]  Heiko Schwarz,et al.  3D High-Efficiency Video Coding for Multi-View Video and Depth Data , 2013, IEEE Transactions on Image Processing.

[6]  Wen Gao,et al.  A Compact Stereoscopic Video Representation for 3D Video Generation and Coding , 2012, 2012 Data Compression Conference.

[7]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[8]  Yo-Sung Ho,et al.  Overview of Multi-view Video Coding , 2007, 2007 14th International Workshop on Systems, Signals and Image Processing and 6th EURASIP Conference focused on Speech and Image Processing, Multimedia Communications and Services.

[9]  Narciso García,et al.  Providing 3D video services: The challenge from 2D to 3DTV quality of experience , 2012, Bell Labs Technical Journal.

[10]  Masahide Kaneko,et al.  Coding of facial image sequence based on a 3-D model of the head and motion detection , 1991, J. Vis. Commun. Image Represent..

[11]  Alan C. Bovik,et al.  Multimodal Interactive Continuous Scoring of Subjective 3D Video Quality of Experience , 2014, IEEE Transactions on Multimedia.

[12]  Hans-Peter Seidel,et al.  Multi-video compression in texture space using 4D SPIHT , 2004, IEEE 6th Workshop on Multimedia Signal Processing, 2004..

[13]  Cisco Visual Networking Index: Forecast and Methodology 2016-2021.(2017) http://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual- networking-index-vni/complete-white-paper-c11-481360.html. High Efficiency Video Coding (HEVC) Algorithms and Architectures https://jvet.hhi.fraunhofer. , 2017 .

[14]  Ahmet M. Kondoz,et al.  Quality Evaluation of Color Plus Depth Map-Based Stereoscopic Video , 2009, IEEE Journal of Selected Topics in Signal Processing.

[15]  Tao Chen,et al.  3D-TV Content Storage and Transmission , 2011, IEEE Transactions on Broadcasting.

[16]  Wei Song,et al.  Acceptability-Based QoE Models for Mobile Video , 2014, IEEE Transactions on Multimedia.

[17]  Aljoscha Smolic,et al.  Toward a 3D video format for auto-stereoscopic displays , 2008, Optical Engineering + Applications.

[18]  Ahmet M. Kondoz,et al.  Hybrid broadcast and broadband networks convergence for immersive TV applications , 2014, IEEE Wireless Communications.

[19]  Hans-Peter Seidel,et al.  Model-Based Free-Viewpoint Video Acquisition, Rendering and Encoding , 2004 .

[20]  Hyunggon Park,et al.  Video streaming over P2P networks: Challenges and opportunities , 2012, Signal Process. Image Commun..

[21]  Markus H. Gross,et al.  3D video fragments: dynamic point samples for real-time free-viewpoint video , 2004, Comput. Graph..

[22]  Ying Chen,et al.  Overview of the Multiview and 3D Extensions of High Efficiency Video Coding , 2016, IEEE Transactions on Circuits and Systems for Video Technology.