An overview of 3D video representation and coding

AbstractAs the next generation of television, three-dimensional television (3DTV) is enkindling various new applications. Since the representation and coding of three-dimensional video has direct effect on successive transmission, synthesis and display, it becomes crucially important and receives a wide publicity. This paper gives an overview of existing 3D video representation, relevantly state-of-the-art coding standards and various coding approaches consisting of conventional stereo video, multi-view video, video plus depth, multi-view video plus depth and layered depth video.

[1]  Sehoon Yea,et al.  RD-Optimized View Synthesis Prediction for Multiview Video Coding , 2007, 2007 IEEE International Conference on Image Processing.

[2]  Wen Gao,et al.  Shape-Based Depth Map Coding , 2009, 2009 Fifth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[3]  Yo-Sung Ho,et al.  H.264-Based Depth Map Sequence Coding Using Motion Information of Corresponding Texture Video , 2006, PSIVT.

[4]  Aljoscha Smolic,et al.  Coding Algorithms for 3DTV—A Survey , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Arun N. Netravali,et al.  Digital Video: An introduction to MPEG-2 , 1996 .

[6]  Markus Flierl,et al.  Motion and Disparity Compensated Coding for Multiview Video , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Yo-Sung Ho,et al.  Preprocessing of Depth and Color Information for Layered Depth Image Coding , 2004, PCM.

[8]  Minh N. Do,et al.  Rate-Distortion Optimal Depth Maps in the Wavelet Domain for Free-Viewpoint Rendering , 2007, 2007 IEEE International Conference on Image Processing.

[9]  Antonio Ortega,et al.  New Coding Tools for Illumination and Focus Mismatch Compensation in Multiview Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Aljoscha Smolic,et al.  3DAV exploration of video-based rendering technology in MPEG , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Hideaki Kimata,et al.  Real-time free-viewpoint viewer from multiview video plus depth representation coded by H.264/AVC MVC extension , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[12]  Heiko Schwarz,et al.  Analysis of Hierarchical B Pictures and MCTF , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[13]  C. Fehn,et al.  Interactive 3-DTV-Concepts and Key Technologies , 2006 .

[14]  Wen Gao,et al.  Compression-Induced Rendering Distortion Analysis for Texture/Depth Rate Allocation in 3D Video Compression , 2009, 2009 Data Compression Conference.

[15]  Source Poznań,et al.  INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC1/SC29/WG11 CODING OF MOVING PICTURES AND AUDIO , 2008 .

[16]  W. Gao,et al.  Inter-View Direct Mode for Multiview Video Coding , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Peter H. N. de With,et al.  Depth-Image Compression Based on an R-D Optimized Quadtree Decomposition for the Transmission of Multiview Images , 2007, 2007 IEEE International Conference on Image Processing.

[18]  Glen G. Langdon,et al.  Book Rvw: Digital Video: An Introduction to MPEG-2. By Barry G. Haskell, Atul Puri, and Arun N. Netravali , 1998 .

[19]  Ajay Luthra,et al.  MPEG-2 multiview profile and its application in 3D TV , 1997, Electronic Imaging.

[20]  Aljoscha Smolic,et al.  Efficient Compression of Multi-View Video Exploiting Inter-View Dependencies Based on H.264/MPEG4-AVC , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[21]  Lifeng Sun,et al.  A multi-view video coding approach using Layered Depth Image , 2007, 2007 IEEE 9th Workshop on Multimedia Signal Processing.

[22]  Yannick Morvan,et al.  Joint depth/texture bit-allocation for multi-view video compression , 2010 .

[23]  Antonio Ortega,et al.  Adaptive reference filtering for bidirectional disparity compensation with focus mismatches , 2008, 2008 15th IEEE International Conference on Image Processing.

[24]  Qingming Huang,et al.  Joint video/depth rate allocation for 3D video coding based on view synthesis distortion model , 2009, Signal Process. Image Commun..

[25]  Yo-Sung Ho,et al.  Multi-view depth video coding using depth view synthesis , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[26]  Jin Li,et al.  Compression of the layered depth image , 2003, IEEE Trans. Image Process..

[27]  Haitao Yang,et al.  Fine-Granular Motion Matching for Inter-View Motion Skip Mode in Multiview Video Coding , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.