Challenges in 3D video standardization

Stereoscopic video transmission systems have now evolved from 2D video systems and have been commercialized for a number of application areas, driven by developments in stereo capturing and display technology. With the new developments in autostereoscopic display technology, these stereo systems need to further advance towards 3D video systems. In contrast to all previous video coding technologies, 3D video data requires a number of new assumptions and novel technology developments. This paper discusses the evolution from 2D to stereo video and finally to 3D video systems and highlights some of the major new challenges for 3D Video. Finally, an evaluation framework for 3D video technology is shown, that addresses these challenges and is used by ISO-MPEG for standardizing the best 3D video coding solution.

[1]  Ismo Rakkolainen,et al.  A Survey of 3DTV Displays: Techniques and Technologies , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Thomas Wiegand,et al.  Diffusion filtering of depth maps in stereo video coding , 2010, 28th Picture Coding Symposium.

[3]  Itu-T and Iso Iec Jtc.  Advanced video coding for generic audiovisual services , 2010 .

[4]  M. Halle,et al.  3-D Displays and Signal Processing , 2007, IEEE Signal Processing Magazine.

[5]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Christophe Tillier,et al.  Adaptive wavelet coding of the depth map for stereoscopic view synthesis , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[7]  Aljoscha Smolic,et al.  The effects of multiview depth video compression on multiview rendering , 2009, Signal Process. Image Commun..

[8]  Dominik Strohmeier.  On comparing different codec profiles of coding methods for mobile 3 D television and video , 2010 .

[9]  Yo-Sung Ho,et al.  Depth Reconstruction Filter and Down/Up Sampling for Depth Coding in 3-D Video , 2009, IEEE Signal Processing Letters.

[10]  Thomas Wiegand,et al.  Correlation histogram analysis of depth-enhanced 3D video coding , 2010, 2010 IEEE International Conference on Image Processing.

[11]  Thomas Wiegand,et al.  3-D Video Representation Using Depth Maps , 2011, Proceedings of the IEEE.

[12]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[13]  J. Konrad,et al.  3D displays and signal processing : an answer to 3-D ills? , 2007 .

[14]  Aljoscha Smolic,et al.  Efficient Prediction Structures for Multiview Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[16]  Minh N. Do,et al.  Shape-adaptivewavelet encoding of depth maps , 2009, 2009 Picture Coding Symposium.