Depth-Based Texture Coding in AVC-Compatible 3D Video Coding

The target of 3D video coding is to compress Multiview Video plus Depth (MVD) format data, which consist of a texture image and its corresponding depth map. In the MVD format, the depth map plays an important role for successful services in 3D video applications, because it enables the user to experience 3D by generating arbitrary intermediate views. The depth map has a strong correlation with its associated texture data, so it can be utilized to improve texture coding efficiency. This paper introduces a novel and efficient depth-based texture coding scheme. It includes depth-based motion vector prediction, block-based view synthesis prediction, and adaptive luminance compensation, which were adopted in an AVC-compatible 3D video coding standard. Simulation results demonstrate that the proposed scheme reduces the total coding bitrates of texture and depth by 19.06% for the coded PSNR and 17.01% for the synthesized PSNR in a P-I-P view prediction structure, respectively.

[1]  Qionghai Dai,et al.  Depth Map Coding for View Synthesis Based on Distortion Analyses , 2014, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[2]  B. Javidi,et al.  Three-dimensional imaging methods based on multiview images , 2005, Journal of Display Technology.

[3]  Aljoscha Smolic,et al.  Efficient Prediction Structures for Multiview Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Sehoon Yea,et al.  View synthesis prediction for multiview video coding , 2009, Signal Process. Image Commun..

[5]  Yo-Sung Ho,et al.  A framework of 3D video coding using view synthesis prediction , 2012, 2012 Picture Coding Symposium.

[6]  Hideaki Kimata,et al.  View Scalable Multiview Video Coding Using 3-D Warping With Depth Map , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Yo-Sung Ho,et al.  H.264-Based Depth Map Sequence Coding Using Motion Information of Corresponding Texture Video , 2006, PSIVT.

[8]  Gene Cheung,et al.  Arbitrarily shaped sub-block motion prediction in texture map compression using depth information , 2012, 2012 Picture Coding Symposium.

[9]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Li Yu,et al.  A Joint Texture/Depth Edge-Directed Up-sampling Algorithm for Depth Map Coding , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[11]  Jin Young Lee,et al.  A novel approach for efficient multi-view depth map coding , 2010, 28th Picture Coding Symposium.

[12]  Thomas Wiegand,et al.  3D Video and Free Viewpoint Video - Technologies, Applications and MPEG Standards , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[13]  Sehoon Yea,et al.  RD-Optimized View Synthesis Prediction for Multiview Video Coding , 2007, 2007 IEEE International Conference on Image Processing.

[14]  Hideaki Kimata,et al.  Adaptive appearance compensated view synthesis prediction for Multiview Video Coding , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[15]  Jaejoon Lee,et al.  Depth Map Coding Based on Synthesized View Distortion Function , 2011, IEEE Journal of Selected Topics in Signal Processing.

[16]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[17]  Gene Cheung,et al.  Arithmetic edge coding for arbitrarily shaped sub-block motion prediction in depth video compression , 2012, 2012 19th IEEE International Conference on Image Processing.

[18]  Christophe Tillier,et al.  Motion Vector Sharing and Bitrate Allocation for 3D Video-Plus-Depth Coding , 2009, EURASIP J. Adv. Signal Process..

[19]  Feng Zou,et al.  View synthesis prediction using skip and merge candidates for HEVC-based 3D video coding , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[20]  Aljoscha Smolic,et al.  Efficient Compression of Multi-View Video Exploiting Inter-View Dependencies Based on H.264/MPEG4-AVC , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[21]  Ying Chen,et al.  Disparity vector based advanced inter-view prediction in 3D-HEVC , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[22]  Detlev Marpe,et al.  3D video: Depth coding based on inter-component prediction of block partitions , 2012, 2012 Picture Coding Symposium.

[23]  Antonio Ortega,et al.  View synthesis prediction using adaptive depth quantization for 3D video coding , 2013, 2013 IEEE International Conference on Image Processing.

[24]  Jin Young Lee,et al.  A Fast and Efficient Multi-View Depth Image Coding Method Based on Temporal and Inter-View Correlations of Texture Images , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .