Efficient Coding of Depth Map by Exploiting Temporal Correlation

With the growing demands for 3D and multi-view video content, efficient depth data coding becomes a vital issue in image and video coding area. In this paper, we propose a simple depth coding scheme using multiple prediction modes exploiting temporal correlation of depth map. Current depth coding techniques mostly depend on intra-coding mode that cannot get the advantage of temporal redundancy in the depth maps and higher spatial redundancy in inter-predicted depth residuals. Depth maps are characterized by smooth regions with sharp edges that play an important role in the view synthesis process. As depth maps are more sensitive to coding errors, use of transformation or approximation of edges by explicit edge modelling has impact on view synthesis quality. Moreover, lossy compression of depth map brings additional geometrical distortion to synthetic view. In this paper, we have demonstrated that encoding inter-coded depth block residuals with quantization at pixel domain is more efficient than the intra-coding techniques relying on explicit edge preservation. On standard 3D video sequences, the proposed depth coding has achieved superior image quality of synthesized views against the new 3D-HEVC standard for depth map bit-rate 0.25 bpp or higher.

[1]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[2]  Antonio Ortega,et al.  Edge-preserving intra depth coding based on context-coding and H.264/AVC , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[3]  Thomas Wiegand,et al.  Coding of depth signals for 3D video using wedgelet block segmentation with residual adaptation , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[4]  Heiko Schwarz,et al.  3D High-Efficiency Video Coding for Multi-View Video and Depth Data , 2013, IEEE Transactions on Image Processing.

[5]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[6]  Peter H. N. de With,et al.  Platelet-based coding of depth maps for the transmission of multiview images , 2006, Electronic Imaging.

[7]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  Detlev Marpe,et al.  3D video: Depth coding based on inter-component prediction of block partitions , 2012, 2012 Picture Coding Symposium.

[9]  Manoranjan Paul,et al.  Inherently edge-preserving depth-map coding without explicit edge detection and approximation , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[10]  Guillermo Sapiro,et al.  From LOGO-I to the JPEG-LS standard , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[11]  Erika Müller,et al.  Sharing of motion vectors in 3D video coding , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[12]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[13]  Thomas Wiegand,et al.  3-D Video Representation Using Depth Maps , 2011, Proceedings of the IEEE.

[14]  Yo-Sung Ho,et al.  H.264-Based Depth Map Sequence Coding Using Motion Information of Corresponding Texture Video , 2006, PSIVT.

[15]  Houqiang Li,et al.  Depth-based motion vector prediction in 3D video coding , 2012, 2012 Picture Coding Symposium.

[16]  Yo-Sung Ho,et al.  Depth map coding using residual segmentation for 3D video system , 2013 .

[17]  Jaejoon Lee,et al.  Edge-adaptive transforms for efficient depth map coding , 2010, 28th Picture Coding Symposium.

[18]  Jaejoon Lee,et al.  Edge-aware intra prediction for depth-map coding , 2010, 2010 IEEE International Conference on Image Processing.

[19]  Dong Tian,et al.  New Depth Coding Techniques With Utilization of Corresponding Video , 2011, IEEE Transactions on Broadcasting.