Efficient depth map compression exploiting correlation with texture data in multiresolution predictive image coders

New 3D applications such as 3DTV and FVV require not only a large amount of data, but also high-quality visual rendering. Based on one or several depth maps, intermediate views can be synthesized using a depth image-based rendering technique. Many compression schemes have been proposed for texture-plus-depth data, but the exploitation of the correlation between the two representations in enhancing compression performances is still an open research issue. In this paper, we present a novel compression scheme that aims at improving the depth coding using a joint depth/texture coding scheme. This method is an extension of the LAR (Locally Adaptive Resolution) codec, initially designed for 2D images. The LAR coding framework provides a lot of functionalities such as lossy/lossless compression, low complexity, resolution and quality scalability and quality control. Experimental results address both lossless and lossy compression aspects, considering some state of the art techniques in the two domains (JPEGLS, JPEGXR). Subjective results on the intermediate view synthesis after depth map coding show that the proposed method significantly improves the visual quality.

[1]  Olivier Déforges,et al.  Quality constraint and rate-distortion optimization for predictive image coders , 2013, Electronic Imaging.

[2]  Simone Milani,et al.  Efficient depth map compression exploiting segmented color data , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[3]  Olivier Déforges,et al.  Color LAR Codec: A Color Image Representation and Compression Scheme Based on Local Resolution Adjustment and Self-Extracting Region Representation , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  T. Wiegand,et al.  Efficient Compression of Multi-View Depth Data Based on MVC , 2007, 2007 3DTV Conference.

[5]  T. Wiegand,et al.  The Effect of Depth Compression on Multiview Rendering Quality , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[6]  A. Gotchev,et al.  Quality assessment of 3D video in rate allocation experiments , 2008, 2008 IEEE International Symposium on Consumer Electronics.

[7]  Guillermo Sapiro,et al.  Evaluation of JPEG-LS, the new lossless and controlled-lossy still image compression standard, for compression of high-resolution elevation data , 2001, IEEE Trans. Geosci. Remote. Sens..

[8]  Jin Young Lee,et al.  A Fast and Efficient Multi-View Depth Image Coding Method Based on Temporal and Inter-View Correlations of Texture Images , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Feng Wu,et al.  Improving Depth Compression in HEVC by Pre/Post Processing , 2012, 2012 IEEE International Conference on Multimedia and Expo Workshops.

[10]  Aljoscha Smolic,et al.  Multi-View Video Plus Depth Representation and Coding , 2007, 2007 IEEE International Conference on Image Processing.

[11]  C. Fehn,et al.  Interactive 3-DTV-Concepts and Key Technologies , 2006 .

[12]  Thomas Wiegand,et al.  3D Video and Free Viewpoint Video - Technologies, Applications and MPEG Standards , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[13]  Luce Morin,et al.  Focus on visual rendering quality through content-based depth map coding , 2010, 28th Picture Coding Symposium.

[14]  Peter H. N. de With,et al.  Depth-Image Compression Based on an R-D Optimized Quadtree Decomposition for the Transmission of Multiview Images , 2007, 2007 IEEE International Conference on Image Processing.

[15]  Olivier Déforges,et al.  Lossless and lossy minimal redundancy pyramidal decomposition for scalable image compression technique , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[16]  Olivier Déforges,et al.  Adaptive color decorrelation for predictive image codecs , 2011, 2011 19th European Signal Processing Conference.

[17]  Aljoscha Smolic,et al.  Coding Algorithms for 3DTV—A Survey , 2007, IEEE Transactions on Circuits and Systems for Video Technology.