Depth Image Coding Using Entropy-Based Adaptive Measurement Allocation

Differently from traditional two-dimensional texture images, the depth images of three-dimensional (3D) video systems have significant sparse characteristics under the certain transform basis, which make it possible for compressive sensing to represent depth information efficiently. Therefore, in this paper, a novel depth image coding scheme is proposed based on a block compressive sensing method. At the encoder, in view of the characteristics of depth images, the entropy of pixels in each block is employed to represent the sparsity of depth signals. Then according to the different sparsity in the pixel domain, the measurements can be adaptively allocated to each block for higher compression efficiency. At the decoder, the sparse transform can be combined to achieve the compressive sensing reconstruction. Experimental results have shown that at the same sampling rate, the proposed scheme can obtain higher PSNR values and better subjective quality of the rendered virtual views, compared with the method using a uniform sampling rate.

[1]  Zhibo Chen,et al.  A novel image/video coding method based on Compressed Sensing theory , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[2]  Masayuki Tanimoto Overview of free viewpoint television , 2006, Signal Process. Image Commun..

[3]  Toshiaki Fujii,et al.  View Generation with 3D Warping Using Depth Information for FTV , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[4]  Lu Gan Block Compressed Sensing of Natural Images , 2007, 2007 15th International Conference on Digital Signal Processing.

[5]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[6]  Antonio Ortega,et al.  Adaptive compressed sensing for depthmap compression using graph-based transform , 2012, 2012 19th IEEE International Conference on Image Processing.

[7]  CHRISTOPH FEHN,et al.  Interactive 3-DTV-Concepts and Key Technologies , 2006, Proceedings of the IEEE.

[8]  A.M. Kondoz,et al.  Bit-Rate Adaptive Downsampling for the Coding of Multi-View Video with Depth Information , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[9]  Peter Kauff,et al.  Three-Dimensional Video Postproduction and Processing , 2011, Proceedings of the IEEE.

[10]  Klaus Diepold,et al.  Depth map compression via compressed sensing , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[11]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[12]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[13]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[14]  Aljoscha Smolic,et al.  The effects of multiview depth video compression on multiview rendering , 2009, Signal Process. Image Commun..