Local entropy minimization and measurement rate allocation for compressed sensing of depth video

Compressed sensing (CS) provides a new method to encode depth videos, which utilizes the sparsity of depth maps to improve the coding efficiency. In this paper, we design a novel CS-based depth video codec. The codec adaptively decomposes blocks from 64 χ 64 to 8 χ 8 sub-blocks via wavelet transforming. The decomposition divides smooth regions and complex boundaries by frequencies, and minimizes the local entropy of sub-blocks. Moreover, a measurement rate allocation algorithm is also proposed, which utilizes the rate-distortion optimization (RDO) to allocate the measurement rate for each block. The experimental results demonstrate that, compared with H.264/AVC and H.265/HEVC, the proposed codec improves the quality of virtual views by 1–2 dB and 0.2–0.5 dB PSNR respectively. Meanwhile, the codec reduces coding complexity greatly.

[1]  Klaus Diepold,et al.  Depth map compression via compressed sensing , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[2]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[3]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[4]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Joohee Kim,et al.  Adaptive measurement rate allocation for block-based compressed sensing of depth maps , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[6]  Joohee Kim,et al.  Quad-tree partitioned compressed sensing for depth map coding , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[7]  Iain E. Richardson,et al.  The H.264 Advanced Video Compression Standard: Richardson/The H.264 Advanced Video Compression Standard , 2010 .

[8]  Soon-kak Kwon,et al.  Overview of H.264/MPEG-4 part 10 , 2006, J. Vis. Commun. Image Represent..

[9]  Klaus Diepold,et al.  Dense disparity maps from sparse disparity measurements , 2011, 2011 International Conference on Computer Vision.

[10]  Liyi Zhang,et al.  An improved video coding scheme for depth map sequences based on compressed sensing , 2011, 2011 International Conference on Multimedia Technology.

[11]  Masayuki Tanimoto Overview of FTV (free-viewpoint television) , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[12]  C. Fehn,et al.  Interactive 3-DTV-Concepts and Key Technologies , 2006 .