Layered compression for high-precision depth data

With the development of depth data acquisition technologies, access to high-precision depth with more than 8-b depths has become much easier and determining how to efficiently represent and compress high-precision depth is essential for practical depth storage and transmission systems. In this paper, we propose a layered high-precision depth compression framework based on an 8-b image/video encoder to achieve efficient compression with low complexity. Within this framework, considering the characteristics of the high-precision depth, a depth map is partitioned into two layers: 1) the most significant bits (MSBs) layer and 2) the least significant bits (LSBs) layer. The MSBs layer provides rough depth value distribution, while the LSBs layer records the details of the depth value variation. For the MSBs layer, an error-controllable pixel domain encoding scheme is proposed to exploit the data correlation of the general depth information with sharp edges and to guarantee the data format of LSBs layer is 8 b after taking the quantization error from MSBs layer. For the LSBs layer, standard 8-b image/video codec is leveraged to perform the compression. The experimental results demonstrate that the proposed coding scheme can achieve real-time depth compression with satisfactory reconstruction quality. Moreover, the compressed depth data generated from this scheme can achieve better performance in view synthesis and gesture recognition applications compared with the conventional coding schemes because of the error control algorithm.

[1]  Shipeng Li,et al.  Layered compression for high dynamic range depth , 2012, 2012 Visual Communications and Image Processing.

[2]  Peter H. N. de With,et al.  Depth-Image Compression Based on an R-D Optimized Quadtree Decomposition for the Transmission of Multiview Images , 2007, 2007 IEEE International Conference on Image Processing.

[3]  Maryann Simmons,et al.  Subband encoding of high dynamic range imagery , 2004, APGV '04.

[4]  Zhengyou Zhang,et al.  Low-complexity, near-lossless coding of depth maps from kinect-like depth cameras , 2011, 2011 IEEE 13th International Workshop on Multimedia Signal Processing.

[5]  Antonio Ortega,et al.  Edge-preserving depth-map coding using graph-based wavelets , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[6]  Vladan Velisavljevic,et al.  Multiview Image Coding Using Depth Layers and an Optimized Bit Allocation , 2012, IEEE Transactions on Image Processing.

[7]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.

[8]  Greg Ward II.5 – REAL PIXELS , 1991 .

[9]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Harry Shum,et al.  A real-time image-based rendering and compression system with Kinect depth camera , 2014, 2014 19th International Conference on Digital Signal Processing.

[11]  Erika Muller,et al.  Evaluation of motion compensation and coding strategies for compression of depth map sequences , 2004, SPIE Optics + Photonics.

[12]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[13]  Kourosh Khoshelham,et al.  Accuracy analysis of kinect depth data , 2012 .

[14]  Takeo Kanade,et al.  A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  S. Burak Gokturk,et al.  A Time-Of-Flight Depth Sensor - System Description, Issues and Solutions , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[16]  Gregory Ward Larson,et al.  LogLuv Encoding for Full-Gamut, High-Dynamic Range Images , 1998, J. Graphics, GPU, & Game Tools.

[17]  Minh N. Do,et al.  Depth and depth-color coding using shape-adaptive wavelets , 2010, J. Vis. Commun. Image Represent..

[18]  Tihao Chiang,et al.  A new rate control scheme using quadratic rate distortion model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[19]  Jaejoon Lee,et al.  Edge-adaptive transforms for efficient depth map coding , 2010, 28th Picture Coding Symposium.

[20]  R. Gray,et al.  Vector quantization , 1984, IEEE ASSP Magazine.

[21]  Xiaolin Wu,et al.  Color quantization by dynamic programming and principal analysis , 1992, TOGS.

[22]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[23]  Simone Milani,et al.  A Depth Image Coder Based on Progressive Silhouettes , 2010, IEEE Signal Processing Letters.

[24]  Rabab Kreidieh Ward,et al.  Visually Favorable Tone-Mapping With High Compression Performance in Bit-Depth Scalable Video Coding , 2010, IEEE Transactions on Multimedia.

[25]  Shipeng Li,et al.  Kinect-Like Depth Data Compression , 2013, IEEE Transactions on Multimedia.

[26]  Seung-Won Jung A bilateral hole filling algorithm for time-of-flight depth camera , 2013, Electronic Imaging.