Scalable depth maps with R-D optimized embedding

Recent work has highlighted the importance of incorporating geometry information into the compression of depth maps. In prior approaches however the geometry information is not resolution scalable nor amenable to embedded coding. In this paper we propose a novel compression strategy for depth maps that incorporates geometry information while achieving the goals of scalability and embedded representation. Our scheme involves two separate image pyramid structures, one for breakpoints and other for sub-band samples produced by a breakpoint-adaptive transform. Breakpoints capture geometric attributes and are amenable to scalable coding. We develop an R-D optimization framework for the breakpoint data. We also use a variation of the EBCOT scheme to produce embedded bit-streams for both the breakpoint and sub-band data, allowing them to be independently and incrementally sequenced based on R-D considerations.

[1]  Christine Guillemot,et al.  Author manuscript, published in "IEEE International Conference on Image Processing (ICIP), Brussels: Belgium (2011)" OBJECT-BASED LAYERED DEPTH IMAGES FOR IMPROVED VIRTUAL VIEW SYNTHESIS IN RATE-CONSTRAINED CONTEXT , 2011 .

[2]  Peter H. N. de With,et al.  Depth-Image Compression Based on an R-D Optimized Quadtree Decomposition for the Transmission of Multiview Images , 2007, 2007 IEEE International Conference on Image Processing.

[3]  Reji Mathew,et al.  Highly Scalable Coding of Depth Maps with Arc Breakpoints , 2012, 2012 Data Compression Conference.

[4]  Yo-Sung Ho,et al.  Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  David S. Taubman,et al.  High performance scalable image compression with EBCOT , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[6]  Hai Tao,et al.  Compression and transmission of depth maps for image-based rendering , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[7]  Charles D. Creusere,et al.  Lossless wavelet-based compression of digital elevation maps for fast and efficient search and retrieval , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Minh N. Do,et al.  Shape-adaptivewavelet encoding of depth maps , 2009, 2009 Picture Coding Symposium.

[9]  Pietro Zanuttigh,et al.  Compression of depth information for 3D rendering , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[10]  Mei Yu,et al.  View Synthesis Oriented Depth Map Coding Algorithm , 2009, 2009 Asia-Pacific Conference on Information Processing.

[11]  Simone Milani,et al.  A Depth Image Coder Based on Progressive Silhouettes , 2010, IEEE Signal Processing Letters.