Adaptive sparse representation of depth maps targeting view synthesis quality

Completely embedded in the 3D era, depth maps coding becomes a must in order to favor 3D admission to different fields of application, ranging from video games to medical imaging. This paper presents a novel depth coding approach that decomposes a decimated version of the original depth image on a sparse set of coefficients and mixed discrete cosine and B-splines atoms. The upstream decimation step reduces encoding bitrate without significant loss of virtual views quality. Depth decomposition is performed through minimization of an adaptive Rate/Distortion cost function, where we manipulate its weight parameter according to depth discontinuities. We then refine the choice of distortion metric in order to quantify the effect of depth maps coding on rendered views quality. Experiments show the relevance of the proposed method, able to obtain considerable tradeoffs between bitrate and synthesized views distortion.

[1]  Laura Rebollo-Neira,et al.  Cardinal B-spline dictionaries on a compact interval , 2005 .

[2]  Antonio Ortega,et al.  Depth map distortion analysis for view rendering and depth coding , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[3]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[4]  Antonio Ortega,et al.  Sparse representation of depth maps for efficient transform coding , 2010, 28th Picture Coding Symposium.

[5]  Tapio Saramäki,et al.  Edge-preserving image resizing using modified B-splines , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[6]  Minh N. Do,et al.  Depth and depth-color coding using shape-adaptive wavelets , 2010, J. Vis. Commun. Image Represent..

[7]  Francesco Palmieri,et al.  A Comparison of Signal Compression Methods by Sparse Solution of Linear Systems , 2002, WIRN.

[8]  Antonio Ortega,et al.  Transform domain sparsification of depth maps using iterative quadratic programming , 2011, 2011 18th IEEE International Conference on Image Processing.

[9]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[10]  Bruno A. Olshausen,et al.  Learning Sparse Representations of Depth , 2010, IEEE Journal of Selected Topics in Signal Processing.

[11]  Antonio Ortega,et al.  Improving view rendering quality and coding efficiency by suppressing compression artifacts in depth-image coding , 2009, Electronic Imaging.

[12]  Luce Morin,et al.  Focus on visual rendering quality through content-based depth map coding , 2010, 28th Picture Coding Symposium.

[13]  Aljoscha Smolic,et al.  The effects of multiview depth video compression on multiview rendering , 2009, Signal Process. Image Commun..

[14]  Mohamed-Jalal Fadili,et al.  Sparsity and Morphological Diversity in Blind Source Separation , 2007, IEEE Transactions on Image Processing.

[15]  Wei Hu,et al.  Image inpainting via sparse representation , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[16]  Aljoscha Smolic,et al.  Multi-View Video Plus Depth Representation and Coding , 2007, 2007 IEEE International Conference on Image Processing.

[17]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).