Edge-aware intra prediction for depth-map coding

This work proposes a new intra prediction coding scheme for depth map images used in view interpolation. The main goal is to design a prediction scheme which can reduce the prediction error energy in blocks with arbitrary edge shapes. This will reduce the rate needed to encode such blocks while also eliminating some of the annoying artifacts caused by quantization. Since depth maps typically consist of smooth regions separated by edges, we find it sufficient to design prediction schemes which can make effective use of edge information. Working from the intra prediction framework in H.264, we provide a graph representation of pixels in a block and pixels from previously coded blocks and construct an edge-aware prediction scheme based on this. We also employ existing rate-distortion (RD) optimization methods to further improve the coding performance. Our proposed methods reduce the bit rate for depth maps by up to 29% for a fixed interpolated PSNR for some sequences.

[1]  Antonio Ortega,et al.  Edge-preserving depth-map coding using graph-based wavelets , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[2]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[3]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[4]  Antonio Ortega,et al.  Depth map coding with distortion estimation of rendered view , 2010, Electronic Imaging.

[5]  Minh N. Do,et al.  Shape-adaptivewavelet encoding of depth maps , 2009, 2009 Picture Coding Symposium.

[6]  Antonio Ortega,et al.  Depth map distortion analysis for view rendering and depth coding , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[7]  Antonio Ortega,et al.  Improving view rendering quality and coding efficiency by suppressing compression artifacts in depth-image coding , 2009, Electronic Imaging.

[8]  Robert D. Nowak,et al.  Platelets: a multiscale approach for recovering edges and surfaces in photon-limited medical imaging , 2003, IEEE Transactions on Medical Imaging.

[9]  Aljoscha Smolic,et al.  Coding Algorithms for 3DTV—A Survey , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Peter H. N. de With,et al.  Platelet-based coding of depth maps for the transmission of multiview images , 2006, Electronic Imaging.

[11]  Toshiaki Fujii,et al.  Multiview Video Coding Using View Interpolation and Color Correction , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Gabriel Valiente,et al.  Algorithms on Trees and Graphs , 2002, Springer Berlin Heidelberg.