A scalable depth coding with arc breakpoints based synthesis in 3-D video

Depth map represents three-dimensional information and is used for depth image-based rendering to support 3-D video applications. Conventional video coding standards may cause serious coding artifacts along the depth discontinuities, which ultimately affect the synthesized view quality. This paper proposes an efficient technique to compress the depth map by encoding a reduced resolution of depth map and using special upsampling method to reconstruct the original depth map. Unlike previous upsampling schemes with the guidance of corresponding color video, the proposed method upsamples the depth map using the breakpoints which are generated at the decoder side with only a few breakpoints. Instead of the edge representation of the depth map, the breakpoints would substantially take less bits and low errors with the regularity of the contour. Experimental results show that the proposed technique significantly reduces bit rate while achieving a better quality of the synthesized view in terms of subjective and objective measures.

[1]  Berthold K. P. Horn The Curve of Least Energy , 1983, TOMS.

[2]  Aljoscha Smolic,et al.  The effects of multiview depth video compression on multiview rendering , 2009, Signal Process. Image Commun..

[3]  Reji Mathew,et al.  Highly Scalable Coding of Depth Maps with Arc Breakpoints , 2012, 2012 Data Compression Conference.

[4]  Minh N. Do,et al.  Depth and depth-color coding using shape-adaptive wavelets , 2010, J. Vis. Commun. Image Represent..

[5]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[6]  Minh N. Do,et al.  Efficient Techniques for Depth Video Compression Using Weighted Mode Filtering , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Ohad Ben-Shahar,et al.  A Tangent Bundle Theory for Visual Curve Completion , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Peter H. N. de With,et al.  Platelet-based coding of depth maps for the transmission of multiview images , 2006, Electronic Imaging.

[9]  Erhan Ekmekcioglu,et al.  Edge and motion-adaptive median filtering for multi-view depth map enhancement , 2009, 2009 Picture Coding Symposium.

[10]  S. Ullman,et al.  Filling-in the gaps: The shape of subjective contours and a model for their generation , 1976, Biological Cybernetics.

[11]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[12]  Yo-Sung Ho,et al.  Depth Reconstruction Filter and Down/Up Sampling for Depth Coding in 3-D Video , 2009, IEEE Signal Processing Letters.

[13]  Thomas Wiegand,et al.  3-D Video Representation Using Depth Maps , 2011, Proceedings of the IEEE.

[14]  Detlev Marpe,et al.  3D video: Depth coding based on inter-component prediction of block partitions , 2012, 2012 Picture Coding Symposium.