Depth down/up-sampling using hybrid correlation for depth coding

In this paper, the spatial correlation and temporal consistency are jointly employed in depth down/up-sampling to achieve efficient depth coding. Given that the temporal consistency of the depth maps, a direct down-sampling method that the pixels at different positions are sampled between the adjacent frames is applied. After down-sampling, High Efficiency Video Coding (HEVC) is adopted to encode and decode the down-sampled depth maps for its good compression efficiency. Then, the proposed up-sampling algorithm which considers the spatial correlation among the neighbor pixels in one depth map and the temporal consistency between the adjacent depth frames, as well as the correlation between the depth map and its corresponding texture image is utilized to get a good quality depth map with full resolution. Experimental results show that the proposed algorithm improves both depth map coding performance and synthesized quality.

[1]  T. Fujii,et al.  Color based depth up-sampling for depth compression , 2010, 28th Picture Coding Symposium.

[2]  T. Fujii,et al.  Depth up-sampling for depth coding using view information , 2011, 2011 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[3]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Yo-Sung Ho,et al.  Depth Reconstruction Filter and Down/Up Sampling for Depth Coding in 3-D Video , 2009, IEEE Signal Processing Letters.

[6]  Li Yu,et al.  A Joint Texture/Depth Edge-Directed Up-sampling Algorithm for Depth Map Coding , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[7]  Ruigang Yang,et al.  Spatial-Depth Super Resolution for Range Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Aljoscha Smolic,et al.  Multi-View Video Plus Depth Representation and Coding , 2007, 2007 IEEE International Conference on Image Processing.

[9]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[10]  Dani Lischinski,et al.  Joint bilateral upsampling , 2007, SIGGRAPH 2007.