Depth Map Down-Sampling and Coding Based on Synthesized View Distortion

In this paper, we propose a depth map down-sampling and coding scheme that minimizes the view synthesis distortion. Moreover, a solution for the optimal depth map down-sampling problem that minimizes the depth-caused distortion in the virtual view by exploiting the depth map and the associated texture information along with the up-sampling method to be used in the decoder side is derived. Furthermore, to enhance compression performance, the synthesized view distortion, which is evaluated by emulating the interpolation and the virtual view synthesis process, is used in the optimization objective function for coding mode selection in the video encoder. Experimental results show that both the proposed depth map down-sampling and encoding methods lead to good performance, and the average bit rate reduction is 2.62% compared with 3D-AVC.

[1]  A.M. Kondoz,et al.  Bit-Rate Adaptive Downsampling for the Coding of Multi-View Video with Depth Information , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[2]  Jaejoon Lee,et al.  Depth Map Coding Based on Synthesized View Distortion Function , 2011, IEEE Journal of Selected Topics in Signal Processing.

[3]  T. Fujii,et al.  Color based depth up-sampling for depth compression , 2010, 28th Picture Coding Symposium.

[4]  Antonio Ortega,et al.  Depth map distortion analysis for view rendering and depth coding , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[5]  Michael Elad,et al.  Down-Scaling for Better Transform Compression , 2001, Scale-Space.

[6]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[7]  Shipeng Li,et al.  Kinect-Like Depth Data Compression , 2013, IEEE Transactions on Multimedia.

[8]  Wen Gao,et al.  Low Complexity Adaptive View Synthesis Optimization in HEVC Based 3D Video Coding , 2014, IEEE Transactions on Multimedia.

[9]  Wei Xiang,et al.  Rate-Distortion Optimized Mode Switching for Error-Resilient Multi-View Video Plus Depth Based 3-D Video Coding , 2014, IEEE Transactions on Multimedia.

[10]  Bruno Macchiavello,et al.  Loss-Resilient Coding of Texture and Depth for Free-Viewpoint Video Conferencing , 2013, IEEE Transactions on Multimedia.

[11]  Byung Tae Oh,et al.  View Synthesis Distortion Estimation for AVC- and HEVC-Compatible 3-D Video Coding , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Dong Tian,et al.  Joint trilateral filtering for depth map compression , 2010, Visual Communications and Image Processing.

[13]  A. Gotchev,et al.  Quality assessment of 3D video in rate allocation experiments , 2008, 2008 IEEE International Symposium on Consumer Electronics.

[14]  Ken Chen,et al.  Asymmetric Coding of Multi-View Video Plus Depth Based 3-D Video for View Rendering , 2012, IEEE Transactions on Multimedia.

[15]  Yo-Sung Ho,et al.  Depth Reconstruction Filter and Down/Up Sampling for Depth Coding in 3-D Video , 2009, IEEE Signal Processing Letters.

[16]  Yue Gao,et al.  Cross-View Down/Up-Sampling Method for Multiview Depth Video Coding , 2012, IEEE Signal Processing Letters.

[17]  Wen Gao,et al.  Interpolation-Dependent Image Downsampling , 2011, IEEE Transactions on Image Processing.

[18]  Miska M. Hannuksela,et al.  Nonlinear Depth Map Resampling for Depth-Enhanced 3-D Video Coding , 2013, IEEE Signal Processing Letters.

[19]  Aljoscha Smolic,et al.  3DAV exploration of video-based rendering technology in MPEG , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Zixiang Xiong,et al.  Edge-preserving interpolation for down/up sampling-based depth compression , 2012, 2012 19th IEEE International Conference on Image Processing.