Parameter-free view synthesis distortion model with application to depth video coding

Depth coding in 3D video is unique in that its quality is measured by the view synthesis distortion (VSD) rather than its own depth distortion, which further complicates the coding optimization as VSD is related to both the depth and texture quality. We propose a parameter-free VSD model to directly estimate the impact of depth errors on VSD on the small block basis, given its depth distortion. The proposed model is incorporated into rate-distortion optimization of depth coding, by adapting the Lagrange multiplier and optimizing the selection of quantization parameters. Simulation results show that our proposed scheme improves the BDPSNR and BDBR by 0.6dB PSNR and 20% bits saving on average compared with H.264 coding standard in depth coding, while keeping the implementation easy.

[1]  David S. Taubman,et al.  Highly scalable video compression with scalable motion coding , 2003, ICIP.

[2]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[3]  Masayuki Tanimoto,et al.  3D-TV System with Depth-Image-Based Rendering , 2012 .

[4]  R. Stevenson,et al.  DCT quantization noise in compressed images , 2005 .

[5]  Antonio Ortega,et al.  Depth map distortion analysis for view rendering and depth coding , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[6]  Joseph W. Goodman,et al.  A mathematical analysis of the DCT coefficient distributions for images , 2000, IEEE Trans. Image Process..

[7]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[8]  张云 Regional bit allocation and rate distortion optimization for multiview depth video coding with View synthesis distortion model , 2013 .

[9]  Qiang Peng,et al.  Source Distortion Temporal Propagation Model for Motion Compensated Video Coding Optimization , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[10]  Thomas Wiegand,et al.  3-D Video Representation Using Depth Maps , 2011, Proceedings of the IEEE.

[11]  Shuai Wan,et al.  Rate-Distortion Optimization for Video Coding under Given Computational Complexity , 2017, 2017 Data Compression Conference (DCC).

[12]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[13]  Ju Liu,et al.  A Novel Distortion Model and Lagrangian Multiplier for Depth Maps Coding , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Lu Fang,et al.  An Analytical Model for Synthesis Distortion Estimation in 3D Video , 2014, IEEE Transactions on Image Processing.