Novel distortion metric for depth coding of 3D video

In state-of-the-art HEVC-based 3D video codec, multiview video plus associated depth maps are used. In order to achieve better coding performance, instead of the conventional sum of squared errors (SSE), view synthesis optimization (VSO) is proposed and included in the anchor encoder software to calculate view synthesis distortion in rate-distortion optimization (RDO) of depth coding. The anchor VSO achieves high rate-distortion (RD) performance. However, it requires partial rendering and is quite complex and time-consuming. On the other hand, simple SSE metric is fast but RD performance is low. In this paper, we propose a new distortion metric to be used in RDO for depth coding. The complexity of the proposed method is slightly higher than SSE, while its RD performance remains competitive. With a good trade-off between complexity and performance, the proposed method can replace the conventional SSE metric in RDO for depth coding, and can be used as a low-complexity alternative to the anchor VSO.

[1]  Qingming Huang,et al.  Joint video/depth rate allocation for 3D video coding based on view synthesis distortion model , 2009, Signal Process. Image Commun..

[2]  M.N. Do,et al.  Error Analysis for Image-Based Rendering With Depth Information , 2006, IEEE Transactions on Image Processing.

[3]  Keita Takahashi,et al.  Theoretical Analysis of View Interpolation With Inaccurate Depth Information , 2012, IEEE Transactions on Image Processing.

[4]  Gene Cheung,et al.  Bit allocation for multiview image compression using cubic synthesized view distortion model , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[5]  Heiko Schwarz,et al.  3D video coding using advanced prediction, depth modeling, and encoder control methods , 2012, 2012 Picture Coding Symposium.

[6]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[8]  Antonio Ortega,et al.  Depth map coding with distortion estimation of rendered view , 2010, Electronic Imaging.

[9]  Dong Tian,et al.  On modeling the rendering error in 3D video , 2012, 2012 19th IEEE International Conference on Image Processing.