View synthesis optimization based on texture smoothness for 3D-HEVC

This paper presents view synthesis optimization for 3D-HEVC based on a new texture smoothness process. In the original method, all pixels are exhaustively rendered to get distortions from synthesized views. Since not all pixels from the distorted depth map may cause distortions in the synthesized view, it brings unnecessary coding complexity. In this paper, lines of pixels are skipped based on the analysis of pixel regularity from smooth texture regions. It is due to the fact that the distorted disparity may not have much effect on the synthesized view in smooth texture regions. The proposed method can reduce the coding complexity of view synthesis optimization without significant performance loss.

[1]  Yan Zhang,et al.  Efficient rendering distortion estimation for depth map compression , 2011, 2011 18th IEEE International Conference on Image Processing.

[2]  Wen Gao,et al.  Zero-synthesis view difference aware view synthesis optimization for HEVC based 3D video compression , 2012, 2012 Visual Communications and Image Processing.

[3]  Wen Gao,et al.  Low Complexity Adaptive View Synthesis Optimization in HEVC Based 3D Video Coding , 2014, IEEE Transactions on Multimedia.

[4]  Oscar C. Au,et al.  Novel distortion metric for depth coding of 3D video , 2013, 2013 IEEE International Conference on Image Processing.

[5]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Heiko Schwarz,et al.  3D High-Efficiency Video Coding for Multi-View Video and Depth Data , 2013, IEEE Transactions on Image Processing.

[7]  Panos Nasiopoulos,et al.  A low complexity mode decision approach for HEVC-based 3D video coding using a Bayesian method , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Byung Tae Oh,et al.  View Synthesis Distortion Estimation for AVC- and HEVC-Compatible 3-D Video Coding , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Jaejoon Lee,et al.  Depth Map Coding Based on Synthesized View Distortion Function , 2011, IEEE Journal of Selected Topics in Signal Processing.

[10]  Aljoscha Smolic,et al.  Intermediate view interpolation based on multiview video plus depth for advanced 3D video systems , 2008, 2008 15th IEEE International Conference on Image Processing.

[11]  Heiko Schwarz,et al.  3D video coding using the synthesized view distortion change , 2012, 2012 Picture Coding Symposium.

[12]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[13]  Toshiaki Fujii,et al.  Synthesis Error COmpeNsateD Multiview Video plus Depth for representation of multiview video , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).