Quality enhancement of quality-asymmetric multiview plus depth video by using virtual view

Currently, multiview video plus depth format is one of the most popular 3D data representations which enables to generate any required intermediate view in a certain range. However, in terms of encoding and decoding complexity and transmission bandwidth, it requires much more than the conventional 2D video or stereo video. Based on the binocular suppression theory, quality-asymmetric video in multiview system can alleviate this problem by using different coding qualities for different views. However, in order to reduce visual uncomfortableness and to make this video format more suitable for free-viewpoint television, the low quality views have to be improved to match the high quality ones. Hence, in this work we propose to enhance the low quality views in quality-asymmetric multiview video plus depth system by exploiting inter-view correlation to compensate compression distortion. The experimental results demonstrate the effectiveness of the proposed approach with an enhanced PSNR gain for the LQ view of up to 2.48dB and for the enhanced asymmetric coding quality over the symmetric coding quality of up to 1.21dB.

[1]  Namho Hur,et al.  Asymmetric Coding of Stereoscopic Video for Transmission Over T-DMB , 2007, 2007 3DTV Conference.

[2]  A. Murat Tekalp,et al.  Quality assessment of asymmetric stereo video coding , 2010, 2010 IEEE International Conference on Image Processing.

[3]  Miska M. Hannuksela,et al.  Subjective quality assessment of asymmetric stereoscopic 3D video , 2015, Signal Image Video Process..

[4]  Mei Yu,et al.  Asymmetric multi-view video coding based on chrominance reconstruction , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[5]  A. Murat Tekalp,et al.  Evaluation of Asymmetric Stereo Video Coding and Rate Scaling for Adaptive 3D Video Streaming , 2011, IEEE Transactions on Broadcasting.

[6]  Ken Chen,et al.  Asymmetric Coding of Multi-View Video Plus Depth Based 3-D Video for View Rendering , 2012, IEEE Transactions on Multimedia.

[7]  Ying Chen,et al.  Low-complexity asymmetric multiview video coding , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[8]  Miska M. Hannuksela,et al.  Subjective study on compressed asymmetric stereoscopic video , 2010, 2010 IEEE International Conference on Image Processing.

[9]  R. Blake Threshold conditions for binocular rivalry. , 1977, Journal of experimental psychology. Human perception and performance.

[10]  Markus Flierl,et al.  Motion and Disparity Compensated Coding for Multiview Video , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.