Asymmetric coding using Binocular Just Noticeable Difference and depth information for stereoscopic 3D

The problem of determining the best level of asymmetry has been addressed by several recent works with the aim to guarantee an optimal binocular perception while keeping the minimum required information. To do so, subjective experiments have been conducted for the definition of an appropriate threshold. However, such an approach is lacking in terms of generalization because of the content variability. Moreover, using a fixed threshold does not allow an adaptation to the content and to the images' quality. The traditional asymmetric stereoscopic coding methods apply a uniform asymmetry by considering that all regions of an image have the same perceptual relevance which is not in compliance with the characteristics of human visual system (HVS). Consequently, this paper describes a fully automated model that dynamically determines the best bounds of asymmetry for each region of the image. Based on the Binocular Just Noticeable Difference (BJND) and the depth level in the scene, the proposed method achieves non-uniform reduction of spatial resolution of one view of the stereo pair with the aim to reduce bandwidth requirement. Experimental results show that the proposed method results in up to 43% of bitrate saving while outperforming the widely used asymmetric coding approaches in terms of 3D visual quality.

[1]  Thomas Wiegand,et al.  Mixed resolution coding with inter view prediction for mobile 3DTV , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[2]  Zhenzhong Chen,et al.  Binocular Just-Noticeable-Difference Model for Stereoscopic Images , 2011, IEEE Signal Processing Letters.

[3]  B. Julesz Foundations of Cyclopean Perception , 1971 .

[4]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[5]  Truong Q. Nguyen,et al.  Comparing Perceived Quality and Fatigue for Two Methods of Mixed Resolution Stereoscopic Coding , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Wa James Tam,et al.  Stereoscopic image coding: Effect of disparate image-quality in left- and right-eye views , 1998, Signal Process. Image Commun..

[7]  Lina J. Karam,et al.  Increased depth perception with sharpness enhancement for stereo video , 2010, Electronic Imaging.

[8]  Ken Chen,et al.  Stereoscopic video coding with asymmetric luminance and chrominance qualities , 2010, IEEE Transactions on Consumer Electronics.

[9]  HOMAS,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H . 264 / MPEG-4 AVC Standard , 2022 .

[10]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[11]  Weisi Lin,et al.  Perceptual Full-Reference Quality Assessment of Stereoscopic Images by Considering Binocular Visual Characteristics , 2013, IEEE Transactions on Image Processing.

[12]  Andreas Klaus,et al.  Segment-Based Stereo Matching Using Belief Propagation and a Self-Adapting Dissimilarity Measure , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[13]  Namho Hur,et al.  Asymmetric Coding of Stereoscopic Video for Transmission Over T-DMB , 2007, 2007 3DTV Conference.

[14]  Miska M. Hannuksela,et al.  Subjective study on compressed asymmetric stereoscopic video , 2010, 2010 IEEE International Conference on Image Processing.

[15]  Miska M. Hannuksela,et al.  Impact of downsampling ratio in mixed-resolution stereoscopic video , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[16]  Ying Chen,et al.  Low-complexity asymmetric multiview video coding , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[17]  Tao Chen,et al.  3D-TV Content Storage and Transmission , 2011, IEEE Transactions on Broadcasting.

[18]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[19]  Ankit K. Jain,et al.  Apparent sharpness of 3D video when one eye's view is more blurry , 2013, i-Perception.

[20]  Ahmet M. Kondoz,et al.  Psycho-physical limits of interocular blur suppression and its application to asymmetric stereoscopic video delivery , 2012, 2012 19th International Packet Video Workshop (PV).

[21]  André Vincent,et al.  Stereo image quality: effects of mixed spatio-temporal resolution , 2000, IEEE Trans. Circuits Syst. Video Technol..

[22]  Aljoscha Smolic,et al.  An overview of available and emerging 3D video formats and depth enhanced stereo as efficient generic solution , 2009, 2009 Picture Coding Symposium.

[23]  Michael G. Perkins,et al.  Data compression of stereopairs , 1992, IEEE Trans. Commun..

[24]  A. Murat Tekalp,et al.  Temporal and spatial scaling for stereoscopic video compression , 2006, 2006 14th European Signal Processing Conference.

[25]  A. Murat Tekalp,et al.  Evaluation of Asymmetric Stereo Video Coding and Rate Scaling for Adaptive 3D Video Streaming , 2011, IEEE Transactions on Broadcasting.