Asymmetric coding of stereoscopic 3D based on perceptual significance

Asymmetric stereoscopic coding is a very promising technique to decrease the bandwidth required for stereoscopic 3D delivery. However, one large obstacle is linked to the limit of asymmetric coding or the just noticeable threshold of asymmetry, so that 3D viewing experience is not altered. By way of subjective experiments, recent works have attempted to identify this asymmetry threshold. However, fixed threshold, highly dependent on the experiment design, do not allow to adapt to quality and content variation of the image. In this paper, we propose a new non-uniform asymmetric stereoscopic coding adjusting in a dynamic manner the level of asymmetry for each image region to ensure unaltered binocular perception. This is achieved by exploiting several HVS-inspired models; specifically we used the Binocular Just Noticeable Difference (BJND) combined with visual saliency map and depth information to quantify precisely the asymmetry threshold. Simulation results show that the proposed method results in up to 44% of bitrate saving and provides better 3D visual quality compared to state-of-the-art asymmetric coding methods.

[1]  Zhenzhong Chen,et al.  Binocular Just-Noticeable-Difference Model for Stereoscopic Images , 2011, IEEE Signal Processing Letters.

[2]  Ankit K. Jain,et al.  Apparent sharpness of 3D video when one eye's view is more blurry , 2013, i-Perception.

[3]  B. Julesz Foundations of Cyclopean Perception , 1971 .

[4]  A. Murat Tekalp,et al.  Evaluation of Asymmetric Stereo Video Coding and Rate Scaling for Adaptive 3D Video Streaming , 2011, IEEE Transactions on Broadcasting.

[5]  Thomas Wiegand,et al.  Mixed resolution coding with inter view prediction for mobile 3DTV , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[6]  Miska M. Hannuksela,et al.  Subjective study on compressed asymmetric stereoscopic video , 2010, 2010 IEEE International Conference on Image Processing.

[7]  Weisi Lin,et al.  Perceptual Full-Reference Quality Assessment of Stereoscopic Images by Considering Binocular Visual Characteristics , 2013, IEEE Transactions on Image Processing.

[8]  André Vincent,et al.  Stereo image quality: effects of mixed spatio-temporal resolution , 2000, IEEE Trans. Circuits Syst. Video Technol..

[9]  D V Meegan,et al.  Unequal weighting of monocular inputs in binocular combination: implications for the compression of stereoscopic imagery. , 2001, Journal of experimental psychology. Applied.

[10]  Ken Chen,et al.  Stereoscopic video coding with asymmetric luminance and chrominance qualities , 2010, IEEE Transactions on Consumer Electronics.

[11]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[12]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[13]  Azeddine Beghdadi,et al.  A survey of perceptual image processing methods , 2013, Signal Process. Image Commun..

[14]  Qingxiong Yang,et al.  Recursive Bilateral Filtering , 2012, ECCV.

[15]  Ahmet M. Kondoz,et al.  Psycho-physical limits of interocular blur suppression and its application to asymmetric stereoscopic video delivery , 2012, 2012 19th International Packet Video Workshop (PV).

[16]  Andreas Klaus,et al.  Segment-Based Stereo Matching Using Belief Propagation and a Self-Adapting Dissimilarity Measure , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[17]  Truong Q. Nguyen,et al.  Comparing Perceived Quality and Fatigue for Two Methods of Mixed Resolution Stereoscopic Coding , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Namho Hur,et al.  Asymmetric Coding of Stereoscopic Video for Transmission Over T-DMB , 2007, 2007 3DTV Conference.

[19]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[20]  Miska M. Hannuksela,et al.  Impact of downsampling ratio in mixed-resolution stereoscopic video , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[21]  Ying Chen,et al.  Low-complexity asymmetric multiview video coding , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[22]  Frédo Durand,et al.  A Benchmark of Computational Models of Saliency to Predict Human Fixations , 2012 .

[23]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[24]  Michael G. Perkins,et al.  Data compression of stereopairs , 1992, IEEE Trans. Commun..

[25]  A. Murat Tekalp,et al.  Temporal and spatial scaling for stereoscopic video compression , 2006, 2006 14th European Signal Processing Conference.

[26]  Wa James Tam,et al.  Stereoscopic image coding: Effect of disparate image-quality in left- and right-eye views , 1998, Signal Process. Image Commun..

[27]  Lina J. Karam,et al.  Increased depth perception with sharpness enhancement for stereo video , 2010, Electronic Imaging.