PERCEPTUAL QUALITY OF ASYMMETRICALLY DISTORTED STEREOSCOPIC IMAGES : THE ROLE OF IMAGE DISTORTION TYPES

Objective quality assessment of asymmetrically distorted stereoscopic 3D images is a challenging problem, for which direct simple combinations of the quality of the left and right views fail to produce adequate predictions. We carried out a subjective quality assessment experiment on a database that contains both single-view images and stereoscopic images with symmetric and asymmetric distortion types and levels, where the distortion types include noise contamination, blur and JPEG compression. Our results suggest that simply averaging the quality of the left and right view images well predicts the quality of symmetrically distorted 3D images, but generates substantial bias when applied to asymmetrically distorted stereoscopic images. More interestingly, we find that such bias could lean towards opposite directions, largely depending on the distortion types. We propose a computational model that accounts for the bias, leading to significantly improved quality prediction of stereoscopic images.

[1]  W. Levelt The alternation process in binocular rivalry , 1966 .

[2]  B. Julesz Foundations of Cyclopean Perception , 1971 .

[3]  J. Pokorny Foundations of Cyclopean Perception , 1972 .

[4]  L. Kaufman Sight and mind : an introduction to visual perception , 1974 .

[5]  R. Blake Threshold conditions for binocular rivalry. , 1977, Journal of experimental psychology. Human perception and performance.

[6]  D V Meegan,et al.  Unequal weighting of monocular inputs in binocular combination: implications for the compression of stereoscopic imagery. , 2001, Journal of experimental psychology. Applied.

[7]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[8]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[9]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[10]  Wijnand A. IJsselsteijn,et al.  Perceived quality of compressed stereoscopic images: Effects of symmetric and asymmetric JPEG coding and camera separation , 2006, TAP.

[11]  Pjh Pieter Seuntiëns,et al.  Visual experience of 3D TV , 2006 .

[12]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[13]  Christopher Joseph Pal,et al.  Learning Conditional Random Fields for Stereo , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Patrick Le Callet,et al.  Quality Assessment of Stereoscopic Images , 2008, EURASIP J. Image Video Process..

[15]  Ahmet M. Kondoz,et al.  Prediction of stereoscopic video quality using objective quality models of 2-D video , 2008 .

[16]  Nick Holliman,et al.  Stereoscopic image quality metrics and compression , 2008, Electronic Imaging.

[17]  Yuukou Horita,et al.  Stereoscopic image quality prediction , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[18]  Gangyi Jiang,et al.  Research on subjective stereoscopic image quality assessment , 2009, Electronic Imaging.

[19]  Yuan Zhou,et al.  Objective quality assessment method of stereo images , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[20]  Christopher Joseph Pal,et al.  On Learning Conditional Random Fields for Stereo , 2010, International Journal of Computer Vision.

[21]  Junyong You,et al.  PERCEPTUAL QUALITY ASSESSMENT FOR STEREOSCOPIC IMAGES BASED ON 2 D IMAGE QUALITY METRICS AND DISPARITY ANALYSIS , 2010 .

[22]  Mei Yu,et al.  Subjective quality analyses of stereoscopic images in 3DTV system , 2011, 2011 Visual Communications and Image Processing (VCIP).

[23]  Do-Kyoung Kwon,et al.  Study of subject agreement on stereoscopic video quality , 2012, 2012 IEEE Southwest Symposium on Image Analysis and Interpretation.

[24]  Marcus Barkowsky,et al.  EXPLORATION OF QUALITY OF EXPERIENCE OF STEREOSCOPIC IMAGES: BINOCULAR DEPTH , 2012 .

[25]  Alan C. Bovik,et al.  No-Reference Quality Assessment of Natural Stereopairs , 2013, IEEE Transactions on Image Processing.

[26]  Alan C. Bovik,et al.  Subjective evaluation of stereoscopic image quality , 2013, Signal Process. Image Commun..