Quality prediction of asymmetrically distorted stereoscopic images from single views

Objective quality assessment of distorted stereoscopic images is a challenging problem. Existing studies suggest that simply averaging the quality of the left- and right-views well predicts the quality of symmetrically distorted stereoscopic images, but generates substantial prediction bias when applied to asymmetrically distorted stereoscopic images. In this study, we first carry out a subjective test, where we find that the prediction bias could lean towards opposite directions, largely depending on the distortion types. We then develop an information-content and divisive normalization based pooling scheme that improves upon SSIM in estimating the quality of single view images. Finally, we propose a binocular rivalry inspired model to predict the quality of stereoscopic images based on that of the single view images. Our results show that the proposed model, without explicitly identifying image distortion types, successfully eliminates the prediction bias, leading to significantly improved quality prediction of stereoscopic images.

[1]  Ahmet M. Kondoz,et al.  Prediction of stereoscopic video quality using objective quality models of 2-D video , 2008 .

[2]  Zhou Wang,et al.  Spatial Pooling Strategies for Perceptual Image Quality Assessment , 2006, 2006 International Conference on Image Processing.

[3]  Yuukou Horita,et al.  Stereoscopic image quality prediction , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[4]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[5]  Patrick Le Callet,et al.  Quality Assessment of Stereoscopic Images , 2008, EURASIP J. Image Video Process..

[6]  Marcus Barkowsky,et al.  EXPLORATION OF QUALITY OF EXPERIENCE OF STEREOSCOPIC IMAGES: BINOCULAR DEPTH , 2012 .

[7]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[8]  Pjh Pieter Seuntiëns,et al.  Visual experience of 3D TV , 2006 .

[9]  Christopher Joseph Pal,et al.  Learning Conditional Random Fields for Stereo , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Alan C. Bovik,et al.  No-Reference Quality Assessment of Natural Stereopairs , 2013, IEEE Transactions on Image Processing.

[11]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[12]  Miska M. Hannuksela,et al.  Subjective quality assessment of asymmetric stereoscopic 3D video , 2015, Signal Image Video Process..

[13]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[14]  Martin J. Wainwright,et al.  Scale Mixtures of Gaussians and the Statistics of Natural Images , 1999, NIPS.

[15]  Mei Yu,et al.  Subjective quality analyses of stereoscopic images in 3DTV system , 2011, 2011 Visual Communications and Image Processing (VCIP).

[16]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[17]  Alan C. Bovik,et al.  Subjective evaluation of stereoscopic image quality , 2013, Signal Process. Image Commun..

[18]  R. Blake Threshold conditions for binocular rivalry. , 1977, Journal of experimental psychology. Human perception and performance.

[19]  Wijnand A. IJsselsteijn,et al.  Perceived quality of compressed stereoscopic images: Effects of symmetric and asymmetric JPEG coding and camera separation , 2006, TAP.

[20]  Nick Holliman,et al.  Stereoscopic image quality metrics and compression , 2008, Electronic Imaging.

[21]  Junyong You,et al.  PERCEPTUAL QUALITY ASSESSMENT FOR STEREOSCOPIC IMAGES BASED ON 2 D IMAGE QUALITY METRICS AND DISPARITY ANALYSIS , 2010 .

[22]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[23]  Yuan Zhou,et al.  Objective quality assessment method of stereo images , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[24]  Do-Kyoung Kwon,et al.  Study of subject agreement on stereoscopic video quality , 2012, 2012 IEEE Southwest Symposium on Image Analysis and Interpretation.

[25]  D V Meegan,et al.  Unequal weighting of monocular inputs in binocular combination: implications for the compression of stereoscopic imagery. , 2001, Journal of experimental psychology. Applied.

[26]  W. Levelt The alternation process in binocular rivalry , 1966 .

[27]  Gangyi Jiang,et al.  Research on subjective stereoscopic image quality assessment , 2009, Electronic Imaging.

[28]  L. Kaufman Sight and mind : an introduction to visual perception , 1974 .