Stereoscopic Image Quality Assessment by Considering Binocular Visual Mechanisms

With the booming of 3-D image processing in the entertainment industry and 3-D multimedia applications todays, the technology for assessing the quality of stereoscopic image faces more challenging tasks than its 2-D counterparts, such as binocular combination, stereo matching, and binocular rivalry. In this paper, a novel stereoscopic image quality assessment method is proposed by jointly exploring binocular fusion and rivalry models. In the quality-aware feature extraction stage, multi-scale binocular combination and binocular rivalry energy responses are first generated from reference and distorted stereopairs. In addition, considering that the changes of luminance affect the quality of stereoscopic image greatly, multi-scale visual features relating to image quality are obtained from its luminance maps as another binocular combination and rivalry features. Then, the dissimilarity of quality-aware features between the reference stereopair and its distorted version is quantified. Finally, such dissimilarities are mapped into an objective score to represent the perceptual quality of stereoscopic image through the pooling strategy of support vector regression. Experiments conducted on LIVE 3-D databases demonstrate that the proposed method achieves 96.61% and 96.03% in terms of Pearson’s linear correlation coefficient on Database Phase I and Phase II, respectively, outperforming most of the state-of-the-art methods.

[1]  Ja-Ling Wu,et al.  Quality Assessment of Stereoscopic 3D Image Compression by Binocular Integration Behaviors , 2014, IEEE Transactions on Image Processing.

[2]  Kai Li,et al.  A stereoscopic image quality assessment model based on independent component analysis and binocular fusion property , 2017, Signal Process. Image Commun..

[3]  Do-Kyoung Kwon,et al.  Full-reference quality assessment of stereopairs accounting for rivalry , 2013, Signal Process. Image Commun..

[4]  Weisi Lin,et al.  Perceptual Full-Reference Quality Assessment of Stereoscopic Images by Considering Binocular Visual Characteristics , 2013, IEEE Transactions on Image Processing.

[5]  Eric L. W. Grimson,et al.  From Images to Surfaces: A Computational Study of the Human Early Visual System , 1981 .

[6]  George Sperling,et al.  A gain-control theory of binocular combination. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Alan C. Bovik,et al.  No-Reference Quality Assessment of Natural Stereopairs , 2013, IEEE Transactions on Image Processing.

[8]  Mohamed-Chaker Larabi,et al.  A perceptual metric for stereoscopic image quality assessment based on the binocular energy , 2013, Multidimens. Syst. Signal Process..

[9]  Il Hong Suh,et al.  Robust stereo matching using adaptive random walk with restart algorithm , 2015, Image Vis. Comput..

[10]  Jiachen Yang,et al.  A perceptual stereoscopic image quality assessment model accounting for binocular combination behavior , 2015, J. Vis. Commun. Image Represent..

[11]  Ahmet M. Kondoz,et al.  Quality analysis for 3D video using 2D video quality models , 2008, IEEE Transactions on Consumer Electronics.

[12]  Alan C. Bovik,et al.  Subjective evaluation of stereoscopic image quality , 2013, Signal Process. Image Commun..

[13]  Mei Yu,et al.  Full-reference quality assessment of stereoscopic images by learning sparse monocular and binocular features , 2014, Photonics Asia.

[14]  Mei Yu,et al.  PMFS: A Perceptual Modulated Feature Similarity Metric for Stereoscopic Image Quality Assessment , 2014, IEEE Signal Processing Letters.

[15]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[16]  Qionghai Dai,et al.  Full-Reference Quality Assessment of Stereoscopic Images by Learning Binocular Receptive Field Properties , 2015, IEEE Transactions on Image Processing.

[17]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[18]  Gangyi Jiang,et al.  Modeling the Perceptual Quality of Stereoscopic Images in the Primary Visual Cortex , 2017, IEEE Access.

[19]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[20]  Yu Cao,et al.  Full-reference perceptual quality assessment for stereoscopic images based on primary visual processing mechanism , 2016, 2016 IEEE International Conference on Multimedia and Expo (ICME).

[21]  Kai Zeng,et al.  Quality prediction of asymmetrically distorted stereoscopic images from single views , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[22]  Mei Yu,et al.  Parts-based stereoscopic image assessment by learning binocular manifold color visual properties , 2016, J. Electronic Imaging.

[23]  Junyong You,et al.  PERCEPTUAL QUALITY ASSESSMENT FOR STEREOSCOPIC IMAGES BASED ON 2 D IMAGE QUALITY METRICS AND DISPARITY ANALYSIS , 2010 .

[24]  Qionghai Dai,et al.  Models of Monocular and Binocular Visual Perception in Quality Assessment of Stereoscopic Images , 2016, IEEE Transactions on Computational Imaging.

[25]  Sinan Kalkan,et al.  Deep Hierarchies in the Primate Visual Cortex: What Can We Learn for Computer Vision? , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Dennis M Levi,et al.  Binocular combination of phase and contrast explained by a gain-control and gain-enhancement model. , 2013, Journal of vision.

[27]  Mei Yu,et al.  Binocular energy response based quality assessment of stereoscopic images , 2014, Digit. Signal Process..

[28]  Dennis M Levi,et al.  Binocular combination in abnormal binocular vision. , 2013, Journal of vision.

[29]  Zhihan Lv,et al.  Quality Index for Stereoscopic Images by Jointly Evaluating Cyclopean Amplitude and Cyclopean Phase , 2017, IEEE Journal of Selected Topics in Signal Processing.

[30]  Mei Yu,et al.  Perceptual stereoscopic image quality assessment method with tensor decomposition and manifold learning , 2018, IET Image Process..

[31]  Alan Conrad Bovik,et al.  Binocular spatial activity and reverse saliency driven no-reference stereopair quality assessment , 2017, Signal Process. Image Commun..