No-Reference Stereoscopic Image Quality Assessment by Both Complex Contourlet Domain with Spatial Domain Features

Stereoscopic image quality assessment (SIQA) is an essential and tricky part of image processing. Recently, many scholars have conducted image quality assessment in either spatial or frequency domain respectively. In this paper, we propose a no-reference stereoscopic image quality evaluation method by considering both complex contourlet and spatial features. Firstly, the original views are converted to the Lab color space. Then the luminance channel of Lab color space and the synthetic cyclopean image are calculated from the original stereo pairs. Next, the perceptual features of these types of images are extracted in the complex contour domain and the spatial domain respectively. Finally, all pre-extracted features are sent to the regression model for training and predicting image quality scores. Our experimental results show that the proposed algorithm achieves high consistency with human subjective perception, and compete with state-of-the-art algorithms.

[1]  Alan C. Bovik,et al.  Visual Quality Assessment of Stereoscopic Image and Video: Challenges, Advances, and Future Trends , 2015 .

[2]  Kai Li,et al.  No-reference stereo image quality assessment by learning gradient dictionary-based color visual characteristics , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[3]  Sumohana S. Channappayya,et al.  Full-Reference Stereo Image Quality Assessment Using Natural Stereo Scene Statistics , 2015, IEEE Signal Processing Letters.

[4]  Bin Jiang,et al.  Predicting Stereoscopic Image Quality via Stacked Auto-Encoders Based on Stereopsis Formation , 2019, IEEE Transactions on Multimedia.

[5]  Kai Li,et al.  Reduced-Reference Stereoscopic Image Quality Assessment Using Natural Scene Statistics and Structural Degradation , 2018, IEEE Access.

[6]  Mei Yu,et al.  Perceptual stereoscopic image quality assessment method with tensor decomposition and manifold learning , 2018, IET Image Process..

[7]  Alan Conrad Bovik,et al.  Binocular spatial activity and reverse saliency driven no-reference stereopair quality assessment , 2017, Signal Process. Image Commun..

[8]  Wen Gao,et al.  Reduced Reference Stereoscopic Image Quality Assessment Based on Binocular Perceptual Information , 2015, IEEE Transactions on Multimedia.

[9]  Roushain Akhter,et al.  No-reference stereoscopic image quality assessment , 2010, Electronic Imaging.

[10]  Yuming Fang,et al.  No reference quality assessment for stereoscopic images by statistical features , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[11]  Alan C. Bovik,et al.  Subjective evaluation of stereoscopic image quality , 2013, Signal Process. Image Commun..

[12]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[13]  Lin Ma,et al.  Learning structure of stereoscopic image for no-reference quality assessment with convolutional neural network , 2016, Pattern Recognit..

[14]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[15]  Xu Han,et al.  Cyclopean Image Based Stereoscopic Image Quality Assessment by Using Sparse Representation , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[16]  Andrey S. Krylov,et al.  No-Reference Stereoscopic Image Quality Assessment Using Convolutional Neural Network for Adaptive Feature Extraction , 2018, IEEE Access.

[17]  Sumohana S. Channappayya,et al.  No- Reference Stereoscopic Image Quality Assessment , 2015 .

[18]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[19]  Ahmet M. Kondoz,et al.  Quality analysis for 3D video using 2D video quality models , 2008, IEEE Transactions on Consumer Electronics.

[20]  Bin Jiang,et al.  Sparse representation based stereoscopic image quality assessment accounting for perceptual cognitive process , 2018, Inf. Sci..

[21]  Baihua Li,et al.  A Blind Stereoscopic Image Quality Evaluator With Segmented Stacked Autoencoders Considering the Whole Visual Perception Route , 2019, IEEE Transactions on Image Processing.

[22]  Do-Kyoung Kwon,et al.  Full-reference quality assessment of stereopairs accounting for rivalry , 2013, Signal Process. Image Commun..

[23]  Liquan Shen,et al.  No-Reference Stereoscopic Image Quality Assessment Based on Image Distortion and Stereo Perceptual Information , 2019, IEEE Transactions on Emerging Topics in Computational Intelligence.

[24]  Min Gao,et al.  No-Reference Stereoscopic Image Quality Assessment Based on Visual Attention and Perception , 2019, IEEE Access.

[25]  Kai Zeng,et al.  Quality Prediction of Asymmetrically Distorted Stereoscopic 3D Images , 2015, IEEE Transactions on Image Processing.

[26]  Kai Li,et al.  SSIM-based binocular perceptual model for quality assessment of stereoscopic images , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[27]  Qionghai Dai,et al.  Full-Reference Quality Assessment of Stereoscopic Images by Learning Binocular Receptive Field Properties , 2015, IEEE Transactions on Image Processing.