Weighted ensemble learning prediction for blind symmetrically distorted stereoscopic images

In recent years, deep learning has been largely applied to 2D image quality assessment (2D-IQA) but rarely to 3D image quality assessment (3D-IQA). In this paper, a new method for blind symmetrically distorted stereoscopic images quality assessment is proposed to utilize multiple features fusion in deep network to assess the left view and right view as an integration with no extra cost. According to binocular rivalry, a weighted ensemble learning network is developed for learning energy of dominant eye. We integrate these two networks into a full end-to-end network called a Weighted Ensemble Deep Quality Network (WEDQN). Our experimental results can demonstrate that the proposed method leads to significant improved quality prediction of symmetrically distorted stereoscopic images.

[1]  Do-Kyoung Kwon,et al.  Full-reference quality assessment of stereopairs accounting for rivalry , 2013, Signal Process. Image Commun..

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Lei Zhang,et al.  Blind Image Quality Assessment Using Joint Statistics of Gradient Magnitude and Laplacian Features , 2014, IEEE Transactions on Image Processing.

[4]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[5]  Yong Man Ro,et al.  Critical Binocular Asymmetry Measure for the Perceptual Quality Assessment of Synthesized Stereo 3D Images in View Synthesis , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[7]  David S. Doermann,et al.  Unsupervised feature learning framework for no-reference image quality assessment , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Paolo Napoletano,et al.  On the use of deep learning for blind image quality assessment , 2016, Signal Image Video Process..

[9]  Ahmet M. Kondoz,et al.  Toward an Impairment Metric for Stereoscopic Video: A Full-Reference Video Quality Metric to Assess Compressed Stereoscopic Video , 2013, IEEE Transactions on Image Processing.

[10]  Lei Zhang,et al.  Learning without Human Scores for Blind Image Quality Assessment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Alan C. Bovik,et al.  No-Reference Quality Assessment of Natural Stereopairs , 2013, IEEE Transactions on Image Processing.

[12]  Damon M. Chandler,et al.  3D-MAD: A Full Reference Stereoscopic Image Quality Estimator Based on Binocular Lightness and Contrast Perception , 2015, IEEE Transactions on Image Processing.

[13]  Wenjun Zhang,et al.  No-Reference Stereoscopic IQA Approach: From Nonlinear Effect to Parallax Compensation , 2012, J. Electr. Comput. Eng..

[14]  Alan C. Bovik,et al.  Oriented Correlation Models of Distorted Natural Images With Application to Natural Stereopair Quality Evaluation , 2015, IEEE Transactions on Image Processing.

[15]  Qionghai Dai,et al.  Learning Receptive Fields and Quality Lookups for Blind Quality Assessment of Stereoscopic Images , 2016, IEEE Transactions on Cybernetics.

[16]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.