No-reference Distorted Image Quality Assessment Based on Deep Learning

In this paper, a new no-reference Image Quality Assessment (IQA) algorithm for distorted image using deep learning network is proposed. The algorithm is composed of three steps. First, a multi-layer convolutional neural network is designed, which consists of four convolutional layers, four pooling layers and three fully connected layers. Second the original distortion image database is used to train the network. In order to solve the problem of insufficient training samples, this paper proposes an image segmentation method to segment the image expansion data set. Third, the trained network is used to predict the distorted image quality score. And it is not necessary to manually extract image features, it makes full use of the deep convolutional network learning ability. Experimental results on four open distorted image databases show that the proposed method predicted distorted image quality scores results have high consistency with the subjective assessment results. This method overall performance is better than other classic image quality assessment method.

[1]  Wenjun Zhang,et al.  Subjective and objective quality assessment for images with contrast change , 2013, 2013 IEEE International Conference on Image Processing.

[2]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[3]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[4]  Decebal Constantin DEEP LEARNING FOR OBJECTIVE QUALITY ASSESSMENT OF 3D IMAGES , 2014 .

[5]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[6]  David S. Doermann,et al.  Unsupervised feature learning framework for no-reference image quality assessment , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Xuelong Li,et al.  Blind Image Quality Assessment via Deep Learning , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Decebal Constantin Mocanu,et al.  Deep learning for objective quality assessment of 3D images , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[9]  Yi Li,et al.  Convolutional Neural Networks for No-Reference Image Quality Assessment , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Xuelong Li,et al.  Universal Blind Image Quality Assessment Metrics Via Natural Scene Statistics and Multiple Kernel Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Xiaogang Wang,et al.  Visual Importance and Distortion Guided Deep Image Quality Assessment Framework , 2017, IEEE Transactions on Multimedia.

[12]  Xuelong Li,et al.  Image Quality Assessment Based on Multiscale Geometric Analysis , 2009, IEEE Transactions on Image Processing.

[13]  Zhiguo Jiang,et al.  No Reference Quality Assessment for Multiply-Distorted Images Based on an Improved Bag-of-Words Model , 2015, IEEE Signal Processing Letters.

[14]  Alan C. Bovik,et al.  No-reference quality assessment using natural scene statistics: JPEG2000 , 2005, IEEE Transactions on Image Processing.

[15]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[16]  Yan Xiao-lang No-reference image quality assessment based on statistical model of natural image , 2010 .

[17]  Weisi Lin,et al.  No-Reference Quality Assessment for Multiply-Distorted Images in Gradient Domain , 2016, IEEE Signal Processing Letters.