Local Feature Descriptor and Derivative Filters for Blind Image Quality Assessment

In this letter, a novel blind image quality assessment (BIQA) technique is introduced to provide an automatic and reproducible evaluation of distorted images. In the approach, the information carried by image derivatives of different orders is captured by local features and used for the image quality prediction. Since a typical local feature descriptor is designed to ensure a robust image patch representation, in this letter, a novel descriptor that additionally highlights local differences enhanced by the filtering is proposed. Furthermore, a set of derivative kernels is introduced. Finally, the support vector regression technique is used to map statistics of described local features into subjective scores, providing an objective quality score for an image. Extensive experimental validation on popular IQA image datasets reveals that the proposed method outperforms the state-of-the-art handcrafted and deep learning BIQA measures.

[1]  Weisi Lin,et al.  BSD: Blind image quality assessment based on structural degradation , 2017, Neurocomputing.

[2]  Xiongkuo Min,et al.  Blind Quality Assessment Based on Pseudo-Reference Image , 2018, IEEE Transactions on Multimedia.

[3]  D. Chandler Seven Challenges in Image Quality Assessment: Past, Present, and Future Research , 2013 .

[4]  Zhengfang Duanmu,et al.  End-to-End Blind Image Quality Assessment Using Deep Neural Networks , 2018, IEEE Transactions on Image Processing.

[5]  Weisi Lin,et al.  No-Reference Quality Assessment for Multiply-Distorted Images in Gradient Domain , 2016, IEEE Signal Processing Letters.

[6]  Weisi Lin,et al.  Blind Image Quality Assessment Using Statistical Structural and Luminance Features , 2016, IEEE Transactions on Multimedia.

[7]  Ke Gu,et al.  An efficient and effective blind camera image quality metric via modeling quaternion wavelet coefficients , 2017, J. Vis. Commun. Image Represent..

[8]  Lei Zhang,et al.  Blind Image Quality Assessment Using Joint Statistics of Gradient Magnitude and Laplacian Features , 2014, IEEE Transactions on Image Processing.

[9]  Ke Gu,et al.  No-Reference Quality Assessment of Screen Content Pictures , 2017, IEEE Transactions on Image Processing.

[10]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[11]  Zhou Wang,et al.  A highly efficient method for blind image quality assessment , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[12]  Qingjie Zhao,et al.  Blind image quality assessment by relative gradient statistics and adaboosting neural network , 2016, Signal Process. Image Commun..

[13]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[14]  Wen Gao,et al.  A study on interest point guided visual saliency , 2015, 2015 Picture Coding Symposium (PCS).

[15]  Daniel Thalmann,et al.  Model-Based Referenceless Quality Metric of 3D Synthesized Images Using Local Image Description , 2018, IEEE Transactions on Image Processing.

[16]  Tariq S. Durrani,et al.  Deep Activation Pooling for Blind Image Quality Assessment , 2018 .

[17]  Qingshan Jiang,et al.  No Reference Image Quality Assessment based on Multi-Expert Convolutional Neural Networks , 2018, IEEE Access.

[18]  Joost van de Weijer,et al.  RankIQA: Learning from Rankings for No-Reference Image Quality Assessment , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[19]  Weisi Lin,et al.  No-Reference Image Sharpness Assessment in Autoregressive Parameter Space , 2015, IEEE Transactions on Image Processing.

[20]  Mariusz Oszust,et al.  No-reference image quality assessment with local features and high-order derivatives , 2018, J. Vis. Commun. Image Represent..

[21]  Lei Zhang,et al.  A Feature-Enriched Completely Blind Image Quality Evaluator , 2015, IEEE Transactions on Image Processing.

[22]  Sebastian Bosse,et al.  A deep neural network for image quality assessment , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[23]  Wenjun Zhang,et al.  No-Reference Quality Metric of Contrast-Distorted Images Based on Information Maximization , 2017, IEEE Transactions on Cybernetics.

[24]  Matthias Bethge,et al.  How Sensitive Is the Human Visual System to the Local Statistics of Natural Images? , 2013, PLoS Comput. Biol..

[25]  Weisi Lin,et al.  No-reference image quality assessment based on high order derivatives , 2016, 2016 IEEE International Conference on Multimedia and Expo (ICME).

[26]  Lei Zhang,et al.  Blind Image Quality Assessment with a Probabilistic Quality Representation , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[27]  Yong Liu,et al.  Blind Image Quality Assessment Based on High Order Statistics Aggregation , 2016, IEEE Transactions on Image Processing.

[28]  Nikolay N. Ponomarenko,et al.  Image database TID2013: Peculiarities, results and perspectives , 2015, Signal Process. Image Commun..

[29]  Lei Zhang,et al.  Learning without Human Scores for Blind Image Quality Assessment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Mariusz Oszust,et al.  Optimized Filtering With Binary Descriptor for Blind Image Quality Assessment , 2018, IEEE Access.

[31]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[32]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[33]  Lei Zhang,et al.  Deep Convolutional Neural Models for Picture-Quality Prediction: Challenges and Solutions to Data-Driven Image Quality Assessment , 2017, IEEE Signal Processing Magazine.

[34]  King Ngi Ngan,et al.  Blind Image Quality Assessment Based on Multichannel Feature Fusion and Label Transfer , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[35]  Sanghoon Lee,et al.  Fully Deep Blind Image Quality Predictor , 2017, IEEE Journal of Selected Topics in Signal Processing.

[36]  Alan C. Bovik,et al.  Massive Online Crowdsourced Study of Subjective and Objective Picture Quality , 2015, IEEE Transactions on Image Processing.

[37]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[38]  Zhou Wang,et al.  dipIQ: Blind Image Quality Assessment by Learning-to-Rank Discriminable Image Pairs , 2017, IEEE Transactions on Image Processing.

[39]  Wenjun Zhang,et al.  Using Free Energy Principle For Blind Image Quality Assessment , 2015, IEEE Transactions on Multimedia.

[40]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[41]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[42]  Mariusz Oszust,et al.  No-Reference Image Quality Assessment Using Image Statistics and Robust Feature Descriptors , 2017, IEEE Signal Processing Letters.