No-reference image quality assessment with local features and high-order derivatives

Abstract The perceptual quality of images is often affected by applied image processing techniques. Their evaluation requires tests which involve human subjects. However, in most cases, image quality assessment (IQA) should be automatic and reproducible. Therefore, in this paper, a novel no-reference IQA method is proposed. The method uses high-order derivatives to extract detailed structure deformation present in distorted images. Furthermore, it employs local features, considering that only some regions of an image carry interesting information. Then, statistics of local features are used by a support vector regression technique to provide an objective quality score. To improve the quality prediction, luminance and chrominance channels of the image are processed. Experimental results on six large-scale public IQA image datasets show that the proposed method outperforms the state-of-the-art hand-crafted and deep-learning techniques in terms of the visual quality prediction accuracy. Furthermore, the method is better than popular full-reference approaches (i.e., SSIM and PSNR).

[1]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[2]  Yong Liu,et al.  Blind Image Quality Assessment Based on High Order Statistics Aggregation , 2016, IEEE Transactions on Image Processing.

[3]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[4]  Alan C. Bovik,et al.  Objective quality assessment of multiply distorted images , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[5]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[6]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[7]  Xiongkuo Min,et al.  Blind Quality Assessment Based on Pseudo-Reference Image , 2018, IEEE Transactions on Multimedia.

[8]  D. Chandler Seven Challenges in Image Quality Assessment: Past, Present, and Future Research , 2013 .

[9]  Zhengfang Duanmu,et al.  End-to-End Blind Image Quality Assessment Using Deep Neural Networks , 2018, IEEE Transactions on Image Processing.

[10]  Weisi Lin,et al.  BSD: Blind image quality assessment based on structural degradation , 2017, Neurocomputing.

[11]  Guangming Shi,et al.  Blind Quality Index for Multiply Distorted Images Using Biorder Structure Degradation and Nonlocal Statistics , 2018, IEEE Transactions on Multimedia.

[12]  Yong Ding,et al.  Image Quality Assessment Based on Joint Quality-Aware Representation Construction in Multiple Domains , 2018 .

[13]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[14]  Songlin Du,et al.  Blind image quality assessment with the histogram sequences of high-order local derivative patterns , 2016, Digit. Signal Process..

[15]  Zhou Wang,et al.  dipIQ: Blind Image Quality Assessment by Learning-to-Rank Discriminable Image Pairs , 2017, IEEE Transactions on Image Processing.

[16]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[17]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[18]  Mariusz Oszust,et al.  No-Reference Image Quality Assessment Using Image Statistics and Robust Feature Descriptors , 2017, IEEE Signal Processing Letters.

[19]  Mariusz Oszust,et al.  Decision Fusion for Image Quality Assessment using an Optimization Approach , 2016, IEEE Signal Processing Letters.

[20]  Ke Gu,et al.  An efficient and effective blind camera image quality metric via modeling quaternion wavelet coefficients , 2017, J. Vis. Commun. Image Represent..

[21]  Sanghoon Lee,et al.  Fully Deep Blind Image Quality Predictor , 2017, IEEE Journal of Selected Topics in Signal Processing.

[22]  Lei Zhang,et al.  Blind Image Quality Assessment Using Joint Statistics of Gradient Magnitude and Laplacian Features , 2014, IEEE Transactions on Image Processing.

[23]  Sandip Sarkar,et al.  Understanding image structure from a new multi-scale representation of higher order derivative filters , 2007, Image Vis. Comput..

[24]  Matthias Bethge,et al.  How Sensitive Is the Human Visual System to the Local Statistics of Natural Images? , 2013, PLoS Comput. Biol..

[25]  Ling Shao,et al.  Non-distortion-specific no-reference image quality assessment: A survey , 2015, Inf. Sci..

[26]  Derek Nowrouzezahrai,et al.  Hierarchical diffusion curves for accurate automatic image vectorization , 2014, ACM Trans. Graph..

[27]  Wujie Zhou,et al.  Utilizing Dictionary Learning and Machine Learning for Blind Quality Assessment of 3-D Images , 2017, IEEE Transactions on Broadcasting.

[28]  Lucjan Janowski,et al.  Lightweight implementation of No-Reference (NR) perceptual quality assessment of H.264/AVC compression , 2015, Signal Process. Image Commun..

[29]  Qingshan Jiang,et al.  No Reference Image Quality Assessment based on Multi-Expert Convolutional Neural Networks , 2018, IEEE Access.

[30]  Hernan D. Benítez-Restrepo,et al.  Non-reference assessment of sharpness in blur/noise degraded images , 2016, J. Vis. Commun. Image Represent..

[31]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[32]  Navdeep Goel,et al.  Anisotropic blind image quality assessment: Survey and analysis with current methods , 2018, J. Vis. Commun. Image Represent..

[33]  Qingjie Zhao,et al.  Blind image quality assessment by relative gradient statistics and adaboosting neural network , 2016, Signal Process. Image Commun..

[34]  Lei Zhang,et al.  A Feature-Enriched Completely Blind Image Quality Evaluator , 2015, IEEE Transactions on Image Processing.

[35]  Weisi Lin,et al.  Image Quality Assessment Based on Gradient Similarity , 2012, IEEE Transactions on Image Processing.

[36]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[37]  Krzysztof Okarma Quality Assessment of Images with Multiple Distortions using Combined Metrics , 2014 .

[38]  Houqiang Li,et al.  A no-reference Image sharpness metric based on structural information using sparse representation , 2016, Inf. Sci..

[39]  Lei Zhang,et al.  Deep Convolutional Neural Models for Picture-Quality Prediction: Challenges and Solutions to Data-Driven Image Quality Assessment , 2017, IEEE Signal Processing Magazine.

[40]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[41]  Alan C. Bovik,et al.  Massive Online Crowdsourced Study of Subjective and Objective Picture Quality , 2015, IEEE Transactions on Image Processing.

[42]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[43]  Abdul Rehman,et al.  Reduced-Reference Image Quality Assessment by Structural Similarity Estimation , 2012, IEEE Transactions on Image Processing.

[44]  Ying Li,et al.  A weighted full-reference image quality assessment based on visual saliency , 2017, J. Vis. Commun. Image Represent..

[45]  Nikolay N. Ponomarenko,et al.  Image database TID2013: Peculiarities, results and perspectives , 2015, Signal Process. Image Commun..

[46]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[47]  Zhou Wang,et al.  Unified Blind Quality Assessment of Compressed Natural, Graphic, and Screen Content Images , 2017, IEEE Transactions on Image Processing.