No-reference image quality assessment based on log-derivative statistics of natural scenes

Abstract. We propose an efficient blind/no-reference image quality assessment algorithm using a log-derivative statistical model of natural scenes. Our method, called DErivative Statistics-based QUality Evaluator (DESIQUE), extracts image quality-related statistical features at two image scales in both the spatial and frequency domains. In the spatial domain, normalized pixel values of an image are modeled in two ways: pointwise-based statistics for single pixel values and pairwise-based log-derivative statistics for the relationship of pixel pairs. In the frequency domain, log-Gabor filters are used to extract the fine scales of the image, which are also modeled by the log-derivative statistics. All of these statistics can be fitted by a generalized Gaussian distribution model, and the estimated parameters are fed into combined frameworks to estimate image quality. We train our models on the LIVE database by using optimized support vector machine learning. Experiment results tested on other databases show that the proposed algorithm not only yields a substantial improvement in predictive performance as compared to other state-of-the-art no-reference image quality assessment methods, but also maintains a high computational efficiency.

[1]  R. Yager.  On the dempster-shafer framework and new combination rules , 1987, Inf. Sci..

[2]  Zhang Hua,et al.  A Weighted Sobel Operator-Based No-Reference Blockiness Metric , 2008, 2008 IEEE Pacific-Asia Workshop on Computational Intelligence and Industrial Application.

[3]  Xin Li,et al.  Blind image quality assessment , 2002, Proceedings. International Conference on Image Processing.

[4]  Zhou Wang,et al.  No-reference perceptual quality assessment of JPEG compressed images , 2002, Proceedings. International Conference on Image Processing.

[5]  Shan Suthaharan.  No-reference visually significant blocking artifact metric for natural scene images , 2009, Signal Process..

[6]  D. Ruderman.  The statistics of natural images , 1994 .

[7]  Alan C. Bovik,et al.  A Two-Step Framework for Constructing Blind Image Quality Indices , 2010, IEEE Signal Processing Letters.

[8]  Jean-Bernard Martens,et al.  A single-ended blockiness measure for JPEG-coded images , 2002, Signal Process..

[9]  Weisi Lin,et al.  Measuring blocking artifacts using edge direction information , 2004, ICME.

[10]  Tiago Rosa Maria Paula Queluz,et al.  No-reference image quality assessment based on DCT domain statistics , 2008, Signal Process..

[11]  Sung-Jea Ko,et al.  Fast Blind Measurement of Blocking Artifacts in both Pixel and DCT Domains , 2007, Journal of Mathematical Imaging and Vision.

[12]  Wen Gao,et al.  A No-Reference Blocking Artifacts Metric Using Selective Gradient and Plainness Measures , 2008, PCM.

[13]  David S. Doermann,et al.  No-Reference Image Quality Assessment Using Visual Codebooks , 2012, IEEE Transactions on Image Processing.

[14]  Alberto Leon-Garcia,et al.  Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[15]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[16]  David S. Doermann,et al.  No-reference image quality assessment based on visual codebook , 2011, 2011 18th IEEE International Conference on Image Processing.

[17]  Ashish Kapoor,et al.  Learning a blind measure of perceptual image quality , 2011, CVPR 2011.

[18]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[19]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[20]  Yitzhak Yitzhaky,et al.  No-reference assessment of blur and noise impacts on image quality , 2010, Signal Image Video Process..

[21]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[22]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[23]  Ram M. Narayanan,et al.  Noise estimation in remote sensing imagery using data masking , 2003 .

[24]  Wei-Ying Ma,et al.  Learning No-Reference Quality Metric by Examples , 2005, 11th International Multimedia Modelling Conference.

[25]  Alan C. Bovik,et al.  No-reference quality assessment using natural scene statistics: JPEG2000 , 2005, IEEE Transactions on Image Processing.

[26]  Zhou Wang,et al.  Reduced-Reference Image Quality Assessment Using Divisive Normalization-Based Image Representation , 2009, IEEE Journal of Selected Topics in Signal Processing.

[27]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[28]  Zhou Wang,et al.  Blind measurement of blocking artifacts in images , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[29]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[30]  David Mumford,et al.  Statistics of natural images and models , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[31]  Anil K. Bera,et al.  Efficient tests for normality, homoscedasticity and serial independence of regression residuals , 1980 .

[32]  Jeffrey A. Bloom,et al.  A Blind Reference-Free Blockiness Measure , 2010, PCM.

[33]  Damon M. Chandler,et al.  S3: A Spectral and Spatial Sharpness Measure , 2009, 2009 First International Conference on Advances in Multimedia.

[34]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[35]  Salvador Gabarda,et al.  No-reference image quality assessment through the von Mises distribution , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.

[36]  J. Daugman.  Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[37]  R. Venkatesh Babu,et al.  No-reference image quality assessment using modified extreme learning machine classifier , 2009, Appl. Soft Comput..

[38]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[39]  Stefan Winkler,et al.  Perceptual blur and ringing metrics: application to JPEG2000 , 2004, Signal Process. Image Commun..

[40]  Sim Heng Ong,et al.  Kurtosis-based no-reference quality assessment of JPEG2000 images , 2011, Signal Process. Image Commun..

[41]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[42]  Xiaojun Wu,et al.  Blind Image Quality Assessment Using a General Regression Neural Network , 2011, IEEE Transactions on Neural Networks.

[43]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[44]  Daniele D. Giusto,et al.  Image blockiness evaluation based on Sobel operator , 2005, IEEE International Conference on Image Processing 2005.

[45]  Yuukou Horita,et al.  No reference image quality assessment for JPEG2000 based on spatial features , 2008, Signal Process. Image Commun..

[46]  Baihua Xiao,et al.  A no reference image quality assessment method for JPEG2000 , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[47]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[48]  Hanghang Tong,et al.  No-reference quality assessment for JPEG2000 compressed images , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[49]  Maliha S. Nash,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 2001, Technometrics.

[50]  S Marcelja,et al.  Mathematical description of the responses of simple cortical cells. , 1980, Journal of the Optical Society of America.

[51]  Alan C. Bovik,et al.  DCT-domain blind measurement of blocking artifacts in DCT-coded images , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).