Blind Image Quality Assessment of Natural Scenes Based on Entropy Differences in the DCT Domain

Blind/no-reference image quality assessment is performed to accurately evaluate the perceptual quality of a distorted image without prior information from a reference image. In this paper, an effective blind image quality assessment approach based on entropy differences in the discrete cosine transform domain for natural images is proposed. Information entropy is an effective measure of the amount of information in an image. We find the discrete cosine transform coefficient distribution of distorted natural images shows a pulse-shape phenomenon, which directly affects the differences of entropy. Then, a Weibull model is used to fit the distributions of natural and distorted images. This is because the Weibull model sufficiently approximates the pulse-shape phenomenon as well as the sharp-peak and heavy-tail phenomena of natural scene statistics rules. Four features that are related to entropy differences and human visual system are extracted from the Weibull model for three scaling images. Image quality is assessed by the support vector regression method based on the extracted features. This blind Weibull statistics algorithm is thoroughly evaluated using three widely used databases: LIVE, TID2008, and CSIQ. The experimental results show that the performance of the proposed blind Weibull statistics method is highly consistent with that of human visual perception and greater than that of the state-of-the-art blind and full-reference image quality assessment methods in most cases.

[1]  Michael S. Lewicki,et al.  Emergence of complex cell properties by learning to generalize in natural scenes , 2009, Nature.

[2]  Alan C. Bovik,et al.  Perceptual quality prediction on authentically distorted images using a bag of features approach , 2016, Journal of vision.

[3]  Hans-Jürgen Zepernick,et al.  No-reference image and video quality assessment: a classification and review of recent approaches , 2014, EURASIP Journal on Image and Video Processing.

[4]  Tiago Rosa Maria Paula Queluz,et al.  No-reference image quality assessment based on DCT domain statistics , 2008, Signal Process..

[5]  Sinan Kalkan,et al.  Deep Hierarchies in the Primate Visual Cortex: What Can We Learn for Computer Vision? , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Jie Fu,et al.  Screen content image quality assessment via convolutional neural network , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[7]  Maliha S. Nash,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 2001, Technometrics.

[8]  Zheng Liu,et al.  Phase congruence measurement for image similarity assessment , 2007, Pattern Recognit. Lett..

[9]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[10]  Wen Gao,et al.  Subjective and Objective Quality Assessment of Compressed Screen Content Images , 2016, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[11]  Weisi Lin,et al.  Blind Image Quality Assessment Using Statistical Structural and Luminance Features , 2016, IEEE Transactions on Multimedia.

[12]  Sebastian Bosse,et al.  A deep neural network for image quality assessment , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[13]  Hongyu Li,et al.  Training Quality-Aware Filters for No-Reference Image Quality Assessment , 2014, IEEE MultiMedia.

[14]  Hua Huang,et al.  No-reference image quality assessment based on spatial and spectral entropies , 2014, Signal Process. Image Commun..

[15]  Vladimir Petrovic,et al.  Focused pooling for objective quality estimation , 2013, 2013 IEEE International Conference on Image Processing.

[16]  Zhou Wang,et al.  No-Reference Quality Assessment of Contrast-Distorted Images Based on Natural Scene Statistics , 2015, IEEE Signal Processing Letters.

[17]  Xueming Qian,et al.  A Cost-Constrained Video Quality Satisfaction Study on Mobile Devices , 2018, IEEE Transactions on Multimedia.

[18]  Sanjit K. Mitra,et al.  Image probability distribution based on generalized gamma function , 2005, IEEE Signal Processing Letters.

[19]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[20]  Xuelong Li,et al.  Blind Image Quality Assessment via Deep Learning , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Alan C. Bovik,et al.  A Two-Step Framework for Constructing Blind Image Quality Indices , 2010, IEEE Signal Processing Letters.

[22]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[23]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[24]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[25]  Q. M. Jonathan Wu,et al.  Utilizing Image Scales Towards Totally Training Free Blind Image Quality Assessment , 2015, IEEE Transactions on Image Processing.

[26]  Xinfeng Zhang,et al.  Multiple-Level Feature-Based Measure for Retargeted Image Quality , 2018, IEEE Transactions on Image Processing.

[27]  Alan C. Bovik,et al.  RRED Indices: Reduced Reference Entropic Differencing for Image Quality Assessment , 2012, IEEE Transactions on Image Processing.

[28]  King Ngi Ngan,et al.  Blind Image Quality Assessment Based on Multichannel Feature Fusion and Label Transfer , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[30]  N. Cho,et al.  Fast algorithm and implementation of 2-D discrete cosine transform , 1991 .

[31]  Arnold W. M. Smeulders,et al.  Brain responses strongly correlate with Weibull image statistics when processing natural images. , 2009, Journal of vision.

[32]  Nikos Komodakis,et al.  Interactive image segmentation based on synthetic graph coordinates , 2013, Pattern Recognit..

[33]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[34]  David S. Doermann,et al.  No-Reference Image Quality Assessment Using Visual Codebooks , 2012, IEEE Transactions on Image Processing.

[35]  Lei Zhang,et al.  A Feature-Enriched Completely Blind Image Quality Evaluator , 2015, IEEE Transactions on Image Processing.

[36]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[37]  Steven L. Parscale,et al.  The Effect of Quality Management Theory on Assessing Student Learning Outcomes , 2015 .

[38]  D. Ruderman The statistics of natural images , 1994 .

[39]  Hongyu Li,et al.  VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment , 2014, IEEE Transactions on Image Processing.

[40]  B. Willmore,et al.  Neural Representation of Natural Images in Visual Area V2 , 2010, The Journal of Neuroscience.

[41]  Wufeng Xue,et al.  Reduced reference image quality assessment based on Weibull statistics , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[42]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[43]  Guangming Shi,et al.  Reduced-Reference Image Quality Assessment With Visual Information Fidelity , 2013, IEEE Transactions on Multimedia.

[44]  Gaobo Yang,et al.  Referenceless Measure of Blocking Artifacts by Tchebichef Kernel Analysis , 2014, IEEE Signal Processing Letters.

[45]  Yi Li,et al.  Convolutional Neural Networks for No-Reference Image Quality Assessment , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  Deshi Li,et al.  RVSIM: a feature similarity method for full-reference image quality assessment , 2018, EURASIP J. Image Video Process..

[47]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[48]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[49]  W. Geisler Visual perception and the statistical properties of natural scenes. , 2008, Annual review of psychology.

[50]  David S. Doermann,et al.  Beyond Human Opinion Scores: Blind Image Quality Assessment Based on Synthetic Scores , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[51]  Weisi Lin,et al.  No-Reference Image Blur Assessment Based on Discrete Orthogonal Moments , 2016, IEEE Transactions on Cybernetics.

[52]  Eero P. Simoncelli,et al.  On Advances in Statistical Modeling of Natural Images , 2004, Journal of Mathematical Imaging and Vision.

[53]  Lina J. Karam,et al.  A no-reference objective image quality metric based on perceptually weighted local noise , 2014, EURASIP J. Image Video Process..

[54]  Weisi Lin,et al.  Saliency-Guided Quality Assessment of Screen Content Images , 2016, IEEE Transactions on Multimedia.

[55]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[56]  Jie Fu,et al.  Blind image quality assessment for multiply distorted images via convolutional neural networks , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[57]  I. Nizami,et al.  Efficient feature selection for Blind Image Quality Assessment based on natural scene statistics , 2017, 2017 14th International Bhurban Conference on Applied Sciences and Technology (IBCAST).

[58]  Alan C. Bovik,et al.  Visual Importance Pooling for Image Quality Assessment , 2009, IEEE Journal of Selected Topics in Signal Processing.