Reduced-Reference Quality Assessment Based on the Entropy of DWT Coefficients of Locally Weighted Gradient Magnitudes

Perceptual image quality assessment (IQA) attempts to use computational models to estimate the image quality in accordance with subjective evaluations. Reduced-reference IQA (RRIQA) methods make use of partial information or features extracted from the reference image for estimating the quality of distorted images. Finding a balance between the number of RR features and accuracy of the estimated image quality is essential and important in IQA. In this paper, we propose a training-free low-cost RRIQA method that requires a very small number of RR features (six RR features). The proposed RRIQA algorithm is based on the discrete wavelet transform (DWT) of locally weighted gradient magnitudes. We apply human visual system’s contrast sensitivity and neighborhood gradient information to weight the gradient magnitudes in a locally adaptive manner. The RR features are computed by measuring the entropy of each DWT subband, for each scale, and pooling the subband entropies along all orientations, resulting in <inline-formula> <tex-math notation="LaTeX">$L$ </tex-math></inline-formula> RR features (one average entropy per scale) for an <inline-formula> <tex-math notation="LaTeX">$L$ </tex-math></inline-formula>-level DWT. Extensive experiments performed on seven large-scale benchmark databases demonstrate that the proposed RRIQA method delivers highly competitive performance as compared with the state-of-the-art RRIQA models as well as full reference ones for both natural and texture images. The MATLAB source code of <italic>REDLOG</italic> and the evaluation results are publicly available online at <uri xlink:type="simple">https://http://lab.engineering.asu.edu/ivulab/software/redlog/</uri>.

[1]  Jinxu Tao,et al.  Reduced-reference image quality assessment based on average directional information , 2012, 2012 IEEE 11th International Conference on Signal Processing.

[2]  Alan C. Bovik,et al.  C-DIIVINE: No-reference image quality assessment based on local magnitude and phase statistics of natural scenes , 2014, Signal Process. Image Commun..

[3]  Preeti Verghese,et al.  Where to look next? Eye movements reduce local uncertainty. , 2007, Journal of vision.

[4]  Weisi Lin,et al.  Image Quality Assessment Based on Gradient Similarity , 2012, IEEE Transactions on Image Processing.

[5]  Yong Xu,et al.  Reduced reference image quality assessment using regularity of phase congruency , 2014, Signal Process. Image Commun..

[6]  Matthew G. Reyes,et al.  Structural texture similarity metrics for retrieval applications , 2008, 2008 15th IEEE International Conference on Image Processing.

[7]  King Ngi Ngan,et al.  Reduced-reference image quality assessment in reorganized DCT domain , 2013, Signal Process. Image Commun..

[8]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[9]  Fan Zhang,et al.  Reduced-Reference Image Quality Assessment Using Reorganized DCT-Based Image Representation , 2011, IEEE Transactions on Multimedia.

[10]  Xuelong Li,et al.  Image Quality Assessment Based on Multiscale Geometric Analysis , 2009, IEEE Transactions on Image Processing.

[11]  David L. Neuhoff,et al.  Structural Texture Similarity Metrics for Image Analysis and Retrieval , 2013, IEEE Transactions on Image Processing.

[12]  Damon M. Chandler,et al.  Seven challenges for image quality research , 2014, Electronic Imaging.

[13]  Anil K. Bera,et al.  Efficient tests for normality, homoscedasticity and serial independence of regression residuals , 1980 .

[14]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[15]  D. Heeger Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[16]  Wufeng Xue,et al.  Reduced reference image quality assessment based on Weibull statistics , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[17]  Wilson S. Geisler,et al.  Image quality assessment based on a degradation model , 2000, IEEE Trans. Image Process..

[18]  Guangming Shi,et al.  Reduced-Reference Image Quality Assessment With Visual Information Fidelity , 2013, IEEE Transactions on Multimedia.

[19]  Theophano Mitsa,et al.  Evaluation of contrast sensitivity functions for the formulation of quality measures incorporated in halftoning algorithms , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[20]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[21]  Min Zhang,et al.  Reduced reference image quality assessment based on statistics of edge , 2011, Electronic Imaging.

[22]  Patrick Le Callet,et al.  Objective quality assessment of color images based on a generic perceptual reduced reference , 2008, Signal Process. Image Commun..

[23]  Lei Zhang,et al.  Blind Image Quality Assessment Using Joint Statistics of Gradient Magnitude and Laplacian Features , 2014, IEEE Transactions on Image Processing.

[24]  Lina J. Karam,et al.  A no-reference objective image quality metric based on perceptually weighted local noise , 2014, EURASIP J. Image Video Process..

[25]  Lina J. Karam,et al.  On the assessment of the quality of textures in visual media , 2010, 2010 44th Annual Conference on Information Sciences and Systems (CISS).

[26]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[27]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[28]  Keiichi Chono,et al.  Reduced-reference image quality assessment using distributed source coding , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[29]  Patrick Le Callet,et al.  Subjective quality assessment IRCCyN/IVC database , 2004 .

[30]  Eero P. Simoncelli,et al.  Statistically and perceptually motivated nonlinear image representation , 2007, Electronic Imaging.

[31]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[32]  Alan C. Bovik,et al.  No-reference quality assessment using natural scene statistics: JPEG2000 , 2005, IEEE Transactions on Image Processing.

[33]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[34]  David J. Sakrison,et al.  The effects of a visual fidelity criterion of the encoding of images , 1974, IEEE Trans. Inf. Theory.

[35]  Lina J. Karam,et al.  A No-Reference Objective Image Sharpness Metric Based on the Notion of Just Noticeable Blur (JNB) , 2009, IEEE Transactions on Image Processing.

[36]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[37]  Patrick Le Callet,et al.  An image quality assessment method based on perception of structural information , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[38]  Eero P. Simoncelli,et al.  Nonlinear image representation using divisive normalization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Zhou Wang,et al.  Modern Image Quality Assessment , 2006, Modern Image Quality Assessment.

[40]  Abdul Rehman,et al.  Reduced-Reference Image Quality Assessment by Structural Similarity Estimation , 2012, IEEE Transactions on Image Processing.

[41]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[42]  Zhou Wang,et al.  Quality-aware images , 2006, IEEE Transactions on Image Processing.

[43]  Xuelong Li,et al.  Reduced-Reference IQA in Contourlet Domain , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[44]  D. Field,et al.  Natural image statistics and efficient coding. , 1996, Network.

[45]  Alan C. Bovik,et al.  RRED Indices: Reduced Reference Entropic Differencing for Image Quality Assessment , 2012, IEEE Transactions on Image Processing.

[46]  Tubagus Maulana Kusuma,et al.  Reduced-reference metric design for objective perceptual quality assessment in wireless imaging , 2009, Signal Process. Image Commun..

[47]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[48]  M. Ghanbari,et al.  Reduced-reference picture quality estimation by using local harmonic amplitude information , .

[49]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[50]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[51]  Hans-Jurgen Zepernick,et al.  A reduced-reference perceptual quality metric for in-service image quality assessment , 2003, SympoTIC'03. Joint 1st Workshop on Mobile Future and Symposium on Trends in Communications.

[52]  Zhou Wang,et al.  Reduced-Reference Image Quality Assessment Using Divisive Normalization-Based Image Representation , 2009, IEEE Journal of Selected Topics in Signal Processing.

[53]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[54]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[55]  Nikolay N. Ponomarenko,et al.  Color image database TID2013: Peculiarities and preliminary results , 2013, European Workshop on Visual Information Processing (EUVIP).

[56]  Eero P. Simoncelli,et al.  A model of neuronal responses in visual area MT , 1998, Vision Research.