No-Reference Image Sharpness Assessment Based on Maximum Gradient and Variability of Gradients

Gradients are commonly used in image sharpness assessment methods.  However, research has not fully addressed the direct relationship between gradients and the perceived sharpness. In this paper, we discover and validate through experiments that the maximum gradient is an effective indicator of the perceived image sharpness on a global or local scale. Based on these observations, we propose a novel and efficient no-reference image quality assessment (NR-IQA) method for blurry images. Our method uses two elements to predict the quality of blurry images: the maximum gradient and the variability of gradients. The maximum gradient represents the sharpest spot in an image, and the variability of gradients shows variations within the content of the image. According to the characteristics of human visual systems, these factors are significant for humans when judging the quality of blurry images. The method was tested using blurry image datasets from five public IQA databases. Compared with nine other state-of-the-art NR-IQA methods for blurry images, the experimental results demonstrate that our method is more consistent with humans’ subjective evaluations. The MATLAB source code of our method is available at https://github.com/Atmegal/Sharpness-evaluation.

[1]  Fan Zhang,et al.  Practical Image Quality Metric Applied to Image Coding , 2011, IEEE Transactions on Multimedia.

[2]  Stefan Winkler,et al.  A no-reference perceptual blur metric , 2002, Proceedings. International Conference on Image Processing.

[3]  Alexandre G. Ciancio,et al.  No-Reference Blur Assessment of Digital Pictures Based on Multifeature Classifiers , 2011, IEEE Transactions on Image Processing.

[4]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[5]  Weisi Lin,et al.  No-Reference Image Blur Assessment Based on Discrete Orthogonal Moments , 2016, IEEE Transactions on Cybernetics.

[6]  Jae S. Lim,et al.  Algorithms for Transform Selection in Multiple-Transform Video Compression , 2013 .

[7]  Xuesong Wang,et al.  Image quality assessment based on multi-scale representation of structure , 2014, Digit. Signal Process..

[8]  Alan C. Bovik,et al.  No-reference image blur assessment using multiscale gradient , 2009, QOMEX 2009.

[9]  Weisi Lin,et al.  No-Reference and Robust Image Sharpness Evaluation Based on Multiscale Spatial and Spectral Features , 2017, IEEE Transactions on Multimedia.

[10]  Rong Zhang,et al.  No-Reference JPEG Image Quality Assessment Based on Blockiness and Luminance Change , 2017, IEEE Signal Processing Letters.

[11]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[12]  Nikolay N. Ponomarenko,et al.  Image database TID2013: Peculiarities, results and perspectives , 2015, Signal Process. Image Commun..

[13]  Lina J. Karam,et al.  A No-Reference Image Blur Metric Based on the Cumulative Probability of Blur Detection (CPBD) , 2011, IEEE Transactions on Image Processing.

[14]  Lina J. Karam,et al.  A No-Reference Objective Image Sharpness Metric Based on the Notion of Just Noticeable Blur (JNB) , 2009, IEEE Transactions on Image Processing.

[15]  Qian Wu,et al.  A Structural Variation Classification Model for Image Quality Assessment , 2017, IEEE Transactions on Multimedia.

[16]  Alex ChiChung Kot,et al.  A Fast Approach for No-Reference Image Sharpness Assessment Based on Maximum Local Variation , 2014, IEEE Signal Processing Letters.

[17]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Alex ChiChung Kot,et al.  Efficient Image Sharpness Assessment Based on Content Aware Total Variation , 2016, IEEE Transactions on Multimedia.

[19]  Wen Gao,et al.  A no-reference perceptual blur metric using histogram of gradient profile sharpness , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[20]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[21]  Gaobo Yang,et al.  Referenceless Measure of Blocking Artifacts by Tchebichef Kernel Analysis , 2014, IEEE Signal Processing Letters.

[22]  N. Graham Visual Pattern Analyzers , 1989 .

[23]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[24]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[25]  Zhou Wang,et al.  Modern Image Quality Assessment , 2006, Modern Image Quality Assessment.

[26]  Weisi Lin,et al.  No-Reference Image Sharpness Assessment in Autoregressive Parameter Space , 2015, IEEE Transactions on Image Processing.

[27]  Wei-Ying Ma,et al.  Blur determination in the compressed domain using DCT information , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[28]  Weisi Lin,et al.  No-reference quality assessment of deblocked images , 2016, Neurocomputing.

[29]  Alan C. Bovik,et al.  Objective quality assessment of multiply distorted images , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[30]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[31]  Wenjun Zhang,et al.  Using Free Energy Principle For Blind Image Quality Assessment , 2015, IEEE Transactions on Multimedia.

[32]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[33]  Rong Zhang,et al.  A novel structural variation detection strategy for image quality assessment , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[34]  Damon M. Chandler,et al.  ${\bf S}_{3}$: A Spectral and Spatial Measure of Local Perceived Sharpness in Natural Images , 2012, IEEE Transactions on Image Processing.

[35]  Rong Zhang,et al.  Image quality assessment based on structure variance classification , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[36]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[37]  Weisi Lin,et al.  Learning Structural Regularity for Evaluating Blocking Artifacts in JPEG Images , 2014, IEEE Signal Processing Letters.

[38]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[39]  Phong V. Vu,et al.  A Fast Wavelet-Based Algorithm for Global and Local Image Sharpness Estimation , 2012, IEEE Signal Processing Letters.

[40]  Zhou Wang,et al.  Image Sharpness Assessment Based on Local Phase Coherence , 2013, IEEE Transactions on Image Processing.

[41]  Sonja Grgic,et al.  VCL@FER image quality assessment database , 2011, Proceedings ELMAR-2011.

[42]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[43]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[44]  Qian Wu,et al.  A new haze image database with detailed air quality information and a novel no-reference image quality assessment method for haze images , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[45]  Jieying Zhu,et al.  Image Quality Assessment by Visual Gradient Similarity , 2012, IEEE Transactions on Image Processing.

[46]  Weisi Lin,et al.  Image Sharpness Assessment by Sparse Representation , 2016, IEEE Transactions on Multimedia.