A no-reference Image sharpness metric based on structural information using sparse representation

As a ubiquitous image distortion, blur casts non-trivial influence on image visual quality. Many image sharpness assessment methods have been proposed in the views of edge information, gradient map, frequency spectrum, or other natural image statistics features. In this paper, we propose a no-reference image sharpness metric based on structural information using sparse representation (SR). We observe that the dictionary atoms learned by SR algorithm convey clear structural information. Considering the distinct sensibility of human visual system (HVS) to different structures, we use the learned dictionary to encode the patches of the blurry image. To embed the locality of the representation, a multi-scale spatial max pooling scheme is incorporated. The final sharpness score is given by an efficient linear support vector regression (SVR) model. We evaluate our approach on three public databases, i.e., LIVE II, TID2008, and CSIQ. The experiments demonstrate that the proposed method achieves competitive performance compared with the state-of-the-art blind image sharpness assessment algorithms.

[1]  Ingeborg Tastl,et al.  Sharpness measure: towards automatic image enhancement , 2005, IEEE International Conference on Image Processing 2005.

[2]  Thomas Serre,et al.  Object recognition with features inspired by visual cortex , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Lina J. Karam,et al.  A no-reference perceptual image sharpness metric based on a cumulative probability of blur detection , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[4]  Yihong Gong,et al.  Linear spatial pyramid matching using sparse coding for image classification , 2009, CVPR.

[5]  Damon M. Chandler,et al.  Main subject detection via adaptive feature refinement , 2011, J. Electronic Imaging.

[6]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[7]  Hyoung Joong Kim,et al.  Efficient Method of Detecting Globally Blurry or Sharp Images , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[8]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[9]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[10]  Jun Yu,et al.  Click Prediction for Web Image Reranking Using Multimodal Sparse Coding , 2014, IEEE Transactions on Image Processing.

[11]  C. L. Philip Chen,et al.  A robust bi-sparsity model with non-local regularization for mixed noise reduction , 2016, Inf. Sci..

[12]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[13]  David S. Doermann,et al.  Unsupervised feature learning framework for no-reference image quality assessment , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Qinghua Hu,et al.  Multi-document summarization via group sparse learning , 2016, Inf. Sci..

[15]  Alex ChiChung Kot,et al.  A Fast Approach for No-Reference Image Sharpness Assessment Based on Maximum Local Variation , 2014, IEEE Signal Processing Letters.

[16]  Weiguo Gong,et al.  Dual-sparsity regularized sparse representation for single image super-resolution , 2015, Inf. Sci..

[17]  Allen Y. Yang,et al.  Fast L1-Minimization Algorithms For Robust Face Recognition , 2010, 1007.3753.

[18]  Lina J. Karam,et al.  A No-Reference Objective Image Sharpness Metric Based on the Notion of Just Noticeable Blur (JNB) , 2009, IEEE Transactions on Image Processing.

[19]  Guanglu Sun,et al.  Dictionary evaluation and optimization for sparse coding based speech processing , 2015, Inf. Sci..

[20]  Meng Wang,et al.  Image clustering based on sparse patch alignment framework , 2014, Pattern Recognit..

[21]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[22]  Damon M. Chandler,et al.  ${\bf S}_{3}$: A Spectral and Spatial Measure of Local Perceived Sharpness in Natural Images , 2012, IEEE Transactions on Image Processing.

[23]  Tanaya Guha,et al.  Sparse representation-based image quality assessment , 2013, Signal Process. Image Commun..

[24]  Zhou Wang,et al.  Image Sharpness Assessment Based on Local Phase Coherence , 2013, IEEE Transactions on Image Processing.

[25]  Ling Shao,et al.  Non-distortion-specific no-reference image quality assessment: A survey , 2015, Inf. Sci..

[26]  Guangming Shi,et al.  Orientation selectivity based visual pattern for reduced-reference image quality assessment , 2016, Inf. Sci..

[27]  Tomaso Poggio,et al.  Learning a dictionary of shape-components in visual cortex: comparison with neurons, humans and machines , 2006 .

[28]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[29]  Alan C. Bovik,et al.  Visual Importance Pooling for Image Quality Assessment , 2009, IEEE Journal of Selected Topics in Signal Processing.

[30]  Xiang Zhu,et al.  A no-reference sharpness metric sensitive to blur and noise , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[31]  Daniel N. Rockmore,et al.  Bayesian Learning of Sparse Multiscale Image Representations , 2013, IEEE Transactions on Image Processing.

[32]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[33]  Chong-Yaw Wee,et al.  Image sharpness measure using eigenvalues , 2008, 2008 9th International Conference on Signal Processing.

[34]  Wei Zhang,et al.  A parallel alternating direction method with application to compound l1-regularized imaging inverse problems , 2016, Inf. Sci..

[35]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[36]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[38]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[39]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[40]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[41]  Meng Wang,et al.  Image quality assessment based on matching pursuit , 2014, Inf. Sci..

[42]  Lei Zhang,et al.  Learning without Human Scores for Blind Image Quality Assessment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Xiaojun Wu,et al.  No-reference image blur index based on singular value curve , 2014, J. Vis. Commun. Image Represent..

[44]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[45]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[46]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[47]  Matej Kristan,et al.  A Bayes-spectral-entropy-based measure of camera focus using a discrete cosine transform , 2006, Pattern Recognit. Lett..

[48]  Allen Y. Yang,et al.  Fast L1-Minimization Algorithms For Robust Face Recognition , 2010 .

[49]  Adam Finkelstein,et al.  A no-reference metric for evaluating the quality of motion deblurring , 2013, ACM Trans. Graph..

[50]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[52]  Xiaojing Chen,et al.  Sparse representation matching for person re-identification , 2016, Inf. Sci..

[53]  Xuelong Li,et al.  Sparse representation for blind image quality assessment , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.