Blind image quality assessment with the histogram sequences of high-order local derivative patterns

Abstract Automatic assessment of the perceptual quality of digital image is an important and challenging issue in computer vision. Although human visual system (HVS) is sensitive to degradations on spatial structures, most of the existing methods do not take into account the spatial distribution of local structures. This paper reports a novel approach coined high-order local derivative pattern (LDP) based metric (HOLDPM). In particular, HOLDPM extracts local image structures with LDPs in multi-directions to yield an accurate assessment of image quality. HOLDPM is extensively evaluated on three large-scale public databases. Experimental results demonstrate that HOLDPM is able to achieve high assessment accuracy. Besides, objective assessment result of the HOLDPM is consistent with the subjective assessment result of the HVS. Specifically, the experimental results also indicate that HOLDPM outperforms most of the state-of-the-art methods in distortion specific tests. Additionally, HOLDPM shows competitive overall performance when measured with the weighted average of Spearman rank-order correlation coefficient (SROCC) and the weighted average of Pearson linear correlation coefficient (PLCC) over the test databases.

[1]  David S. Doermann,et al.  No-Reference Image Quality Assessment Using Visual Codebooks , 2012, IEEE Transactions on Image Processing.

[2]  Zhou Wang,et al.  Modern Image Quality Assessment , 2006, Modern Image Quality Assessment.

[3]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[4]  Guangming Shi,et al.  Reduced-Reference Image Quality Assessment With Visual Information Fidelity , 2013, IEEE Transactions on Multimedia.

[5]  David R. Musicant,et al.  Robust Linear and Support Vector Regression , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[7]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[8]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[9]  Baochang Zhang,et al.  Local Derivative Pattern Versus Local Binary Pattern: Face Recognition With High-Order Local Pattern Descriptor , 2010, IEEE Transactions on Image Processing.

[10]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  David S. Doermann,et al.  Unsupervised feature learning framework for no-reference image quality assessment , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Lorenzo Bruzzone,et al.  Kernel methods for remote sensing data analysis , 2009 .

[13]  Alan C. Bovik,et al.  A Two-Step Framework for Constructing Blind Image Quality Indices , 2010, IEEE Signal Processing Letters.

[14]  H. Chipman,et al.  Adaptive Bayesian Wavelet Shrinkage , 1997 .

[15]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[16]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[17]  Mohamed Cheriet,et al.  FSITM: A Feature Similarity Index For Tone-Mapped Images , 2015, IEEE Signal Processing Letters.

[18]  Xinbo Gao,et al.  No-reference image quality assessment in contourlet domain , 2010, Neurocomputing.

[19]  Hao Shen,et al.  Video is a Cube , 2011, IEEE Signal Processing Magazine.

[20]  Guangming Shi,et al.  Image Quality Assessment with Degradation on Spatial Structure , 2014, IEEE Signal Processing Letters.

[21]  Xuelong Li,et al.  Universal Blind Image Quality Assessment Metrics Via Natural Scene Statistics and Multiple Kernel Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Zhou Wang,et al.  Reduced- and No-Reference Image Quality Assessment , 2011, IEEE Signal Processing Magazine.

[23]  Min Zhang,et al.  Blind Image Quality Assessment Using the Joint Statistics of Generalized Local Binary Pattern , 2015, IEEE Signal Processing Letters.

[24]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Jing Tian,et al.  Blind noisy image quality assessment using block homogeneity , 2014, Comput. Electr. Eng..

[26]  Lina J. Karam,et al.  A No-Reference Image Blur Metric Based on the Cumulative Probability of Blur Detection (CPBD) , 2011, IEEE Transactions on Image Processing.

[27]  Songlin Du,et al.  Learning the histogram sequences of generalized local ternary patterns for blind image quality assessment , 2015, International Conference on Graphic and Image Processing.

[28]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[29]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[30]  Hongyu Li,et al.  VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment , 2014, IEEE Transactions on Image Processing.

[31]  Hua Huang,et al.  No-reference image quality assessment in curvelet domain , 2014, Signal Process. Image Commun..

[32]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[33]  Lei Zhang,et al.  Blind Image Quality Assessment Using Joint Statistics of Gradient Magnitude and Laplacian Features , 2014, IEEE Transactions on Image Processing.

[34]  Yi Zhang,et al.  An algorithm for no-reference image quality assessment based on log-derivative statistics of natural scenes , 2013, Electronic Imaging.

[35]  Yuukou Horita,et al.  No-reference image quality assessment for JPEG/JPEG2000 coding , 2004, 2004 12th European Signal Processing Conference.

[36]  D. Ruderman The statistics of natural images , 1994 .

[37]  Hui Kong,et al.  Generalizing Laplacian of Gaussian Filters for Vanishing-Point Detection , 2013, IEEE Transactions on Intelligent Transportation Systems.

[38]  Rodney A. Kennedy,et al.  Radial Function Based Kernel Design for Time-Frequency Distributions , 2010, IEEE Transactions on Signal Processing.

[39]  Alberto Leon-Garcia,et al.  Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[40]  Sandip Sarkar,et al.  A possible mechanism of stochastic resonance in the light of an extra-classical receptive field model of retinal ganglion cells , 2009, Biological Cybernetics.

[41]  Alan C. Bovik,et al.  Automatic Prediction of Perceptual Image and Video Quality , 2013, Proceedings of the IEEE.

[42]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[43]  Farid Melgani,et al.  Support vector regression with kernel combination for missing data reconstruction , 2013, IEEE Geoscience and Remote Sensing Letters.

[44]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[45]  Matti Pietikäinen,et al.  Computer Vision Using Local Binary Patterns , 2011, Computational Imaging and Vision.

[46]  Wenjun Zhang,et al.  Using Free Energy Principle For Blind Image Quality Assessment , 2015, IEEE Transactions on Multimedia.

[47]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[48]  Christophe Charrier,et al.  DCT statistics model-based blind image quality assessment , 2011, 2011 18th IEEE International Conference on Image Processing.

[49]  Martin J. Wainwright,et al.  Scale Mixtures of Gaussians and the Statistics of Natural Images , 1999, NIPS.

[50]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..