Blind image blur metric based on orientation-aware local patterns

Abstract We develop an effective blind image blur assessment model based on a novel orientation-aware local pattern operator. The resulting metric first proposes an orientation-aware local pattern operator that fully considers the impact of anisotropy of orientation selectivity mechanism and the gradient orientation effect on visual perception. Our results indicate that the proposed descriptor is sensitive to image distortion and can effectively represent orientation information. We thus use it to extract image structure information. In order to enhance features’ representation capability for blur image, we extract edge information by a Toggle operator and use it as weight of local patterns to optimize the computed structural statistical features. Finally, a support vector regression method is used to train a predictive model with optimized features and subjective scores. Experimental results obtained on six public databases show that our proposed model performs better than state-of-the-art image blur assessment models.

[1]  Baojun Zhao,et al.  Gradient-based no-reference image blur assessment using extreme learning machine , 2016, Neurocomputing.

[2]  Xiaojun Wu,et al.  No-reference image blur index based on singular value curve , 2014, J. Vis. Commun. Image Represent..

[3]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[4]  R. Mansfield,et al.  Neural Basis of Orientation Perception in Primate Vision , 1974, Science.

[5]  Lina J. Karam,et al.  A No-Reference Image Blur Metric Based on the Cumulative Probability of Blur Detection (CPBD) , 2011, IEEE Transactions on Image Processing.

[6]  Guangming Shi,et al.  Attended Visual Content Degradation Based Reduced Reference Image Quality Assessment , 2018, IEEE Access.

[7]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[8]  Mohammad Reza Mosavi,et al.  Flying small target detection in IR images based on adaptive toggle operator , 2018, IET Comput. Vis..

[9]  Lei Zhang,et al.  Blind Image Quality Assessment Using Joint Statistics of Gradient Magnitude and Laplacian Features , 2014, IEEE Transactions on Image Processing.

[10]  Wenjun Zhang,et al.  No-Reference Quality Metric of Contrast-Distorted Images Based on Information Maximization , 2017, IEEE Transactions on Cybernetics.

[11]  Baochang Zhang,et al.  Local Derivative Pattern Versus Local Binary Pattern: Face Recognition With High-Order Local Pattern Descriptor , 2010, IEEE Transactions on Image Processing.

[12]  Qingjie Zhao,et al.  Blind image quality assessment by relative gradient statistics and adaboosting neural network , 2016, Signal Process. Image Commun..

[13]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Weisi Lin,et al.  No-Reference Image Sharpness Assessment in Autoregressive Parameter Space , 2015, IEEE Transactions on Image Processing.

[15]  Alan C. Bovik,et al.  Objective quality assessment of multiply distorted images , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[16]  Nikolay N. Ponomarenko,et al.  Image database TID2013: Peculiarities, results and perspectives , 2015, Signal Process. Image Commun..

[17]  Weisi Lin,et al.  No-Reference and Robust Image Sharpness Evaluation Based on Multiscale Spatial and Spectral Features , 2017, IEEE Transactions on Multimedia.

[18]  Leida Li,et al.  No Reference Quality Assessment for Screen Content Images With Both Local and Global Feature Representation , 2018, IEEE Transactions on Image Processing.

[19]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[20]  László Bernáth,et al.  Straightness as the Main Factor of the Hermann Grid Illusion , 2008, Perception.

[21]  Alex ChiChung Kot,et al.  A Fast Approach for No-Reference Image Sharpness Assessment Based on Maximum Local Variation , 2014, IEEE Signal Processing Letters.

[22]  Weisi Lin,et al.  Image Sharpness Assessment by Sparse Representation , 2016, IEEE Transactions on Multimedia.

[23]  Chunping Hou,et al.  No reference image blurriness assessment with local binary patterns , 2017, J. Vis. Commun. Image Represent..

[24]  Mislav Grgic,et al.  Blind image sharpness assessment based on local contrast map statistics , 2018, J. Vis. Commun. Image Represent..

[25]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[27]  Damon M. Chandler,et al.  ${\bf S}_{3}$: A Spectral and Spatial Measure of Local Perceived Sharpness in Natural Images , 2012, IEEE Transactions on Image Processing.

[28]  F. Campbell,et al.  Neurophysiological Localization of the Vertical and Horizontal Visual Coordinates in Man , 1970, Science.

[29]  Guangming Shi,et al.  Orientation selectivity based visual pattern for reduced-reference image quality assessment , 2016, Inf. Sci..

[30]  Guangming Shi,et al.  Blind Quality Index for Multiply Distorted Images Using Biorder Structure Degradation and Nonlocal Statistics , 2018, IEEE Transactions on Multimedia.

[31]  Yang Zhao,et al.  Completed Local Binary Count for Rotation Invariant Texture Classification , 2012, IEEE Transactions on Image Processing.

[32]  Matti Pietikäinen,et al.  Combining LBP Difference and Feature Correlation for Texture Description , 2014, IEEE Transactions on Image Processing.

[33]  Alan Conrad Bovik,et al.  Binocular spatial activity and reverse saliency driven no-reference stereopair quality assessment , 2017, Signal Process. Image Commun..

[34]  Zhou Wang,et al.  Image Sharpness Assessment Based on Local Phase Coherence , 2013, IEEE Transactions on Image Processing.

[35]  Mariusz Oszust,et al.  Local Feature Descriptor and Derivative Filters for Blind Image Quality Assessment , 2019, IEEE Signal Processing Letters.

[36]  Alan C. Bovik,et al.  Automatic Prediction of Perceptual Image and Video Quality , 2013, Proceedings of the IEEE.

[37]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[38]  P. H. Schiller,et al.  The Hermann Grid Illusion Revisited , 2005, Perception.

[39]  Xiangzhi Bai,et al.  Edge preserved image fusion based on multiscale toggle contrast operator , 2011, Image Vis. Comput..

[40]  Hua Huang,et al.  Image Quality Assessment Using Directional Anisotropy Structure Measurement , 2017, IEEE Transactions on Image Processing.

[41]  Yibing Zhan,et al.  No-Reference Image Sharpness Assessment Based on Maximum Gradient and Variability of Gradients , 2018, IEEE Transactions on Multimedia.

[42]  Shu-Tao Xia,et al.  Referenceless quality metric of multiply-distorted images based on structural degradation , 2018, Neurocomputing.

[43]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[44]  Hua Huang,et al.  No-reference image quality assessment based on spatial and spectral entropies , 2014, Signal Process. Image Commun..

[45]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[46]  Sonja Grgic,et al.  VCL@FER image quality assessment database , 2011, Proceedings ELMAR-2011.