LAP: a bio-inspired local image structure descriptor and its applications

Local structural information is crucially important for human visual system to perceive natural scenes. Recent years, a variety of local image structure description methods have been proposed for the artificial modeling of visual perception. Although existing local image structure descriptors have shown successful performances, one general limitation is their numerical instability caused by ignoring the information of the spatial correlation of local orientation. In this paper, we propose a local image structure descriptor by modeling the anisotropic mechanism in the primary visual cortex. In particular, the pixel-wise anisotropy values of a given image are calculated by pseudo-Wigner-Ville distribution (PWVD) and Rényi entropy. Then the excitatory/inhibitory interactions among visual neurons in the local receptive field are modeled by measuring the similarities between their anisotropies. By mapping visual neurons to image pixels, the correlation between a central pixel and its local neighbors can be represented by a binary pattern which is named as local anisotropic pattern (LAP). Experimental results on texture classification verified that the proposed LAP has satisfactory texture classification accuracy, rotation invariance, and noise robustness; experimental results on no-reference image quality assessment demonstrated that the proposed LAP achieves state-of-the-art performance in objective evaluation of the perceptual quality of natural image, and this reflects that LAP can accurately represent the degradation of local image structure.

[1]  Nabil Aouf,et al.  A Novel Image Representation via Local Frequency Analysis for Illumination Invariant Stereo Matching , 2015, IEEE Transactions on Image Processing.

[2]  Subrahmanyam Murala,et al.  Local Tetra Patterns: A New Feature Descriptor for Content-Based Image Retrieval , 2012, IEEE Transactions on Image Processing.

[3]  Yuan Zhao,et al.  Salient target detection based on pseudo-Wigner-Ville distribution and Rényi entropy. , 2010, Optics letters.

[4]  Zhou Wang,et al.  Modern Image Quality Assessment , 2006, Modern Image Quality Assessment.

[5]  Zhenhua Guo,et al.  Rotation invariant texture classification using LBP variance (LBPV) with global matching , 2010, Pattern Recognit..

[6]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[7]  Hua Huang,et al.  No-reference image quality assessment in curvelet domain , 2014, Signal Process. Image Commun..

[8]  Timo Ahonen,et al.  Local phase quantization for blur-insensitive image analysis , 2012, Image Vis. Comput..

[9]  Hui Kong,et al.  Generalizing Laplacian of Gaussian Filters for Vanishing-Point Detection , 2013, IEEE Transactions on Intelligent Transportation Systems.

[10]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[11]  Antoine Triller,et al.  Synaptic stability and plasticity in a floating world , 2010, Current Opinion in Neurobiology.

[12]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[14]  Guangming Shi,et al.  Image Quality Assessment with Degradation on Spatial Structure , 2014, IEEE Signal Processing Letters.

[15]  Yan Guo,et al.  Local-Manifold-Learning-Based Graph Construction for Semisupervised Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Bo Yang,et al.  A comparative study on local binary pattern (LBP) based face recognition: LBP histogram versus LBP image , 2013, Neurocomputing.

[17]  David R. Musicant,et al.  Robust Linear and Support Vector Regression , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Zhi-Chao Zhang Unified Wigner-Ville distribution and ambiguity function in the linear canonical transform domain , 2015, Signal Process..

[19]  Michael G. Sadovsky,et al.  Entropy Approach in the Analysis of Anisotropy of Digital Images , 2002, Open Syst. Inf. Dyn..

[20]  C. Furmanski,et al.  An oblique effect in human primary visual cortex , 2000, Nature Neuroscience.

[21]  Jean-Michel Morel,et al.  Multiscale Image Blind Denoising , 2015, IEEE Transactions on Image Processing.

[22]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[23]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[24]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[25]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[26]  Baochang Zhang,et al.  Local Derivative Pattern Versus Local Binary Pattern: Face Recognition With High-Order Local Pattern Descriptor , 2010, IEEE Transactions on Image Processing.

[27]  S. Gabarda,et al.  Blind image quality assessment through anisotropy. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[28]  Adel Hafiane,et al.  Joint Adaptive Median Binary Patterns for texture classification , 2015, Pattern Recognit..

[29]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Guangming Shi,et al.  Visual Orientation Selectivity Based Structure Description , 2015, IEEE Transactions on Image Processing.

[31]  Jascha D. Swisher,et al.  Multiscale Pattern Analysis of Orientation-Selective Activity in the Primary Visual Cortex , 2010, The Journal of Neuroscience.

[32]  Charles F. Hockett,et al.  A mathematical theory of communication , 1948, MOCO.

[33]  Rodney A. Kennedy,et al.  Radial Function Based Kernel Design for Time-Frequency Distributions , 2010, IEEE Transactions on Signal Processing.

[34]  Kuo-Chin Fan,et al.  A Novel Local Pattern Descriptor—Local Vector Pattern in High-Order Derivative Space for Face Recognition , 2014, IEEE Transactions on Image Processing.

[35]  John K. Goutsias,et al.  A comparative study of matrix measures for maximum likelihood texture classification , 1991, IEEE Trans. Syst. Man Cybern..

[36]  Lior Wolf,et al.  Local Trinary Patterns for human action recognition , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[37]  Damon M. Chandler,et al.  No-reference image quality assessment based on log-derivative statistics of natural scenes , 2013, J. Electronic Imaging.

[38]  Dimitrios Michmizos,et al.  Synaptic Plasticity: A Unifying Model to Address Some Persisting Questions , 2011, The International journal of neuroscience.

[39]  Lorenzo Bruzzone,et al.  Kernel methods for remote sensing data analysis , 2009 .

[40]  Min Zhang,et al.  Blind Image Quality Assessment Using the Joint Statistics of Generalized Local Binary Pattern , 2015, IEEE Signal Processing Letters.

[41]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  G. Crooks On Measures of Entropy and Information , 2015 .

[43]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[44]  Hugo Thienpont,et al.  Optical and Digital Image Processing: Fundamentals and Applications , 2011 .

[45]  F. Campbell,et al.  Orientational selectivity of the human visual system , 1966, The Journal of physiology.

[46]  Paul Fieguth,et al.  Statistical Image Processing and Multidimensional Modeling , 2010 .

[47]  Subrahmanyam Murala,et al.  Local Gabor maximum edge position octal patterns for image retrieval , 2015, Neurocomputing.

[48]  Farid Melgani,et al.  Support vector regression with kernel combination for missing data reconstruction , 2013, IEEE Geoscience and Remote Sensing Letters.

[49]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[50]  Li Ma,et al.  Local Manifold Learning-Based $k$ -Nearest-Neighbor for Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[52]  Matti Pietikäinen,et al.  Outex - new framework for empirical evaluation of texture analysis algorithms , 2002, Object recognition supported by user interaction for service robots.

[53]  Damien J. Mannion,et al.  Orientation anisotropies in human visual cortex. , 2010, Journal of neurophysiology.

[54]  Colin W. G. Clifford,et al.  Orientation anisotropies in human primary visual cortex depend on contrast , 2015, NeuroImage.

[55]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[56]  Sandip Sarkar,et al.  A possible mechanism of stochastic resonance in the light of an extra-classical receptive field model of retinal ganglion cells , 2009, Biological Cybernetics.

[57]  Kentaro Yamada,et al.  Inter-subject neural code converter for visual image representation , 2015, NeuroImage.

[58]  A. Bovik F Mean Squared Error: Love It or Leave It? , 2009 .

[59]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[60]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[61]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[62]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[63]  Sang-Hun Lee,et al.  Coaxial Anisotropy of Cortical Point Spread in Human Visual Areas , 2013, The Journal of Neuroscience.

[64]  Li Zhang,et al.  Texture Classification Using Local Pattern Based on Vector Quantization , 2015, IEEE Transactions on Image Processing.

[65]  Hyun Seung Yang,et al.  Sorted Consecutive Local Binary Pattern for Texture Classification , 2015, IEEE Transactions on Image Processing.