Local Concave-and-Convex Micro-Structure Patterns for texture classification

A formal definition of Concave and Convex Binary Thresholding Functions are introduced.Two new LBP-like descriptors: Local Concave and Convex Micro-Structures Pattern (LCvMSP and LCxMSP) descriptors are proposed.LCvMSP and LCxMSP are concatened into a single vector feature to obtain the multiscale LCCMSP descriptor.A statistical hypothesis testing based method for parameters optimization on several datasets is proposed.The proposed methods demonstrate superior performance to 79 LBP variants and non-LBP methods over 13 texture datasets. Motivated by researching new image texture modeling that improves state-of-the-art LBP variants and non-LBP descriptors, this paper proposes a novel approach for constructing local image descriptors, which are suitable for histogram based image representation. Instead of heuristic code constructions, the proposed approach is based on local concave-and-convex characteristics, which have high ability to extract discriminative and stable texture representation. Different from the majority of descriptors that only encode relationships between the pixels in doublets around central pixel (within 33 neighborhood), the proposed approach encodes relationships between the pixels in triplets by including the central pixel in the modeling. We build two distinct descriptors by dividing local features into two distinct groups, i.e., local concave and convex microstructure patterns (LCvMSP and LCxMSP), according to relationships between the pixels inside the triplets, formed along closed path around the central pixel of a 33-grayscale image patch. To make the descriptors more insensitive to noise and invariant to monotonic gray scale transformation, two supplementary triplets are added in the modeling. These triplets are formed using the central pixel and four virtual pixels set to the median of the grey-scale values of the 33 neighbourhood and the whole image and the average local and global gray levels respectively. The histograms obtained from the single scale descriptors LCvMSP and LCxMSP are concatenated together to build multi-scale histogram feature vector referred to as local concave-and-convex micro-structure pattern (LCCMSP), that is expected to better represent salient local texture structure. We evaluated the effectiveness of the proposed methods on thirteen challenging representative widely-used texture datasets, and found that the proposed LCvMSP, LCxMSP and LCCMSP operators achieve performances that are competitive or better than a large number of recent most promising state-of- the-art LBP variants and non-LBP descriptors. Statistical comparison based on Wilcoxon signed rank test demonstrated that the proposed methods are the top three over all the tested datasets.

[1]  Paul W. Fieguth,et al.  Texture Classification from Random Features , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Laura Fernández-Robles,et al.  Local Oriented Statistics Information Booster (LOSIB) for Texture Classification , 2014, 2014 22nd International Conference on Pattern Recognition.

[3]  B. Xu,et al.  Comparison of gray-level reduction and different texture spectrum encoding methods for land-use classification using a panchromatic Ikonos image , 2003 .

[4]  Shu Liao,et al.  Dominant Local Binary Patterns for Texture Classification , 2009, IEEE Transactions on Image Processing.

[5]  Housam Khalifa Bashier,et al.  Plant Identification Based on Leaf Shape and Texture Pattern Using Local Graph Structure (LGS) , 2013 .

[6]  A. Ouslimani,et al.  NOISE-ROBUST TEXTURE FEATURES USING LOCAL DIRECTIONAL RANK CODING , 2016 .

[7]  Francisco José Madrid-Cuevas,et al.  Simplified Texture Unit: A New Descriptor of the Local Texture in Gray-Level Images , 2003, IbPRIA.

[8]  Dimitris K. Iakovidis,et al.  Fuzzy binary patterns for uncertainty-aware texture representation , 2012 .

[9]  Francesco Bianconi,et al.  Dominant local binary patterns for texture classification: Labelled or unlabelled? , 2015, Pattern Recognit. Lett..

[10]  Sun-Yuan Kung,et al.  Decision-based neural networks with signal/image classification applications , 1995, IEEE Trans. Neural Networks.

[11]  Yang Zhao,et al.  Completed Local Binary Count for Rotation Invariant Texture Classification , 2012, IEEE Transactions on Image Processing.

[12]  Fakhry M. Khellah,et al.  Texture Classification Using Dominant Neighborhood Structure , 2011, IEEE Transactions on Image Processing.

[13]  Gerald Schaefer,et al.  A comprehensive benchmark of local binary pattern algorithms for texture retrieval , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[14]  Matti Pietikäinen,et al.  Rotation Invariant Image Description with Local Binary Pattern Histogram Fourier Features , 2009, SCIA.

[15]  Kai-Kuang Ma,et al.  Quad binary pattern and its application in mean-shift tracking , 2016, Neurocomputing.

[16]  T. J. Stonham,et al.  A single layer neural network for texture discrimination , 1991, 1991., IEEE International Sympoisum on Circuits and Systems.

[17]  Wei Wei,et al.  Centralized Binary Patterns Embedded with Image Euclidean Distance for Facial Expression Recognition , 2008, 2008 Fourth International Conference on Natural Computation.

[18]  Wen Gao,et al.  Local Quantization Code histogram for texture classification , 2016, Neurocomputing.

[19]  Housam Khalifa Bashier,et al.  Texture classification via extended local graph structure , 2016 .

[20]  Francesco Bianconi,et al.  Image classification with binary gradient contours , 2011 .

[21]  Dong-Chen He,et al.  Texture Unit, Texture Spectrum, And Texture Analysis , 1990 .

[22]  R. K. Goyal,et al.  Scale and rotation invariant texture analysis based on structural property , 1995, Proceedings of IECON '95 - 21st Annual Conference on IEEE Industrial Electronics.

[23]  Azriel Rosenfeld,et al.  A Comparative Study of Texture Measures for Terrain Classification , 1975, IEEE Transactions on Systems, Man, and Cybernetics.

[24]  Xudong Jiang,et al.  Noise-Resistant Local Binary Pattern With an Embedded Error-Correction Mechanism , 2013, IEEE Transactions on Image Processing.

[25]  Yong Xu,et al.  Scale-space texture description on SIFT-like textons , 2012, Comput. Vis. Image Underst..

[26]  Dong-Chen He,et al.  Unsupervised textural classification of images using the texture spectrum , 1992, Pattern Recognit..

[27]  Cedric Nishan Canagarajah,et al.  Robust rotation invariant texture classification , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[28]  Kalaiarasi Sonai Muthu,et al.  Face recognition with Symmetric Local Graph Structure (SLGS) , 2014, Expert Syst. Appl..

[29]  Yee-Hong Yang,et al.  Rotation Invariant Local Frequency Descriptors for Texture Classification , 2013, IEEE Transactions on Image Processing.

[30]  Loris Nanni,et al.  Survey on LBP based texture descriptors for image classification , 2012, Expert Syst. Appl..

[31]  Balasubramanian Raman,et al.  Local neighborhood difference pattern: A new feature descriptor for natural and texture image retrieval , 2018, Multimedia Tools and Applications.

[32]  Ling Shao,et al.  Spatio-temporal Dynamic Texture Descriptors for Human Motion Recognition , 2011, Intelligent Video Event Analysis and Understanding.

[33]  Paul Southam,et al.  Theoretical and experimental comparison of different approaches for color texture classification , 2011, J. Electronic Imaging.

[34]  Meng Wu,et al.  Hybrid center-symmetric local pattern for dynamic background subtraction , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[35]  Ömer Faruk Ertuğrul,et al.  Two novel local binary pattern descriptors for texture analysis , 2015, Appl. Soft Comput..

[36]  Marko Heikkilä,et al.  Description of interest regions with local binary patterns , 2009, Pattern Recognit..

[37]  Yong Xu,et al.  A new texture descriptor using multifractal analysis in multi-orientation wavelet pyramid , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  Zhenhua Guo,et al.  Rotation invariant texture classification using adaptive LBP with directional statistical features , 2010, 2010 IEEE International Conference on Image Processing.

[39]  Francesco Bianconi,et al.  Robust color texture features based on ranklets and discrete Fourier transform , 2009, J. Electronic Imaging.

[40]  Loris Nanni,et al.  A local approach based on a Local Binary Patterns variant texture descriptor for classifying pain states , 2010, Expert Syst. Appl..

[41]  M. Cervantes,et al.  Quasi-statistical approach to digital binary image representation , 1996 .

[42]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[43]  Subrahmanyam Murala,et al.  Local Gabor maximum edge position octal patterns for image retrieval , 2015, Neurocomputing.

[44]  Qiang Wu,et al.  Fast and Accurate Human Detection Using a Cascade of Boosted MS-LBP Features , 2012, IEEE Signal Processing Letters.

[45]  Thierry Bouwmans,et al.  An eXtended Center-Symmetric Local Binary Pattern for Background Modeling and Subtraction in Videos , 2015, VISAPP.

[46]  Matti Pietikäinen,et al.  Combining LBP Difference and Feature Correlation for Texture Description , 2014, IEEE Transactions on Image Processing.

[47]  Chein-I. Chang,et al.  Gradient texture unit coding for texture analysis , 2004 .

[48]  Vasif V. Nabiyev,et al.  Down syndrome recognition using local binary patterns and statistical evaluation of the system , 2011, Expert Syst. Appl..

[49]  Patrick Robertson,et al.  Bayesian Time Delay Estimation of GNSS Signals in Dynamic Multipath Environments , 2008 .

[50]  Yong Xu,et al.  Viewpoint Invariant Texture Description Using Fractal Analysis , 2009, International Journal of Computer Vision.

[51]  Yang Gao,et al.  High-Sensitivity GPS Data Classification Based on Signal Degradation Conditions , 2007, IEEE Transactions on Vehicular Technology.

[52]  Baochang Zhang,et al.  Local Derivative Pattern Versus Local Binary Pattern: Face Recognition With High-Order Local Pattern Descriptor , 2010, IEEE Transactions on Image Processing.

[53]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[54]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[55]  Satish Kumar Singh,et al.  Local quadruple pattern: A novel descriptor for facial image recognition and retrieval , 2017, Comput. Electr. Eng..

[56]  Matti Pietikäinen,et al.  Efficient Image Appearance Description Using Dense Sampling Based Local Binary Patterns , 2012, ACCV.

[57]  Di Huang,et al.  Local Binary Patterns and Its Application to Facial Image Analysis: A Survey , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[58]  R. Balasubramanian,et al.  Local maximum edge binary patterns: A new descriptor for image retrieval and object tracking , 2012, Signal Process..

[59]  Yee-Hong Yang,et al.  Noise robust rotation invariant features for texture classification , 2013, Pattern Recognit..

[60]  Matti Pietikäinen,et al.  Modeling pixel process with scale invariant local patterns for background subtraction in complex scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[61]  Mu Zhi A Robust Method for Local Image Feature Region Description , 2011 .

[62]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[63]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[64]  Zhenhua Guo,et al.  Local directional derivative pattern for rotation invariant texture classification , 2011, Neural Computing and Applications.

[65]  Paolo Napoletano,et al.  Evaluating color texture descriptors under large variations of controlled lighting conditions , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[66]  T. John Stonham,et al.  Texture classification using n-tuple pattern recognition , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[67]  Kazunori Miyata,et al.  Effective Feature Description Using Intensity Order Local Binary Pattern , 2013, 2013 International Conference on Cyberworlds.

[68]  Larry S. Davis,et al.  Polarograms: A new tool for image texture analysis , 1979, Pattern Recognit..

[69]  Matti Pietikäinen,et al.  Median Robust Extended Local Binary Pattern for Texture Classification , 2016, IEEE Transactions on Image Processing.

[70]  J. Duvernoy Optical-digital processing of directional terrain textures invariant under translation, rotation, and change of scale. , 1984, Applied optics.

[71]  Abdelmalik Taleb-Ahmed,et al.  Gender and texture classification: A comparative analysis using 13 variants of local binary patterns , 2015, Pattern Recognit. Lett..

[72]  Matti Pietikäinen,et al.  Local binary features for texture classification: Taxonomy and experimental study , 2017, Pattern Recognit..

[73]  Hui Zeng,et al.  Center Symmetric Local Multilevel Pattern Based Descriptor and Its Application in Image Matching , 2016 .

[74]  C. Schmid,et al.  Description of Interest Regions with Center-Symmetric Local Binary Patterns , 2006, ICVGIP.

[75]  Ville Ojansivu,et al.  Blur Insensitive Texture Classification Using Local Phase Quantization , 2008, ICISP.

[76]  F. S. Cohen,et al.  Classification of Rotated and Scaled Textured Images Using Gaussian Markov Random Field Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[77]  Changsheng Liu,et al.  Adjacent evaluation of local binary pattern for texture classification , 2015, J. Vis. Commun. Image Represent..

[78]  Ida-Maria Sintorn,et al.  Evaluation of noise robustness for local binary pattern descriptors in texture classification , 2013, EURASIP J. Image Video Process..

[79]  Hanqing Lu,et al.  Face detection using improved LBP under Bayesian framework , 2004, Third International Conference on Image and Graphics (ICIG'04).

[80]  Paul W. Fieguth,et al.  Extended local binary patterns for texture classification , 2012, Image Vis. Comput..

[81]  Nong Sang,et al.  Robust Illumination Invariant Texture Classification Using Gradient Local Binary Patterns , 2011, 2011 International Workshop on Multi-Platform/Multi-Sensor Remote Sensing and Mapping.

[82]  Karen O. Egiazarian,et al.  Dominant Rotated Local Binary Patterns (DRLBP) for texture classification , 2016, Pattern Recognit. Lett..

[83]  Shyam Krishna Nagar,et al.  Local extreme complete trio pattern for multimedia image retrieval system , 2016, Int. J. Autom. Comput..

[84]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[85]  Andrew Zisserman,et al.  A Statistical Approach to Texture Classification from Single Images , 2005, International Journal of Computer Vision.

[86]  Zhenhua Guo,et al.  Rotation invariant texture classification using LBP variance (LBPV) with global matching , 2010, Pattern Recognit..

[87]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[88]  Michael Unser,et al.  Sum and Difference Histograms for Texture Classification , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[89]  Olivier Alata,et al.  Classification of rotated and scaled textures using HMHV spectrum estimation and the Fourier-Mellin transform , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[90]  Douglas C. Montgomery,et al.  Applied Statistics and Probability for Engineers, Third edition , 1994 .

[91]  G. EICHMANN,et al.  Topologically invariant texture descriptors , 1988, Comput. Vis. Graph. Image Process..

[92]  Lewis D. Griffin,et al.  Using Basic Image Features for Texture Classification , 2010, International Journal of Computer Vision.

[93]  Bertrand Zavidovique,et al.  Median Binary Pattern for Textures Classification , 2007, ICIAR.

[94]  Tieniu Tan,et al.  Combining Statistics of Geometrical and Correlative Features for 3D Face Recognition , 2006, BMVC.

[95]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[96]  Chunhua Shen,et al.  Pyramid Center-Symmetric Local Binary/Trinary Patterns for Effective Pedestrian Detection , 2010, ACCV.

[97]  Md. Monirul Islam,et al.  Rotation Invariant Curvelet Features for Region Based Image Retrieval , 2011, International Journal of Computer Vision.

[98]  Marcos X. Álvarez-Cid,et al.  Texture Description Through Histograms of Equivalent Patterns , 2012, Journal of Mathematical Imaging and Vision.

[99]  Yong Xu,et al.  A Projective Invariant for Textures , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[100]  A. Kundu,et al.  Rotation and gray-scale transform invariant texture recognition using hidden Markov model , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[101]  Rangasami L. Kashyap,et al.  A Model-Based Method for Rotation Invariant Texture Classification , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[102]  Andrew Zisserman,et al.  A Statistical Approach to Material Classification Using Image Patch Exemplars , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[103]  Loris Nanni,et al.  Local binary patterns variants as texture descriptors for medical image analysis , 2010, Artif. Intell. Medicine.

[104]  Matti Pietikäinen,et al.  Discriminative features for texture description , 2012, Pattern Recognit..

[105]  Matti Pietikäinen,et al.  Descriptor Learning Based on Fisher Separation Criterion for Texture Classification , 2010, ACCV.

[106]  Xiaosheng Wu,et al.  An Effective Texture Spectrum Descriptor , 2009, 2009 Fifth International Conference on Information Assurance and Security.

[107]  Ahmad Reza Naghsh-Nilchi,et al.  Noise tolerant local binary pattern operator for efficient texture analysis , 2012, Pattern Recognit. Lett..

[108]  Andrew Zisserman,et al.  Texture classification: are filter banks necessary? , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[109]  Ramin Zabih,et al.  Non-parametric Local Transforms for Computing Visual Correspondence , 1994, ECCV.

[110]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.