Directional Neighborhood Topologies Based Multi-Scale Quinary Pattern for Texture Classification

This paper ideates a new computationally simple and effective local image feature descriptor, referred to as Directional Neighborhood Topologies based Multi-scale Quinary Pattern (DNT-MQP) for texture description and classification. The essence of DNT-MQP is to encode the structure of local neighborhood by analyzing the differential excitation and directional information using various directional neighborhood topologies and new pattern encoding scheme. We first designed four different versions of single scale DNT-QP features based on four directional neighborhood topologies based sampling sets which are then combined together to build the effective multiscale DNT-MQP model. Unlike some existing parametric methods that employ static thresholds to perform thresholding, the construction process of DNT-MQP includes an automatic mechanism for dynamic thresholds estimation. Thanks to a richer local description ensured by exploiting complementary information resulting from single scale DNT-QP operators’ combination, DNT-MQP descriptor has high capability to elicit stable and discriminative feature representation than other local feature descriptors. In addition, DNT-QP has the advantages of computational simplicity in feature extraction and low-dimensionality in feature representation. The effectiveness of DNT-QP is evaluated on sixteen challenging texture datasets and it is found that it maintains a high level of performance stability where the achieved performances are competitive or better than several recent most promising state-of-the-art texture descriptors as well as deep learning-based feature extraction approaches. Impressively, DNT-MQP showed good tolerance to rotation as well as illumination, scale and viewpoint changes against certain descriptors which are originally conceived to deal with these challenges. Furthermore, statistical hypothesis testing through Wilcoxon signed rank test is applied to prove the statistical significance of the accuracy improvement obtained in all the datasets.

[1]  Tiecheng Song,et al.  Robust Texture Description Using Local Grouped Order Pattern and Non-Local Binary Pattern , 2021, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Ki-Hyun Jung,et al.  Local diagonal extrema number pattern: A new feature descriptor for face recognition , 2018, Future Gener. Comput. Syst..

[3]  Francesco Bianconi,et al.  Image classification with binary gradient contours , 2011 .

[4]  Sengul Dogan,et al.  A novel and accurate chess pattern for automated texture classification , 2019 .

[5]  Satish Kumar Singh,et al.  R-theta local neighborhood pattern for unconstrained facial image recognition and retrieval , 2018, Multimedia Tools and Applications.

[6]  Paolo Napoletano,et al.  Improved opponent color local binary patterns: an effective local image descriptor for color texture classification , 2017, J. Electronic Imaging.

[7]  R. K. Goyal,et al.  Scale and rotation invariant texture analysis based on structural property , 1995, Proceedings of IECON '95 - 21st Annual Conference on IEEE Industrial Electronics.

[8]  Umapada Pal,et al.  LOOP Descriptor: Local Optimal-Oriented Pattern , 2017, IEEE Signal Processing Letters.

[9]  Satish Kumar Singh,et al.  Local quadruple pattern: A novel descriptor for facial image recognition and retrieval , 2017, Comput. Electr. Eng..

[10]  Abdelmgeid A. Ali,et al.  Ear recognition using local binary patterns: A comparative experimental study , 2019, Expert Syst. Appl..

[11]  Achour Ouslimani,et al.  Rotation-invariant features based on directional coding for texture classification , 2019, Neural Computing and Applications.

[12]  Shervan Fekri Ershad,et al.  Texture image analysis and texture classification methods - A review , 2019, ArXiv.

[13]  Shervan Fekri-Ershad,et al.  Bark texture classification using improved local ternary patterns and multilayer neural network , 2020, Expert Syst. Appl..

[14]  Rangasami L. Kashyap,et al.  A Model-Based Method for Rotation Invariant Texture Classification , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Andrew Zisserman,et al.  A Statistical Approach to Material Classification Using Image Patch Exemplars , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Naoto Yokoya,et al.  Invariant Attribute Profiles: A Spatial-Frequency Joint Feature Extractor for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Loris Nanni,et al.  Local binary patterns variants as texture descriptors for medical image analysis , 2010, Artif. Intell. Medicine.

[18]  Yassine Ruichek,et al.  Attractive-and-repulsive center-symmetric local binary patterns for texture classification , 2019, Eng. Appl. Artif. Intell..

[19]  G. Sucharitha,et al.  Biomedical image retrieval by using local directional edge binary patterns and Zernike moments , 2019, Multimedia Tools and Applications.

[20]  Bhabatosh Chanda,et al.  Local directional ZigZag pattern: A rotation invariant descriptor for texture classification , 2018, Pattern Recognit. Lett..

[21]  Matti Pietikäinen,et al.  Two decades of local binary patterns: A survey , 2016, ArXiv.

[22]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[23]  Jian Su,et al.  A novel hierarchical approach for multispectral palmprint recognition , 2015, Neurocomputing.

[24]  Y. Ruichek,et al.  A comprehensive comparative study of handcrafted methods for face recognition LBP-like and non LBP operators , 2019, Multimedia Tools and Applications.

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Ali Douik,et al.  Image classification by combining local and global features , 2018, The Visual Computer.

[27]  Yassine Ruichek,et al.  Mixed neighborhood topology cross decoded patterns for image-based face recognition , 2018, Expert Syst. Appl..

[28]  Ghassan Al-Regib,et al.  Texture retrieval using periodically extended and adaptive curvelets , 2019, Signal Process. Image Commun..

[29]  Yassine Ruichek,et al.  O3S-MTP: Oriented star sampling structure based multi-scale ternary pattern for texture classification , 2020, Signal Process. Image Commun..

[30]  Yong Xu,et al.  A Projective Invariant for Textures , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[31]  Francesco Bianconi,et al.  Robust color texture features based on ranklets and discrete Fourier transform , 2009, J. Electronic Imaging.

[32]  J. Duvernoy.  Optical-digital processing of directional terrain textures invariant under translation, rotation, and change of scale. , 1984, Applied optics.

[33]  Junding Sun,et al.  Face recognition based on multi-scale local directional value , 2019, Multimedia Tools and Applications.

[34]  Li Liu,et al.  Surface Defect Classification for Hot-Rolled Steel Strips by Selectively Dominant Local Binary Patterns , 2019, IEEE Access.

[35]  Sengul Dogan,et al.  Pyramid and multi kernel based local binary pattern for texture recognition , 2019, Journal of Ambient Intelligence and Humanized Computing.

[36]  Huimin Lu,et al.  An LBP encoding scheme jointly using quaternionic representation and angular information , 2019, Neural Computing and Applications.

[37]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[38]  Cedric Nishan Canagarajah,et al.  Robust rotation invariant texture classification , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[39]  Balasubramanian Raman,et al.  Local neighborhood difference pattern: A new feature descriptor for natural and texture image retrieval , 2018, Multimedia Tools and Applications.

[40]  Odemir M. Bruno,et al.  Spatio-spectral networks for color-texture analysis , 2019, Inf. Sci..

[41]  Yong Xu,et al.  Viewpoint Invariant Texture Description Using Fractal Analysis , 2009, International Journal of Computer Vision.

[42]  Pavan Chakraborty,et al.  Cascaded asymmetric local pattern: a novel descriptor for unconstrained facial image recognition and retrieval , 2019, Multimedia Tools and Applications.

[43]  Thanh Phuong Nguyen,et al.  Statistical binary patterns for rotational invariant texture classification , 2016, Neurocomputing.

[44]  Zhenhua Guo,et al.  Local directional derivative pattern for rotation invariant texture classification , 2011, Neural Computing and Applications.

[45]  Larry S. Davis,et al.  Polarograms: A new tool for image texture analysis , 1979, Pattern Recognit..

[46]  Hongliang Li,et al.  Exploring space-frequency co-occurrences via local quantized patterns for texture representation , 2015, Pattern Recognit..

[47]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[48]  Jianfei Cai,et al.  LETRIST: Locally Encoded Transform Feature Histogram for Rotation-Invariant Texture Classification , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[49]  Yassine Ruichek,et al.  Repulsive-and-attractive local binary gradient contours: New and efficient feature descriptors for texture classification , 2018, Inf. Sci..

[50]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  Hsu-Yung Cheng,et al.  Image Classification Using Synchronized Rotation Local Ternary Pattern , 2020, IEEE Sensors Journal.

[52]  Matti Pietikäinen,et al.  Median Robust Extended Local Binary Pattern for Texture Classification , 2016, IEEE Transactions on Image Processing.

[53]  Farshad Tajeripour,et al.  Developing a Novel Approach for Stone Porosity Computing Using Modified Local Binary Patterns and Single Scale Retinex , 2014 .

[54]  Zhenhua Guo,et al.  Rotation invariant texture classification using LBP variance (LBPV) with global matching , 2010, Pattern Recognit..

[55]  Debotosh Bhattacharjee,et al.  Pattern of Local Gravitational Force (PLGF): A Novel Local Image Descriptor , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Jin Liu,et al.  A novel local texture feature extraction method called multi-direction local binary pattern , 2018, Multimedia Tools and Applications.

[57]  Moncef Gabbouj,et al.  Noise-Robust Texture Description Using Local Contrast Patterns via Global Measures , 2014, IEEE Signal Processing Letters.

[58]  Satish Kumar Singh,et al.  Centre symmetric quadruple pattern: A novel descriptor for facial image recognition and retrieval , 2017, Pattern Recognit. Lett..

[59]  Yassine Ruichek,et al.  Local Concave-and-Convex Micro-Structure Patterns for texture classification , 2018, Pattern Recognit..

[60]  Yan Ren,et al.  Median local ternary patterns optimized with rotation-invariant uniform-three mapping for noisy texture classification , 2018, Pattern Recognit..

[61]  Yassine Ruichek,et al.  Multi Level Directional Cross Binary Patterns: New handcrafted descriptor for SVM-based texture classification , 2020, Eng. Appl. Artif. Intell..

[62]  Shervan Fekri Ershad,et al.  Texture image Classification based on improved local Quinary patterns , 2019, Multimedia Tools and Applications.

[63]  G. EICHMANN,et al.  Topologically invariant texture descriptors , 1988, Comput. Vis. Graph. Image Process..

[64]  Partha Pratim Roy,et al.  Local Neighborhood Intensity Pattern: A new texture feature descriptor for image retrieval , 2017, Expert Syst. Appl..

[65]  F. S. Cohen,et al.  Classification of Rotated and Scaled Textured Images Using Gaussian Markov Random Field Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[66]  Matti Pietikäinen,et al.  From BoW to CNN: Two Decades of Texture Representation for Texture Classification , 2018, International Journal of Computer Vision.

[67]  Yassine Ruichek,et al.  Local directional ternary pattern: A New texture descriptor for texture classification , 2018, Comput. Vis. Image Underst..

[68]  Paul W. Fieguth,et al.  Texture Classification from Random Features , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[70]  Shiv Ram Dubey,et al.  Local Wavelet Pattern: A New Feature Descriptor for Image Retrieval in Medical CT Databases , 2015, IEEE Transactions on Image Processing.

[71]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.