Petersen Graph Multi-Orientation Based Multi-Scale Ternary Pattern (PGMO-MSTP): An Efficient Descriptor for Texture and Material Recognition

Classifying and modeling texture images, especially those with significant rotation, illumination, scale, and view-point variations, is a hot topic in the computer vision field. Inspired by local graph structure (LGS), local ternary patterns (LTP), and their variants, this paper proposes a novel image feature descriptor for texture and material classification, which we call Petersen Graph Multi-Orientation based Multi-Scale Ternary Pattern (PGMO-MSTP). PGMO-MSTP is a histogram representation that efficiently encodes the joint information within an image across feature and scale spaces, exploiting the concepts of both LTP-like and LGS-like descriptors, in order to overcome the shortcomings of these approaches. We first designed two single-scale horizontal and vertical Petersen Graph-based Ternary Pattern descriptors (<inline-formula> <tex-math notation="LaTeX">$PGTP_{h}$ </tex-math></inline-formula> and <inline-formula> <tex-math notation="LaTeX">$PGTP_{v}$ </tex-math></inline-formula>). The essence of <inline-formula> <tex-math notation="LaTeX">$PGTP_{h}$ </tex-math></inline-formula> and <inline-formula> <tex-math notation="LaTeX">$PGTP_{v}$ </tex-math></inline-formula> is to encode each <inline-formula> <tex-math notation="LaTeX">$5\times 5$ </tex-math></inline-formula> image patch, extending the ideas of the LTP and LGS concepts, according to relationships between pixels sampled in a variety of spatial arrangements (i.e., up, down, left, and right) of Petersen graph-shaped oriented sampling structures. The histograms obtained from the single-scale descriptors <inline-formula> <tex-math notation="LaTeX">$PGTP_{h}$ </tex-math></inline-formula> and <inline-formula> <tex-math notation="LaTeX">$PGTP_{v}$ </tex-math></inline-formula> are then combined, in order to build the effective multi-scale PGMO-MSTP model. Extensive experiments are conducted on sixteen challenging texture data sets, demonstrating that PGMO-MSTP can outperform state-of-the-art handcrafted texture descriptors and deep learning-based feature extraction approaches. Moreover, a statistical comparison based on the Wilcoxon signed rank test demonstrates that PGMO-MSTP performed the best over all tested data sets.

[1]  Partha Pratim Roy,et al.  Local Neighborhood Intensity Pattern: A new texture feature descriptor for image retrieval , 2017, Expert Syst. Appl..

[2]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[4]  Ali Douik,et al.  Image classification by combining local and global features , 2018, The Visual Computer.

[5]  Satish Kumar Singh,et al.  Local quadruple pattern: A novel descriptor for facial image recognition and retrieval , 2017, Comput. Electr. Eng..

[6]  Changsheng Liu,et al.  Adjacent evaluation of local binary pattern for texture classification , 2015, J. Vis. Commun. Image Represent..

[7]  Wen Gao,et al.  Local Quantization Code histogram for texture classification , 2016, Neurocomputing.

[8]  Xiaojun Qi,et al.  Face recognition under varying illuminations using logarithmic fractal dimension-based complete eight local directional patterns , 2016, Neurocomputing.

[9]  Michael Felsberg,et al.  Unveiling the Power of Deep Tracking , 2018, ECCV.

[10]  Ting Chen,et al.  Image feature representation with orthogonal symmetric local weber graph structure , 2017, Neurocomputing.

[11]  Dmitry Chetverikov,et al.  Pilot Comparative Study of Different Deep Features for Palmprint Identification in Low-Quality Images , 2018, ArXiv.

[12]  Eimad E. A. Abusham,et al.  Face Recognition Using Local Graph Structure (LGS) , 2011, HCI.

[13]  Zhiguang Cao,et al.  Distilling the Knowledge From Handcrafted Features for Human Activity Recognition , 2018, IEEE Transactions on Industrial Informatics.

[14]  Yassine Ruichek,et al.  O3S-MTP: Oriented star sampling structure based multi-scale ternary pattern for texture classification , 2020, Signal Process. Image Commun..

[15]  Yassine Ruichek,et al.  Maximal similarity based region classification method through local image region descriptors and Bhattacharyya coefficient-based distance: Application to horizon line detection using wide-angle camera , 2017, Neurocomputing.

[16]  Sayed Mohamad Tabatabaei,et al.  Noise-tolerant texture feature extraction through directional thresholded local binary pattern , 2019, The Visual Computer.

[17]  Shervan Fekri Ershad,et al.  Texture image Classification based on improved local Quinary patterns , 2019, Multimedia Tools and Applications.

[18]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[19]  Yassine Ruichek,et al.  Local directional ternary pattern: A New texture descriptor for texture classification , 2018, Comput. Vis. Image Underst..

[20]  Sengul Dogan,et al.  Pyramid and multi kernel based local binary pattern for texture recognition , 2019, Journal of Ambient Intelligence and Humanized Computing.

[21]  Rong Xiao,et al.  Pairwise Rotation Invariant Co-Occurrence Local Binary Pattern , 2014, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Jin Liu,et al.  A novel local texture feature extraction method called multi-direction local binary pattern , 2018, Multimedia Tools and Applications.

[23]  Jucheng Yang,et al.  A New Finger Vein Recognition Method Based on the Difference Symmetric Local Graph Structure (DSLGS) , 2015 .

[24]  Jonghyun Choi,et al.  Multi-Directional Multi-Level Dual-Cross Patterns for Robust Face Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Rasmus Larsen,et al.  HEp-2 Cell Classification Using Shape Index Histograms With Donut-Shaped Spatial Pooling , 2014, IEEE Transactions on Medical Imaging.

[26]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[27]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Pavan Chakraborty,et al.  Cascaded asymmetric local pattern: a novel descriptor for unconstrained facial image recognition and retrieval , 2019, Multimedia Tools and Applications.

[29]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[30]  Housam Khalifa Bashier,et al.  Texture classification via extended local graph structure , 2016 .

[31]  Ki-Hyun Jung,et al.  Local diagonal extrema number pattern: A new feature descriptor for face recognition , 2018, Future Gener. Comput. Syst..

[32]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[33]  Tiecheng Song,et al.  Robust Texture Description Using Local Grouped Order Pattern and Non-Local Binary Pattern , 2021, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[35]  Balasubramanian Raman,et al.  Local neighborhood difference pattern: A new feature descriptor for natural and texture image retrieval , 2018, Multimedia Tools and Applications.

[36]  Jianfei Cai,et al.  LETRIST: Locally Encoded Transform Feature Histogram for Rotation-Invariant Texture Classification , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[37]  Achour Ouslimani,et al.  Rotation-invariant features based on directional coding for texture classification , 2019, Neural Computing and Applications.

[38]  Yassine Ruichek,et al.  Repulsive-and-attractive local binary gradient contours: New and efficient feature descriptors for texture classification , 2018, Inf. Sci..

[39]  Kalaiarasi Sonai Muthu,et al.  Face recognition with Symmetric Local Graph Structure (SLGS) , 2014, Expert Syst. Appl..

[40]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Umapada Pal,et al.  LOOP Descriptor: Local Optimal-Oriented Pattern , 2017, IEEE Signal Processing Letters.

[42]  Subrahmanyam Murala,et al.  Local Tetra Patterns: A New Feature Descriptor for Content-Based Image Retrieval , 2012, IEEE Transactions on Image Processing.

[43]  Satish Kumar Singh,et al.  Centre symmetric quadruple pattern: A novel descriptor for facial image recognition and retrieval , 2017, Pattern Recognit. Lett..

[44]  Dmitry Chetverikov,et al.  Detailed Investigation of Deep Features with Sparse Representation and Dimensionality Reduction in CBIR: A Comparative Study , 2018, Intell. Data Anal..

[45]  Housam Khalifa Bashier,et al.  Plant Identification Based on Leaf Shape and Texture Pattern Using Local Graph Structure (LGS) , 2013 .

[46]  Soo-Chang Pei,et al.  Feature-Based Sparse Representation for Image Similarity Assessment , 2011, IEEE Transactions on Multimedia.

[47]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[48]  Michael Riegler,et al.  Deep learning and handcrafted feature based approaches for automatic detection of angiectasia , 2018, 2018 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[49]  Xi Chen,et al.  Local convex-and-concave pattern: An effective texture descriptor , 2016, Inf. Sci..

[50]  Rochdi Messoussi,et al.  Directional Neighborhood Topologies Based Multi-Scale Quinary Pattern for Texture Classification , 2020, IEEE Access.

[51]  Debotosh Bhattacharjee,et al.  Pattern of Local Gravitational Force (PLGF): A Novel Local Image Descriptor , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Thanh Phuong Nguyen,et al.  Statistical binary patterns for rotational invariant texture classification , 2016, Neurocomputing.

[53]  Siong Hoe Lau,et al.  Face Spoofing Detection Based on Improved Local Graph Structure , 2014, 2014 International Conference on Information Science & Applications (ICISA).

[54]  Chao Wang,et al.  Finger Vein Recognition Based on Multi-Orientation Weighted Symmetric Local Graph Structure , 2015, KSII Trans. Internet Inf. Syst..

[55]  Yassine Ruichek,et al.  Attractive-and-repulsive center-symmetric local binary patterns for texture classification , 2019, Eng. Appl. Artif. Intell..

[56]  G. Sucharitha,et al.  Biomedical image retrieval by using local directional edge binary patterns and Zernike moments , 2019, Multimedia Tools and Applications.

[57]  Yassine Ruichek,et al.  Local Concave-and-Convex Micro-Structure Patterns for texture classification , 2018, Pattern Recognit..

[58]  Matti Pietikäinen,et al.  Median Robust Extended Local Binary Pattern for Texture Classification , 2016, IEEE Transactions on Image Processing.

[59]  Tze Hui Liew,et al.  Real Time Face tracker based on Local Graph Structure Threshold (LGS-TH) , 2013 .

[60]  Snehasis Mukherjee,et al.  LDOP: local directional order pattern for robust face retrieval , 2018, Multimedia Tools and Applications.