Noise-tolerant texture feature extraction through directional thresholded local binary pattern

Local binary pattern (LBP) is a multi-applicable texture descriptor applied in machine vision. Despite its outstanding abilities in revealing textural properties of image, it is sensitive to noise, due to its thresholding mechanism. To make LBP robust against noise, a directional thresholded LBP (DTLBP) is developed in this article which applies the directional neighboring pixels average values for thresholding. Applying this type of thresholding in addition to reducing noise, due to using the information of neighboring pixels with bigger radii, increases efficiency in extracting features. The DTLBP is able to be combined with other descriptors like completed LBP (CLBP) and local ternary pattern (LTP) which improves their functionality against noise. To evaluate the functionality of DTLBP, four known datasets including Outex (TC10), CUReT, UIUC and UMD are tested. Numerous and extensive experiments on these datasets with different kinds of noises indicate this newly developed descriptor’s efficiency, with or without incremental white Gaussian and Gaussian blur noises. The proposed descriptor is compared with its available state of the art counterparts. The results show that the combination of DTLBP with CLBP descriptors provide the best classification accuracy in the experiments, which confirms the efficiency and robustness of the proposed descriptor when extracting features from noisy and raw images.

[1]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[2]  Faisal Ahmed,et al.  Robust facial expression recognition based on median ternary pattern (MTP) , 2014, 2013 International Conference on Electrical Information and Communication Technology (EICT).

[3]  Mudar Sarem,et al.  A novel local derivative quantized binary pattern for object recognition , 2017, The Visual Computer.

[4]  Gerald Schaefer,et al.  A comprehensive benchmark of local binary pattern algorithms for texture retrieval , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[5]  Matti Pietikäinen,et al.  Computer Vision Using Local Binary Patterns , 2011, Computational Imaging and Vision.

[6]  Matti Pietikäinen,et al.  Outex - new framework for empirical evaluation of texture analysis algorithms , 2002, Object recognition supported by user interaction for service robots.

[7]  Changsheng Liu,et al.  Adjacent evaluation of local binary pattern for texture classification , 2015, J. Vis. Commun. Image Represent..

[8]  Oksam Chae,et al.  Local Directional Number Pattern for Face Analysis: Face and Expression Recognition , 2013, IEEE Transactions on Image Processing.

[9]  Cordelia Schmid,et al.  Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[10]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Yong Xu,et al.  A new texture descriptor using multifractal analysis in multi-orientation wavelet pyramid , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Matti Pietikäinen,et al.  Median Robust Extended Local Binary Pattern for Texture Classification , 2016, IEEE Transactions on Image Processing.

[13]  Hyun Seung Yang,et al.  Sorted Consecutive Local Binary Pattern for Texture Classification , 2015, IEEE Transactions on Image Processing.

[14]  Pod Hyb Extended Set of Local Binary Patterns for Rapid Object Detection , 2010 .

[15]  Kin-Man Lam,et al.  Histogram-based local descriptors for facial expression recognition (FER): A comprehensive study , 2018, J. Vis. Commun. Image Represent..

[16]  Vishnu Naresh Boddeti,et al.  Local Binary Convolutional Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Cordelia Schmid,et al.  A sparse texture representation using local affine regions , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[19]  Matti Pietikäinen,et al.  Two decades of local binary patterns: A survey , 2016, ArXiv.

[20]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[21]  Stéphane Mallat,et al.  Invariant Scattering Convolution Networks , 2012, IEEE transactions on pattern analysis and machine intelligence.

[22]  Zhenhua Guo,et al.  Robust Texture Image Representation by Scale Selective Local Binary Patterns , 2016, IEEE Transactions on Image Processing.

[23]  Oksam Chae,et al.  Local Directional Texture Pattern image descriptor , 2015, Pattern Recognit. Lett..

[24]  WangXiaogang,et al.  Local binary features for texture classification , 2017 .

[25]  Lakhmi C. Jain,et al.  Local Binary Patterns: New Variants and Applications , 2013, Local Binary Patterns.

[26]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[27]  Donald A. Adjeroh,et al.  Comparison of Texture Analysis Schemes Under Nonideal Conditions , 2011, IEEE Transactions on Image Processing.

[28]  Jana Reinhard,et al.  Textures A Photographic Album For Artists And Designers , 2016 .

[29]  Emam Hossain,et al.  Automated Facial Expression Recognition Using Gradient-Based Ternary Texture Patterns , 2013 .

[30]  Wei Pan,et al.  Towards Accurate Binary Convolutional Neural Network , 2017, NIPS.

[31]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Loris Nanni,et al.  A local approach based on a Local Binary Patterns variant texture descriptor for classifying pain states , 2010, Expert Syst. Appl..

[33]  Andrew Zisserman,et al.  A Statistical Approach to Material Classification Using Image Patch Exemplars , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Loris Nanni,et al.  Local binary patterns variants as texture descriptors for medical image analysis , 2010, Artif. Intell. Medicine.

[35]  Jiri Matas,et al.  Extended Set of Local Binary Patterns for Rapid Object Detection , 2010 .

[36]  Marko Heikkilä,et al.  Description of interest regions with local binary patterns , 2009, Pattern Recognit..

[37]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Weidong Zhou,et al.  Iris recognition based on a novel variation of local binary pattern , 2014, The Visual Computer.

[39]  Bertrand Zavidovique,et al.  Median Binary Pattern for Textures Classification , 2007, ICIAR.

[40]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Marcos X. Álvarez-Cid,et al.  Texture Description Through Histograms of Equivalent Patterns , 2012, Journal of Mathematical Imaging and Vision.

[42]  Matti Pietikäinen,et al.  Local binary features for texture classification: Taxonomy and experimental study , 2017, Pattern Recognit..

[43]  C. Schmid,et al.  Description of Interest Regions with Center-Symmetric Local Binary Patterns , 2006, ICVGIP.

[44]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[45]  T. Ojala,et al.  Gray level cooccurrence histograms via learning vector quantization , 1999 .

[46]  Matti Pietikäinen,et al.  From BoW to CNN: Two Decades of Texture Representation for Texture Classification , 2018, International Journal of Computer Vision.

[47]  Hanqing Lu,et al.  Face detection using improved LBP under Bayesian framework , 2004, Third International Conference on Image and Graphics (ICIG'04).

[48]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.