Mixed co-occurrence of local binary patterns and Hamming-distance-based local binary patterns

Abstract Local binary patterns (LBP) have powerful discriminative capabilities. However, traditional methods with LBP histograms cannot capture spatial structures of LBP codes. To extract the spatial structures of an LBP code map, we compute and encode the Hamming distances between LBP codes of a center point and its neighbors on the LBP code map to generate a new code, which is called Hamming-distance-based local binary patterns (HDLBP). Then, we calculate a joint histogram of LBP and HDLBP to represent the LBP co-occurrence with HDLBP (LBPCoHDLBP). Circular bit-wise shift techniques are used to align HDLBP with LBP for rotation invariance. To achieve scale invariance, we extract the feature of LBPCoHDLBP from each scale and concatenate all features of different scales. Finally, we use the sum of absolute differences (SAD) between the intensities of the center point and its neighbors to weight LBPCoHDLBP for further improvement. Extensive experiments show that our method achieves better performance for smoke detection, texture classification and material recognition than most existing methods and is more computationally efficient.

[1]  Edward H. Adelson,et al.  Material perception: What can you see in a brief glance? , 2010 .

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  Guizhong Liu,et al.  Scale- and Rotation-Invariant Local Binary Pattern Using Scale-Adaptive Texton and Subuniform-Based Circular Shift , 2012, IEEE Transactions on Image Processing.

[4]  Matti Pietikäinen,et al.  Rotation-Invariant Image and Video Description With Local Binary Pattern Features , 2012, IEEE Transactions on Image Processing.

[5]  Tao Mei,et al.  High-order local ternary patterns with locality preserving projection for smoke detection and image classification , 2016, Inf. Sci..

[6]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[7]  Shu Liao,et al.  Face Recognition by Using Elongated Local Binary Patterns with Average Maximum Distance Gradient Magnitude , 2007, ACCV.

[8]  Zhenhua Guo,et al.  Rotation invariant texture classification using LBP variance (LBPV) with global matching , 2010, Pattern Recognit..

[9]  Marimuthu Palaniswami,et al.  Smoke detection in video using wavelets and support vector machines , 2009 .

[10]  Mei Chen,et al.  Food recognition using statistics of pairwise local features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Subrahmanyam Murala,et al.  Local Tetra Patterns: A New Feature Descriptor for Content-Based Image Retrieval , 2012, IEEE Transactions on Image Processing.

[12]  Baochang Zhang,et al.  Local Derivative Pattern Versus Local Binary Pattern: Face Recognition With High-Order Local Pattern Descriptor , 2010, IEEE Transactions on Image Processing.

[13]  Nuno Vasconcelos,et al.  Holistic context modeling using semantic co-occurrences , 2009, CVPR.

[14]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Huu-Giao Nguyen,et al.  Visual textures as realizations of multivariate log-Gaussian Cox processes , 2011, CVPR 2011.

[16]  Alice Caplier,et al.  Enhanced Patterns of Oriented Edge Magnitudes for Face Recognition and Image Matching , 2012, IEEE Transactions on Image Processing.

[17]  Rong Xiao,et al.  Pairwise Rotation Invariant Co-Occurrence Local Binary Pattern , 2014, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Phil Brodatz,et al.  Textures: A Photographic Album for Artists and Designers , 1966 .

[19]  Daijin Kim,et al.  A compact local binary pattern using maximization of mutual information for face analysis , 2011, Pattern Recognit..

[20]  Cordelia Schmid,et al.  Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[21]  Mario Fritz,et al.  Classifying materials in the real world , 2010, Image Vis. Comput..

[22]  Runsheng Wang,et al.  Local multiple patterns based multiresolution gray-scale and rotation invariant texture classification , 2012, Inf. Sci..

[23]  Xudong Jiang,et al.  Noise-Resistant Local Binary Pattern With an Embedded Error-Correction Mechanism , 2013, IEEE Transactions on Image Processing.

[24]  Xi Chen,et al.  Local convex-and-concave pattern: An effective texture descriptor , 2016, Inf. Sci..

[25]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, AMFG.

[26]  Shawn D. Newsam,et al.  Spatial pyramid co-occurrence for image classification , 2011, 2011 International Conference on Computer Vision.

[27]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[28]  Andrew Zisserman,et al.  A Statistical Approach to Material Classification Using Image Patch Exemplars , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Xueming Qian,et al.  PLBP: An effective local binary patterns texture descriptor with pyramid representation , 2011, Pattern Recognit..

[30]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Cordelia Schmid,et al.  A sparse texture representation using local affine regions , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[33]  Feiniu Yuan,et al.  Rotation and scale invariant local binary pattern based on high order directional derivatives for texture classification , 2014, Digit. Signal Process..

[34]  Paul W. Fieguth,et al.  Texture Classification from Random Features , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Feiniu Yuan,et al.  A fast accumulative motion orientation model based on integral image for video smoke detection , 2008, Pattern Recognit. Lett..

[36]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[37]  Zhenhua Guo,et al.  Local directional derivative pattern for rotation invariant texture classification , 2011, Neural Computing and Applications.

[38]  Frederick W. Williams,et al.  Video Image Fire Detection for Shipboard Use , 2006 .

[39]  Chengjun Liu,et al.  Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition , 2002, IEEE Trans. Image Process..

[40]  Matti Pietikäinen,et al.  Rotation Invariant Image Description with Local Binary Pattern Histogram Fourier Features , 2009, SCIA.

[41]  Cheng Wang,et al.  A novel extended local-binary-pattern operator for texture analysis , 2008, Inf. Sci..

[42]  Zhijing Yang,et al.  Normalized Co-Occurrence Mutual Information for Facial Pose Detection Inside Videos , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[43]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[44]  Shu Liao,et al.  Dominant Local Binary Patterns for Texture Classification , 2009, IEEE Transactions on Image Processing.

[45]  Hanqing Lu,et al.  Face detection using improved LBP under Bayesian framework , 2004, Third International Conference on Image and Graphics (ICIG'04).

[46]  Loris Nanni,et al.  A local approach based on a Local Binary Patterns variant texture descriptor for classifying pain states , 2010, Expert Syst. Appl..

[47]  Kazuhiro Fukui,et al.  Feature Extraction Based on Co-occurrence of Adjacent Local Binary Patterns , 2011, PSIVT.

[48]  Feiniu Yuan,et al.  Video-based smoke detection with histogram sequence of LBP and LBPV pyramids , 2011 .

[49]  Feiniu Yuan,et al.  A double mapping framework for extraction of shape-invariant features based on multi-scale partitions with AdaBoost for video smoke detection , 2012, Pattern Recognit..

[50]  Alice Caplier,et al.  Face Recognition with Patterns of Oriented Edge Magnitudes , 2010, ECCV.