A novel scheme based on local binary pattern for dynamic texture recognition

Dynamic texture recognition method based on LBP and Michelson contrast is proposed.An adaptive threshold is proposed to compute the texture pattern in DT frames.Michelson contrast is used to compute the contrast of local image patch.A new formulation is devised to extend local binary pattern to spatiotemporal domain.Center pixel is combined with feature vector to boost its descriptive power. Dynamic textures (DTs) are moving sequences of natural scenes with some form of temporal regularity such as boiling water, a flag fluttering in the wind. The motion causes continuous changes in the geometry of dynamic textures thus it is difficult to apply traditional vision algorithms to recognize this class of textures. This paper proposes a scheme for modeling and classification of dynamic textures using a local image descriptor which efficiently encodes texture information in a space-time domain. The proposed descriptor extends the well-known spatial texture descriptor, local binary pattern (LBP), to spatio-temporal domain in order to represent the DT by combining appearance feature with the motion. Although, local binary patterns are used extensively in visual recognition applications due to their excellent performance and computational simplicity, but sometimes unable to differentiate different structures properly due to their dependency on center pixel as a threshold. In this paper, a new descriptor based on a global adaptive threshold is employed to compute the structure pattern of local image patch which differentiates various local image structures more efficiently. However, the LBP pattern defines the spatial structure of a local image patch but it does not give information about the contrast of local image patch. We have used Michelson contrast to compute the difference in luminance in the local texture and clubbed with local structure pattern computed using the proposed descriptor. Extensive experiments on dynamic texture databases (Dyntex, Dyntex++ and UCLA) prove the efficiency of the proposed method.

[1]  Matti Pietikäinen,et al.  Globally rotation invariant multi-scale co-occurrence local binary pattern , 2015, Image Vis. Comput..

[2]  M. Johnson,et al.  Circulating microRNAs in Sera Correlate with Soluble Biomarkers of Immune Activation but Do Not Predict Mortality in ART Treated Individuals with HIV-1 Infection: A Case Control Study , 2015, PloS one.

[3]  Josef Kittler,et al.  Dynamic Texture Recognition Using Multiscale Binarized Statistical Image Features , 2014, IEEE Transactions on Multimedia.

[4]  Yong Wang,et al.  Chaotic features for dynamic textures recognition , 2016, Soft Comput..

[5]  Nuno Vasconcelos,et al.  Classifying Video with Kernel Dynamic Textures , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[7]  Oksam Chae,et al.  Spatiotemporal Directional Number Transitional Graph for Dynamic Texture Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  A. Enis Çetin,et al.  Computer vision based method for real-time fire and flame detection , 2006, Pattern Recognit. Lett..

[9]  Yong Xu,et al.  Dynamic texture classification using dynamic fractal analysis , 2011, 2011 International Conference on Computer Vision.

[10]  Brian C. Lovell,et al.  Discriminative Non-Linear Stationary Subspace Analysis for Video Classification , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Dmitry Chetverikov,et al.  A Brief Survey of Dynamic Texture Description and Recognition , 2005, CORES.

[12]  Albert A. Michelson,et al.  Studies in Optics , 1995 .

[13]  Vipin Tyagi,et al.  Dynamic Texture Recognition: A Review , 2016 .

[14]  W. Ali,et al.  Visual tree detection for autonomous navigation in forest environment , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[15]  Payam Saisan,et al.  Dynamic texture recognition , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[16]  Nuno Vasconcelos,et al.  Probabilistic kernels for the classification of auto-regressive visual processes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Xudong Jiang,et al.  Dynamic texture recognition using enhanced LBP features , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[18]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Narendra Ahuja,et al.  Maximum Margin Distance Learning for Dynamic Texture Recognition , 2010, ECCV.

[21]  A.B. Chan,et al.  Classification and retrieval of traffic video using auto-regressive stochastic processes , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[22]  Vipin Tyagi,et al.  Dynamic texture recognition based on completed volume local binary pattern , 2016, Multidimens. Syst. Signal Process..

[23]  Yong Xu,et al.  Wavelet Domain Multifractal Analysis for Static and Dynamic Texture Classification , 2013, IEEE Transactions on Image Processing.

[24]  René Vidal,et al.  View-invariant dynamic texture recognition using a bag of dynamical systems , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Zhiyong Yuan,et al.  Dynamic texture based smoke detection using Surfacelet transform and HMT model , 2015 .

[26]  Yong Wang,et al.  Exploiting high level feature for dynamic textures recognition , 2015, Neurocomputing.

[27]  Gang Wang,et al.  Optimizing LBP Structure For Visual Recognition Using Binary Quadratic Programming , 2014, IEEE Signal Processing Letters.

[28]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[29]  Brian C. Lovell,et al.  Non-Linear Stationary Subspace Analysis with Application to Video Classification , 2013, ICML.

[30]  Nuno Vasconcelos,et al.  Privacy preserving crowd monitoring: Counting people without people models or tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Mark J. Huiskes,et al.  DynTex: A comprehensive database of dynamic textures , 2010, Pattern Recognit. Lett..

[32]  Richard P. Wildes,et al.  Spacetime Texture Representation and Recognition Based on a Spatiotemporal Orientation Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Volume Local Binary Patterns , 2006, WDV.

[34]  Esa Rahtu,et al.  BSIF: Binarized statistical image features , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[35]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Odemir Martinez Bruno,et al.  Spatiotemporal Gabor filters: a new method for dynamic texture recognition , 2012, ArXiv.

[37]  Stefano Soatto,et al.  Dynamic Textures , 2003, International Journal of Computer Vision.

[38]  Maja Pantic,et al.  A Dynamic Texture-Based Approach to Recognition of Facial Actions and Their Temporal Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Chunxiao Fan,et al.  Uniform Local Binary Pattern Based Texture-Edge Feature for 3D Human Behavior Recognition , 2015, PloS one.

[40]  Yong Xu,et al.  Scale-space texture description on SIFT-like textons , 2012, Comput. Vis. Image Underst..