Dynamic texture recognition using multiresolution edge-weighted local structure pattern

Abstract Dynamic texture has been found as a powerful cue for modeling natural scenes such as fire, waves and smoke, etc. It combines appearance with motion to characterize the moving scene that exhibits certain spatially repetitive and time-varying visual patterns. This paper proposes a new method of recognizing dynamic texture using the well-known texture descriptor, local binary pattern. The new variant differentiates different structural patterns more efficiently using the additional information from the local patch. This pattern information is further combined with shape information to improve the discriminative power of texture descriptor. The proposed method is extended to multiscale using classifier fusion scheme to capture the spatio-temporal content of a moving scene at multiple scales, thus improves representation capability of the new descriptor. Proposed descriptor is tested on three dynamic texture databases: UCLA, Dyntex and Dyntex++. Results demonstrate that the proposed feature descriptor outperforms various state-of-the-art approaches on all representative databases in terms of classification accuracy.

[1]  Vipin Tyagi,et al.  Dynamic Texture Recognition: A Review , 2016 .

[2]  Nuno Vasconcelos,et al.  Classifying Video with Kernel Dynamic Textures , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Satoshi Goto,et al.  Gradient Local Binary Patterns for human detection , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[4]  Xudong Jiang,et al.  Dynamic texture recognition using enhanced LBP features , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[6]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Volume Local Binary Patterns , 2006, WDV.

[7]  Vipin Tyagi,et al.  Improved Weber’s law based local binary pattern for dynamic texture recognition , 2017, Multimedia Tools and Applications.

[8]  Josef Kittler,et al.  Dynamic Texture Recognition Using Multiscale Binarized Statistical Image Features , 2014, IEEE Transactions on Multimedia.

[9]  Michel Ménard,et al.  Characterization and recognition of dynamic textures based on the 2D+T curvelet transform , 2015, Signal Image Video Process..

[10]  Brian C. Lovell,et al.  Discriminative Non-Linear Stationary Subspace Analysis for Video Classification , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Narendra Ahuja,et al.  Maximum Margin Distance Learning for Dynamic Texture Recognition , 2010, ECCV.

[13]  Vipin Tyagi,et al.  A novel scheme based on local binary pattern for dynamic texture recognition , 2016, Comput. Vis. Image Underst..

[14]  Matti Pietikäinen,et al.  Edge-based texture measures for surface inspection , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[15]  Vipin Tyagi,et al.  Dynamic texture recognition based on completed volume local binary pattern , 2016, Multidimens. Syst. Signal Process..

[16]  Yong Xu,et al.  Scale-space texture description on SIFT-like textons , 2012, Comput. Vis. Image Underst..

[17]  Oksam Chae,et al.  Spatiotemporal Directional Number Transitional Graph for Dynamic Texture Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Yong Xu,et al.  Dynamic texture classification using dynamic fractal analysis , 2011, 2011 International Conference on Computer Vision.

[19]  Yong Wang,et al.  Chaotic features for dynamic textures recognition , 2016, Soft Comput..

[20]  Randal C. Nelson,et al.  Qualitative recognition of motion using temporal texture , 1992, CVGIP Image Underst..

[21]  Yong Xu,et al.  Wavelet Domain Multifractal Analysis for Static and Dynamic Texture Classification , 2013, IEEE Transactions on Image Processing.

[22]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Richard P. Wildes,et al.  Spacetime Texture Representation and Recognition Based on a Spatiotemporal Orientation Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Gang Wang,et al.  Optimizing LBP Structure For Visual Recognition Using Binary Quadratic Programming , 2014, IEEE Signal Processing Letters.

[25]  Mark J. Huiskes,et al.  DynTex: A comprehensive database of dynamic textures , 2010, Pattern Recognit. Lett..

[26]  René Vidal,et al.  View-invariant dynamic texture recognition using a bag of dynamical systems , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Yong Wang,et al.  Exploiting high level feature for dynamic textures recognition , 2015, Neurocomputing.

[28]  Payam Saisan,et al.  Dynamic texture recognition , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[29]  Ludmila I. Kuncheva,et al.  A Theoretical Study on Six Classifier Fusion Strategies , 2002, IEEE Trans. Pattern Anal. Mach. Intell..