An auto tuned noise resistant descriptor for dynamic texture recognition

This paper presents a scheme for the representation and recognition of the dynamic texture in the noisy environment. Dynamic texture is the sequence of images of a moving scene that shows some form of temporal regularity. Though, the dynamic texture is the spatiotemporal extension of the conventional texture, its analysis requires additional attention, since the motion causes continuous changes in the geometry of these textures. Hence, to recognize the noisy dynamic texture, the noise should be estimated not only at the spatial level; it must also be estimated at the temporal level. To this end, an auto tuned noise resistance descriptor, based on the Local Binary Pattern approach, is proposed for the modeling and classification of the dynamic texture. Our approach based on the fact that, uniform local binary patterns are the fundamental units of image texture and occur more frequently in an image in comparison to non-uniform patterns. Noise affects these uniform local binary patterns and more likely fall into non-uniform codes. To counter this, we have extended conventional local binary pattern descriptor from a 2-value code to a 3-value code to include an additional state (called indecisive state) to represent the noise affected pixels. However, the estimation of the indecisive state is of the primary concern of this letter due to the inherently varying nature of the dynamic texture. The proposed technique devised a new scheme to estimate the noisy pixels in a dynamic texture. Eventually, the indecisive state is corrected back to non-noisy natural states using a mapping function so as to form a uniform LBP code. Experimental results on the UCLA and Dyntex++ databases demonstrate high classification efficiency of the proposed approach in the noisy environment.

[1]  Seiichi Serikawa,et al.  Texture databases - A comprehensive survey , 2013, Pattern Recognit. Lett..

[2]  Matti Pietikäinen,et al.  RLBP: Robust Local Binary Pattern , 2013, BMVC.

[3]  Paul W. Fieguth,et al.  Extended local binary patterns for texture classification , 2012, Image Vis. Comput..

[4]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Payam Saisan,et al.  Dynamic texture recognition , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Narendra Ahuja,et al.  Maximum Margin Distance Learning for Dynamic Texture Recognition , 2010, ECCV.

[7]  Vipin Tyagi,et al.  Dynamic Texture Recognition: A Review , 2016 .

[8]  Ahmad Reza Naghsh-Nilchi,et al.  Noise tolerant local binary pattern operator for efficient texture analysis , 2012, Pattern Recognit. Lett..

[9]  Nuno Vasconcelos,et al.  Probabilistic kernels for the classification of auto-regressive visual processes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Xudong Jiang,et al.  Dynamic texture recognition using enhanced LBP features , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  Matti Pietikäinen,et al.  Rotation-Invariant Image and Video Description With Local Binary Pattern Features , 2012, IEEE Transactions on Image Processing.

[12]  Dmitry Chetverikov,et al.  A Brief Survey of Dynamic Texture Description and Recognition , 2005, CORES.

[13]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Xudong Jiang,et al.  Noise-Resistant Local Binary Pattern With an Embedded Error-Correction Mechanism , 2013, IEEE Transactions on Image Processing.

[15]  Matti Pietikäinen,et al.  Improving Rotation Invariance of the Volume Local Binary Pattern Operator , 2007, MVA.

[16]  Song-Chun Zhu,et al.  Minimax Entropy Principle and Its Application to Texture Modeling , 1997, Neural Computation.

[17]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Volume Local Binary Patterns , 2006, WDV.

[18]  M. Pietikäinen,et al.  SOFT HISTOGRAMS FOR LOCAL BINARY PATTERNS , 2007 .

[19]  Vipin Tyagi,et al.  Improved Weber’s law based local binary pattern for dynamic texture recognition , 2017, Multimedia Tools and Applications.

[20]  Stefano Soatto,et al.  Dynamic Textures , 2003, International Journal of Computer Vision.

[21]  Vipin Tyagi,et al.  Dynamic texture recognition based on completed volume local binary pattern , 2016, Multidimens. Syst. Signal Process..

[22]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[23]  Mark J. Huiskes,et al.  DynTex: A comprehensive database of dynamic textures , 2010, Pattern Recognit. Lett..

[24]  Xudong Jiang,et al.  Learning LBP structure by maximizing the conditional mutual information , 2015, Pattern Recognit..