Rubik Gaussian-based patterns for dynamic texture classification

Abstract Illumination, noise, and changes of environments, scales negatively impact on encoding chaotic motions for dynamic texture (DT) representation. This paper proposes a new method to overcome those issues by addressing the following novel concepts. First, different Gaussian-based kernels are taken into account as an effective filtered pre-processing with low computational cost to point out robust and invariant features. Second, a discriminative operator, named Local Rubik-based Pattern (LRP), is introduced to adequately capture both shape and motion cues of DTs by proposing a new concept of complemented components together with an effective encoding method. In addition, it also addresses a novel thresholding to take into account rich spatio-temporal relationships extracted from a new model of neighborhood supporting region. Finally, an efficient framework for DT description is presented by exploiting operator LRP for encoding various instances of Gaussian-based volumes in order to form a robust descriptor against noise, changes of illumination, scale, and environment. Experiments for DT classification on benchmark datasets have authenticated the interest of our proposal.

[1]  Josef Kittler,et al.  Dynamic Texture Recognition Using Multiscale Binarized Statistical Image Features , 2014, IEEE Transactions on Multimedia.

[2]  Yong Xu,et al.  Spatiotemporal lacunarity spectrum for dynamic texture classification , 2017, Comput. Vis. Image Underst..

[3]  Michel Ménard,et al.  Characterization and recognition of dynamic textures based on the 2D+T curvelet transform , 2015, Signal Image Video Process..

[4]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[5]  Antoni B. Chan,et al.  Clustering dynamic textures with the hierarchical EM algorithm , 2013, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Xudong Jiang,et al.  Dynamic texture recognition using enhanced LBP features , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[7]  Thanh Tuan Nguyen,et al.  Completed statistical adaptive patterns on three orthogonal planes for recognition of dynamic textures and scenes , 2018, J. Electronic Imaging.

[8]  Mark Berman,et al.  Nonparametric Estimation and Simulation of Two-Dimensional Gaussian Image Textures , 1997, CVGIP Graph. Model. Image Process..

[9]  Vipin Tyagi,et al.  A novel scheme based on local binary pattern for dynamic texture recognition , 2016, Comput. Vis. Image Underst..

[10]  Vipin Tyagi,et al.  Dynamic texture recognition based on completed volume local binary pattern , 2016, Multidimens. Syst. Signal Process..

[11]  Shervin Rahimzadeh Arashloo,et al.  Dynamic texture representation using a deep multi-scale convolutional network , 2017, J. Vis. Commun. Image Represent..

[12]  Thanh Tuan Nguyen,et al.  Completed local structure patterns on three orthogonal planes for dynamic texture recognition , 2017, 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA).

[13]  Vipin Tyagi,et al.  Dynamic texture recognition using multiresolution edge-weighted local structure pattern , 2017, Comput. Electr. Eng..

[14]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[15]  Oksam Chae,et al.  Spatiotemporal Directional Number Transitional Graph for Dynamic Texture Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Brian C. Lovell,et al.  Discriminative Non-Linear Stationary Subspace Analysis for Video Classification , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Yong Xu,et al.  Classifying dynamic textures via spatiotemporal fractal analysis , 2015, Pattern Recognit..

[18]  Yong Xu,et al.  Dynamic texture classification using dynamic fractal analysis , 2011, 2011 International Conference on Computer Vision.

[19]  Hyun Seung Yang,et al.  D3: Recognizing dynamic scenes with deep dual descriptor based on key frames and key segments , 2017, Neurocomputing.

[20]  Payam Saisan,et al.  Dynamic texture recognition , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[21]  Yang Zhao,et al.  Completed Local Binary Count for Rotation Invariant Texture Classification , 2012, IEEE Transactions on Image Processing.

[22]  Hui Ji,et al.  Equiangular Kernel Dictionary Learning with Applications to Dynamic Texture Analysis , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Thanh Phuong Nguyen,et al.  Topological Attribute Patterns for texture recognition , 2016, Pattern Recognit. Lett..

[24]  Matti Pietikäinen,et al.  Multi-scale Binary Patterns for Texture Analysis , 2003, SCIA.

[25]  Thanh Phuong Nguyen,et al.  Statistical binary patterns for rotational invariant texture classification , 2016, Neurocomputing.

[26]  Thanh Tuan Nguyen,et al.  Smooth-Invariant Gaussian Features for Dynamic Texture Recognition , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[27]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Vipin Tyagi,et al.  Improved Weber’s law based local binary pattern for dynamic texture recognition , 2017, Multimedia Tools and Applications.

[29]  Narendra Ahuja,et al.  Maximum Margin Distance Learning for Dynamic Texture Recognition , 2010, ECCV.

[30]  René Vidal,et al.  View-invariant dynamic texture recognition using a bag of dynamical systems , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Tony Lindeberg,et al.  Dynamic Texture Recognition Using Time-Causal and Time-Recursive Spatio-Temporal Receptive Fields , 2018, Journal of Mathematical Imaging and Vision.

[32]  Richard P. Wildes,et al.  Spacetime Texture Representation and Recognition Based on a Spatiotemporal Orientation Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Paul F. Whelan,et al.  Convolutional neural network on three orthogonal planes for dynamic texture classification , 2017, Pattern Recognit..

[34]  Dmitry Chetverikov,et al.  Dynamic Texture Recognition Using Normal Flow and Texture Regularity , 2005, IbPRIA.

[35]  Matti Pietikäinen,et al.  Dynamic texture and scene classification by transferring deep image features , 2015, Neurocomputing.

[36]  Thanh Tuan Nguyen,et al.  Momental directional patterns for dynamic texture recognition , 2020, Comput. Vis. Image Underst..

[37]  Yong Wang,et al.  Chaotic features for dynamic textures recognition , 2016, Soft Comput..

[38]  Thanh Tuan Nguyen,et al.  Volumes of Blurred-Invariant Gaussians for Dynamic Texture Classification , 2019, CAIP.

[39]  Antoni B. Chan,et al.  A Scalable and Accurate Descriptor for Dynamic Textures Using Bag of System Trees , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Yong Xu,et al.  Scale-space texture description on SIFT-like textons , 2012, Comput. Vis. Image Underst..

[41]  Thanh Tuan Nguyen,et al.  Directional Beams of Dense Trajectories for Dynamic Texture Recognition , 2018, ACIVS.

[42]  Matti Pietikäinen,et al.  Rotation-Invariant Image and Video Description With Local Binary Pattern Features , 2012, IEEE Transactions on Image Processing.

[43]  Yan Huang,et al.  Dynamic Texture Recognition via Orthogonal Tensor Dictionary Learning , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[44]  Thanh Tuan Nguyen,et al.  Dynamic Texture Representation Based on Hierarchical Local Patterns , 2020, ACIVS.

[45]  Yong Xu,et al.  Wavelet Domain Multifractal Analysis for Static and Dynamic Texture Classification , 2013, IEEE Transactions on Image Processing.

[46]  Yaping Lin,et al.  Dynamic Texture Recognition Using Volume Local Binary Count Patterns With an Application to 2D Face Spoofing Detection , 2018, IEEE Transactions on Multimedia.

[47]  Gang Wang,et al.  Optimizing LBP Structure For Visual Recognition Using Binary Quadratic Programming , 2014, IEEE Signal Processing Letters.

[48]  Mark J. Huiskes,et al.  DynTex: A comprehensive database of dynamic textures , 2010, Pattern Recognit. Lett..

[49]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[50]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.