Improving dynamic texture recognition by using a color spatio-temporal decomposition

The study of Dynamic Textures (DT) is a recent research topic in the field of video processing. Description and recognition of this phenomena is notoriously a difficult problem but necessary, for example, in video indexation system or video synthesis. The contribution of this paper is to show that it is possible to improve the recognition of a color DT with only a part of its information. In our approach, we propose to split a color image sequence into two components (a geometrical component and a textural component) using the Vectorial Rudin-Osher-Fatemi (VROF) model. The obtained components are used in an application of dynamic texture recognition. The experimental results clearly show that the textural part gives better recognition rates than those obtained with the geometrical part or the original video.

[1]  Richard J. Martin.  A metric for ARMA processes , 2000, IEEE Trans. Signal Process..

[2]  T. Chan,et al.  Fast dual minimization of the vectorial total variation norm and applications to color image processing , 2008 .

[3]  Renaud Péteri,et al.  Tracking dynamic textures using a particle filter driven by intrinsic motion information , 2011, Machine Vision and Applications.

[4]  Michel Ménard,et al.  Characterization and recognition of dynamic textures based on the 2D+T curvelet transform , 2015, Signal Image Video Process..

[5]  Michel Ménard,et al.  Weighted and extended total variation for image restoration and decomposition , 2010, Pattern Recognit..

[6]  Mubarak Shah,et al.  Flame recognition in video , 2002, Pattern Recognit. Lett..

[7]  S. Suzuki,et al.  Feature extraction of temporal texture based on spatiotemporal motion trajectory , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[8]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Stefano Soatto,et al.  Dynamic Textures , 2003, International Journal of Computer Vision.

[10]  Martin Szummer,et al.  Temporal texture modeling , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[11]  Randal C. Nelson,et al.  Qualitative recognition of motion using temporal texture , 1992, CVGIP Image Underst..

[12]  Dmitry Chetverikov,et al.  A Brief Survey of Dynamic Texture Description and Recognition , 2005, CORES.

[13]  Payam Saisan,et al.  Dynamic texture recognition , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[14]  PietikainenMatti,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007 .

[15]  Nuno Vasconcelos,et al.  Generalized Stauffer–Grimson background subtraction for dynamic scenes , 2011, Machine Vision and Applications.