Phase Based Modelling of Dynamic Textures

This paper presents a model of spatiotemporal variations in a dynamic texture (DT) sequence. Most recent work on DT modelling represents images in a DT sequence as the responses of a linear dynamical system (LDS) to noise. Despite its merits, this model has limitations because it attempts to model temporal variations in pixel intensities which do not take advantage of global motion coherence. We propose a model that relates texture dynamics to the variation of the Fourier phase, which captures the relationships among the motions of all pixels (i.e. global motion) within the texture, as well as the appearance of the texture. Unlike LDS, our model does not require segmentation or cropping during the training stage, which allows it to handle DT sequences containing a static background. We test the performance of this model on recognition and synthesis of DT's. Experiments with a dataset that we have compiled demonstrate that our phase based model outperforms LDS.

[1]  M. Hayes.  The reconstruction of a multidimensional sequence from the phase or magnitude of its Fourier transform , 1982 .

[2]  Bart De Moor,et al.  Subspace angles between ARMA models , 2002, Syst. Control. Lett..

[3]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[5]  M. Sznaier,et al.  Dynamic Texture with Fourier Descriptors , 2005 .

[6]  Richard J. Martin.  A metric for ARMA processes , 2000, IEEE Trans. Signal Process..

[7]  Alain Fournier,et al.  A simple model of ocean waves , 1986, SIGGRAPH.

[8]  Dmitry Chetverikov,et al.  Dynamic Texture Recognition Using Normal Flow and Texture Regularity , 2005, IbPRIA.

[9]  Matti Pietikäinen,et al.  Local Binary Pattern Descriptors for Dynamic Texture Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[10]  Marios Savvides,et al.  Eigenphases vs eigenfaces , 2004, ICPR 2004.

[11]  Daniel Cremers,et al.  Dynamic texture segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  Narendra Ahuja,et al.  Spatial and Fourier Error Minimization for Motion Estimation and Segmentation , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[13]  Dmitry Chetverikov,et al.  A Brief Survey of Dynamic Texture Description and Recognition , 2005, CORES.

[14]  Stefano Soatto,et al.  Dynamic Textures , 2003, International Journal of Computer Vision.

[15]  Martin Szummer,et al.  Temporal texture modeling , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[16]  Payam Saisan,et al.  Dynamic texture recognition , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  A.V. Oppenheim,et al.  The importance of phase in signals , 1980, Proceedings of the IEEE.

[18]  S. Nayar,et al.  Recognition of Dynamic Textures using Impulse Responses of State Variables , 2004 .

[19]  Patrick Bouthemy,et al.  Motion characterization from temporal cooccurrences of local motion-based measures for video indexing , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[20]  Dani Lischinski,et al.  Texture Mixing and Texture Movie Synthesis Using Statistical Learning , 2001, IEEE Trans. Vis. Comput. Graph..

[21]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Volume Local Binary Patterns , 2006, WDV.

[22]  Randal C. Nelson,et al.  Qualitative recognition of motion using temporal texture , 1992, CVGIP Image Underst..

[23]  Nuno Vasconcelos,et al.  Mixtures of dynamic textures , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.