Dynamic texture editing

A fast simple method for dynamic textures enlargement and editing is presented. The resulting edited dynamic texture is a mixture of several color dynamic textures that realistically matches the given color textures appearance and respects their original optical flows. The method simultaneously allows to spatially and temporarily enlarge the original dynamic textures to fill any required four dimensional dynamic texture space. The method is based on a generalization of the prominent static double toroid-shaped texture modeling roller method to the dynamic texture domain. The presented method keeps the original static texture roller principle of separated analysis and synthesis parts of the algorithm. In its analytical step, the input textures patches are found by an optimal overlap tiling and the subsequent minimum boundary cut. The optimal toroid-shaped dynamic texture patches are created in each spatial and time dimension, respectively. The spatial dimension tile border is derived by textural features, color-tone, and the minimal overlapping error. The time dimension tile border is detected by minimizing the overlapping error and using the input textures optical flow. The realistic appearance of the dynamic textures mix requires to edit the patch color space and to find border patches which consists from more than one type of the texture. These border patches are found similarly to the multi-texture analysis patch step. Since all time-consuming processing, such as the finding of optimal spatio-temporal triple toroidal patches, are done in the analytical step which is completely separated from synthesis part, the synthesis of the edited and enlarged resulting texture can by done very efficiently by applying simple set of repeating rules for these triple toroidal patches. Thus the presented method is extremely fast and capable to synthesize a learned natural dynamic texture spatially and its time span in real-time.

[1]  Martin Szummer,et al.  Temporal texture modeling , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[2]  Nuno Vasconcelos,et al.  Layered Dynamic Textures , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Eugene Fiume,et al.  Turbulent wind fields for gaseous phenomena , 1993, SIGGRAPH.

[4]  Michal Haindl,et al.  Dynamic Texture Enlargement , 2013, SCCG.

[5]  Norishige Chiba,et al.  Two-dimensional visual simulation of flames, smoke and the spread of fire , 1994, Comput. Animat. Virtual Worlds.

[6]  Stefano Soatto,et al.  Dynamic Textures , 2003, International Journal of Computer Vision.

[7]  Paul M. Phillips,et al.  Generalizing video textures , 2003, Proceedings of Theory and Practice of Computer Graphics, 2003..

[8]  Rosalind W. Picard,et al.  Synthesizing Flames and their Spreading , 1994 .

[9]  Nuno Vasconcelos,et al.  Mixtures of dynamic textures , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[10]  Nipun Kwatra,et al.  Texture optimization for example-based synthesis , 2005, ACM Trans. Graph..

[11]  Dani Lischinski,et al.  Texture Mixing and Texture Movie Synthesis Using Statistical Learning , 2001, IEEE Trans. Vis. Comput. Graph..

[12]  Gui Yun Tian,et al.  Colour correction for panoramic imaging , 2002, Proceedings Sixth International Conference on Information Visualisation.

[13]  Matti Pietikäinen,et al.  Local spatiotemporal features for dynamic texture synthesis , 2014, EURASIP J. Image Video Process..

[14]  M. Werman Statistical Learning of Multi-Dimensional Textures , 1999 .

[15]  Nuno Vasconcelos,et al.  Modeling, Clustering, and Segmenting Video with Mixtures of Dynamic Textures , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Dmitry Chetverikov,et al.  Fast Synthesis of Dynamic Colour Textures , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[17]  Jirí Filip,et al.  Visual Texture , 2013, Advances in Computer Vision and Pattern Recognition.

[18]  Sabine Süsstrunk,et al.  Dynamic Texture Synthesis: Compact Models Based on Luminance-Chrominance Color Representation , 2006, 2006 International Conference on Image Processing.

[19]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[20]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[21]  T. Poggio,et al.  Visual hyperacuity: spatiotemporal interpolation in human vision , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[22]  Sabine Süsstrunk,et al.  Higher Order SVD Analysis for Dynamic Texture Synthesis , 2008, IEEE Transactions on Image Processing.

[23]  Song-Chun Zhu,et al.  Filters, Random Fields and Maximum Entropy (FRAME): Towards a Unified Theory for Texture Modeling , 1998, International Journal of Computer Vision.

[24]  Mark J. Huiskes,et al.  DynTex: A comprehensive database of dynamic textures , 2010, Pattern Recognit. Lett..

[25]  Michal Haindl,et al.  A Roller - Fast Sampling-Based Texture Synthesis Algorithm , 2005, WSCG.

[26]  R. Haber,et al.  Visual Perception , 2018, Encyclopedia of Database Systems.