Time-Varying Textures

Essentially all computer graphics rendering assumes that the reflectance and texture of surfaces is a static phenomenon. Yet, there is an abundance of materials in nature whose appearance varies dramatically with time, such as cracking paint, growing grass, or ripening banana skins. In this paper, we take a significant step towards addressing this problem, investigating a new class of time-varying textures. We make three contributions. First, we describe the carefully controlled acquisition of datasets of a variety of natural processes including the growth of grass, the accumulation of snow, and the oxidation of copper. Second, we show how to adapt quilting-based methods to time-varying texture synthesis, addressing the important challenges of maintaining temporal coherence, efficient synthesis on large time-varying datasets, and reducing visual artifacts specific to time-varying textures. Finally, we show how simple procedural techniques can be used to control the evolution of the results, such as allowing for a faster growth of grass in well lit (as opposed to shadowed) areas.

[1]  Brian D. Sleeman,et al.  Mathematics in Nature : Modeling Patterns in the Natural World , 2005 .

[2]  Martin Szummer,et al.  Temporal texture modeling , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[3]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[4]  Michael Garland,et al.  Jump map-based interactive texture synthesis , 2004, ACM Trans. Graph..

[5]  Greg Turk,et al.  Generating textures on arbitrary surfaces using reaction-diffusion , 1991, SIGGRAPH.

[6]  Jeremy S. De Bonet,et al.  Multiresolution sampling procedure for analysis and synthesis of texture images , 1997, SIGGRAPH.

[7]  H. Meinhardt.  Pattern formation in biology: a comparison of models and experiments , 1992 .

[8]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[9]  E. KostShelton,et al.  Growth and development. , 1951, Ciba clinical symposia.

[10]  John A. Adam,et al.  Mathematics in Nature: Modeling Patterns in the Natural World , 2003 .

[11]  Song-Chun Zhu,et al.  A Generative Method for Textured Motion: Analysis and Synthesis , 2002, ECCV.

[12]  Greg Turk,et al.  Texture synthesis on surfaces , 2001, SIGGRAPH.

[13]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[14]  Daniel Willis,et al.  On Weathering: The Life of Buildings in Time , 1993 .

[15]  Baining Guo,et al.  Synthesis of bidirectional texture functions on arbitrary surfaces , 2002, SIGGRAPH.

[16]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[17]  Marc Levoy,et al.  Texture synthesis over arbitrary manifold surfaces , 2001, SIGGRAPH.

[18]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[19]  Andrew Witkin,et al.  Reaction-diffusion textures , 1991, SIGGRAPH.

[20]  Alan Edelman,et al.  Modeling and rendering of weathered stone , 1999, SIGGRAPH.

[21]  Baining Guo,et al.  Real-time texture synthesis by patch-based sampling , 2001, TOGS.

[22]  Jean-Michel Dischler,et al.  Corrosion: Simulating and Rendering , 2001, Graphics Interface.

[23]  Philip Ball,et al.  The Self-Made Tapestry: Pattern Formation in Nature , 1999 .

[24]  Przemyslaw Prusinkiewicz,et al.  The Algorithmic Beauty of Plants , 1990, The Virtual Laboratory.

[25]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[26]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[27]  Stefano Soatto,et al.  Dynamic Textures , 2003, International Journal of Computer Vision.