Dynamic element textures

Many natural phenomena consist of geometric elements with dynamic motions characterized by small scale repetitions over large scale structures, such as particles, herds, threads, and sheets. Due to their ubiquity, controlling the appearance and behavior of such phenomena is important for a variety of graphics applications. However, such control is often challenging; the repetitive elements are often too numerous for manual edit, while their overall structures are often too versatile for fully automatic computation. We propose a method that facilitates easy and intuitive controls at both scales: high-level structures through spatial-temporal output constraints (e.g. overall shape and motion of the output domain), and low-level details through small input exemplars (e.g. element arrangements and movements). These controls are suitable for manual specification, while the corresponding geometric and dynamic repetitions are suitable for automatic computation. Our system takes such user controls as inputs, and generates as outputs the corresponding repetitions satisfying the controls. Our method, which we call dynamic element textures, aims to produce such controllable repetitions through a combination of constrained optimization (satisfying controls) and data driven computation (synthesizing details). We use spatial-temporal samples as the core representation for dynamic geometric elements. We propose analysis algorithms for decomposing small scale repetitions from large scale themes, as well as synthesis algorithms for generating outputs satisfying user controls. Our method is general, producing a range of artistic effects that previously required disparate and specialized techniques.

[1]  Eugene Fiume,et al.  Turbulent wind fields for gaseous phenomena , 1993, SIGGRAPH.

[2]  Rupert Paget,et al.  Texture Synthesis via a Non-parametric Markov Random Field , 1995 .

[3]  Martin Szummer,et al.  Temporal texture modeling , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[4]  Steven M. Seitz,et al.  Interactive manipulation of rigid body simulations , 2000, SIGGRAPH.

[5]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[6]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[7]  Greg Turk,et al.  Texture synthesis on surfaces , 2001, SIGGRAPH.

[8]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[9]  Baining Guo,et al.  Synthesis of bidirectional texture functions on arbitrary surfaces , 2002, SIGGRAPH.

[10]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[11]  Jean-Michel Dischler,et al.  Texture Particles , 2002, Comput. Graph. Forum.

[12]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[13]  Sylvain Lefebvre,et al.  Parallel controllable texture synthesis , 2005, ACM Trans. Graph..

[14]  Nipun Kwatra,et al.  Texture optimization for example-based synthesis , 2005, ACM Trans. Graph..

[15]  Irfan Essa,et al.  Texture optimization for example-based synthesis , 2005, SIGGRAPH 2005.

[16]  Yongning Zhu,et al.  Animating sand as a fluid , 2005, SIGGRAPH 2005.

[17]  Robert Bridson,et al.  Animating sand as a fluid , 2005, ACM Trans. Graph..

[18]  Ulrich Rüde,et al.  Detail-preserving fluid control , 2006, Symposium on Computer Animation.

[19]  Sylvain Lefebvre,et al.  Appearance-space texture synthesis , 2006, ACM Trans. Graph..

[20]  Pascal Barla,et al.  Stroke Pattern Analysis and Synthesis , 2006, Comput. Graph. Forum.

[21]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[22]  H. Shum,et al.  Appearance manifolds for modeling time-variant appearance of materials , 2006, SIGGRAPH 2006.

[23]  Doug L. James,et al.  Mesh Ensemble Motion Graphs: Data-driven mesh animation with constraints , 2007, TOGS.

[24]  Baining Guo,et al.  Context-aware textures , 2007, TOGS.

[25]  Narendra Ahuja,et al.  Extracting Texels in 2.1D Natural Textures , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[26]  Nipun Kwatra,et al.  Texturing Fluids , 2006, IEEE Transactions on Visualization and Computer Graphics.

[27]  Apurva Shah,et al.  Session details: Course 6: Anyone can cook: inside Ratatouille's kitchen , 2007, ACM SIGGRAPH 2007 courses.

[28]  Nipun Kwatra,et al.  Physics-Based Subsurface Visualization of Human Tissue , 2007 .

[29]  Kun Zhou,et al.  Online Submission ID: papers 0027 Inverse Texture Synthesis , 2022 .

[30]  Sylvain Lefebvre,et al.  Lazy Solid Texture Synthesis , 2008, Comput. Graph. Forum.

[31]  Radomír Mech,et al.  An Example‐based Procedural System for Element Arrangement , 2008, Comput. Graph. Forum.

[32]  Andrew Chi-Sing Leung,et al.  Animating animal motion from still , 2008, SIGGRAPH Asia '08.

[33]  Lucas Kovar,et al.  Motion Graphs , 2002, ACM Trans. Graph..

[34]  Taesoo Kwon,et al.  Group motion editing , 2008, SIGGRAPH 2008.

[35]  Kun Zhou,et al.  Inverse texture synthesis , 2008, ACM Trans. Graph..

[36]  Jovan Popović,et al.  Deformable object animation using reduced optimal control , 2009, SIGGRAPH 2009.

[37]  Baining Guo,et al.  Example-based hair geometry synthesis , 2009, SIGGRAPH 2009.

[38]  Sylvain Lefebvre,et al.  State of the Art in Example-based Texture Synthesis , 2009, Eurographics.

[39]  Jernej Barbic,et al.  Deformable object animation using reduced optimal control , 2009, ACM Trans. Graph..

[40]  Ming C. Lin,et al.  Aggregate dynamics for dense crowd simulation , 2009, ACM Trans. Graph..

[41]  Kun Zhou,et al.  Example-based hair geometry synthesis , 2009, ACM Trans. Graph..

[42]  Shi-Min Hu,et al.  RepFinder: finding approximately repeated scene elements for image editing , 2010, ACM Trans. Graph..

[43]  James F. O'Brien,et al.  Example-based wrinkle synthesis for clothing animation , 2010, ACM Trans. Graph..

[44]  Huamin Wang,et al.  Example-based wrinkle synthesis for clothing animation , 2010, SIGGRAPH 2010.

[45]  Ming C. Lin,et al.  Free-flowing granular materials with two-way solid coupling , 2010, ACM Trans. Graph..

[46]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[47]  Jehee Lee,et al.  Morphable crowds , 2010, SIGGRAPH 2010.

[48]  Ming C. Lin,et al.  Interactive hybrid simulation of large-scale traffic , 2011, ACM Trans. Graph..

[49]  Matthias Müller,et al.  Solid simulation with oriented particles , 2011, ACM Trans. Graph..

[50]  N. Chentanez,et al.  Solid simulation with oriented particles , 2011, SIGGRAPH 2011.

[51]  Huamin Wang,et al.  Data-driven elastic models for cloth: modeling and measurement , 2011, SIGGRAPH 2011.

[52]  Adam W. Bargteil,et al.  Physics-inspired upsampling for cloth simulation in games , 2011, SIGGRAPH 2011.

[53]  Huamin Wang,et al.  Data-driven elastic models for cloth: modeling and measurement , 2011, ACM Trans. Graph..

[54]  Peter-Pike J. Sloan,et al.  Physics-inspired upsampling for cloth simulation in games , 2011, ACM Trans. Graph..

[55]  Li-Yi Wei,et al.  Discrete element textures , 2011, ACM Trans. Graph..

[56]  Li-yi Wei,et al.  Discrete element textures , 2011, SIGGRAPH 2011.

[57]  Dinesh Manocha,et al.  A statistical similarity measure for aggregate crowd dynamics , 2012, ACM Trans. Graph..

[58]  Takeo Igarashi,et al.  Vignette: interactive texture design and manipulation with freeform gestures for pen-and-ink illustration , 2012, CHI.

[59]  Yi Li,et al.  Cloning crowd motions , 2012, SCA '12.

[60]  Hayley N. Iben,et al.  Curls gone wild: hair simulation in Brave , 2012, SIGGRAPH '12.