LazyFluids: appearance transfer for fluid animations

In this paper we present a novel approach to appearance transfer for fluid animations based on flow-guided texture synthesis. In contrast to common practice where pre-captured sets of fluid elements are combined in order to achieve desired motion and look, we bring the possibility of fine-tuning motion properties in advance using CG techniques, and then transferring the desired look from a selected appearance exemplar. We demonstrate that such a practical work-flow cannot be simply implemented using current state-of-the-art techniques, analyze what the main obstacles are, and propose a solution to resolve them. In addition, we extend the algorithm to allow for synthesis with rich boundary effects and video exemplars. Finally, we present numerous results that demonstrate the versatility of the proposed approach.

[1]  Kun Zhou,et al.  Fast example-based surface texture synthesis via discrete optimization , 2006, The Visual Computer.

[2]  Nelson L. Max,et al.  Visualizing wind velocities by advecting cloud textures , 1992, Proceedings Visualization '92.

[3]  Patrick Pérez,et al.  Video Inpainting of Complex Scenes , 2014, SIAM J. Imaging Sci..

[4]  Dani Lischinski,et al.  Self Tuning Texture Optimization , 2015, Comput. Graph. Forum.

[5]  Sylvain Lefebvre,et al.  Appearance-space texture synthesis , 2006, ACM Trans. Graph..

[6]  Adam Finkelstein,et al.  The Generalized PatchMatch Correspondence Algorithm , 2010, ECCV.

[7]  Adam Finkelstein,et al.  Stylized keyframe animation of fluid simulations , 2014, NPAR '14.

[8]  Fabrice Neyret,et al.  Lagrangian Texture Advection: Preserving both Spectrum and Velocity Field , 2011, IEEE Transactions on Visualization and Computer Graphics.

[9]  Jos Stam,et al.  Stable fluids , 1999, SIGGRAPH.

[10]  Neel Joshi,et al.  Automated video looping with progressive dynamism , 2013, ACM Trans. Graph..

[11]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[12]  Jean Charles Bazin,et al.  Painting by feature , 2013, ACM Trans. Graph..

[13]  Nipun Kwatra,et al.  Physics-Based Subsurface Visualization of Human Tissue , 2007 .

[14]  Pierre Bénard,et al.  Stylizing animation by example , 2013, ACM Trans. Graph..

[15]  Ken Perlin,et al.  [Computer Graphics]: Three-Dimensional Graphics and Realism , 2022 .

[16]  Dani Lischinski,et al.  Solid texture synthesis from 2D exemplars , 2007, ACM Trans. Graph..

[17]  Bin Wang,et al.  High quality solid texture synthesis using position and index histogram matching , 2010, The Visual Computer.

[18]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[19]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[20]  Nipun Kwatra,et al.  Texturing Fluids , 2006, IEEE Transactions on Visualization and Computer Graphics.

[21]  Eli Shechtman,et al.  Regenerative morphing , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Dani Lischinski,et al.  Layered shape synthesis: automatic generation of control maps for non-stationary textures , 2009, ACM Trans. Graph..

[23]  Ming C. Lin,et al.  Feature-Guided Dynamic Texture Synthesis on Continuous Flows , 2007, Rendering Techniques.

[24]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..

[25]  Eli Shechtman,et al.  Image melding , 2012, ACM Trans. Graph..

[26]  David Salesin,et al.  Video watercolorization using bidirectional texture advection , 2007, SIGGRAPH 2007.

[27]  Nipun Kwatra,et al.  Texture optimization for example-based synthesis , 2005, ACM Trans. Graph..

[28]  James F. O'Brien,et al.  A texture synthesis method for liquid animations , 2006, SCA '06.

[29]  Jessica K. Hodgins,et al.  Flow-based video synthesis and editing , 2004, SIGGRAPH 2004.

[30]  Eli Shechtman,et al.  Space-Time Completion of Video , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Denis Simakov,et al.  Summarizing visual data using bidirectional similarity , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Kun Zhou,et al.  Inverse texture synthesis , 2008, ACM Trans. Graph..

[33]  Fabrice Neyret,et al.  Advected textures , 2003, SCA '03.