One-to-many: example-based mesh animation synthesis

We propose an example-based approach for synthesizing diverse mesh animations. Provided a short clip of deformable mesh animation, our method synthesizes a large number of different animations of arbitrary length. Combining an automatically inferred linear blending skinning (LBS) model with a PCA-based model reduction, our method identifies possible smooth transitions in the example sequence. To create smooth transitions, we synthesize reduced deformation parameters based on a set of characteristic key vertices on the mesh. Furthermore, by analyzing cut nodes on a graph built upon the LBS model, we are able to decompose the mesh into independent components. Motions of these components are synthesized individually and assembled together. Our method has the complexity independent from mesh resolutions, enabling efficient generation of arbitrarily long animations without tedious parameter tuning and heavy computation. We evaluate our method on various animation examples, and demonstrate that numerous diverse animations can be generated from each single example.

[1]  Irfan Essa,et al.  Texture optimization for example-based synthesis , 2005, SIGGRAPH 2005.

[2]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[3]  Hyun Joon Shin,et al.  Snap-together motion: assembling run-time animations , 2003, SIGGRAPH '08.

[4]  Adam W. Bargteil,et al.  Physics-inspired upsampling for cloth simulation in games , 2011, SIGGRAPH 2011.

[5]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[6]  Siddhartha Chaudhuri,et al.  A probabilistic model for component-based shape synthesis , 2012, ACM Trans. Graph..

[7]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[8]  Bruno Galerne,et al.  Gabor noise by example , 2012, ACM Trans. Graph..

[9]  Doug L. James,et al.  Energy-based self-collision culling for arbitrary mesh deformations , 2012, ACM Trans. Graph..

[10]  Kun Zhou,et al.  Interactive Shape Interpolation through Controllable Dynamic Deformation , 2011, IEEE Transactions on Visualization and Computer Graphics.

[11]  David Salesin,et al.  Panoramic video textures , 2005, SIGGRAPH 2005.

[12]  Jovan Popovic,et al.  Deformation transfer for triangle meshes , 2004, ACM Trans. Graph..

[13]  James F. O'Brien,et al.  Example-based wrinkle synthesis for clothing animation , 2010, ACM Trans. Graph..

[14]  Eitan Grinspun,et al.  Example-based elastic materials , 2011, ACM Trans. Graph..

[15]  Kevin G. Der,et al.  Inverse kinematics for reduced deformable models , 2006, SIGGRAPH 2006.

[16]  Huamin Wang,et al.  Example-based wrinkle synthesis for clothing animation , 2010, SIGGRAPH 2010.

[17]  Peter-Pike J. Sloan,et al.  Physics-inspired upsampling for cloth simulation in games , 2011, ACM Trans. Graph..

[18]  Doug L. James,et al.  Skinning mesh animations , 2005, SIGGRAPH 2005.

[19]  Doug L. James,et al.  Mesh Ensemble Motion Graphs: Data-driven mesh animation with constraints , 2007, TOGS.

[20]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[21]  Kun Zhou,et al.  Mesh editing with poisson-based gradient field manipulation , 2004, ACM Trans. Graph..

[22]  Jovan Popović,et al.  Deformation transfer for triangle meshes , 2004, SIGGRAPH 2004.

[23]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH Classes.

[24]  Ziv Bar-Joseph,et al.  Modeling spatial and temporal variation in motion data , 2009, ACM Trans. Graph..

[25]  Jovan Popović,et al.  Mesh-based inverse kinematics , 2005, SIGGRAPH 2005.

[26]  Doug L. James,et al.  Skinning mesh animations , 2005, ACM Trans. Graph..

[27]  Peter-Pike J. Sloan,et al.  Fast and Efficient Skinning of Animated Meshes , 2010, Comput. Graph. Forum.

[28]  Kun Zhou,et al.  Mesh editing with poisson-based gradient field manipulation , 2004, SIGGRAPH 2004.

[29]  Hyun Joon Shin,et al.  Snap-together motion: assembling run-time animations , 2003, I3D '03.

[30]  Eitan Grinspun,et al.  Example-based elastic materials , 2011, ACM Trans. Graph..

[31]  Doug L. James,et al.  Precomputing interactive dynamic deformable scenes , 2003, ACM Trans. Graph..

[32]  Lucas Kovar,et al.  Motion Graphs , 2002, ACM Trans. Graph..

[33]  Nipun Kwatra,et al.  Texture optimization for example-based synthesis , 2005, ACM Trans. Graph..

[34]  Gene H. Golub,et al.  Matrix computations , 1983 .

[35]  Matthias Zwicker,et al.  Mesh-based inverse kinematics , 2005, ACM Trans. Graph..

[36]  Steven H. Strogatz,et al.  Nonlinear Dynamics and Chaos , 2024 .

[37]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[38]  Mark Meyer,et al.  Key Point Subspace Acceleration and soft caching , 2007, SIGGRAPH 2007.

[39]  Pedro V. Sander,et al.  Geometry videos: a new representation for 3D animations , 2003, SCA '03.

[40]  Jovan Popovic,et al.  Inverse kinematics for reduced deformable models , 2006, SIGGRAPH '06.

[41]  M. N. Shanmukha Swamy,et al.  Graphs: Theory and Algorithms , 1992 .

[42]  Huamin Wang,et al.  Data-driven elastic models for cloth: modeling and measurement , 2011, SIGGRAPH 2011.

[43]  Zhigang Deng,et al.  Smooth skinning decomposition with rigid bones , 2012, ACM Trans. Graph..

[44]  Sylvain Lefebvre,et al.  State of the Art in Example-based Texture Synthesis , 2009, Eurographics.

[45]  David Salesin,et al.  Panoramic video textures , 2005, ACM Trans. Graph..

[46]  Huamin Wang,et al.  Data-driven elastic models for cloth: modeling and measurement , 2011, ACM Trans. Graph..

[47]  Kari Pulli,et al.  Real-time enveloping with rotational regression , 2007, ACM Trans. Graph..

[48]  Irfan A. Essa,et al.  Controlled animation of video sprites , 2002, SCA '02.

[49]  Christoph Bregler,et al.  Animating by multi-level sampling , 2000, Proceedings Computer Animation 2000.