Example-based dynamic skinning in real time

In this paper we present an approach to enrich skeleton-driven animations with physically-based secondary deformation in real time. To achieve this goal, we propose a novel, surface-based deformable model that can interactively emulate the dynamics of both low-and high-frequency volumetric effects. Given a surface mesh and a few sample sequences of its physical behavior, a set of motion parameters of the material are learned during an off-line preprocessing step. The deformable model is then applicable to any given skeleton-driven animation of the surface mesh. Additionally, our dynamic skinning technique can be entirely implemented on GPUs and executed with great efficiency. Thus, with minimal changes to the conventional graphics pipeline, our approach can drastically enhance the visual experience of skeleton-driven animations by adding secondary deformation in real time.

[1]  Hans-Peter Seidel,et al.  Elastic secondary deformations by vector field integration , 2007, Symposium on Geometry Processing.

[2]  Doug L. James,et al.  FastLSM: fast lattice shape matching for robust real-time deformation , 2007, ACM Trans. Graph..

[3]  Daniel Thalmann,et al.  Joint-dependent local deformations for hand animation and object grasping , 1989 .

[4]  Steve Capell,et al.  Interactive skeleton-driven dynamic deformations , 2002, ACM Trans. Graph..

[5]  Michael Gleicher,et al.  Building efficient, accurate character skins from examples , 2003, ACM Trans. Graph..

[6]  Jane Wilhelms MODELING ANIMALS WITH BONES, MUSCLES, AND SKIN , 1995 .

[7]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[8]  Ronald Fedkiw,et al.  A Crystalline, Red Green Strategy for Meshing Highly Deformable Objects with Tetrahedra , 2003, IMR.

[9]  Eitan Grinspun,et al.  TRACKS: toward directable thin shells , 2007, ACM Trans. Graph..

[10]  Markus H. Gross,et al.  Meshless deformations based on shape matching , 2005, ACM Trans. Graph..

[11]  Alex Pentland,et al.  Good vibrations: modal dynamics for graphics and animation , 1989, SIGGRAPH.

[12]  Markus H. Gross,et al.  Interactive Virtual Materials , 2004, Graphics Interface.

[13]  Xinhua Zhuang,et al.  Pose estimation from corresponding point data , 1989, IEEE Trans. Syst. Man Cybern..

[14]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[15]  Marie-Paule Cani,et al.  Controlling Anisotropy in Mass-Spring Systems , 2000, Computer Animation and Simulation.

[16]  Gábor Székely,et al.  Simultaneous Topology and Stiffness Identification for Mass-Spring Models Based on FEM Reference Deformations , 2004, MICCAI.

[17]  Dinesh K. Pai,et al.  ArtDefo: accurate real time deformable objects , 1999, SIGGRAPH.

[18]  Adrien Treuille,et al.  Fluid control using the adjoint method , 2004, ACM Trans. Graph..

[19]  Jessica K. Hodgins,et al.  Combining Active and Passive Simulations for Secondary Motion , 2000, IEEE Computer Graphics and Applications.

[20]  Bruno Arnaldi,et al.  Dynamic skinning: adding real-time dynamic effects to an existing character animation , 2005, SCCG '05.

[21]  Markus H. Gross,et al.  A versatile and robust model for geometrically complex deformable solids , 2004, Proceedings Computer Graphics International, 2004..

[22]  Matthias Zwicker,et al.  Mesh-based inverse kinematics , 2005, ACM Trans. Graph..

[23]  Chen Shen,et al.  Interactive Deformation Using Modal Analysis with Constraints , 2003, Graphics Interface.

[24]  Kun Zhou,et al.  Mesh puppetry: cascading optimization of mesh deformation with inverse kinematics , 2007, ACM Trans. Graph..

[25]  Dinesh K. Pai,et al.  Real time simulation of multizone elastokinematic models , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[26]  Mariette Yvinec,et al.  Variational tetrahedral meshing , 2005, ACM Trans. Graph..

[27]  John P. Lewis,et al.  Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation , 2000, SIGGRAPH.

[28]  Jessica K. Hodgins,et al.  Capturing and animating skin deformation in human motion , 2006, SIGGRAPH '06.

[29]  Dinesh K. Pai,et al.  DyRT: dynamic response textures for real time deformation simulation with graphics hardware , 2002, SIGGRAPH.

[30]  Jovan Popovic,et al.  Continuous capture of skin deformation , 2003, ACM Trans. Graph..

[31]  Erik Lindholm,et al.  A user-programmable vertex engine , 2001, SIGGRAPH.

[32]  Jessica K. Hodgins,et al.  Estimating cloth simulation parameters from video , 2003, SCA '03.

[33]  Sunil Hadap,et al.  Introduction to articulated rigid body dynamics. , 2005, SIGGRAPH 2005.