A Deep Emulator for Secondary Motion of 3D Characters

Fast and light-weight methods for animating 3D characters are desirable in various applications such as computer games. We present a learning-based approach to enhance skinning-based animations of 3D characters with vivid secondary motion effects. We design a neural network that encodes each local patch of a character simulation mesh where the edges implicitly encode the internal forces between the neighboring vertices. The network emulates the ordinary differential equations of the character dynamics, predicting new vertex positions from the current accelerations, velocities and positions. Being a local method, our network is independent of the mesh topology and generalizes to arbitrarily shaped 3D character meshes at test time. We further represent per-vertex constraints and material properties such as stiffness, enabling us to easily adjust the dynamics in different parts of the mesh. We evaluate our method on various character meshes and complex motion sequences. Our method can be over 30 times more efficient than ground-truth physically based simulation, and outperforms alternative solutions that provide fast approximations.

[1]  Baining Guo,et al.  Simulation and control of skeleton-driven soft body characters , 2013, ACM Trans. Graph..

[2]  B. Wang,et al.  Adjustable Constrained Soft‐Tissue Dynamics , 2020, Comput. Graph. Forum.

[3]  Derek Nowrouzezahrai,et al.  Subspace neural physics: fast data-driven interactive simulation , 2019, Symposium on Computer Animation.

[4]  J. Zico Kolter,et al.  Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Prediction , 2020, ICML.

[5]  Shi-Min Hu,et al.  Alternating ConvLSTM: Learning Force Propagation with Alternate State Updates , 2020, ArXiv.

[6]  Jernej Barbic,et al.  Squashing cubes: automating deformable model construction for graphics , 2004, SIGGRAPH '04.

[7]  Vladlen Koltun,et al.  Lagrangian Fluid Simulation with Continuous Convolutions , 2020, ICLR.

[8]  Raia Hadsell,et al.  Graph networks as learnable physics engines for inference and control , 2018, ICML.

[9]  David I. W. Levin,et al.  Latent‐space Dynamics for Reduced Deformable Simulation , 2019, Comput. Graph. Forum.

[10]  Meire Fortunato,et al.  Learning Mesh-Based Simulation with Graph Networks , 2020, ArXiv.

[11]  Miguel A. Otaduy,et al.  Modeling and Estimation of Nonlinear Skin Mechanics for Animated Avatars , 2020, Comput. Graph. Forum.

[12]  James F. O'Brien,et al.  Fast and deep deformation approximations , 2018, ACM Trans. Graph..

[13]  Markus H. Gross,et al.  Rig-space physics , 2012, ACM Trans. Graph..

[14]  Geoffrey E. Hinton,et al.  NeuroAnimator: fast neural network emulation and control of physics-based models , 1998, SIGGRAPH.

[15]  Lin Gao,et al.  Realtime Simulation of Thin-Shell Deformable Materials Using CNN-Based Mesh Embedding , 2020, IEEE Robotics and Automation Letters.

[16]  Markus H. Gross,et al.  Efficient simulation of secondary motion in rig-space , 2013, SCA '13.

[17]  Jernej Barbic,et al.  Vega: Non‐Linear FEM Deformable Object Simulator , 2013, Comput. Graph. Forum.

[18]  Alec Jacobson,et al.  Skinning: real-time shape deformation , 2014, SIGGRAPH ASIA Courses.

[19]  Jiajun Wu,et al.  Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluids , 2018, ICLR.

[20]  Miguel A. Otaduy,et al.  SoftSMPL: Data‐driven Modeling of Nonlinear Soft‐tissue Dynamics for Parametric Humans , 2020, Comput. Graph. Forum.

[21]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[22]  Tommaso Mansi,et al.  Deep learning acceleration of Total Lagrangian Explicit Dynamics for soft tissue mechanics , 2020 .

[23]  Jure Leskovec,et al.  Learning to Simulate Complex Physics with Graph Networks , 2020, ICML.

[24]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[25]  Eftychios Sifakis,et al.  Efficient elasticity for character skinning with contact and collisions , 2011, ACM Trans. Graph..