DiffPD: Differentiable Projective Dynamics with Contact

We present a novel, fast differentiable simulator for soft-body learning and control applications. Existing differentiable soft-body simulators can be classified into two categories based on their time integration methods. Simulators using explicit time-stepping scheme require tiny time steps to avoid numerical instabilities in gradient computation, and simulators using implicit time integration typically compute gradients by employing the adjoint method to solve the expensive linearized dynamics. Inspired by Projective Dynamics (PD), we present DiffPD, an efficient differentiable soft-body simulator with implicit time integration. The key idea in DiffPD is to speed up backpropagation by exploiting the prefactorized Cholesky decomposition in PD to achieve a super-linear convergence rate. To handle contacts, DiffPD solves contact forces by analyzing a linear complementarity problem (LCP) and its gradients. With the assumption that contacts occur on a small number of nodes, we develop an efficient method for gradient computation by exploring the low-rank structure in the linearized dynamics. We evaluate the performance of DiffPD and observe a speedup of 4-19 times compared to the standard Newton’s method in various applications including system identification, inverse design problems, trajectory optimization, and closed-loop control.

[1]  Jernej Barbic,et al.  FEM simulation of 3D deformable solids: a practitioner's guide to theory, discretization and model reduction , 2012, SIGGRAPH '12.

[2]  Jiancheng Liu,et al.  ChainQueen: A Real-Time Differentiable Physical Simulator for Soft Robotics , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[3]  Steven M. Seitz,et al.  Motion sketching for control of rigid-body simulations , 2003, TOGS.

[4]  Xuchen Han,et al.  A Hybrid Material Point Method for Frictional Contact with Diverse Materials , 2019, PACMCGIT.

[5]  Eitan Grinspun,et al.  Example-based elastic materials , 2011, ACM Trans. Graph..

[6]  A. Bountis Dynamical Systems And Numerical Analysis , 1997, IEEE Computational Science and Engineering.

[7]  Joshua B. Tenenbaum,et al.  End-to-End Differentiable Physics for Learning and Control , 2018, NeurIPS.

[8]  Larry Rudolph,et al.  Implementation Matters in Deep RL: A Case Study on PPO and TRPO , 2020, ICLR.

[9]  Tiantian Liu,et al.  Quasi-newton methods for real-time simulation of hyperelastic materials , 2017, TOGS.

[10]  Elmar Eisemann,et al.  Hyper-reduced projective dynamics , 2018, ACM Trans. Graph..

[11]  Roi Poranne,et al.  Trajectory Optimization for Cable-Driven Soft Robot Locomotion , 2019, Robotics: Science and Systems.

[12]  Jernej Barbic,et al.  Vega: Non‐Linear FEM Deformable Object Simulator , 2013, Comput. Graph. Forum.

[13]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[14]  Vladlen Koltun,et al.  Learning to Control PDEs with Differentiable Physics , 2020, ICLR.

[15]  Hod Lipson,et al.  Unshackling evolution: evolving soft robots with multiple materials and a powerful generative encoding , 2013, GECCO '13.

[16]  H. Lipson,et al.  Dynamic Simulation of Soft Multimaterial 3D-Printed Objects , 2014 .

[17]  Timothy R. Langlois,et al.  Incremental Potential Contact: Intersection- and Inversion-free, Large-Deformation Dynamics , 2020 .

[18]  Stephane Cotin,et al.  EP4A: Software and Computer Based Simulator Research: Development and Outlook SOFA—An Open Source Framework for Medical Simulation , 2007, MMVR.

[19]  Jie Li,et al.  ADMM ⊇ Projective Dynamics: Fast Simulation of Hyperelastic Models with Dynamic Constraints , 2017, IEEE Trans. Vis. Comput. Graph..

[20]  Jiajun Wu,et al.  Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluids , 2018, ICLR.

[21]  Adrien Treuille,et al.  Fluid control using the adjoint method , 2004, ACM Trans. Graph..

[22]  Dinesh K. Pai,et al.  ArtDefo: accurate real time deformable objects , 1999, SIGGRAPH.

[23]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[24]  M. Pauly,et al.  Projective Dynamics: Fusing Constraint Projections for Fast Simulation , 2023 .

[25]  Yin Yang,et al.  Descent methods for elastic body simulation on the GPU , 2016, ACM Trans. Graph..

[26]  Ladislav Kavan,et al.  Stabilizing Integrators for Real-Time Physics , 2018, ACM Trans. Graph..

[27]  Ming C. Lin,et al.  Scalable Differentiable Physics for Learning and Control , 2020, ICML.

[28]  Christian Duriez,et al.  Control Design for Soft Robots Based on Reduced-Order Model , 2019, IEEE Robotics and Automation Letters.

[29]  Hod Lipson,et al.  Material properties affect evolutions ability to exploit morphological computation in growing soft-bodied creatures , 2016, ALIFE.

[30]  Jure Leskovec,et al.  Learning to Simulate Complex Physics with Graph Networks , 2020, ICML.

[31]  Huamin Wang,et al.  A chebyshev semi-iterative approach for accelerating projective and position-based dynamics , 2015, ACM Trans. Graph..

[32]  Wojciech Matusik,et al.  Learning-In-The-Loop Optimization: End-To-End Control And Co-Design Of Soft Robots Through Learned Deep Latent Representations , 2019, NeurIPS.

[33]  Xin Tong,et al.  A scalable galerkin multigrid method for real-time simulation of deformable objects , 2019, ACM Trans. Graph..

[34]  Ming C. Lin,et al.  Differentiable Cloth Simulation for Inverse Problems , 2019, NeurIPS.

[35]  Marco Fratarcangeli,et al.  Vivace: a practical gauss-seidel method for stable soft body dynamics , 2016, ACM Trans. Graph..

[36]  Jing Li,et al.  Fast simulation of deformable characters with articulated skeletons in projective dynamics , 2019, Symposium on Computer Animation.

[37]  Greg Turk,et al.  Keyframe control of complex particle systems using the adjoint method , 2006, SCA '06.

[38]  Jonas Degrave,et al.  A DIFFERENTIABLE PHYSICS ENGINE FOR DEEP LEARNING IN ROBOTICS , 2016, Front. Neurorobot..

[39]  Eftychios Sifakis,et al.  Dexterous manipulation and control with volumetric muscles , 2018, ACM Trans. Graph..

[40]  Rahul Narain,et al.  ADMM ⊇ projective dynamics: fast simulation of general constitutive models , 2016, Symposium on Computer Animation.

[41]  Doug L. James,et al.  Real-Time subspace integration for St. Venant-Kirchhoff deformable models , 2005, ACM Trans. Graph..

[42]  Marc Toussaint,et al.  Differentiable Physics and Stable Modes for Tool-Use and Manipulation Planning , 2018, Robotics: Science and Systems.

[43]  Adrien Treuille,et al.  Keyframe control of smoke simulations , 2003, ACM Trans. Graph..

[44]  Florence Bertails-Descoubes,et al.  Projective dynamics with dry frictional contact , 2020, ACM Trans. Graph..

[45]  Wojciech Matusik,et al.  Dynamics-aware numerical coarsening for fabrication design , 2017, ACM Trans. Graph..