ChainQueen: A Real-Time Differentiable Physical Simulator for Soft Robotics

Physical simulators have been widely used in robot planning and control. Among them, differentiable simulators are particularly favored, as they can be incorporated into gradient-based optimization algorithms that are efficient in solving inverse problems such as optimal control and motion planning. Therefore, rigid body simulators and recently their differentiable variants are studied extensively. Simulating deformable objects is, however, more challenging compared to rigid body dynamics. The underlying physical laws of deformable objects are more complex, and the resulting systems have orders of magnitude more degrees of freedom and there-fore they are significantly more computationally expensive to simulate. Computing gradients with respect to physical design or controller parameters is typically even more computationally challenging. In this paper, we propose a real-time, differentiable hybrid Lagrangian-Eulerian physical simulator for deformable objects, ChainQueen, based on the Moving Least Squares Material Point Method (MLS-MPM). MLS-MPM can simulate deformable objects with collisions and can be seamlessly incorporated into soft robotic systems. We demonstrate that our simulator achieves high precision in both forward simulation and backward gradient computation. We have successfully employed it in a diverse set of inference, control and co-design tasks for soft robotics.

[1]  Yuval Tassa,et al.  Simulation tools for model-based robotics: Comparison of Bullet, Havok, MuJoCo, ODE and PhysX , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Alec Radford,et al.  Proximal Policy Optimization Algorithms , 2017, ArXiv.

[3]  Andre Pradhana,et al.  A moving least squares material point method with displacement discontinuity and two-way rigid body coupling , 2018, ACM Trans. Graph..

[4]  J. Teran,et al.  Dynamic anticrack propagation in snow , 2018, Nature Communications.

[5]  Joshua B. Tenenbaum,et al.  End-to-End Differentiable Physics for Learning and Control , 2018, NeurIPS.

[6]  D. Sulsky Erratum: Application of a particle-in-cell method to solid mechanics , 1995 .

[7]  Marc Toussaint,et al.  Differentiable Physics and Stable Modes for Tool-Use and Manipulation Planning , 2018, Robotics: Science and Systems.

[8]  Chenfanfu Jiang,et al.  The affine particle-in-cell method , 2015, ACM Trans. Graph..

[9]  Chenfanfu Jiang,et al.  Multi-species simulation of porous sand and water mixtures , 2017, ACM Trans. Graph..

[10]  Yuanming Hu Taichi: An Open-Source Computer Graphics Library , 2018, ArXiv.

[11]  Xuchen Han,et al.  A material point method for thin shells with frictional contact , 2018, ACM Trans. Graph..

[12]  Raia Hadsell,et al.  Graph networks as learnable physics engines for inference and control , 2018, ICML.

[13]  Jonas Degrave,et al.  A DIFFERENTIABLE PHYSICS ENGINE FOR DEEP LEARNING IN ROBOTICS , 2016, Front. Neurorobot..

[14]  Andre Pradhana,et al.  GPU optimization of material point methods , 2018, ACM Trans. Graph..

[15]  Chenfanfu Jiang,et al.  A material point method for viscoelastic fluids, foams and sponges , 2015, Symposium on Computer Animation.

[16]  Joshua B. Tenenbaum,et al.  A Compositional Object-Based Approach to Learning Physical Dynamics , 2016, ICLR.

[17]  Daniel L. K. Yamins,et al.  Flexible Neural Representation for Physics Prediction , 2018, NeurIPS.

[18]  Connor Schenck,et al.  SPNets: Differentiable Fluid Dynamics for Deep Neural Networks , 2018, CoRL.

[19]  Razvan Pascanu,et al.  Interaction Networks for Learning about Objects, Relations and Physics , 2016, NIPS.

[20]  Chenfanfu Jiang,et al.  The material point method for simulating continuum materials , 2016, SIGGRAPH Courses.

[21]  Ming Gao,et al.  Animating fluid sediment mixture in particle-laden flows , 2018, ACM Trans. Graph..

[22]  Darwin G. Caldwell,et al.  RobCoGen: a code generator for efficient kinematics and dynamics of articulated robots, based on Domain Specific Languages , 2016 .

[23]  Florence Bertails-Descoubes,et al.  A semi-implicit material point method for the continuum simulation of granular materials , 2016, ACM Trans. Graph..

[24]  Tae-Yong Kim,et al.  Unified particle physics for real-time applications , 2014, ACM Trans. Graph..

[25]  W. Takashima,et al.  Artificial Muscles Based on Polypyrrole Actuators with Large Strain and Stress Induced Electrically , 2004 .

[26]  Miles Macklin,et al.  Position based fluids , 2013, ACM Trans. Graph..

[27]  Yuval Tassa,et al.  MuJoCo: A physics engine for model-based control , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Chenfanfu Jiang,et al.  Anisotropic elastoplasticity for cloth, knit and hair frictional contact , 2017, ACM Trans. Graph..

[29]  Alexey Stomakhin,et al.  A material point method for snow simulation , 2013, ACM Trans. Graph..

[30]  Shi-Min Hu,et al.  A Temporally Adaptive Material Point Method with Regional Time Stepping , 2018, Comput. Graph. Forum.

[31]  Andre Pradhana,et al.  Drucker-prager elastoplasticity for sand animation , 2016, ACM Trans. Graph..

[32]  Eftychios Sifakis,et al.  An adaptive generalized interpolation material point method for simulating elastoplastic materials , 2017, ACM Trans. Graph..