Differentiable Simulation for Physical System Identification

Simulating frictional contacts remains a challenging research topic in robotics. Recently, differentiable physics emerged and has proven to be a key element in model-based Reinforcement Learning (RL) and optimal control fields. However, most of the current formulations deploy coarse approximations of the underlying physical principles. Indeed, the classic simulators loose precision by casting the Nonlinear Complementarity Problem (NCP) of frictional contact into a Linear Complementarity Problem (LCP) to simplify computations. Moreover, such methods deploy non-smooth operations and cannot be automatically differentiated. In this letter, we propose (i) an extension of the staggered projections algorithm for more accurate solutions of the problem of contacts with friction. Based on this formulation, we introduce (ii) a differentiable simulator and an efficient way to compute the analytical derivatives of the involved optimization problems. Finally, (iii) we validate the proposed framework with a set of experiments to present a possible application of our differentiable simulator. In particular, using our approach we demonstrate accurate estimation of friction coefficients and object masses both in synthetic and real experiments.

[1]  Joshua B. Tenenbaum,et al.  End-to-End Differentiable Physics for Learning and Control , 2018, NeurIPS.

[2]  Wojciech Zaremba,et al.  Domain randomization for transferring deep neural networks from simulation to the real world , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Peter C. Horak,et al.  On the Similarities and Differences Among Contact Models in Robot Simulation , 2019, IEEE Robotics and Automation Letters.

[4]  Olivier Stasse,et al.  Whole-body model-predictive control applied to the HRP-2 humanoid , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  M. Anitescu,et al.  Formulating Dynamic Multi-Rigid-Body Contact Problems with Friction as Solvable Linear Complementarity Problems , 1997 .

[6]  Nicolas Mansard,et al.  Multicontact Locomotion of Legged Robots , 2018, IEEE Transactions on Robotics.

[7]  D. Tabor,et al.  The friction of wood , 1958, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[8]  Stephen P. Boyd,et al.  Differentiating through a cone program , 2019, Journal of Applied and Numerical Optimization.

[9]  Justin Domke,et al.  Generic Methods for Optimization-Based Modeling , 2012, AISTATS.

[10]  Nicolas Mansard,et al.  Crocoddyl: An Efficient and Versatile Framework for Multi-Contact Optimal Control , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Mihai Anitescu,et al.  An iterative approach for cone complementarity problems for nonsmooth dynamics , 2010, Comput. Optim. Appl..

[12]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..

[13]  Jiajun Wu,et al.  Galileo: Perceiving Physical Object Properties by Integrating a Physics Engine with Deep Learning , 2015, NIPS.

[14]  Russ Tedrake,et al.  A direct method for trajectory optimization of rigid bodies through contact , 2014, Int. J. Robotics Res..

[15]  Naveen Kuppuswamy,et al.  A Transition-Aware Method for the Simulation of Compliant Contact With Regularized Friction , 2020, IEEE Robotics and Automation Letters.

[16]  Abhinav Gupta,et al.  Bounce and Learn: Modeling Scene Dynamics with Real-World Bounces , 2019, ICLR.

[17]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[18]  Carol O'Sullivan,et al.  Complementarity based multiple point collision resolution , 2003 .

[19]  Olivier Stasse,et al.  The Pinocchio C++ library : A fast and flexible implementation of rigid body dynamics algorithms and their analytical derivatives , 2019, 2019 IEEE/SICE International Symposium on System Integration (SII).

[20]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[21]  Abdeslam Boularias,et al.  Learning to Slide Unknown Objects with Differentiable Physics Simulations , 2020, Robotics: Science and Systems.

[22]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[23]  Yuval Tassa,et al.  MuJoCo: A physics engine for model-based control , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Nicolas Mansard,et al.  Analytical Derivatives of Rigid Body Dynamics Algorithms , 2018, Robotics: Science and Systems.

[25]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[26]  J. Zico Kolter,et al.  OptNet: Differentiable Optimization as a Layer in Neural Networks , 2017, ICML.

[27]  Atil Iscen,et al.  Sim-to-Real: Learning Agile Locomotion For Quadruped Robots , 2018, Robotics: Science and Systems.

[28]  Michael I. Jordan,et al.  A General Analysis of the Convergence of ADMM , 2015, ICML.

[29]  Doug L. James,et al.  Staggered projections for frictional contact in multibody systems , 2008, SIGGRAPH Asia '08.

[30]  Marco Hutter,et al.  Trajectory Optimization With Implicit Hard Contacts , 2018, IEEE Robotics and Automation Letters.

[31]  Richard W. Cottle,et al.  Linear Complementarity Problem , 2009, Encyclopedia of Optimization.

[32]  Roy Featherstone,et al.  Rigid Body Dynamics Algorithms , 2007 .