Parameter Identification and Motion Control for Articulated Rigid Body Robots Using Differentiable Position-based Dynamics

Simulation modeling of robots, objects, and environments is the backbone for all model-based control and learning. It is leveraged broadly across dynamic programming and model-predictive control, as well as data generation for imitation, transfer, and reinforcement learning. In addition to fidelity, key features of models in these control and learning contexts are speed, stability, and native differentiability. However, many popular simulation platforms for robotics today lack at least one of the features above. More recently, positionbased dynamics (PBD) has become a very popular simulation tool for modeling complex scenes of rigid and non-rigid object interactions, due to its speed and stability, and is starting to gain significant interest in robotics for its potential use in model-based control and learning. Thus, in this paper, we present a mathematical formulation for coupling position-based dynamics (PBD) simulation and optimal robot design, modelbased motion control and system identification. Our framework breaks down PBD definitions and derivations for various types of joint-based articulated rigid bodies. We present a backpropagation method with automatic differentiation, which can integrate both positional and angular geometric constraints. Our framework can critically provide the native gradient information and perform gradient-based optimization tasks. We also propose articulated joint model representations and simulation workflow for our differentiable framework. We demonstrate the capability of the framework in efficient optimal robot design, accurate trajectory torque estimation and supporting spring stiffness estimation, where we achieve minor errors. We also implement impedance control in real robots to demonstrate the potential of our differentiable framework in human-in-the-loop applications.

[1]  J. Salisbury,et al.  Active stiffness control of a manipulator in cartesian coordinates , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[2]  Jan Peters,et al.  A Differentiable Newton-Euler Algorithm for Real-World Robotics , 2021, ArXiv.

[3]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[4]  Cordelia Schmid,et al.  Differentiable Simulation for Physical System Identification , 2021, IEEE Robotics and Automation Letters.

[5]  Joshua B. Tenenbaum,et al.  PlasticineLab: A Soft-Body Manipulation Benchmark with Differentiable Physics , 2021, ICLR.

[6]  Jonas Degrave,et al.  A DIFFERENTIABLE PHYSICS ENGINE FOR DEEP LEARNING IN ROBOTICS , 2016, Front. Neurorobot..

[7]  Wojciech Zaremba,et al.  OpenAI Gym , 2016, ArXiv.

[8]  Wojciech Matusik,et al.  An End-to-End Differentiable Framework for Contact-Aware Robot Design , 2021, Robotics: Science and Systems.

[9]  Yashraj S. Narang,et al.  DiSECt: A Differentiable Simulation Engine for Autonomous Robotic Cutting , 2021, Robotics: Science and Systems.

[10]  Moritz Bächer,et al.  Automated Routing of Muscle Fibers for Soft Robots , 2021, IEEE Transactions on Robotics.

[11]  Wojciech Matusik,et al.  DiffAqua , 2021, ACM Trans. Graph..

[12]  C. Karen Liu,et al.  Fast and Feature-Complete Differentiable Physics for Articulated Rigid Bodies with Contact , 2021, ArXiv.

[13]  Jingpei Lu,et al.  Robust Keypoint Detection and Pose Estimation of Robot Manipulators with Self-Occlusions via Sim-to-Real Transfer , 2020, ArXiv.

[14]  Sehoon Ha,et al.  Joint Optimization of Robot Design and Motion Parameters using the Implicit Function Theorem , 2017, Robotics: Science and Systems.

[15]  Alessandro Chiuso,et al.  System Identification: A Machine Learning Perspective , 2019, Annu. Rev. Control. Robotics Auton. Syst..

[16]  Stefan Jeschke,et al.  Detailed Rigid Body Simulation with Extended Position Based Dynamics , 2020, Comput. Graph. Forum.

[17]  Kevin M. Lynch,et al.  Modern Robotics: Mechanics, Planning, and Control , 2017 .

[18]  Yuval Tassa,et al.  MuJoCo: A physics engine for model-based control , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Sehoon Ha,et al.  PODS: Policy Optimization via Differentiable Simulation , 2021, ICML.

[20]  Jan Bender,et al.  Position-Based Simulation Methods in Computer Graphics , 2015, Eurographics.

[21]  Ming C. Lin,et al.  Efficient Differentiable Simulation of Articulated Bodies , 2021, ICML.

[22]  Roi Poranne,et al.  Trajectory Optimization for Cable-Driven Soft Robot Locomotion , 2019, Robotics: Science and Systems.

[23]  Jan Peters,et al.  Differentiable Physics Models for Real-world Offline Model-based Reinforcement Learning , 2020, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Siddhartha S. Srinivasa,et al.  DART: Dynamic Animation and Robotics Toolkit , 2018, J. Open Source Softw..

[25]  V. Koltun,et al.  Differentiable Simulation of Soft Multi-body Systems , 2022, NeurIPS.

[26]  Frédo Durand,et al.  DiffTaichi: Differentiable Programming for Physical Simulation , 2020, ICLR.

[27]  Tingxiang Fan,et al.  DiffSRL: Learning Dynamic-aware State Representation for Deformable Object Control with Differentiable Simulator , 2021, ArXiv.

[28]  Sanja Fidler,et al.  gradSim: Differentiable simulation for system identification and visuomotor control , 2021, ICLR.

[29]  Matthias Müller,et al.  Solid simulation with oriented particles , 2011, ACM Trans. Graph..

[30]  S. Sagar Imambi,et al.  PyTorch , 2021, Programming with TensorFlow.

[31]  Wojciech Matusik,et al.  Learning-In-The-Loop Optimization: End-To-End Control And Co-Design Of Soft Robots Through Learned Deep Latent Representations , 2019, NeurIPS.

[32]  Michael C. Yip,et al.  Real-to-Sim Registration of Deformable Soft Tissue with Position-Based Dynamics for Surgical Robot Autonomy , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[33]  Yuke Zhu,et al.  Emergent Hand Morphology and Control from Optimizing Robust Grasps of Diverse Objects , 2020, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[34]  Ruzena Bajcsy,et al.  Inferring the Material Properties of Granular Media for Robotic Tasks , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[35]  Kostas E. Bekris,et al.  A First Principles Approach for Data-Efficient System Identification of Spring-Rod Systems via Differentiable Physics Engines , 2020, L4DC.

[36]  Markus H. Gross,et al.  Meshless deformations based on shape matching , 2005, ACM Trans. Graph..

[37]  Eric Heiden,et al.  Automatic Differentiation and Continuous Sensitivity Analysis of Rigid Body Dynamics , 2020, ICRA 2020.

[38]  Dieter Fox,et al.  BayesSim: adaptive domain randomization via probabilistic inference for robotics simulators , 2019, Robotics: Science and Systems.

[39]  Gaurav S. Sukhatme,et al.  NeuralSim: Augmenting Differentiable Simulators with Neural Networks , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[40]  Michael C. Yip,et al.  Model-Predictive Control of Blood Suction for Surgical Hemostasis using Differentiable Fluid Simulations , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[41]  Jiajun Wu,et al.  Galileo: Perceiving Physical Object Properties by Integrating a Physics Engine with Deep Learning , 2015, NIPS.

[42]  Bernhard Thomaszewski,et al.  ADD , 2020, ACM Trans. Graph..

[43]  Wojciech Matusik,et al.  DiffPD: Differentiable Projective Dynamics , 2021 .

[44]  Joshua B. Tenenbaum,et al.  End-to-End Differentiable Physics for Learning and Control , 2018, NeurIPS.

[45]  Joan Solà,et al.  Quaternion kinematics for the error-state Kalman filter , 2015, ArXiv.

[46]  Jan Bender,et al.  Position‐based rigid‐body dynamics , 2016, Comput. Animat. Virtual Worlds.

[47]  Connor Schenck,et al.  SPNets: Differentiable Fluid Dynamics for Deep Neural Networks , 2018, CoRL.

[48]  Michael C. Yip,et al.  A 2D Surgical Simulation Framework for Tool-Tissue Interaction , 2020, ArXiv.