Impedance Optimization for Uncertain Contact Interactions Through Risk Sensitive Optimal Control

This paper addresses the problem of computing optimal impedance schedules for legged locomotion tasks involving complex contact interactions. We formulate the problem of impedance regulation as a trade-off between disturbance rejection and measurement uncertainty. We extend a stochastic optimal control algorithm known as Risk Sensitive Control to take into account measurement uncertainty and propose a formal way to include such uncertainty for unknown contact locations. The approach can efficiently generate optimal state and control trajectories along with local feedback control gains, i.e. impedance schedules. Extensive simulations demonstrate the capabilities of the approach in generating meaningful stiffness and damping modulation patterns before and after contact interaction. For example, contact forces are reduced during early contacts, damping increases to anticipate a high impact event and tracking is automatically traded-off for increased stability. In particular, we show a significant improvement in performance during jumping and trotting tasks with a simulated quadruped robot.

[1]  Frédéric Crevecoeur,et al.  Beyond Muscles Stiffness: Importance of State-Estimation to Account for Very Fast Motor Corrections , 2014, PLoS Comput. Biol..

[2]  Neville Hogan,et al.  Stable execution of contact tasks using impedance control , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[3]  D. Mayne.  A Second-order Gradient Method for Determining Optimal Trajectories of Non-linear Discrete-time Systems , 1966 .

[4]  Jong Hyeon Park,et al.  Impedance control of quadruped robot and its impedance characteristic modulation for trotting on irregular terrain , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Stefan Schaal,et al.  Optimal distribution of contact forces with inverse-dynamics control , 2013, Int. J. Robotics Res..

[6]  Jong Hyeon Park,et al.  Impedance control for biped robot locomotion , 2001, IEEE Trans. Robotics Autom..

[7]  On the Effects of Measurement Uncertainty in Optimal Control of Contact Interactions , 2016, WAFR.

[8]  Darwin G. Caldwell,et al.  Model-Based Hydraulic Impedance Control for Dynamic Robots , 2015 .

[9]  Emanuel Todorov,et al.  Evidence for the Flexible Sensorimotor Strategies Predicted by Optimal Feedback Control , 2007, The Journal of Neuroscience.

[10]  Maryam Fazel,et al.  On the Convergence of the Iterative Linear Exponential Quadratic Gaussian Algorithm to Stationary Points , 2019, 2020 American Control Conference (ACC).

[11]  Sandra Hirche,et al.  Considering Uncertainty in Optimal Robot Control Through High-Order Cost Statistics , 2018, IEEE Transactions on Robotics.

[12]  Yuval Tassa,et al.  Control-limited differential dynamic programming , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Ruben Grandia,et al.  Frequency-Aware Model Predictive Control , 2018, IEEE Robotics and Automation Letters.

[14]  Daniel A. Braun,et al.  Risk-sensitivity and the mean-variance trade-off: decision making in sensorimotor control , 2011, Proceedings of the Royal Society B: Biological Sciences.

[15]  Rhodes,et al.  Optimal stochastic linear systems with exponential performance criteria and their relation to deterministic differential games , 1973 .

[16]  Alexander Herzog,et al.  On Time Optimization of Centroidal Momentum Dynamics , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[17]  James E. Bobrow,et al.  An efficient sequential linear quadratic algorithm for solving nonlinear optimal control problems , 2005, Proceedings of the 2005, American Control Conference, 2005..

[18]  Ludovic Righetti,et al.  An Open Torque-Controlled Modular Robot Architecture for Legged Locomotion Research , 2019, IEEE Robotics and Automation Letters.

[19]  Hermano Igo Krebs,et al.  Summary of Human Ankle Mechanical Impedance During Walking , 2016, IEEE Journal of Translational Engineering in Health and Medicine.

[20]  David E. Stewart,et al.  Rigid-Body Dynamics with Friction and Impact , 2000, SIAM Rev..

[21]  Joan Solà,et al.  Quaternion kinematics for the error-state Kalman filter , 2015, ArXiv.

[22]  Dong Jin Hyun,et al.  On the dynamics of a quadruped robot model with impedance control: Self-stabilizing high speed trot-running and period-doubling bifurcations , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Yuval Tassa,et al.  Synthesis and stabilization of complex behaviors through online trajectory optimization , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  D. Jacobson,et al.  Optimization of stochastic linear systems with additive measurement and process noise using exponential performance criteria , 1974 .

[25]  Dinesh Atchuthan,et al.  A micro Lie theory for state estimation in robotics , 2018, ArXiv.

[26]  Inna Sharf,et al.  Literature survey of contact dynamics modelling , 2002 .

[27]  Jonas Buchli,et al.  Risk Sensitive, Nonlinear Optimal Control: Iterative Linear Exponential-Quadratic Optimal Control with Gaussian Noise , 2015, ArXiv.

[28]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[29]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation: Part II—Implementation , 1985 .

[30]  Ruben Grandia,et al.  Feedback MPC for Torque-Controlled Legged Robots , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[31]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation: Part I—Theory , 1985 .

[32]  Ludovic Righetti,et al.  Fast and Accurate Multi-Body Simulation with Stiff Viscoelastic Contacts , 2021, ArXiv.

[33]  Nicolas Mansard,et al.  Crocoddyl: An Efficient and Versatile Framework for Multi-Contact Optimal Control , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[34]  Emanuel Todorov,et al.  A Unifying Framework for Linearly Solvable Control , 2011, UAI.

[35]  E. Todorov,et al.  A generalized iterative LQG method for locally-optimal feedback control of constrained nonlinear stochastic systems , 2005, Proceedings of the 2005, American Control Conference, 2005..

[36]  Daniel A. Braun,et al.  Risk-Sensitivity in Sensorimotor Control , 2011, Front. Hum. Neurosci..

[37]  Emanuel Todorov,et al.  Iterative Linear Quadratic Regulator Design for Nonlinear Biological Movement Systems , 2004, ICINCO.

[38]  Olivier Stasse,et al.  The Pinocchio C++ library : A fast and flexible implementation of rigid body dynamics algorithms and their analytical derivatives , 2019, 2019 IEEE/SICE International Symposium on System Integration (SII).

[39]  Emanuel Todorov,et al.  Iterative linearization methods for approximately optimal control and estimation of non-linear stochastic system , 2007, Int. J. Control.