Feedback MPC for Torque-Controlled Legged Robots

The computational power of mobile robots is currently insufficient to achieve torque level whole-body Model Predictive Control (MPC) at the update rates required for complex dynamic systems such as legged robots. This problem is commonly circumvented by using a fast tracking controller to compensate for model errors between updates. In this work, we show that the feedback policy from a Differential Dynamic Programming (DDP) based MPC algorithm is a viable alternative to bridge the gap between the low MPC update rate and the actuation command rate. We propose to augment the DDP approach with a relaxed barrier function to address inequality constraints arising from the friction cone. A frequency-dependent cost function is used to reduce the sensitivity to high-frequency model errors and actuator bandwidth limits. We demonstrate that our approach can find stable locomotion policies for the torque-controlled quadruped, ANYmal, both in simulation and on hardware.

[1]  MORITZ DIEHL,et al.  A Real-Time Iteration Scheme for Nonlinear Optimization in Optimal Feedback Control , 2005, SIAM J. Control. Optim..

[2]  Olivier Stasse,et al.  Whole-body model-predictive control applied to the HRP-2 humanoid , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Yuval Tassa,et al.  Control-limited differential dynamic programming , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Anthony Tzes,et al.  Model predictive quadrotor indoor position control , 2011, 2011 19th Mediterranean Conference on Control & Automation (MED).

[5]  Darwin G. Caldwell,et al.  Robot impedance control and passivity analysis with inner torque and velocity feedback loops , 2014, Control Theory and Technology.

[6]  John R. Hauser,et al.  Constrained optimal motion planning for autonomous vehicles using PRONTO , 2017 .

[7]  Edo Jelavic,et al.  Real-time motion planning of legged robots: A model predictive control approach , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[8]  Manfred Morari,et al.  Optimization‐based autonomous racing of 1:43 scale RC cars , 2015, ArXiv.

[9]  Alberto Bemporad,et al.  Robust model predictive control: A survey , 1998, Robustness in Identification and Control.

[10]  D. Mayne A Second-order Gradient Method for Determining Optimal Trajectories of Non-linear Discrete-time Systems , 1966 .

[11]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[12]  Ruben Grandia,et al.  Frequency-Aware Model Predictive Control , 2018, IEEE Robotics and Automation Letters.

[13]  Scott Kuindersma,et al.  Optimization and stabilization of trajectories for constrained dynamical systems , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Lisa Turner,et al.  Applications of Second Order Cone Programming , 2012 .

[15]  John R. Hauser,et al.  A Barrier Function Method for the Optimization of Trajectory Functionals with Constraints , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[16]  Peter Fankhauser,et al.  Perception-less terrain adaptation through whole body control and hierarchical optimization , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[17]  Richard M. Murray,et al.  Optimization-Based Control , 2010 .

[18]  Johannes Englsberger,et al.  Sensitivity of Legged Balance Control to Uncertainties and Sampling Period , 2019, IEEE Robotics and Automation Letters.

[19]  D. Mayne,et al.  Min-max feedback model predictive control for constrained linear systems , 1998, IEEE Trans. Autom. Control..

[20]  Christian Feller,et al.  Relaxed Logarithmic Barrier Function Based Model Predictive Control of Linear Systems , 2015, IEEE Transactions on Automatic Control.

[21]  Jonas Buchli,et al.  An efficient optimal planning and control framework for quadrupedal locomotion , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Stefan Schaal,et al.  Full dynamics LQR control of a humanoid robot: An experimental study on balancing and squatting , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[23]  Yuval Tassa,et al.  Synthesis and stabilization of complex behaviors through online trajectory optimization , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  J. H. Leet,et al.  Worst-case formulations of model predictive control for systems with bounded parameters , 1997, Autom..

[25]  Nicholas Rotella,et al.  Balancing and walking using full dynamics LQR control with contact constraints , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[26]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..