Whole-body model-predictive control applied to the HRP-2 humanoid

Controlling the robot with a permanently-updated optimal trajectory, also known as model predictive control, is the Holy Grail of whole-body motion generation. Before obtaining it, several challenges should be faced: computation cost, non-linear local minima, algorithm stability, etc. In this paper, we address the problem of applying the updated optimal control in real-time on the physical robot. In particular, we focus on the problems raised by the delays due to computation and by the differences between the real robot and the simulated model. Based on the optimal-control solver MuJoCo, we implemented a complete model-predictive controller and we applied it in real-time on the physical HRP-2 robot. It is the first time that such a whole-body model predictive controller is applied in real-time on a complex dynamic robot. Aside from the technical contributions cited above, the main contribution of this paper is to report the experimental results of this première implementation.

[1]  David Q. Mayne,et al.  Differential dynamic programming , 1972, The Mathematical Gazette.

[2]  S. Yakowitz,et al.  Differential dynamic programming and Newton's method for discrete optimal control problems , 1984 .

[3]  Ronan Boulic,et al.  Task-priority formulations for the kinematic control of highly redundant articulated structures , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[4]  Carlos Canudas de Wit,et al.  Friction Models and Friction Compensation , 1998, Eur. J. Control.

[5]  Miomir Vukobratovic,et al.  Zero-Moment Point - Thirty Five Years of its Life , 2004, Int. J. Humanoid Robotics.

[6]  Emanuel Todorov,et al.  Iterative Linear Quadratic Regulator Design for Nonlinear Biological Movement Systems , 2004, ICINCO.

[7]  MORITZ DIEHL,et al.  A Real-Time Iteration Scheme for Nonlinear Optimization in Optimal Feedback Control , 2005, SIAM J. Control. Optim..

[8]  Mazen Alamir,et al.  Stabilization of nonlinear systems using receding-horizon control schemes , 2013 .

[9]  Oussama Khatib,et al.  Control Strategies for Robots in Contact , 2006 .

[10]  Pierre-Brice Wieber,et al.  Viability and predictive control for safe locomotion , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Katja D. Mombaur,et al.  Using optimization to create self-stable human-like running , 2009, Robotica.

[12]  Victor M. Zavala,et al.  The advanced-step NMPC controller: Optimality, stability and robustness , 2009, Autom..

[13]  Paper-ID Control-Limited Differential Dynamic Programming , 2010 .

[14]  Emanuel Todorov,et al.  Implicit nonlinear complementarity: A new approach to contact dynamics , 2010, 2010 IEEE International Conference on Robotics and Automation.

[15]  Yuval Tassa,et al.  Synthesis and stabilization of complex behaviors through online trajectory optimization , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Yuval Tassa,et al.  MuJoCo: A physics engine for model-based control , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Zoran Popovic,et al.  Discovery of complex behaviors through contact-invariant optimization , 2012, ACM Trans. Graph..

[18]  Riccardo Muradore,et al.  Inertial parameter identification including friction and motor dynamics , 2014, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[19]  Mazen Alamir,et al.  Monitoring control updating period in fast gradient based NMPC , 2012, 2013 European Control Conference (ECC).

[20]  François Keith,et al.  Dynamic Whole-Body Motion Generation Under Rigid Contacts and Other Unilateral Constraints , 2013, IEEE Transactions on Robotics.

[21]  Mazen Alamir,et al.  Fast NMPC: A reality-steered paradigm: Key properties of fast NMPC algorithms , 2014, 2014 European Control Conference (ECC).

[22]  Nicolas Mansard,et al.  Optimality in robot motion , 2014, Commun. ACM.

[23]  Sofiane Achiche,et al.  From Inverse Kinematics to Optimal Control , 2014 .