Full-Body Optimal Control Toward Versatile and Agile Behaviors in a Humanoid Robot

In this letter, we develop an optimal control framework that takes the full-body dynamics of a humanoid robot into account. Employing full-body dynamics has been explored in, especially, an online optimal control approach known as model predictive control (MPC). However, whole-body motions cannot be updated in a short period of time due to MPC's large computational burden. Thus, MPC has generally been evaluated with a physical humanoid robot in a limited range of tasks where high-speed motion executions are unnecessary. To cope with this problem, our multi-timescale control framework drives whole-body motions with a computationally efficient hierarchical MPC. Meanwhile, a biologically inspired controller maintains the robot's posture for a very short control period. We evaluated our framework in skating tasks with simulated and real lower-body humanoids that have rollers on the feet. Our simulated robot generated various agile motions such as jumping over a bump and flipping down from a cliff in real time. Our real lower-body humanoid also successfully generated a movement down a slope.

[1]  Edo Jelavic,et al.  Real-time motion planning of legged robots: A model predictive control approach , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[2]  Roland Siegwart,et al.  Fast nonlinear Model Predictive Control for unified trajectory optimization and tracking , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Larry Jackel,et al.  The DARPA Robotics Challenge Finals: Results and Perspectives , 2017, J. Field Robotics.

[4]  Jun Morimoto,et al.  CB: A Humanoid Research Platform for Exploring NeuroScience , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[5]  Jonas Buchli,et al.  An efficient optimal planning and control framework for quadrupedal locomotion , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Hassan K. Khalil,et al.  Singular perturbation methods in control : analysis and design , 1986 .

[7]  Yuval Tassa,et al.  Synthesis and stabilization of complex behaviors through online trajectory optimization , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Allen Hurlburt.  The design concept , 1981 .

[9]  C. Atkeson,et al.  Optimization based controller design and implementation for the Atlas robot in the DARPA Robotics Challenge Finals , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[10]  William D. Smart,et al.  Optimal control for autonomous motor behavior , 2011 .

[11]  Xianzhong Chen,et al.  Composite fast-slow MPC design for nonlinear singularly perturbed systems: Stability analysis , 2012, ACC.

[12]  William H. Press,et al.  Numerical recipes in C , 2002 .

[13]  Florentin Wörgötter,et al.  Adaptive, Fast Walking in a Biped Robot under Neuronal Control and Learning , 2007, PLoS Comput. Biol..

[14]  Scott Kuindersma,et al.  Optimization-based locomotion planning, estimation, and control design for the atlas humanoid robot , 2015, Autonomous Robots.

[15]  M. Diehl,et al.  Nonlinear receding horizon control of an underactuated hovercraft with a multiple-shooting-based algorithm , 2006 .

[16]  Jun Morimoto,et al.  Minimax Differential Dynamic Programming: An Application to Robust Biped Walking , 2002, NIPS.

[17]  E. Todorov,et al.  A generalized iterative LQG method for locally-optimal feedback control of constrained nonlinear stochastic systems , 2005, Proceedings of the 2005, American Control Conference, 2005..

[18]  Kazuhito Yokoi,et al.  Biped walking pattern generation by using preview control of zero-moment point , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[19]  Olivier Stasse,et al.  Whole-body model-predictive control applied to the HRP-2 humanoid , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Yuval Tassa,et al.  An integrated system for real-time model predictive control of humanoid robots , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[21]  S. Arimoto,et al.  A Control Theoretic Study on Dynamical Biped Locomotion , 1980 .

[22]  Nicolas Mansard,et al.  Differential Dynamic Programming for Multi-Phase Rigid Contact Dynamics , 2018, 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids).

[23]  Yun-Jung Lee,et al.  Motion planning for biped robot with quad roller skates , 2008, 2008 International Conference on Control, Automation and Systems.

[24]  Christopher G. Atkeson,et al.  Push Recovery by stepping for humanoid robots with force controlled joints , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[25]  Riccardo Scattolini,et al.  Architectures for distributed and hierarchical Model Predictive Control - A review , 2009 .

[26]  Masayuki Inaba,et al.  Extended Three-Dimensional Walking and Skating Motion Generation for Multiple Noncoplanar Contacts With Anisotropic Friction: Application to Walk and Skateboard and Roller Skate , 2019, IEEE Robotics and Automation Letters.

[27]  Florentin Wörgötter,et al.  Two ways of walking: Contrasting a reflexive neuro-controller and a LIP-based ZMP-controller on the humanoid robot ARMAR-4 , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[28]  Russ Tedrake,et al.  Whole-body motion planning with centroidal dynamics and full kinematics , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[29]  D. Jacobson.  New second-order and first-order algorithms for determining optimal control: A differential dynamic programming approach , 1968 .

[30]  Jun Morimoto,et al.  Real-time Model Predictive Control with two-step optimization based on singularly perturbed system , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[31]  Barbara M. Chapman,et al.  OpenMP , 2005, Parallel Comput..