Multi-Fidelity Receding Horizon Planning for Multi-Contact Locomotion

When traversing uneven terrain, humans consider their future steps for choosing the best location and timing of their current step. Likewise, when planning multi-contact motions for legged robots (e.g. humanoids), a ‘prediction horizon’ has to be considered. However, planning several steps ahead increases the dimensionality and non-linearity of an already challenging problem, which makes online planning intractable. We propose to reduce the problem complexity by using convex relaxations in the prediction horizon. We realize this idea within a Receding Horizon Planning (RHP) framework to plan dynamically consistent centroidal trajectories of humanoid walking on uneven terrain. This results in a novel formulation that combines an accurate non-convex model with a relaxed convex model, which we call RHP with multiple levels of model fidelity. We evaluate three candidate multi-fidelity RHPs with convex relaxations of the centroidal dynamics in the prediction horizon. The best candidate is 1.4x-3.0x (average 2.4x) faster than the traditional RHP that employs a single dynamics model over the entire look-ahead horizon. We also validate the resultant centroidal trajectories by tracking them with a whole-body inverse dynamics controller in simulation. Lastly, we find that incorporating angular dynamics in the prediction horizon is important to the success of multi-fidelity RHP.

[1]  Katja Mombaur,et al.  Modeling and optimal control of human platform diving with somersaults and twists , 2011, Optimization and Engineering.

[2]  Alexander Herzog,et al.  A Convex Model of Momentum Dynamics for Multi-Contact Motion Generation , 2016, ArXiv.

[3]  Abderrahmane Kheddar,et al.  Multi-contact walking pattern generation based on model preview control of 3D COM accelerations , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[4]  Olivier Stasse,et al.  Whole Body Model Predictive Control with a Memory of Motion: Experiments on a Torque-Controlled Talos , 2020, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Olivier Stasse,et al.  C-CROC: Continuous and Convex Resolution of Centroidal Dynamic Trajectories for Legged Robots in Multicontact Scenarios , 2020, IEEE Transactions on Robotics.

[6]  Vladimir Ivan,et al.  Optimizing Dynamic Trajectories for Robustness to Disturbances Using Polytopic Projections , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[7]  Kazuhito Yokoi,et al.  Biped walking pattern generation by using preview control of zero-moment point , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[8]  Quang-Cuong Pham,et al.  When to make a step? Tackling the timing problem in multi-contact locomotion by TOPP-MPC , 2016, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[9]  Kai Henning Koch,et al.  Optimization-Based Walking Generation for Humanoid Robot , 2012, SyRoCo.

[10]  Moritz Diehl,et al.  CasADi: a software framework for nonlinear optimization and optimal control , 2018, Mathematical Programming Computation.

[11]  Russ Tedrake,et al.  Direct Trajectory Optimization of Rigid Body Dynamical Systems through Contact , 2012, WAFR.

[12]  Sangbae Kim,et al.  Online Planning for Autonomous Running Jumps Over Obstacles in High-Speed Quadrupeds , 2015, Robotics: Science and Systems.

[13]  Alexander Herzog,et al.  Structured contact force optimization for kino-dynamic motion generation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Olivier Stasse,et al.  TALOS: A new humanoid research platform targeted for industrial applications , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[15]  He Li,et al.  Model Hierarchy Predictive Control of Robotic Systems , 2020, IEEE Robotics and Automation Letters.

[16]  Nicolas Mansard,et al.  Crocoddyl: An Efficient and Versatile Framework for Multi-Contact Optimal Control , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[17]  John Hauser,et al.  On the stability of receding horizon control with a general terminal cost , 2005, IEEE Transactions on Automatic Control.

[18]  John T. Betts,et al.  Practical Methods for Optimal Control and Estimation Using Nonlinear Programming , 2009 .

[19]  Sethu Vijayakumar,et al.  Automatic Gait Pattern Selection for Legged Robots , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Zoran Popovic,et al.  Discovery of complex behaviors through contact-invariant optimization , 2012, ACM Trans. Graph..

[21]  Vladimir Ivan,et al.  Modeling and Control of a Hybrid Wheeled Jumping Robot , 2020, ArXiv.

[22]  Vladimir Ivan,et al.  Inverse Dynamics vs. Forward Dynamics in Direct Transcription Formulations for Trajectory Optimization , 2020, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Sangbae Kim,et al.  Dynamic Locomotion in the MIT Cheetah 3 Through Convex Model-Predictive Control , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[24]  Nicolas Mansard,et al.  SL1M: Sparse L1-norm Minimization for contact planning on uneven terrain , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Chonhyon Park,et al.  An Efficient Acyclic Contact Planner for Multiped Robots , 2018, IEEE Transactions on Robotics.

[26]  Russ Tedrake,et al.  Planning robust walking motion on uneven terrain via convex optimization , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[27]  David E. Orin,et al.  Generation of dynamic humanoid behaviors through task-space control with conic optimization , 2013, 2013 IEEE International Conference on Robotics and Automation.

[28]  Sethu Vijayakumar,et al.  Online Hybrid Motion Planning for Dyadic Collaborative Manipulation via Bilevel Optimization , 2020, IEEE Transactions on Robotics.

[29]  Jorge Nocedal,et al.  Knitro: An Integrated Package for Nonlinear Optimization , 2006 .

[30]  Marco Hutter,et al.  Gait and Trajectory Optimization for Legged Systems Through Phase-Based End-Effector Parameterization , 2018, IEEE Robotics and Automation Letters.

[31]  Marco Hutter,et al.  Whole-Body Nonlinear Model Predictive Control Through Contacts for Quadrupeds , 2017, IEEE Robotics and Automation Letters.

[32]  Robin Deits,et al.  Footstep planning on uneven terrain with mixed-integer convex optimization , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[33]  Russ Tedrake,et al.  Whole-body motion planning with centroidal dynamics and full kinematics , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[34]  Yiming Yang,et al.  Whole-Body End-Pose Planning for Legged Robots on Inclined Support Surfaces in Complex Environments , 2018, 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids).

[35]  Pierre-Brice Wieber,et al.  Viability and predictive control for safe locomotion , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[36]  Alexander Herzog,et al.  On Time Optimization of Centroidal Momentum Dynamics , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[37]  Alexander Herzog,et al.  Trajectory generation for multi-contact momentum control , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[38]  Sethu Vijayakumar,et al.  Dyadic collaborative Manipulation through Hybrid Trajectory Optimization , 2018, CoRL.

[39]  Nicolas Mansard,et al.  Multicontact Locomotion of Legged Robots , 2018, IEEE Transactions on Robotics.

[40]  Marc Toussaint,et al.  Differentiable Physics and Stable Modes for Tool-Use and Manipulation Planning , 2018, Robotics: Science and Systems.

[41]  Yuval Tassa,et al.  Synthesis and stabilization of complex behaviors through online trajectory optimization , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[42]  Sethu Vijayakumar,et al.  Versatile Locomotion by Integrating Ankle, Hip, Stepping, and Height Variation Strategies , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[43]  Nicolas Mansard,et al.  Robustness to Joint-Torque-Tracking Errors in Task-Space Inverse Dynamics , 2016, IEEE Transactions on Robotics.

[44]  Olivier Stasse,et al.  A versatile and efficient pattern generator for generalized legged locomotion , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[45]  Carlos Mastalli,et al.  Simultaneous Contact, Gait, and Motion Planning for Robust Multilegged Locomotion via Mixed-Integer Convex Optimization , 2017, IEEE Robotics and Automation Letters.

[46]  Emanuel Todorov,et al.  Trajectory optimization for domains with contacts using inverse dynamics , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[47]  David E. Orin,et al.  Centroidal dynamics of a humanoid robot , 2013, Auton. Robots.

[48]  Alin Albu-Schäffer,et al.  Three-Dimensional Bipedal Walking Control Based on Divergent Component of Motion , 2015, IEEE Transactions on Robotics.

[49]  Nicolas Mansard,et al.  2PAC: Two Point Attractors for Center of Mass Trajectories in Multi Contact Scenarios , 2018 .