Reachability Map for Diverse Balancing Strategies and Energy Efficient Stepping of Humanoids

In legged locomotion, the relationship between different gait behaviors and energy consumption must consider the full-body dynamics and the robot control as a whole, which cannot be captured by simple models. This work studies the robot dynamics and whole-body optimal control as a coupled system to investigate energy consumption during balance recovery. We developed a 2-phase nonlinear optimization pipeline for dynamic stepping, which generates reachability maps showing complex energy-stepping relations. We optimize gait parameters to search all reachable locations and quantify the energy cost during dynamic transitions, which allows studying the relationship between energy consumption and stepping locations given different initial conditions. We found that to achieve efficient actuation, the stepping location and timing can have simple approximations close to the underlying optimality. Despite the complexity of this nonlinear process, we show that near-minimal effort stepping locations fall within a region of attractions, rather than a narrow solution space suggested by a simple model. This provides new insights into the non-uniqueness of near-optimal solutions in robot motion planning and control, and the diversity of stepping behavior in humans.

[1]  Wenbin Hu,et al.  Comparison Study of Nonlinear Optimization of Step Durations and Foot Placement for Dynamic Walking , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Michel Taïx,et al.  CROC: Convex Resolution of Centroidal Dynamics Trajectories to Provide a Feasibility Criterion for the Multi Contact Planning Problem , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Olivier Stasse,et al.  The Pinocchio C++ library : A fast and flexible implementation of rigid body dynamics algorithms and their analytical derivatives , 2019, 2019 IEEE/SICE International Symposium on System Integration (SII).

[4]  Olivier Stasse,et al.  Implementing Torque Control with High-Ratio Gear Boxes and Without Joint-Torque Sensors , 2016, Int. J. Humanoid Robotics.

[5]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  Masayuki Inaba,et al.  Footstep planning among obstacles for biped robots , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[7]  Dmitry Berenson,et al.  Robust Humanoid Contact Planning With Learned Zero- and One-Step Capturability Prediction , 2020, IEEE Robotics and Automation Letters.

[8]  Abderrahmane Kheddar,et al.  Humanoid Loco-Manipulation Planning Based on Graph Search and Reachability Maps , 2021, IEEE Robotics and Automation Letters.

[9]  Sethu Vijayakumar,et al.  Unified Push Recovery Fundamentals: Inspiration from Human Study , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Carlos Mastalli,et al.  Simultaneous Contact, Gait, and Motion Planning for Robust Multilegged Locomotion via Mixed-Integer Convex Optimization , 2017, IEEE Robotics and Automation Letters.

[11]  Katja D. Mombaur,et al.  Optimization-based analysis of push recovery during walking motions to support the design of rigid and compliant lower limb exoskeletons , 2017, Adv. Robotics.

[12]  Alexander Herzog,et al.  A convex model of humanoid momentum dynamics for multi-contact motion generation , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[13]  Robin Deits,et al.  Footstep planning on uneven terrain with mixed-integer convex optimization , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[14]  Olivier Stasse,et al.  Real-time replanning using 3D environment for humanoid robot , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[15]  Olivier Stasse,et al.  Fast Humanoid Robot Collision-Free Footstep Planning Using Swept Volume Approximations , 2012, IEEE Transactions on Robotics.

[16]  Nicolas Mansard,et al.  SL1M: Sparse L1-norm Minimization for contact planning on uneven terrain , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Zhibin Li,et al.  Bayesian Optimization for Whole-Body Control of High-Degree-of-Freedom Robots Through Reduction of Dimensionality , 2019, IEEE Robotics and Automation Letters.

[18]  Russ Tedrake,et al.  Whole-body motion planning with centroidal dynamics and full kinematics , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[19]  Maren Bennewitz,et al.  Stance selection for humanoid grasping tasks by inverse reachability maps , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Yiming Yang,et al.  Efficient Humanoid Motion Planning on Uneven Terrain Using Paired Forward-Inverse Dynamic Reachability Maps , 2017, IEEE Robotics and Automation Letters.

[21]  Oussama Khatib,et al.  Whole-Body Dynamic Behavior and Control of Human-like Robots , 2004, Int. J. Humanoid Robotics.

[22]  Kazuhito Yokoi,et al.  The 3D linear inverted pendulum mode: a simple modeling for a biped walking pattern generation , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[23]  Maja J. Mataric,et al.  Motion planning using dynamic roadmaps , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[24]  T. Asfour,et al.  Human Push-Recovery : Strategy Selection Based on Push Intensity Estimation , 2016 .

[25]  Nikolaos G. Tsagarakis,et al.  Dynamic and Reactive Walking for Humanoid Robots Based on Foot Placement Control , 2016, Int. J. Humanoid Robotics.

[26]  Scott Kuindersma,et al.  An Architecture for Online Affordance‐based Perception and Whole‐body Planning , 2015, J. Field Robotics.

[27]  Mihir Vedantam,et al.  Finding Locomanipulation Plans Quickly in the Locomotion Constrained Manifold , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Young-Dae Hong,et al.  Real-Time Feasible Footstep Planning for Bipedal Robots in Three-Dimensional Environments Using Particle Swarm Optimization , 2020, IEEE/ASME Transactions on Mechatronics.