Reactive Locomotion Decision-Making and Robust Motion Planning for Real-Time Perturbation Recovery

In this paper, we examine the problem of push recovery for bipedal robot locomotion and present a reactive decision-making and robust planning framework for locomotion resilient to external perturbations. Rejecting perturbations is an essential capability of bipedal robots and has been widely studied in the locomotion literature. However, adversarial disturbances and aggressive turning can lead to negative lateral step width (i.e., crossed-leg scenarios) with unstable motions and self-collision risks. These motion planning problems are computationally difficult and have not been explored under a hierarchically integrated task and motion planning method. We explore a planning and decision-making framework that closely ties linear-temporal-logic-based reactive synthesis with trajectory optimization incorporating the robot’s full-body dynamics, kinematics, and leg collision avoidance constraints. Between the high-level discrete symbolic decision-making and the lowlevel continuous motion planning, behavior trees serve as a reactive interface to handle perturbations occurring at any time of the locomotion process. Our experimental results show the efficacy of our method in generating resilient recovery behaviors in response to diverse perturbations from any direction with bounded magnitudes.

[1]  Christel Baier,et al.  Principles of model checking , 2008 .

[2]  Jessy W. Grizzle,et al.  Feedback Control of a Cassie Bipedal Robot: Walking, Standing, and Riding a Segway , 2018, 2019 American Control Conference (ACC).

[3]  Jessy W. Grizzle,et al.  A Finite-State Machine for Accommodating Unexpected Large Ground-Height Variations in Bipedal Robot Walking , 2013, IEEE Transactions on Robotics.

[4]  Vasumathi Raman,et al.  Slugs: Extensible GR(1) Synthesis , 2016, CAV.

[5]  Petter Ögren,et al.  Towards a unified behavior trees framework for robot control , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Nikolay Atanasov,et al.  Temporal Logic Guided Locomotion Planning and Control in Cluttered Environments , 2020, 2020 American Control Conference (ACC).

[7]  Lydia E. Kavraki,et al.  Efficient Symbolic Reactive Synthesis for Finite-Horizon Tasks , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[8]  Nikolaos G. Tsagarakis,et al.  A generic optimization-based framework for reactive collision avoidance in bipedal locomotion , 2016, 2016 IEEE International Conference on Automation Science and Engineering (CASE).

[9]  Hadas Kress-Gazit,et al.  Temporal-Logic-Based Reactive Mission and Motion Planning , 2009, IEEE Transactions on Robotics.

[10]  Nicholas Roy,et al.  Reactive Task and Motion Planning under Temporal Logic Specifications , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Jan Maluszy¿ski Verification, Model Checking, and Abstract Interpretation , 2009, Lecture Notes in Computer Science.

[12]  Amir Pnueli,et al.  Synthesis of Reactive(1) designs , 2006, J. Comput. Syst. Sci..

[13]  Benjamin J. Stephens,et al.  Push Recovery Control for Force-Controlled Humanoid Robots , 2011 .

[14]  Kang An,et al.  Active balance of humanoid movement based on dynamic task-prior system , 2017 .

[15]  Ye Zhao,et al.  Towards Safe Locomotion Navigation in Partially Observable Environments with Uneven Terrain , 2020, 2020 59th IEEE Conference on Decision and Control (CDC).

[16]  Ufuk Topcu,et al.  Synthesis of Reactive Switching Protocols From Temporal Logic Specifications , 2013, IEEE Transactions on Automatic Control.

[17]  Aaron D. Ames,et al.  FROST∗: Fast robot optimization and simulation toolkit , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Ye Zhao,et al.  Robust optimal planning and control of non-periodic bipedal locomotion with a centroidal momentum model , 2017, Int. J. Robotics Res..

[19]  Byoung-Tak Zhang,et al.  Online learning of a full body push recovery controller for omnidirectional walking , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[20]  Daniele Pucci,et al.  Online DCM Trajectory Generation for Push Recovery of Torque-Controlled Humanoid Robots , 2019, 2019 IEEE-RAS 19th International Conference on Humanoid Robots (Humanoids).

[21]  Aude Billard,et al.  Real-Time Self-Collision Avoidance in Joint Space for Humanoid Robots , 2021, IEEE Robotics and Automation Letters.

[22]  Koushil Sreenath,et al.  Dynamic Walking on Stepping Stones with Gait Library and Control Barrier Functions , 2016, WAFR.

[23]  Anil V. Rao,et al.  ( Preprint ) AAS 09-334 A SURVEY OF NUMERICAL METHODS FOR OPTIMAL CONTROL , 2009 .

[24]  Pierre-Brice Wieber,et al.  Trajectory Free Linear Model Predictive Control for Stable Walking in the Presence of Strong Perturbations , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[25]  Robert Wittmann,et al.  Real-time 3D collision avoidance for biped robots , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Petter Ögren,et al.  Behavior Trees in Robotics and AI: An Introduction , 2017, ArXiv.

[27]  Sergey V. Drakunov,et al.  Capture Point: A Step toward Humanoid Push Recovery , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[28]  Ye Zhao,et al.  Reactive task and motion planning for robust whole-body dynamic locomotion in constrained environments , 2018, Int. J. Robotics Res..

[29]  Petter Ögren,et al.  A Survey of Behavior Trees in Robotics and AI , 2020, Robotics Auton. Syst..

[30]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[31]  Ufuk Topcu,et al.  Correct, Reactive, High-Level Robot Control , 2011, IEEE Robotics & Automation Magazine.

[32]  Alexander Dietrich,et al.  Extensions to reactive self-collision avoidance for torque and position controlled humanoids , 2011, 2011 IEEE International Conference on Robotics and Automation.