Optimization-free Ground Contact Force Constraint Satisfaction in Quadrupedal Locomotion

We are seeking control design paradigms for legged systems that allow bypassing costly algorithms that depend on heavy on-board computers widely used in these systems and yet being able to match what they can do by using less expensive optimization-free frameworks. In this work, we present our preliminary results in modeling and control design of a quadrupedal robot called Husky Carbon, which under development at Northeastern University (NU) in Boston. In our approach, we utilized a supervisory controller and an Explicit Reference Governor (ERG) to enforce ground reaction force constraints. These constraints are usually enforced using costly optimizations. However, in this work, the ERG manipulates the state references applied to the supervisory controller to enforce the ground contact constraints through an updated law based on Lyapunov stability arguments. As a result, the approach is much faster to compute than the widely used optimizationbased methods.

[1]  Peter Fankhauser,et al.  Perception-less terrain adaptation through whole body control and hierarchical optimization , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[2]  Koushil Sreenath,et al.  Torque Saturation in Bipedal Robotic Walking Through Control Lyapunov Function-Based Quadratic Programs , 2013, IEEE Access.

[3]  Alberto Bemporad,et al.  Reference governor for constrained nonlinear systems , 1998, IEEE Trans. Autom. Control..

[4]  S. Bhat,et al.  Continuous finite-time stabilization of the translational and rotational double integrators , 1998, IEEE Trans. Autom. Control..

[5]  James E. Bobrow,et al.  An efficient sequential linear quadratic algorithm for solving nonlinear optimal control problems , 2005, Proceedings of the 2005, American Control Conference, 2005..

[6]  Sergey Levine,et al.  Learning to Walk via Deep Reinforcement Learning , 2018, Robotics: Science and Systems.

[7]  Eric N. Sihite,et al.  Generative Design of NU’s Husky Carbon, A Morpho-Functional, Legged Robot , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[8]  E. Todorov,et al.  A generalized iterative LQG method for locally-optimal feedback control of constrained nonlinear stochastic systems , 2005, Proceedings of the 2005, American Control Conference, 2005..

[9]  E. Westervelt,et al.  Feedback Control of Dynamic Bipedal Robot Locomotion , 2007 .

[10]  I. Kanellakopoulos,et al.  Backstepping to passivity: recursive design of adaptive systems , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[11]  Panos M. Pardalos,et al.  Approximate dynamic programming: solving the curses of dimensionality , 2009, Optim. Methods Softw..

[12]  Ilya Kolmanovsky,et al.  Nonlinear control of discrete-time linear systems with state and control constraints: a reference governor with global convergence properties , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[13]  Panganamala Ramana Kumar,et al.  A Near-Optimal Separation Principle for Nonlinear Stochastic Systems Arising in Robotic Path Planning and Control , 2017, ArXiv.

[14]  Timothy Bretl,et al.  Testing Static Equilibrium for Legged Robots , 2008, IEEE Transactions on Robotics.

[15]  Pravin Dangol,et al.  Rough-Terrain Locomotion and Unilateral Contact Force Regulations With a Multi-Modal Legged Robot , 2021, 2021 American Control Conference (ACC).

[16]  Marco Hutter,et al.  Gait and Trajectory Optimization for Legged Systems Through Phase-Based End-Effector Parameterization , 2018, IEEE Robotics and Automation Letters.

[17]  Friedrich Pfeiffer,et al.  A collocation method for real-time walking pattern generation , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[18]  Yuval Tassa,et al.  Emergence of Locomotion Behaviours in Rich Environments , 2017, ArXiv.

[19]  Carlos Mastalli,et al.  Passive Whole-Body Control for Quadruped Robots: Experimental Validation Over Challenging Terrain , 2018, IEEE Robotics and Automation Letters.

[20]  Aaron D. Ames,et al.  3D dynamic walking with underactuated humanoid robots: A direct collocation framework for optimizing hybrid zero dynamics , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Oussama Khatib,et al.  A whole-body control framework for humanoids operating in human environments , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[22]  Glen Berseth,et al.  Feedback Control For Cassie With Deep Reinforcement Learning , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Kate Saenko,et al.  Learning Deep Object Detectors from 3D Models , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[24]  James Bergstra,et al.  Benchmarking Reinforcement Learning Algorithms on Real-World Robots , 2018, CoRL.

[25]  Gerardo Bledt,et al.  Regularized predictive control framework for robust dynamic legged locomotion , 2020 .

[26]  Koushil Sreenath,et al.  Rapidly Exponentially Stabilizing Control Lyapunov Functions and Hybrid Zero Dynamics , 2014, IEEE Transactions on Automatic Control.

[27]  Darwin G. Caldwell,et al.  On-line and on-board planning and perception for quadrupedal locomotion , 2015, 2015 IEEE International Conference on Technologies for Practical Robot Applications (TePRA).

[28]  Jonas Buchli,et al.  Evaluating Direct Transcription and Nonlinear Optimization Methods for Robot Motion Planning , 2015, IEEE Robotics and Automation Letters.

[29]  Darwin G. Caldwell,et al.  Trajectory and foothold optimization using low-dimensional models for rough terrain locomotion , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[30]  Carlos Mastalli,et al.  Simultaneous Contact, Gait, and Motion Planning for Robust Multilegged Locomotion via Mixed-Integer Convex Optimization , 2017, IEEE Robotics and Automation Letters.

[31]  Taylor Apgar,et al.  Fast Online Trajectory Optimization for the Bipedal Robot Cassie , 2018, Robotics: Science and Systems.

[32]  Russ Tedrake,et al.  Planning robust walking motion on uneven terrain via convex optimization , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[33]  Peter Fankhauser,et al.  ANYmal - a highly mobile and dynamic quadrupedal robot , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[34]  Glen Berseth,et al.  Progressive Reinforcement Learning with Distillation for Multi-Skilled Motion Control , 2018, ICLR.

[35]  Emanuele Garone,et al.  Explicit Reference Governor for Constrained Nonlinear Systems , 2016, IEEE Transactions on Automatic Control.

[36]  Ilya V. Kolmanovsky,et al.  Nonlinear tracking control in the presence of state and control constraints: a generalized reference governor , 2002, Autom..

[37]  Koushil Sreenath,et al.  Optimal Robust Control for Bipedal Robots through Control Lyapunov Function based Quadratic Programs , 2015, Robotics: Science and Systems.

[38]  Sergey Levine,et al.  Composable Deep Reinforcement Learning for Robotic Manipulation , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[39]  Pravin Dangol,et al.  Towards thruster-assisted bipedal locomotion for enhanced efficiency and robustness , 2020, IFAC-PapersOnLine.

[40]  Twan Koolen,et al.  Design of a Momentum-Based Control Framework and Application to the Humanoid Robot Atlas , 2016, Int. J. Humanoid Robotics.

[41]  Sergey Levine,et al.  Reinforcement Learning with Deep Energy-Based Policies , 2017, ICML.

[42]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[43]  Eduardo Sontag.  A Lyapunov-Like Characterization of Asymptotic Controllability , 1983, SIAM Journal on Control and Optimization.

[44]  Nader Jalili,et al.  Performance satisfaction in Midget, a thruster-assisted bipedal robot , 2020, 2020 American Control Conference (ACC).