Running into a trap: Numerical design of task-optimal preflex behaviors for delayed disturbance responses

Legged robots enjoy kilohertz control rates but are still making incremental gains towards becoming as nimble as animals. In contrast, bipedal animals are amazingly robust runners despite lagged state feedback from protracted neuromechanical delays. Based on evidence from biological experiments, we posit that much of disturbance rejection can be offloaded from feedback control and encoded into feed-forward pre-reflexive behaviors called preflexes. We present a framework for the offline numerical generation of preflex behaviors to optimally stabilize legged locomotion tasks in the presence of response delays. By coupling directly collocated trajectory optimizations, we optimize the preflexive motion of a simple bipedal running model to recover from uncertain terrain geometry using minimal actuator work. In simulation, the optimized preflex maneuver showed 30-77% economy improvements over a level-ground strategy when responding to terrain deviating just 2-4cm from the nominal condition. We claim this “preflex-and-replan” framework for designing efficient and robust gaits is amenable to a variety of robots and extensible to arbitrary locomotion tasks.

[1]  Jonathan E. Clark,et al.  Running over unknown rough terrain with a one-legged planar robot , 2011, Bioinspiration & biomimetics.

[2]  John Guckenheimer,et al.  The Dynamics of Legged Locomotion: Models, Analyses, and Challenges , 2006, SIAM Rev..

[3]  Ming C. Lin,et al.  Example-guided physically based modal sound synthesis , 2013, ACM Trans. Graph..

[4]  Yuval Tassa,et al.  An integrated system for real-time model predictive control of humanoid robots , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[5]  Auke Jan Ijspeert,et al.  Learning robot gait stability using neural networks as sensory feedback function for Central Pattern Generators , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Manoj Srinivasan,et al.  Fifteen observations on the structure of energy-minimizing gaits in many simple biped models , 2011, Journal of The Royal Society Interface.

[7]  R Blickhan,et al.  Extension and Customization of Self-stability Control in Compliant Legged Systems , 2011 .

[8]  Michiel van de Panne,et al.  Flexible muscle-based locomotion for bipedal creatures , 2013, ACM Trans. Graph..

[9]  Hartmut Geyer,et al.  Muscle-reflex control of robust swing leg placement , 2013, 2013 IEEE International Conference on Robotics and Automation.

[10]  Ian R. Manchester,et al.  Stable dynamic walking over uneven terrain , 2011, Int. J. Robotics Res..

[11]  Justin Seipel,et al.  A simple model for clock-actuated legged locomotion , 2007 .

[12]  R. Full,et al.  Dynamic stabilization of rapid hexapedal locomotion. , 2002, The Journal of experimental biology.

[13]  T. Erez,et al.  Optimal Limit-Cycle Control recast as Bayesian Inference , 2011 .

[14]  Katie Byl,et al.  Metastable Walking Machines , 2009, Int. J. Robotics Res..

[15]  Joel E. Chestnutt,et al.  A Policy for Open-Loop Attenuation of Disturbance Effects Caused by Uncertain Ground Properties in Running , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[16]  Philip Holmes,et al.  Stability Analysis of a Clock-Driven Rigid-Body SLIP Model for RHex , 2004, Int. J. Robotics Res..

[17]  Russ Tedrake,et al.  L2-gain optimization for robust bipedal walking on unknown terrain , 2013, 2013 IEEE International Conference on Robotics and Automation.

[18]  Michael A. Saunders,et al.  SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization , 2002, SIAM J. Optim..

[19]  Andrew A Biewener,et al.  Running over rough terrain reveals limb control for intrinsic stability , 2006, Proceedings of the National Academy of Sciences.

[20]  R J Full,et al.  Templates and anchors: neuromechanical hypotheses of legged locomotion on land. , 1999, The Journal of experimental biology.

[21]  J W Hurst,et al.  Bio-inspired swing leg control for spring-mass robots running on ground with unexpected height disturbance , 2013, Bioinspiration & biomimetics.

[22]  Richard W. Longman,et al.  Open-loop stable running , 2005, Robotica.

[23]  Oskar von Stryk,et al.  Direct and indirect methods for trajectory optimization , 1992, Ann. Oper. Res..

[24]  J. Hutchinson,et al.  Scaling of sensorimotor control in terrestrial mammals , 2010, Proceedings of the Royal Society B: Biological Sciences.

[25]  Jesse A. Grimes ATRIAS 1.0 & 2.1 : enabling agile biped locomotion with a template-driven approach to robot design , 2013 .

[26]  Koushil Sreenath,et al.  Switching control design for accommodating large step-down disturbances in bipedal robot walking , 2012, 2012 IEEE International Conference on Robotics and Automation.

[27]  M. Daley,et al.  Birds achieve high robustness in uneven terrain through active control of landing conditions , 2012, Journal of Experimental Biology.

[28]  Auke Jan Ijspeert,et al.  Towards dynamic trot gait locomotion: Design, control, and experiments with Cheetah-cub, a compliant quadruped robot , 2013, Int. J. Robotics Res..