Evolved embodied phase coordination enables robust quadruped robot locomotion

Overcoming robotics challenges in the real world requires resilient control systems capable of handling a multitude of environments and unforeseen events. Evolutionary optimization using simulations is a promising way to automatically design such control systems, however, if the disparity between simulation and the real world becomes too large, the optimization process may result in dysfunctional real-world behaviors. In this paper, we address this challenge by considering embodied phase coordination in the evolutionary optimization of a quadruped robot controller based on central pattern generators. With this method, leg phases, and indirectly also inter-leg coordination, are influenced by sensor feedback. By comparing two very similar control systems we gain insight into how the sensory feedback approach affects the evolved parameters of the control system, and how the performances differ in simulation, in transferal to the real world, and to different real-world environments. We show that evolution enables the design of a control system with embodied phase coordination which is more complex than previously seen approaches, and that this system is capable of controlling a real-world multi-jointed quadruped robot. The approach reduces the performance discrepancy between simulation and the real world, and displays robustness towards new environments.

[1]  Auke Jan Ijspeert,et al.  Towards dynamic trot gait locomotion: Design, control, and experiments with Cheetah-cub, a compliant quadruped robot , 2013, Int. J. Robotics Res..

[2]  Antoine Cully,et al.  How do Different Encodings Influence the Performance of the MAP-Elites Algorithm? , 2016, GECCO.

[3]  Anders Lyhne Christensen,et al.  Open Issues in Evolutionary Robotics , 2016, Evolutionary Computation.

[4]  Auke Jan Ijspeert,et al.  Effects of passive and active joint compliance in quadrupedal locomotion , 2018, Adv. Robotics.

[5]  Auke Jan Ijspeert,et al.  Learning robot gait stability using neural networks as sensory feedback function for Central Pattern Generators , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Dario Floreano,et al.  Evolution of Adaptive Synapses: Robots with Fast Adaptive Behavior in New Environments , 2001, Evolutionary Computation.

[7]  Kyrre Glette,et al.  Combining MAP-Elites and Incremental Evolution to Generate Gaits for a Mammalian Quadruped Robot , 2018, EvoApplications.

[8]  Kyrre Glette,et al.  Real-world evolution adapts robot morphology and control to hardware limitations , 2018, GECCO.

[9]  Kyrre Glette,et al.  Filling the reality gap: Using obstacles to promote robust gaits in evolutionary robotics , 2014, 2014 IEEE International Conference on Evolvable Systems.

[10]  Rolf Pfeifer,et al.  How the body shapes the way we think - a new view on intelligence , 2006 .

[11]  Jean-Baptiste Mouret,et al.  20 years of reality gap: a few thoughts about simulators in evolutionary robotics , 2017, GECCO.

[12]  Sebastian Risi,et al.  Single-unit pattern generators for quadruped locomotion , 2013, GECCO '13.

[13]  D. Owaki,et al.  Simple robot suggests physical interlimb communication is essential for quadruped walking , 2013, Journal of The Royal Society Interface.

[14]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[15]  Jean-Baptiste Mouret,et al.  Evolvability signatures of generative encodings: Beyond standard performance benchmarks , 2014, Inf. Sci..

[16]  Inman Harvey,et al.  Noise and the Reality Gap: The Use of Simulation in Evolutionary Robotics , 1995, ECAL.

[17]  Auke Jan Ijspeert,et al.  Central Pattern Generators augmented with virtual model control for quadruped rough terrain locomotion , 2013, 2013 IEEE International Conference on Robotics and Automation.

[18]  Auke Jan Ijspeert,et al.  Central pattern generators for locomotion control in animals and robots: A review , 2008, Neural Networks.

[19]  Auke Jan Ijspeert,et al.  Active stabilization of a stiff quadruped robot using local feedback , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Kyrre Glette,et al.  Evolving Gaits for Physical Robots with the HyperNEAT Generative Encoding: The Benefits of Simulation , 2013, EvoApplications.

[21]  Kyrre Glette,et al.  Multi-objective evolution of fast and stable gaits on a physical quadruped robotic platform , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[22]  Randall D. Beer,et al.  Evolving Dynamical Neural Networks for Adaptive Behavior , 1992, Adapt. Behav..

[23]  A. E. Eiben,et al.  Evolutionary Robotics: What, Why, and Where to , 2015, Front. Robot. AI.

[24]  Akio Ishiguro,et al.  A Quadruped Robot Exhibiting Spontaneous Gait Transitions from Walking to Trotting to Galloping , 2017, Scientific Reports.

[25]  Antoine Cully,et al.  Evolving a Behavioral Repertoire for a Walking Robot , 2013, Evolutionary Computation.

[26]  Gregory J. Barlow,et al.  Article in Press Robotics and Autonomous Systems ( ) – Robotics and Autonomous Systems Fitness Functions in Evolutionary Robotics: a Survey and Analysis , 2022 .

[27]  Kyrre Glette,et al.  Self-Modifying Morphology Experiments with DyRET: Dynamic Robot for Embodied Testing , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[28]  Risto Miikkulainen,et al.  Modular neuroevolution for multilegged locomotion , 2008, GECCO '08.

[29]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[30]  Fumitoshi Matsuno,et al.  Simple analytical model reveals the functional role of embodied sensorimotor interaction in hexapod gaits , 2018, PloS one.

[31]  Stefano Nolfi,et al.  How to Evolve Autonomous Robots: Different Approaches in Evolutionary Robotics , 1994 .

[32]  Hitay Özbay,et al.  Introduction to Feedback Control Theory , 1999 .

[33]  Hod Lipson,et al.  Evolving Dynamic Gaits on a Physical Robot , 2004 .

[34]  Auke Jan Ijspeert,et al.  Modular control of limit cycle locomotion over unperceived rough terrain , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[35]  Fumitoshi Matsuno,et al.  Adaptive Control Strategies for Interlimb Coordination in Legged Robots: A Review , 2017, Front. Neurorobot..

[36]  Stéphane Doncieux,et al.  The Transferability Approach: Crossing the Reality Gap in Evolutionary Robotics , 2013, IEEE Transactions on Evolutionary Computation.