The transferability of evolved hexapod locomotion controllers from simulation to real hardware

The creation of control programs for legged robots has received much attention in the robotics community. Evolutionary Robotics (ER) offers one method of developing such controllers. The goal of this work was to use ER to evolve simple open-loop locomotion controllers for a real-world hexapod (six-legged) robot. This evolution was performed in a physics engine-based simulation, as is typically done in the ER process. Since our ultimate goal was to produce controllers which could perform adequately on the real-world robot, the current study explored different techniques which could potentially improve the transferability of the evolved controllers from simulation to the real-world robot. These techniques included optimization of parameters of the simulator by making use of real-world data, the addition of noise to the simulator predictions during controller evolution and explicitly taking into account the torque limits of the robot's motors in the simulator. The results obtained indicated that the transferability of these evolved controllers from simulation to the real-world robot was greatly aided by the simulator optimization, noise injection and incorporation of torque limits in the simulator.

[1]  Inman Harvey,et al.  Noise and the Reality Gap: The Use of Simulation in Evolutionary Robotics , 1995, ECAL.

[2]  Tim Laue,et al.  Automatic Parameter Optimization for a Dynamic Robot Simulation , 2009, RoboCup.

[3]  Kyrre Glette,et al.  A Comparison of Sampling Strategies for Parameter Estimation of a Robot Simulator , 2012, SIMPAR.

[4]  K. Glette,et al.  Evolution of locomotion in a simulated quadruped robot and transferral to reality , 2011 .

[5]  Hod Lipson,et al.  Evolving robot gaits in hardware: the HyperNEAT generative encoding vs. parameter optimization , 2011, ECAL.

[6]  Antoine Cully,et al.  Abstract of: "Fast Damage Recovery in Robotics with the T-Resilience Algorithm" , 2018, ALIFE.

[7]  Gary B. Parker,et al.  The co-evolution of model parameters and control programs in evolutionary robotics , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[8]  Stéphane Doncieux,et al.  The Transferability Approach: Crossing the Reality Gap in Evolutionary Robotics , 2013, IEEE Transactions on Evolutionary Computation.

[9]  Chia-Feng Juang,et al.  Evolving Gaits of a Hexapod Robot by Recurrent Neural Networks With Symbiotic Species-Based Particle Swarm Optimization , 2011, IEEE Transactions on Industrial Electronics.

[10]  Kyung-Joong Kim,et al.  Evolution of Neural Controllers for Simulated and Real Quadruped Robots , 2013, 2013 Second International Conference on Robot, Vision and Signal Processing.

[11]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[12]  Guido C. H. E. de Croon,et al.  Abstraction, Sensory-Motor Coordination, and the Reality Gap in Evolutionary Robotics , 2017, Artificial Life.

[13]  Yura N. Perov,et al.  Gait optimization for roombots modular robots — Matching simulation and reality , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Antoine Cully,et al.  Evolving a Behavioral Repertoire for a Walking Robot , 2013, Evolutionary Computation.

[15]  Piotr Skrzypczynski,et al.  A biologically inspired approach to feasible gait learning for a hexapod robot , 2010, Int. J. Appl. Math. Comput. Sci..

[16]  Nick Jacobi,et al.  Running Across the Reality Gap: Octopod Locomotion Evolved in a Minimal Simulation , 1998, EvoRobot.