A testbed that evolves hexapod controllers in hardware

Evolutionary algorithms have previously shown promise in generating controllers for legged robots. Multiple evaluations across many evolutionary generations are typically required — simulators are frequently used to accommodate this. However, performance degradation is frequently observed when transferring controllers from simulation to reality due to inconsistencies between the two. In this paper we demonstrate a testbed that permits repeated, direct evolution of hexapod controllers as a closed-loop system. The testbed uses a two-stage evolutionary process. In stage 1, a multi-objective evolutionary algorithm spreads a population of controllers across a space of desirable criteria. The second stage allows for specific criteria to be selected for on a per-mission basis, with promising initial controller parameters taken from the first stage. As the optimisation occurs directly on the robot, performance is guaranteed. Furthermore, controllers can be made specific to irregularities in e.g., motor wear, and robot mass distribution, creating controllers that are sensitive to the hardware state of the individual robot.

[1]  Gregory S. Hornby,et al.  Autonomous evolution of gaits with the Sony Quadruped Robot , 1999 .

[2]  Ruijun Dong,et al.  Differential Evolution Versus Particle Swarm Optimization for PID Controller Design , 2009, 2009 Fifth International Conference on Natural Computation.

[3]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[4]  Nicolas Bredeche,et al.  Embedded Evolutionary Robotics: The (1+1)-Restart-Online Adaptation Algorithm , 2011 .

[5]  Manuela M. Veloso,et al.  An evolutionary approach to gait learning for four-legged robots , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[6]  Stéphane Doncieux,et al.  Crossing the reality gap in evolutionary robotics by promoting transferable controllers , 2010, GECCO '10.

[7]  Daniel E. Koditschek,et al.  Automated gait adaptation for legged robots , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[8]  Tsu-Tian Lee,et al.  On the stability properties of hexapod tripod gait , 1988, IEEE J. Robotics Autom..

[9]  Jonathan Currie,et al.  Software Evolution Of A Hexapod Robot Walking Gait , 2008 .

[10]  David Howard,et al.  A platform for the direct hardware evolution of quadcopter controllers , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[12]  Marc H. Raibert,et al.  Legged robots , 1986, CACM.

[13]  Hod Lipson,et al.  Evolving robot gaits in hardware: the HyperNEAT generative encoding vs. parameter optimization , 2011, ECAL.

[14]  B. V. Babu,et al.  Non-dominated Sorting Differential Evolution (NSDE): An Extension of Differential Evolution for Multi-objective Optimization , 2005, IICAI.

[15]  Inman Harvey,et al.  Noise and the Reality Gap: The Use of Simulation in Evolutionary Robotics , 1995, ECAL.

[16]  Gordon Wyeth,et al.  Improved joint control using a genetic algorithm for a humanoid robot , 2003 .

[17]  Jonas Degrave,et al.  Transfer learning of gaits on a quadrupedal robot , 2015, Adapt. Behav..

[18]  Jie Yan,et al.  A Review of Gait Optimization Based on Evolutionary Computation , 2010, Appl. Comput. Intell. Soft Comput..

[19]  Hod Lipson,et al.  Resilient Machines Through Continuous Self-Modeling , 2006, Science.

[20]  Peter Stone,et al.  Policy gradient reinforcement learning for fast quadrupedal locomotion , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[21]  Navinda Kottege,et al.  Energetics-informed hexapod gait transitions across terrains , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Qijun Chen,et al.  Learning based gaits evolution for an AIBO dog , 2007, 2007 IEEE Congress on Evolutionary Computation.

[23]  Antoine Cully,et al.  Robots that can adapt like animals , 2014, Nature.

[24]  Xin Yao,et al.  Fast Evolution Strategies , 1997, Evolutionary Programming.