Time delays in a HyperNEAT network to improve gait learning for legged robots

Gait generation for legged robots is an important task to allow an appropriate displacement in different scenarios. The classical manner to generate gaits involves handtuning design generating high computational and time efforts. Neuroevolution algorithms with the ability to learn network topologies, such as, Neuroevolution of Augmenting Topologies (NEAT) and Hypercube-based NEAT (HyperNEAT), have been used in the computational community to learn gaits in legged robots. Recently, a new version of NEAT, called τ-NEAT, has been reported including a time delay in the connectivity between neurons, values that are also learned by the underlying genetic algorithm. Extending this idea, we included time delays in the HyperNEAT implementation (τ-HyperNEAT) making the algorithm capture time-series variations that could be important for gait generation. Using a four-legged robot platform (Quadratot) and a fitness function with two objectives, we compared the performance of HyperNEAT versus τ-HyperNEAT for the learning gait task. The comparative analysis of the results reveals that quantitative performance variables showed no differences between HyperNEAT and τ-HyperNEAT. The difference between the two approaches appears in the nonquantitative observation of the generated gaits: τ-HyperNEAT outperforms HyperNEAT generating more coordinated, realistic and natural gaits.

[1]  Richard J. Duro,et al.  τ-NEAT , 2015 .

[2]  Hod Lipson,et al.  Evolving robot gaits in hardware: the HyperNEAT generative encoding vs. parameter optimization , 2011, ECAL.

[3]  Kazuhito Yokoi,et al.  Planning walking patterns for a biped robot , 2001, IEEE Trans. Robotics Autom..

[4]  Risto Miikkulainen,et al.  Automatic feature selection in neuroevolution , 2005, GECCO '05.

[5]  Joshua Evan Auerbach,et al.  Evolving complete robots with CPPN-NEAT: the utility of recurrent connections , 2011, GECCO '11.

[6]  Giuseppe Carbone,et al.  A Hybrid Multi-objective Evolutionary Approach for Optimal Path Planning of a Hexapod Robot - A Preliminary Study , 2016, HM.

[7]  E. Ruppin Evolutionary autonomous agents: A neuroscience perspective , 2002, Nature Reviews Neuroscience.

[8]  Kenneth O. Stanley,et al.  A Hypercube-Based Encoding for Evolving Large-Scale Neural Networks , 2009, Artificial Life.

[9]  Kenneth O. Stanley,et al.  Autonomous Evolution of Topographic Regularities in Artificial Neural Networks , 2010, Neural Computation.

[10]  Risto Miikkulainen,et al.  Real-time neuroevolution in the NERO video game , 2005, IEEE Transactions on Evolutionary Computation.

[11]  David B. Knoester,et al.  Neuroevolution of Controllers for Self-Organizing Mobile Ad Hoc Networks , 2011, 2011 IEEE Fifth International Conference on Self-Adaptive and Self-Organizing Systems.

[12]  Shugen Ma,et al.  Omnidirectional static walking of a quadruped robot , 2005, IEEE Transactions on Robotics.

[13]  Richard J. Duro,et al.  Augmenting the NEAT algorithm to improve its temporal processing capabilities , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[14]  Richard J. Duro,et al.  τ-NEAT: Initial experiments in precise temporal processing through neuroevolution , 2015, Neurocomputing.

[15]  Constantinos Mavroidis,et al.  Robotic Systems for Gait Rehabilitation , 2014 .

[16]  A. E. Eiben,et al.  HyperNEAT for Locomotion Control in Modular Robots , 2010, ICES.

[17]  Risto Miikkulainen,et al.  Evolving adaptive neural networks with and without adaptive synapses , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[18]  Gen Endo,et al.  Quadruped walking robots at Tokyo Institute of Technology , 2009, IEEE Robotics & Automation Magazine.

[19]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[20]  Kenneth O. Stanley and Bobby D. Bryant and Risto Miikkulainen,et al.  Real-Time Evolution in the NERO Video Game (Winner of CIG 2005 Best Paper Award) , 2005, CIG.

[21]  Charles Ofria,et al.  Evolving coordinated quadruped gaits with the HyperNEAT generative encoding , 2009, 2009 IEEE Congress on Evolutionary Computation.

[22]  Richard J. Duro,et al.  Introducing Synaptic Delays in the NEAT Algorithm to Improve Modelling in Cognitive Robotics , 2016, Neural Processing Letters.