Evolving spiking neural networks for robot control

Abstract We describe a sequence of experiments in which a robot “brain” was evolved to mimic the behaviours captured under control of a heuristic rule program (imitation learning). The task was light-seeking while avoiding obstacles using binocular light sensors and a trio of IR proximity sensors. The “brain” was a spiking neural network simulator whose parameters were tuned by a genetic algorithm, where fitness was assessed by the closeness to target output spike trains. Spike trains were frequency encoded. The network topology was manually designed, and then modified in response to observed difficulties during evolution. We noted that good performance seems best approached by judicious mixing of excitation and inhibition. Besides robotic applications, the domain of “smart” prosthetics also appears promising.

[1]  Dario Floreano,et al.  Evolving Vision-Based Flying Robots , 2002, Biologically Motivated Computer Vision.

[2]  Hani Hagras,et al.  Evolving spiking neural network controllers for autonomous robots , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[3]  Dario Floreano,et al.  Neuroevolution: from architectures to learning , 2008, Evol. Intell..

[4]  J. David Schaffer,et al.  A series of failed and partially successful fitness functions for evolving spiking neural networks , 2009, GECCO '09.

[5]  V. Braitenberg Vehicles, Experiments in Synthetic Psychology , 1984 .

[6]  Heike Sichtig The SGE framework: Discovering spatio-temporal patterns in biological systems with spiking neural ne , 2009 .

[7]  Dario Floreano,et al.  Evolution of Spiking Neural Controllers for Autonomous Vision-Based Robots , 2001, EvoRobots.

[8]  Heike Sichtig,et al.  Taste-specific cell assemblies in a biologically informed model of the nucleus of the solitary tract. , 2010, Journal of neurophysiology.

[9]  Long Cheng,et al.  A behavior controller based on spiking neural networks for mobile robots , 2008, Neurocomputing.

[10]  Wolfgang Maass,et al.  Noisy Spiking Neurons with Temporal Coding have more Computational Power than Sigmoidal Neurons , 1996, NIPS.

[11]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[12]  Larry J. Eshelman,et al.  The CHC Adaptive Search Algorithm: How to Have Safe Search When Engaging in Nontraditional Genetic Recombination , 1990, FOGA.