A Simple Aplysia-Like Spiking Neural Network to Generate Adaptive Behavior in Autonomous Robots

In this article, we describe an adaptive controller for an autonomous mobile robot with a simple structure. Sensorimotor connections were made using a three-layered spiking neural network (SNN) with only one hidden-layer neuron and synapses with spike timing-dependent plasticity (STDP). In the SNN controller, synapses from the hidden-layer neuron to the motor neurons received presynaptic modulation signals from sensory neurons, a mechanism similar to that of the withdrawal reflex circuit of the sea slug, Aplysia. The synaptic weights were modified dependent on the firing rates of the presynaptic modulation signal and that of the hidden-layer neuron by STDP. In experiments using a real robot, which uses a similar simple SNN controller, the robot adapted quickly to the given environment in a single trial by organizing the weights, acquired navigation and obstacle-avoidance behavior. In addition, it followed dynamical changes in the environment. This associative learning scheme can be a new strategy for constructing adaptive agents with minimal structures, and may be utilized as an essential mechanism of an SNN ensemble that binds multiple sensory inputs and generates multiple motor outputs.

[1]  M. Quirk,et al.  Experience-Dependent Asymmetric Shape of Hippocampal Receptive Fields , 2000, Neuron.

[2]  Jeffrey L. Krichmar,et al.  Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines , 2001, Complex..

[3]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[4]  Inman Harvey,et al.  An Evolutionary Ecological Approach to the Study of Learning Behavior Using a Robot-Based Model , 2002, Adapt. Behav..

[5]  Michael V. Johnston,et al.  Fundamental neuroscience, 2nd edition: Edited by Duane E. Haines, PhD. 582 pp., illustrated. New York: Churchill Livingstone, 2002. $52.00. ISBN 0-443-066035. , 2002 .

[6]  D. McCandless Fundamental neuroscience , 1997, Metabolic Brain Disease.

[7]  E. D. Di Paolo Evolving spike-timing-dependent plasticity for single-trial learning in robots. , 2003, Philosophical transactions. Series A, Mathematical, physical, and engineering sciences.

[8]  Stefano Nolfi,et al.  How to Evolve Autonomous Robots: Different Approaches in Evolutionary Robotics , 1994 .

[9]  Robert I. Damper,et al.  Evolution of a circuit of spiking neurons for phototaxis in a Braitenberg vehicle , 2002 .

[10]  Dario Floreano,et al.  Evolution of Spiking Neural Controllers for Autonomous Vision-Based Robots , 2001, EvoRobots.

[11]  Naoyuki Kubota,et al.  Genetic algorithm for a fuzzy spiking neural network of a mobile robot , 2005, 2005 International Symposium on Computational Intelligence in Robotics and Automation.

[12]  E R Kandel,et al.  Presynaptic facilitation revisited: state and time dependence , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  Francesco Mondada,et al.  Mobile Robot Miniaturisation: A Tool for Investigation in Control Algorithms , 1993, ISER.

[14]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[15]  Joshua G. Hale,et al.  Using Humanoid Robots to Study Human Behavior , 2000, IEEE Intell. Syst..

[16]  Kazuyuki Murase,et al.  Self-organization of Spiking Neural Network that Generates Autonomous Behavior in a Real Mobile Robot , 2006, Int. J. Neural Syst..

[17]  W. Walter The Living Brain , 1963 .

[18]  J J Hopfield,et al.  What is a moment? Transient synchrony as a collective mechanism for spatiotemporal integration. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[20]  Michael Schmitt,et al.  Unsupervised learning and self-organization in networks of spiking neurons , 2001 .

[21]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[22]  Rodney A. Brooks,et al.  Intelligence Without Reason , 1991, IJCAI.

[23]  Florentin Wörgötter,et al.  Temporal Sequence Learning, Prediction, and Control: A Review of Different Models and Their Relation to Biological Mechanisms , 2005, Neural Computation.

[24]  A V Herz,et al.  Neural codes: firing rates and beyond. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Makoto Tsuda,et al.  Long‐term potentiation of neuronal excitation by neuron–glia interactions in the rat spinal dorsal horn , 2007, The European journal of neuroscience.

[26]  Kazuyuki Murase,et al.  Sensor-fusion in spiking neural network that generates autonomous behavior in real mobile robot , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[27]  E. Kandel In search of memory : the emergence of a new science of mind , 2007 .

[28]  Wolfgang Maass,et al.  Computing with spiking neurons , 1999 .

[29]  K. I. Blum,et al.  Functional significance of long-term potentiation for sequence learning and prediction. , 1996, Cerebral cortex.

[30]  Dario Floreano,et al.  From Wheels to Wings with Evolutionary Spiking Circuits , 2003, Artificial Life.

[31]  Xin Yao,et al.  A constructive algorithm for training cooperative neural network ensembles , 2003, IEEE Trans. Neural Networks.

[32]  Wulfram Gerstner,et al.  Spiking Neuron Models , 2002 .

[33]  R. F. Tredgold,et al.  The Living Brain , 1954, Mental Health.

[34]  Kazuyuki Murase,et al.  Glial Nitric Oxide-Mediated Long-Term Presynaptic Facilitation Revealed by Optical Imaging in Rat Spinal Dorsal Horn , 2004, The Journal of Neuroscience.

[35]  Wolfgang Maass,et al.  Networks of Spiking Neurons: The Third Generation of Neural Network Models , 1996, Electron. Colloquium Comput. Complex..

[36]  Wulfram Gerstner,et al.  Spiking Neuron Models: An Introduction , 2002 .

[37]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.