Digital implementation of a virtual insect trained by spike-timing dependent plasticity

Neural network approach to processing have been shown successful and efficient in numerous real world applications. The most successful of this approach are implemented in software but in order to achieve real-time processing similar to that of biological neural networks, hardware implementations of these networks need to be continually improved. This work presents a spiking neural network (SNN) implemented in digital CMOS. The SNN is constructed based on an indirect training algorithm that utilizes spike-timing dependent plasticity (STDP). The SNN is validated by using its outputs to control the motion of a virtual insect. The indirect training algorithm is used to train the SNN to navigate through a terrain with obstacles. The indirect approach is more appropriate for nanoscale CMOS implementation synaptic training since it is getting more difficult to perfectly control matching in CMOS circuits.

[1]  Manfred Glesner,et al.  Neurocomputers: an overview of neural networks in VLSI , 1994 .

[2]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[3]  Dan Hammerstrom.  A Highly Parallel Digital Architecture for Neural Network Emulation , 1991 .

[4]  Gregory S. Snider,et al.  Spike-timing-dependent learning in memristive nanodevices , 2008, 2008 IEEE International Symposium on Nanoscale Architectures.

[5]  Luigi Fortuna,et al.  Learning Anticipation via Spiking Networks: Application to Navigation Control , 2009, IEEE Transactions on Neural Networks.

[6]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[7]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[8]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[9]  Christopher J. Bishop,et al.  Pulsed Neural Networks , 1998 .

[10]  Mohammed Ismail,et al.  Analog VLSI Implementation of Neural Systems , 2011, The Kluwer International Series in Engineering and Computer Science.

[11]  M. Vellasco,et al.  VLSI architectures for neural networks , 1989, IEEE Micro.

[12]  Harald Burgsteiner,et al.  Imitation learning with spiking neural networks and real-world devices , 2006, Eng. Appl. Artif. Intell..

[13]  Heinrich Klar,et al.  Digital Neurohardware: Principles and Perspectives , 1998 .

[14]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[15]  Xu Zhang,et al.  Spike-based indirect training of a spiking neural network-controlled virtual insect , 2013, 52nd IEEE Conference on Decision and Control.

[16]  Bernabé Linares-Barranco,et al.  On Spike-Timing-Dependent-Plasticity, Memristive Devices, and Building a Self-Learning Visual Cortex , 2011, Front. Neurosci..

[17]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[18]  Wolfgang Maass,et al.  Networks of Spiking Neurons: The Third Generation of Neural Network Models , 1996, Electron. Colloquium Comput. Complex..

[19]  Yi Liu,et al.  Allocating Tasks in Multi-core Processor based Parallel System , 2007, 2007 IFIP International Conference on Network and Parallel Computing Workshops (NPC 2007).

[20]  Ulrich Ramacher,et al.  SYNAPSE - A Neurocomputer that Synthesizes Neural Algorithms on a Parallel Systolic Engine , 1992, J. Parallel Distributed Comput..

[21]  Silvia Ferrari,et al.  Biologically realizable reward-modulated hebbian training for spiking neural networks , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[22]  Steven M. LaValle,et al.  Planning algorithms , 2006 .