Efficient Event-Driven Simulation of Large Networks of Spiking Neurons and Dynamical Synapses

A simulation procedure is described for making feasible large-scale simulations of recurrent neural networks of spiking neurons and plastic synapses. The procedure is applicable if the dynamic variables of both neurons and synapses evolve deterministically between any two successive spikes. Spikes introduce jumps in these variables, and since spike trains are typically noisy, spikes introduce stochasticity into both dynamics. Since all events in the simulation are guided by the arrival of spikes, at neurons or synapses, we name this procedure event-driven. The procedure is described in detail, and its logic and performance are compared with conventional (synchronous) simulations. The main impact of the new approach is a drastic reduction of the computational load incurred upon introduction of dynamic synaptic efficacies, which vary organically as a function of the activities of the pre- and postsynaptic neurons. In fact, the computational load per neuron in the presence of the synaptic dynamics grows linearly with the number of neurons and is only about 6 more than the load with fixed synapses. Even the latter is handled quite efficiently by the algorithm. We illustrate the operation of the algorithm in a specific case with integrate-and-fire neurons and specific spike-driven synaptic dynamics. Both dynamical elements have been found to be naturally implementable in VLSI. This network is simulated to show the effects on the synaptic structure of the presentation of stimuli, as well as the stability of the generated matrix to the neural activity it induces.

[1]  Davide Badoni,et al.  Spike-Driven Synaptic Plasticity: Theory, Simulation, VLSI Implementation , 2000, Neural Computation.

[2]  J. Bower,et al.  The Book of GENESIS , 1998, Springer New York.

[3]  Paolo Del Giudice,et al.  Asynchronous simulation of large networks of spiking neurons and dynamical synapses , 1998 .

[4]  E. Zohary,et al.  Inter-trial neuronal activity in inferior temporal cortex: a putative vehicle to generate long-term visual associations , 1998, Nature Neuroscience.

[5]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[6]  Nicolas Brunel,et al.  Dynamics of a recurrent network of spiking neurons before and following learning , 1997 .

[7]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[8]  Maurizio Mattia,et al.  Collective Behavior of Networks with Linear (VLSI) Integrate-and-Fire Neurons , 1999, Neural Computation.

[9]  Daniel J. Amit,et al.  Learning in Neural Networks with Material Synapses , 1994, Neural Computation.

[10]  Daniel J. Amit,et al.  E ective neurons and attractor neural networks in cortical environment , 1992 .

[11]  Stefano Fusi,et al.  Queuing theory for spike driven synaptic dynamics , 1998 .

[12]  Henry Markram,et al.  An Algorithm for Synaptic Modification Based on Exact Timing of Pre- and Post-Synaptic Action Potentials , 1997, ICANN.

[13]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[14]  D. Johnston,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997 .

[15]  Germán Mato,et al.  On Numerical Simulations of Integrate-and-Fire Neural Networks , 1998, Neural Computation.

[16]  Y. Miyashita.  Neuronal correlate of visual associative long-term memory in the primate temporal cortex , 1988, Nature.

[17]  Hillel J. Chiel,et al.  Fast Calculation of Synaptic Conductances , 1993, Neural Computation.

[18]  Jacques Gautrais,et al.  SpikeNET: A simulator for modeling large networks of integrate and fire neurons , 1999, Neurocomputing.

[19]  Davide Badoni,et al.  Analog VLSI implementation of a spike driven stochastic dynamical synapse , 1998 .

[20]  Lloyd Watts,et al.  Event-Driven Simulation of Networks of Spiking Neurons , 1993, NIPS.

[21]  Misha Mahowald,et al.  A Spike Based Learning Neuron in Analog VLSI , 1996, NIPS.

[22]  Sompolinsky,et al.  Pattern of synchrony in inhomogeneous networks of oscillators with pulse interactions. , 1993, Physical review letters.

[23]  Sander M. Bohte,et al.  Unsupervised clustering with spiking neurons by sparse temporal coding and multilayer RBF networks , 2002, IEEE Trans. Neural Networks.

[24]  Yali Amit,et al.  Attractor Networks for Shape Recognition , 2001, Neural Computation.

[25]  D. Amit.  The Hebbian paradigm reintegrated: Local reverberations as internal representations , 1995, Behavioral and Brain Sciences.

[26]  J. Hopfield,et al.  All-or-none potentiation at CA3-CA1 synapses. , 1998, Proceedings of the National Academy of Sciences of the United States of America.