A Radial Basis Function Spike Model for Indirect Learning via Integrate-and-Fire Sampling and Reconstruction Techniques

This paper presents a deterministic and adaptive spike model derived from radial basis functions and a leaky integrate-and-fire sampler developed for training spiking neural networks without direct weight manipulation. Several algorithms have been proposed for training spiking neural networks through biologically-plausible learning mechanisms, such as spike-timing dependent synaptic plasticity and Hebbian plasticity. These algorithms typically rely on the ability to update the synaptic strengths, or weights, directly, through a weight update rule in which the weight increment can be decided and implemented based on the training equations. However, in several potential applications of adaptive spiking neural networks, including neuroprosthetic devices and CMOS/memristor nanoscale neuromorphic chips, the weights cannot be manipulated directly and, instead, tend to change over time by virtue of the pre- and postsynaptic neural activity. This paper presents an indirect learning method that induces changes in the synaptic weights by modulating spike-timing-dependent plasticity by means of controlled input spike trains. In place of the weights, the algorithmmanipulates the input spike trains used to stimulate the input neurons by determining a sequence of spike timings that minimize a desired objective function and, indirectly, induce the desired synaptic plasticity in the network.

[1]  Antonius M J VanDongen,et al.  The Nonkinase Phorbol Ester Receptor α1-Chimerin Binds the NMDA Receptor NR2A Subunit and Regulates Dendritic Spine Density , 2005, The Journal of Neuroscience.

[2]  Akram Aldroubi,et al.  Nonuniform Sampling and Reconstruction in Shift-Invariant Spaces , 2001, SIAM Rev..

[3]  Anthony N. Burkitt,et al.  A Review of the Integrate-and-fire Neuron Model: I. Homogeneous Synaptic Input , 2006, Biological Cybernetics.

[4]  A. VanDongen,et al.  Newly identified brain potassium channels gated by the guanine nucleotide binding protein Go. , 1988, Science.

[5]  Robert A. Legenstein,et al.  What Can a Neuron Learn with Spike-Timing-Dependent Plasticity? , 2005, Neural Computation.

[6]  Silvia Ferrari,et al.  Indirect training of a spiking neural network for flight control via spike-timing-dependent synaptic plasticity , 2010, 49th IEEE Conference on Decision and Control (CDC).

[7]  R. Bellman,et al.  Dynamic Programming and Markov Processes , 1960 .

[8]  Razvan V. Florian,et al.  Reinforcement Learning Through Modulation of Spike-Timing-Dependent Synaptic Plasticity , 2007, Neural Computation.

[9]  Jean-Pascal Pfister,et al.  Optimal Spike-Timing-Dependent Plasticity for Precise Action Potential Firing in Supervised Learning , 2005, Neural Computation.

[10]  Silvia Ferrari,et al.  Biologically realizable reward-modulated hebbian training for spiking neural networks , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[11]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[12]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990 .

[13]  László Tóth,et al.  A real-time algorithm for Time Decoding Machines , 2006, 2006 14th European Signal Processing Conference.

[14]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[15]  C. Pennartz Reinforcement learning by Hebbian synapses with adaptive thresholds , 1997, Neuroscience.

[16]  Wulfram Gerstner,et al.  Spiking Neuron Models: An Introduction , 2002 .

[17]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[18]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[19]  Simei Gomes Wysoski,et al.  Adaptive Learning Procedure for a Network of Spiking Neurons and Visual Pattern Recognition , 2006, ACIVS.

[20]  R. Bellman Dynamic programming. , 1957, Science.

[21]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[22]  Robert F. Stengel,et al.  Optimal Control and Estimation , 1994 .

[23]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[24]  S. F. R. F. Stengel 3 Model-Based Adaptive Critic Designs , 2004 .

[25]  J. Jack,et al.  Electric current flow in excitable cells , 1975 .

[26]  José Carlos Príncipe,et al.  Approximate reconstruction of bandlimited functions for the integrate and fire sampler , 2009, Advances in Computational Mathematics.

[27]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[28]  Wolfgang Maass,et al.  Noisy Spiking Neurons with Temporal Coding have more Computational Power than Sigmoidal Neurons , 1996, NIPS.

[29]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.