Precise-Spike-Driven Synaptic Plasticity: Learning Hetero-Association of Spatiotemporal Spike Patterns

A new learning rule (Precise-Spike-Driven (PSD) Synaptic Plasticity) is proposed for processing and memorizing spatiotemporal patterns. PSD is a supervised learning rule that is analytically derived from the traditional Widrow-Hoff rule and can be used to train neurons to associate an input spatiotemporal spike pattern with a desired spike train. Synaptic adaptation is driven by the error between the desired and the actual output spikes, with positive errors causing long-term potentiation and negative errors causing long-term depression. The amount of modification is proportional to an eligibility trace that is triggered by afferent spikes. The PSD rule is both computationally efficient and biologically plausible. The properties of this learning rule are investigated extensively through experimental simulations, including its learning performance, its generality to different neuron models, its robustness against noisy conditions, its memory capacity, and the effects of its learning parameters. Experimental results show that the PSD rule is capable of spatiotemporal pattern classification, and can even outperform a well studied benchmark algorithm with the proposed relative confidence criterion. The PSD rule is further validated on a practical example of an optical character recognition problem. The results again show that it can achieve a good recognition performance with a proper encoding. Finally, a detailed discussion is provided about the PSD rule and several related algorithms including tempotron, SPAN, Chronotron and ReSuMe.

[1]  A. Hill.  The Basis of Sensation: the Action of the Sense Organs , 1929, Nature.

[2]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[3]  E. Gardner.  The space of interactions in neural network models , 1988 .

[4]  Bernard Widrow,et al.  30 years of adaptive neural networks: perceptron, Madaline, and backpropagation , 1990, Proc. IEEE.

[5]  W. Singer,et al.  Different voltage-dependent thresholds for inducing long-term depression and long-term potentiation in slices of rat visual cortex , 1990, Nature.

[6]  R. Llinás,et al.  In vitro neurons in mammalian cortical layer 4 exhibit intrinsic oscillatory activity in the 10- to 50-Hz frequency range. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[7]  E. Knudsen.  Supervised learning in the brain , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  T. Sejnowski,et al.  Reliability of spike timing in neocortical neurons. , 1995, Science.

[9]  J. J. Hopfield,et al.  Pattern recognition computation using action potential timing for stimulus representation , 1995, Nature.

[10]  Christof Koch,et al.  Temporal Precision of Spike Trains in Extrastriate Cortex of the Behaving Macaque Monkey , 1999, Neural Computation.

[11]  W. T. Thach.  Motor Learning and Synaptic Plasticity in the Cerebellum: On the specific role of the cerebellum in motor learning and cognition: Clues from PET activation and lesion studies in man , 1997 .

[12]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[13]  Wolfgang Maass,et al.  Networks of Spiking Neurons: The Third Generation of Neural Network Models , 1996, Electron. Colloquium Comput. Complex..

[14]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[15]  Jonathan D. Victor,et al.  Metric-space analysis of spike trains: theory, algorithms and application , 1998, q-bio/0309031.

[16]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[17]  Michael J. Berry,et al.  Refractoriness and Neural Precision , 1997, The Journal of Neuroscience.

[18]  Wulfram Gerstner,et al.  Spike-Based Compared to Rate-Based Hebbian Learning , 1998, NIPS.

[19]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .

[20]  Alexander Borst,et al.  Information theory and neural coding , 1999, Nature Neuroscience.

[21]  R. Foehring,et al.  Neuromodulation, development and synaptic plasticity. , 1999, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[22]  J. Anthony Movshon,et al.  Review A Critical Evaluation of the Temporal Binding Hypothesis , 1999 .

[23]  Michael N. Shadlen,et al.  Synchrony Unbound A Critical Evaluation of the Temporal Binding Hypothesis , 1999, Neuron.

[24]  Mark C. W. van Rossum,et al.  Stable Hebbian Learning from Spike Timing-Dependent Plasticity , 2000, The Journal of Neuroscience.

[25]  R. Reid,et al.  Temporal Coding of Visual Information in the Thalamus , 2000, The Journal of Neuroscience.

[26]  A. Artola,et al.  Synaptic Activity Modulates the Induction of Bidirectional Synaptic Changes in Adult Mouse Hippocampus , 2000, The Journal of Neuroscience.

[27]  Masao Ito.  Mechanisms of motor learning in the cerebellum 1 1 Published on the World Wide Web on 24 November 2000. , 2000, Brain Research.

[28]  Eugene M. Izhikevich,et al.  Resonate-and-fire neurons , 2001, Neural Networks.

[29]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[30]  Mark C. W. van Rossum,et al.  A Novel Spike Distance , 2001, Neural Computation.

[31]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[32]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[33]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[34]  J. Seamans,et al.  The principal features and mechanisms of dopamine modulation in the prefrontal cortex , 2004, Progress in Neurobiology.

[35]  E. Chichilnisky,et al.  Precision of spike trains in primate retinal ganglion cells. , 2004, Journal of neurophysiology.

[36]  Dean V Buonomano,et al.  A learning rule for the emergence of stable dynamics and timing in recurrent networks. , 2005, Journal of neurophysiology.

[37]  S. Thorpe,et al.  Spike times make sense , 2005, Trends in Neurosciences.

[38]  Y. Dan,et al.  Spike-timing-dependent synaptic plasticity depends on dendritic location , 2005, Nature.

[39]  F. Ponulak.  ReSuMe-New Supervised Learning Method for Spiking Neural Networks , 2005 .

[40]  Megan R. Carey,et al.  Instructive signals for motor learning from visual cortical area MT , 2005, Nature Neuroscience.

[41]  N. Spruston,et al.  Postsynaptic depolarization requirements for LTP and LTD: a critique of spike timing-dependent plasticity , 2005, Nature Neuroscience.

[42]  Hieu Tat Nguyen,et al.  A gradient descent rule for spiking neurons emitting multiple spikes , 2005, Inf. Process. Lett..

[43]  H. Sompolinsky,et al.  The tempotron: a neuron that learns spike timing–based decisions , 2006, Nature Neuroscience.

[44]  Arne D. Ekstrom,et al.  Brain Oscillations Control Timing of Single-Neuron Activity in Humans , 2007, The Journal of Neuroscience.

[45]  Walter Senn,et al.  Learning Real-World Stimuli in a Neural Network with Spike-Driven Synaptic Dynamics , 2007, Neural Computation.

[46]  Hojjat Adeli,et al.  Improved spiking neural networks for EEG classification and epilepsy and seizure detection , 2007, Integr. Comput. Aided Eng..

[47]  Tim Gollisch,et al.  Rapid Neural Coding in the Retina with Relative Spike Latencies , 2008, Science.

[48]  Zoltan Nadasdy,et al.  Information Encoding and Reconstruction from the Phase of Action Potentials , 2009, Front. Syst. Neurosci..

[49]  Hojjat Adeli,et al.  Spiking Neural Networks , 2009, Int. J. Neural Syst..

[50]  Timothée Masquelier,et al.  Competitive STDP-Based Spike Pattern Learning , 2009, Neural Computation.

[51]  Xin Wang,et al.  Retinal Oscillations Carry Visual Information to Cortex , 2008, Front. Syst. Neurosci..

[52]  Nicolas Brunel,et al.  Sensory neural codes using multiplexed temporal scales , 2010, Trends in Neurosciences.

[53]  Andrzej J. Kasinski,et al.  Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting , 2010, Neural Computation.

[54]  Liam McDaid,et al.  SWAT: A Spiking Neural Network Training Algorithm for Classification Problems , 2010, IEEE Transactions on Neural Networks.

[55]  Olaf Sporns,et al.  Neurobiologically Realistic Determinants of Self-Organized Criticality in Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[56]  Kay Chen Tan,et al.  Pattern recognition computation in a spiking neural network with temporal encoding and learning , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[57]  Razvan V. Florian,et al.  The Chronotron: A Neuron That Learns to Fire Temporally Precise Spike Patterns , 2010, PloS one.

[58]  Stefan Schliebs,et al.  Span: Spike Pattern Association Neuron for Learning Spatio-Temporal Spike Patterns , 2012, Int. J. Neural Syst..

[59]  Oren Shriki,et al.  Fast Coding of Orientation in Primary Visual Cortex , 2012, PLoS Comput. Biol..

[60]  Xiaoqin Zeng,et al.  A New Supervised Learning Algorithm for Spiking Neurons , 2013, Neural Computation.

[61]  Haizhou Li,et al.  Rapid Feedforward Computation by Temporal Encoding and Learning With Spiking Neurons , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[62]  Haizhou Li,et al.  A Spike-Timing-Based Integrated Model for Pattern Recognition , 2013, Neural Computation.