Competitive STDP-Based Spike Pattern Learning

Recently it has been shown that a repeating arbitrary spatiotemporal spike pattern hidden in equally dense distracter spike trains can be robustly detected and learned by a single neuron equipped with spike-timing-dependent plasticity (STDP) (Masquelier, Guyonneau, & Thorpe, 2008). To be precise, the neuron becomes selective to successive coincidences of the pattern. Here we extend this scheme to a more realistic scenario with multiple repeating patterns and multiple STDP neurons listening to the incoming spike trains. These listening neurons are in competition: as soon as one fires, it strongly inhibits the others through lateral connections (one-winner-take-all mechanism). This tends to prevent the neurons from learning the same (parts of the) repeating patterns, as shown in simulations. Instead, the population self-organizes, trying to cover the different patterns or coding one pattern by the successive firings of several neurons, and a powerful distributed coding scheme emerges. Taken together, these results illustrate how the brain could easily encode and decode information in the spike times, a theory referred to as temporal coding, and how STDP could play a key role by detecting repeating patterns and generating selective response to them.

[1]  Li I. Zhang,et al.  A critical window for cooperation and competition among developing retinotectal synapses , 1998, Nature.

[2]  M. Quirk,et al.  Experience-Dependent Asymmetric Shape of Hippocampal Receptive Fields , 2000, Neuron.

[3]  Steve M. Potter,et al.  Precisely timed spatiotemporal patterns of neural activity in dissociated cortical cultures , 2007, Neuroscience.

[4]  Timothée Masquelier,et al.  Unsupervised Learning of Visual Features through Spike Timing Dependent Plasticity , 2007, PLoS Comput. Biol..

[5]  Rufin VanRullen,et al.  Temporal codes and sparse representations: A key to understanding rapid processing in the visual system , 2004, Journal of Physiology-Paris.

[6]  Tohru Ikeguchi,et al.  STDP Provides the Substrate for Igniting Synfire Chains by Spatiotemporal Input Patterns , 2008, Neural Computation.

[7]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[8]  Wulfram Gerstner,et al.  Spiking Neuron Models , 2002 .

[9]  Simon J. Thorpe,et al.  Spike arrival times: A highly efficient coding scheme for neural networks , 1990 .

[10]  G. Laurent,et al.  Hebbian STDP in mushroom bodies facilitates the synchronous flow of olfactory information in locusts , 2007, Nature.

[11]  Arnaud Delorme,et al.  Networks of integrate-and-fire neurons using Rank Order Coding B: Spike timing dependent plasticity and emergence of orientation selectivity , 2001, Neurocomputing.

[12]  Robert A. Legenstein,et al.  What Can a Neuron Learn with Spike-Timing-Dependent Plasticity? , 2005, Neural Computation.

[13]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .

[14]  Nicolas Y. Masse,et al.  Olfactory Information Processing in Drosophila , 2009, Current Biology.

[15]  Yuji Ikegaya,et al.  Synfire Chains and Cortical Songs: Temporal Modules of Cortical Activity , 2004, Science.

[16]  Wulfram Gerstner,et al.  Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns , 1993, Biological Cybernetics.

[17]  M. Poo,et al.  Spike Timing-Dependent LTP/LTD Mediates Visual Experience-Dependent Plasticity in a Developing Retinotectal System , 2006, Neuron.

[18]  D. Feldman,et al.  Spike Timing-Dependent Synaptic Depression in the In Vivo Barrel Cortex of the Rat , 2007, The Journal of Neuroscience.

[19]  Simon J. Thorpe,et al.  Category-dependent variations in visual processing time , 2010 .

[20]  G. Buzsáki,et al.  Sequential structure of neocortical spontaneous activity in vivo , 2007, Proceedings of the National Academy of Sciences.

[21]  T. Sejnowski,et al.  Discovering Spike Patterns in Neuronal Responses , 2004, The Journal of Neuroscience.

[22]  E. Vaadia,et al.  Spatiotemporal structure of cortical activity: properties and behavioral relevance. , 1998, Journal of neurophysiology.

[23]  Martin A. Giese,et al.  Biophysiologically Plausible Implementations of the Maximum Operation , 2002, Neural Computation.

[24]  Richard Granger,et al.  A cortical model of winner-take-all competition via lateral inhibition , 1992, Neural Networks.

[25]  György Buzsáki,et al.  Neural Syntax: Cell Assemblies, Synapsembles, and Readers , 2010, Neuron.

[26]  Guo-Qiang Bi,et al.  Spatiotemporal specificity of synaptic plasticity: cellular rules and mechanisms , 2002, Biological Cybernetics.

[27]  K. Obermayer,et al.  Cortical reorganization consistent with spike timing–but not correlation-dependent plasticity , 2007, Nature Neuroscience.

[28]  D. Johnston,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997 .

[29]  Klaus Obermayer,et al.  Erratum: Cortical reorganization consistent with spike timing-but not correlation-dependent plasticity (Nature Neuroscience (2007) 10, (887-895)) , 2007 .

[30]  Mark C. W. van Rossum,et al.  Stable Hebbian Learning from Spike Timing-Dependent Plasticity , 2000, The Journal of Neuroscience.

[31]  W. Gerstner,et al.  Triplets of Spikes in a Model of Spike Timing-Dependent Plasticity , 2006, The Journal of Neuroscience.

[32]  S. Thorpe,et al.  Spike Timing Dependent Plasticity Finds the Start of Repeating Patterns in Continuous Spike Trains , 2008, PloS one.

[33]  M. Yoshioka Spike-timing-dependent learning rule to encode spatiotemporal patterns in a network of spiking neurons. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[35]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[36]  Wolfgang Maass,et al.  On the Computational Power of Winner-Take-All , 2000, Neural Computation.

[37]  Alan L. Yuille,et al.  A Winner-Take-All Mechanism Based on Presynaptic Inhibition Feedback , 1989, Neural Computation.

[38]  H. Sompolinsky,et al.  The tempotron: a neuron that learns spike timing–based decisions , 2006, Nature Neuroscience.

[39]  D. Feldman,et al.  Timing-Based LTP and LTD at Vertical Inputs to Layer II/III Pyramidal Cells in Rat Barrel Cortex , 2000, Neuron.

[40]  R. D. Frostig,et al.  Recurring discharge patterns in multiple spike trains , 2004, Biological Cybernetics.

[41]  Rufin van Rullen,et al.  Neurons Tune to the Earliest Spikes Through STDP , 2005, Neural Computation.

[42]  T. Sejnowski,et al.  Regulation of spike timing in visual cortical circuits , 2008, Nature Reviews Neuroscience.

[43]  Timothée Masquelier,et al.  Learning mechanisms to account for the speed, selectivity and invariance of responses in the visual cortex , 2008 .

[44]  Wulfram Gerstner,et al.  Spiking Neuron Models: An Introduction , 2002 .

[45]  Y. Dan,et al.  Receptive-Field Modification in Rat Visual Cortex Induced by Paired Visual Stimulation and Single-Cell Spiking , 2006, Neuron.

[46]  Wolfgang Maass,et al.  A Theoretical Basis for Emergent Pattern Discrimination in Neural Systems Through Slow Feature Extraction , 2010, Neural Computation.

[47]  Tomaso A. Poggio,et al.  A Canonical Neural Circuit for Cortical Nonlinear Operations , 2008, Neural Computation.

[48]  Tomaso A. Poggio,et al.  Biophysical Models of Neural Computation: Max and Tuning Circuits , 2006, WImBI.

[49]  Arnaud Delorme,et al.  Networks of integrate-and-fire neuron using rank order coding A: How to implement spike time dependent Hebbian plasticity , 2001, Neurocomputing.

[50]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[51]  Daniel Pressnitzer,et al.  Rapid Formation of Robust Auditory Memories: Insights from Noise , 2010, Neuron.

[52]  Florian Engert,et al.  Spatiotemporal Specificity of Neuronal Activity Directs the Modification of Receptive Fields in the Developing Retinotectal System , 2006, Neuron.

[53]  Terrence J. Sejnowski,et al.  Synaptic Learning Rules and Sparse Coding in a Model Sensory System , 2008, PLoS Comput. Biol..

[54]  Michèle Fabre-Thorpe,et al.  ULTRA RAPID FACE DETECTION IN NATURAL IMAGES : IMPLICATIONS FOR COMPUTATION IN THE VISUAL SYSTEM , 2006 .

[55]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[56]  Moshe Abeles,et al.  Time Is Precious , 2004, Science.

[57]  S. Grossberg,et al.  Pattern formation, contrast control, and oscillations in the short term memory of shunting on-center off-surround networks , 1975, Biological Cybernetics.