Associative memory of phase-coded spatiotemporal patterns in leaky Integrate and Fire networks

We study the collective dynamics of a Leaky Integrate and Fire network in which precise relative phase relationship of spikes among neurons are stored, as attractors of the dynamics, and selectively replayed at different time scales. Using an STDP-based learning process, we store in the connectivity several phase-coded spike patterns, and we find that, depending on the excitability of the network, different working regimes are possible, with transient or persistent replay activity induced by a brief signal. We introduce an order parameter to evaluate the similarity between stored and recalled phase-coded pattern, and measure the storage capacity. Modulation of spiking thresholds during replay changes the frequency of the collective oscillation or the number of spikes per cycle, keeping preserved the phases relationship. This allows a coding scheme in which phase, rate and frequency are dissociable. Robustness with respect to noise and heterogeneity of neurons parameters is studied, showing that, since dynamics is a retrieval process, neurons preserve stable precise phase relationship among units, keeping a unique frequency of oscillation, even in noisy conditions and with heterogeneity of internal parameters of the units.

[1]  M. Migliore,et al.  Control of GABA Release at Mossy Fiber-CA3 Connections in the Developing Hippocampus , 2010, Front. Syn. Neurosci..

[2]  P. Dayan,et al.  Matching storage and recall: hippocampal spike timing–dependent plasticity and phase response curves , 2005, Nature Neuroscience.

[3]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[4]  Silvia Scarpetta,et al.  Encoding and Replay of Dynamic Attractors with Multiple Frequencies: Analysis of a STDP Based Learning Rule , 2007, Summer School on Neural Networks.

[5]  Kechen Zhang,et al.  Universal conditions for exact path integration in neural systems , 2012, Proceedings of the National Academy of Sciences.

[6]  M. Hasselmo.  Neuromodulation: acetylcholine and memory consolidation , 1999, Trends in Cognitive Sciences.

[7]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[8]  Alessandro Treves,et al.  Stable and Rapid Recurrent Processing in Realistic Autoassociative Memories , 1998, Neural Computation.

[9]  M. Moser,et al.  Understanding memory through hippocampal remapping , 2008, Trends in Neurosciences.

[10]  Silvia Scarpetta,et al.  Spatiotemporal learning in analog neural networks using spike-timing-dependent synaptic plasticity. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  Bard Ermentrout,et al.  A model for complex sequence learning and reproduction in neural populations , 2011, Journal of Computational Neuroscience.

[12]  Asohan Amarasingham,et al.  Internally Generated Cell Assembly Sequences in the Rat Hippocampus , 2008, Science.

[13]  J. O’Keefe,et al.  Phase relationship between hippocampal place units and the EEG theta rhythm , 1993, Hippocampus.

[14]  Silvia Scarpetta,et al.  Spike-Timing-Dependent Learning for Oscillatory Networks , 2000, NIPS.

[15]  Maria Marinaro,et al.  A learning rule for place fields in a cortical model: Theta phase precession as a network effect , 2005, Hippocampus.

[16]  D. Debanne,et al.  Long‐term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures , 1998, The Journal of physiology.

[17]  S. Wang,et al.  Malleability of Spike-Timing-Dependent Plasticity at the CA3–CA1 Synapse , 2006, The Journal of Neuroscience.

[18]  Alessandro Treves,et al.  Autoassociative memory retrieval and spontaneous activity bumps in small-world networks of integrate-and-fire neurons , 2005, Journal of Physiology-Paris.

[19]  H. T. Blair,et al.  Cosine Directional Tuning of Theta Cell Burst Frequencies: Evidence for Spatial Coding by Oscillatory Interference , 2011, The Journal of Neuroscience.

[20]  Neil Burgess,et al.  Attractor Dynamics in the Hippocampal Representation of the Local Environment , 2005, Science.

[21]  Yvonne Aratyn,et al.  Integrate-and-Fire Neurons , 2002 .

[22]  M. Hasselmo,et al.  Coupled Noisy Spiking Neurons as Velocity-Controlled Oscillators in a Model of Grid Cell Spatial Firing , 2010, The Journal of Neuroscience.

[23]  L. Abbott,et al.  Cortical Development and Remapping through Spike Timing-Dependent Plasticity , 2001, Neuron.

[24]  D. R. Euston,et al.  Fast-Forward Playback of Recent Memory Sequences in Prefrontal Cortex During Sleep , 2007, Science.

[25]  Wulfram Gerstner,et al.  A History of Spike-Timing-Dependent Plasticity , 2011, Front. Syn. Neurosci..

[26]  H. Abarbanel,et al.  Dynamical model of long-term synaptic plasticity , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Michael E. Hasselmo,et al.  Acetylcholine and Learning in a Cortical Associative Memory , 1993, Neural Computation.

[28]  Wulfram Gerstner,et al.  Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns , 1993, Biological Cybernetics.

[29]  H. T. Blair,et al.  Conversion of a phase‐ to a rate‐coded position signal by a three‐stage model of theta cells, grid cells, and place cells , 2008, Hippocampus.

[30]  Michael E. Hasselmo,et al.  Evaluation of the Oscillatory Interference Model of Grid Cell Firing through Analysis and Measured Period Variance of Some Biological Oscillators , 2009, PLoS Comput. Biol..

[31]  Matthieu Gilson,et al.  STDP Allows Fast Rate-Modulated Coding with Poisson-Like Spike Trains , 2011, PLoS Comput. Biol..

[32]  Wulfram Gerstner,et al.  Spiking Neuron Models: An Introduction , 2002 .

[33]  Pak-Ming Lau,et al.  Synaptic mechanisms of persistent reverberatory activity in neuronal networks. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[34]  A. Politi,et al.  Collective oscillations in disordered neural networks. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[35]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[36]  Silvia Scarpetta,et al.  Dynamics and storage capacity of neural networks with small-world topology , 2011, WIRN.

[37]  B. McNaughton,et al.  Hippocampus Leads Ventral Striatum in Replay of Place-Reward Information , 2009, PLoS biology.

[38]  D. Feldman,et al.  Timing-Based LTP and LTD at Vertical Inputs to Layer II/III Pyramidal Cells in Rat Barrel Cortex , 2000, Neuron.

[39]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.

[40]  Margaret F. Carr,et al.  Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval , 2011, Nature Neuroscience.

[41]  Lisa M. Giocomo,et al.  Computational Models of Grid Cells , 2011, Neuron.

[42]  Silvia Scarpetta,et al.  Storage of Phase-Coded Patterns via STDP in Fully-Connected and Sparse Network: A Study of the Network Capacity , 2010, Front. Syn. Neurosci.

[43]  Bruce L McNaughton,et al.  Hippocampal-cortical interactions and the dynamics of memory trace reactivation. , 2011, Progress in brain research.

[44]  J. J. Hopfield,et al.  Pattern recognition computation using action potential timing for stimulus representation , 1995, Nature.

[45]  J. O’Keefe,et al.  Grid cells and theta as oscillatory interference: Electrophysiological data from freely moving rats , 2008, Hippocampus.

[46]  Michaël Zugaro,et al.  Hippocampal ripples and memory consolidation , 2011, Current Opinion in Neurobiology.

[47]  Peter Dayan,et al.  Uncertainty, phase and oscillatory hippocampal recall , 2006, NIPS.

[48]  D. Johnston,et al.  A Synaptically Controlled, Associative Signal for Hebbian Plasticity in Hippocampal Neurons , 1997, Science.

[49]  N. Logothetis,et al.  Phase-of-Firing Coding of Natural Visual Stimuli in Primary Visual Cortex , 2008, Current Biology.

[50]  G. Buzsáki,et al.  Neuronal Oscillations in Cortical Networks , 2004, Science.

[51]  J. O’Keefe,et al.  Dual phase and rate coding in hippocampal place cells: Theoretical significance and relationship to entorhinal grid cells , 2005, Hippocampus.

[52]  Marcelo A. Montemurro,et al.  Spike-Phase Coding Boosts and Stabilizes Information Carried by Spatial and Temporal Spike Patterns , 2009, Neuron.

[53]  J. Seamans,et al.  Default activity patterns at the neocortical microcircuit level , 2012, Front. Integr. Neurosci..

[54]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[55]  Robert A. Legenstein,et al.  What Can a Neuron Learn with Spike-Timing-Dependent Plasticity? , 2005, Neural Computation.

[56]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[57]  Ila R Fiete,et al.  Grid cells: The position code, neural network models of activity, and the problem of learning , 2008, Hippocampus.

[58]  R M Borisyuk,et al.  Memorizing and recalling spatial-temporal patterns in an oscillator model of the hippocampus. , 1998, Bio Systems.

[59]  C. I. De Zeeuw,et al.  Timing in the cerebellum: oscillations and resonance in the granular layer , 2009, Neuroscience.

[60]  Gayle M. Wittenberg,et al.  Spike Timing Dependent Plasticity: A Consequence of More Fundamental Learning Rules , 2010, Front. Comput. Neurosci..

[61]  Ferdinando Giacco,et al.  Storage capacity of phase-coded patterns in sparse neural networks , 2011, 1106.2032.

[62]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[63]  György Buzsáki,et al.  Hippocampal place cell assemblies are speed-controlled oscillators , 2007, Proceedings of the National Academy of Sciences.

[64]  Richard Kempter,et al.  Memory Capacity for Sequences in a Recurrent Network with Biological Constraints , 2006 .

[65]  Asohan Amarasingham,et al.  Hippocampus Internally Generated Cell Assembly Sequences in the Rat , 2011 .

[66]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[67]  Péter Érdi,et al.  Computational theories on the function of theta oscillations , 2005, Biological Cybernetics.

[68]  Matthew A. Wilson,et al.  Hippocampal Replay of Extended Experience , 2009, Neuron.

[69]  Nicolas Brunel,et al.  Frontiers in Computational Neuroscience Computational Neuroscience , 2022 .

[70]  Richard Hans Robert Hahnloser,et al.  Spike-Time-Dependent Plasticity and Heterosynaptic Competition Organize Networks to Produce Long Scale-Free Sequences of Neural Activity , 2010, Neuron.

[71]  Silvia Scarpetta,et al.  Hebbian Imprinting and Retrieval in Oscillatory Neural Networks , 2001, Neural Computation.

[72]  G. Buzsáki,et al.  Forward and reverse hippocampal place-cell sequences during ripples , 2007, Nature Neuroscience.

[73]  Marco Idiart,et al.  Memory retrieval time and memory capacity of the CA3 network: role of gamma frequency oscillations. , 2007, Learning & memory.

[74]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[75]  John O'Keefe,et al.  Independent rate and temporal coding in hippocampal pyramidal cells , 2003, Nature.

[76]  Gustavo Deco,et al.  Oscillations, Phase-of-Firing Coding, and Spike Timing-Dependent Plasticity: An Efficient Learning Scheme , 2009, The Journal of Neuroscience.

[77]  J. O’Keefe,et al.  An oscillatory interference model of grid cell firing , 2007, Hippocampus.

[78]  A Treves,et al.  Associative memory neural network with low temporal spiking rates. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[79]  Alan Gelperin,et al.  Olfactory Computations and Network Oscillation , 2006, The Journal of Neuroscience.

[80]  Marc Timme,et al.  Designing the dynamics of spiking neural networks. , 2006, Physical review letters.

[81]  M. Wilson,et al.  Coordinated memory replay in the visual cortex and hippocampus during sleep , 2007, Nature Neuroscience.

[82]  Dario L Ringach,et al.  Spontaneous and driven cortical activity: implications for computation , 2009, Current Opinion in Neurobiology.

[83]  Feng Qi Han,et al.  Reverberation of Recent Visual Experience in Spontaneous Cortical Waves , 2008, Neuron.

[84]  Bruce L. McNaughton,et al.  Path integration and the neural basis of the 'cognitive map' , 2006, Nature Reviews Neuroscience.

[85]  J. Csicsvari,et al.  Replay and Time Compression of Recurring Spike Sequences in the Hippocampus , 1999, The Journal of Neuroscience.

[86]  Markus Siegel,et al.  Phase-dependent neuronal coding of objects in short-term memory , 2009, Proceedings of the National Academy of Sciences.