Memory replay in balanced recurrent networks

Complex patterns of neural activity appear during up-states in the neocortex and sharp waves in the hippocampus, including sequences that resemble those during prior behavioral experience. The mechanisms underlying this replay are not well understood. How can small synaptic footprints engraved by experience control large-scale network activity during memory retrieval and consolidation? We hypothesize that sparse and weak synaptic connectivity between Hebbian assemblies are boosted by pre-existing recurrent connectivity within them. To investigate this idea, we connect sequences of assemblies in randomly connected spiking neuronal networks with a balance of excitation and inhibition. Simulations and analytical calculations show that recurrent connections within assemblies allow for a fast amplification of signals that indeed reduces the required number of inter-assembly connections. Replay can be evoked by small sensory-like cues or emerge spontaneously by activity fluctuations. Global—potentially neuromodulatory—alterations of neuronal excitability can switch between network states that favor retrieval and consolidation.

[1]  Robert C. Froemke,et al.  Inhibitory and Excitatory Spike-Timing-Dependent Plasticity in the Auditory Cortex , 2015, Neuron.

[2]  Markus Diesmann,et al.  Activity dynamics and propagation of synchronous spiking in locally connected random networks , 2003, Biological Cybernetics.

[3]  Sen Cheng,et al.  The CRISP theory of hippocampal function in episodic memory , 2013, Front. Neural Circuits.

[4]  J. Csicsvari,et al.  Oscillatory Coupling of Hippocampal Pyramidal Cells and Interneurons in the Behaving Rat , 1999, The Journal of Neuroscience.

[5]  R. Traub,et al.  Electrical coupling underlies high-frequency oscillations in the hippocampus in vitro , 1998, Nature.

[6]  Junfei Qiao,et al.  A Self Organizing Recurrent Neural Network , 2017 .

[7]  Arvind Kumar,et al.  Communication through Resonance in Spiking Neuronal Networks , 2014, PLoS Comput. Biol..

[8]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  Jason N MacLean,et al.  Circuit reactivation dynamically regulates synaptic plasticity in neocortex , 2013, Nature Communications.

[10]  Alex M. Andrew,et al.  Spiking Neuron Models: Single Neurons, Populations, Plasticity , 2003 .

[11]  Margaret Floy Washburn,et al.  Movement and Mental Imagery: Outlines of a Motor Theory of the Complexer Mental Processes , 2008 .

[12]  T. Brown On the nature of the fundamental activity of the nervous centres; together with an analysis of the conditioning of rhythmic activity in progression, and a theory of the evolution of function in the nervous system , 1914, The Journal of physiology.

[13]  Peter Jonas,et al.  Intrinsic membrane properties determine hippocampal differential firing pattern in vivo in anesthetized rats , 2015, Hippocampus.

[14]  K. Harris,et al.  Spontaneous Events Outline the Realm of Possible Sensory Responses in Neocortical Populations , 2009, Neuron.

[15]  J. Rinn,et al.  DeCoN: Genome-wide Analysis of In Vivo Transcriptional Dynamics during Pyramidal Neuron Fate Selection in Neocortex , 2015, Neuron.

[16]  Edgar Bermudez Contreras,et al.  Formation and Reverberation of Sequential Neural Activity Patterns Evoked by Sensory Stimulation Are Enhanced during Cortical Desynchronization , 2013, Neuron.

[17]  Christine M. Walsh,et al.  Cognitive neuroscience of sleep. , 2010, Progress in brain research.

[18]  Ad Aertsen,et al.  Stable propagation of synchronous spiking in cortical neural networks , 1999, Nature.

[19]  Markus Diesmann,et al.  The mechanism of synchronization in feed-forward neuronal networks , 2008 .

[20]  Everton J. Agnes,et al.  Diverse synaptic plasticity mechanisms orchestrated to form and retrieve memories in spiking neural networks , 2015, Nature Communications.

[21]  Patrick R Hof,et al.  Gap junctions on hippocampal mossy fiber axons demonstrated by thin-section electron microscopy and freeze–fracture replica immunogold labeling , 2007, Proceedings of the National Academy of Sciences.

[22]  Feng Qi Han,et al.  Cortical Sensitivity to Visual Features in Natural Scenes , 2005, PLoS biology.

[23]  Xiao-Jing Wang,et al.  Mean-Driven and Fluctuation-Driven Persistent Activity in Recurrent Networks , 2007, Neural Computation.

[24]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[25]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[26]  Stefan Rotter,et al.  Emergence of Functional Specificity in Balanced Networks with Synaptic Plasticity , 2015, PLoS Comput. Biol..

[27]  Peter E. Latham,et al.  A Balanced Memory Network , 2007, PLoS Comput. Biol..

[28]  H. Gundersen,et al.  Unbiased stereological estimation of the total number of neurons in the subdivisions of the rat hippocampus using the optical fractionator , 1991, The Anatomical record.

[29]  Damian J. Wallace,et al.  Chasing the cell assembly , 2010, Current Opinion in Neurobiology.

[30]  E. Hanse,et al.  AMPA-silent synapses in brain development and pathology , 2013, Nature Reviews Neuroscience.

[31]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[32]  R. Yuste,et al.  Attractor dynamics of network UP states in the neocortex , 2003, Nature.

[33]  Moshe Abeles,et al.  On Embedding Synfire Chains in a Balanced Network , 2003, Neural Computation.

[34]  David J. Foster,et al.  Reverse replay of behavioural sequences in hippocampal place cells during the awake state , 2006, Nature.

[35]  W. Gerstner,et al.  Non-normal amplification in random balanced neuronal networks. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  G. Buzsáki Two-stage model of memory trace formation: A role for “noisy” brain states , 1989, Neuroscience.

[37]  M. Hasselmo Neuromodulation: acetylcholine and memory consolidation , 1999, Trends in Cognitive Sciences.

[38]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[39]  Stephen Coombes,et al.  Modeling sharp wave‐ripple complexes through a CA3‐CA1 network model with chemical synapses , 2012, Hippocampus.

[40]  B L McNaughton,et al.  Dynamics of the hippocampal ensemble code for space. , 1993, Science.

[41]  Albert K. Lee,et al.  Memory of Sequential Experience in the Hippocampus during Slow Wave Sleep , 2002, Neuron.

[42]  Alois Schlögl,et al.  Synaptic mechanisms of pattern completion in the hippocampal CA3 network , 2016, Science.

[43]  A. Aertsen,et al.  Conditions for Propagating Synchronous Spiking and Asynchronous Firing Rates in a Cortical Network Model , 2008, The Journal of Neuroscience.

[44]  Mattias P. Karlsson,et al.  Awake replay of remote experiences in the hippocampus , 2009, Nature Neuroscience.

[45]  Nicolas Brunel,et al.  Can Attractor Network Models Account for the Statistics of Firing During Persistent Activity in Prefrontal Cortex? , 2008, Front. Neurosci..

[46]  F. Rieke,et al.  Noise correlations improve response fidelity and stimulus encoding , 2010, Nature.

[47]  R. Woodworth,et al.  Lectures on the Experimental Psychology of the Thought-Processes , 1910 .

[48]  M. Gallagher,et al.  Preserved neuron number in the hippocampus of aged rats with spatial learning deficits. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[49]  Dimitri M Kullmann,et al.  Interneuron networks in the hippocampus , 2011, Current Opinion in Neurobiology.

[50]  Gordon Pipa,et al.  SORN: A Self-Organizing Recurrent Neural Network , 2009, Front. Comput. Neurosci..

[51]  Romain Brette,et al.  The Brian Simulator , 2009, Front. Neurosci..

[52]  Peter A. Appleby,et al.  Triphasic spike-timing-dependent plasticity organizes networks to produce robust sequences of neural activity , 2012, Front. Comput. Neurosci..

[53]  Maxim Bazhenov,et al.  Hippocampal CA1 Ripples as Inhibitory Transients , 2016, PLoS Comput. Biol..

[54]  Edmund T. Rolls,et al.  What determines the capacity of autoassociative memories in the brain? Network , 1991 .

[55]  Moshe Abeles,et al.  Synfire chain in a balanced network , 2002, Neurocomputing.

[56]  Wolfgang Maass,et al.  Emergence of Dynamic Memory Traces in Cortical Microcircuit Models through STDP , 2013, The Journal of Neuroscience.

[57]  H. Markram,et al.  The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[58]  R. Monasson,et al.  Crosstalk and transitions between multiple spatial maps in an attractor neural network model of the hippocampus: collective motion of the activity. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[59]  Raoul-Martin Memmesheimer,et al.  Quantitative prediction of intermittent high-frequency oscillations in neural networks with supralinear dendritic interactions , 2010, Proceedings of the National Academy of Sciences.

[60]  Haim Sompolinsky,et al.  Chaotic Balanced State in a Model of Cortical Circuits , 1998, Neural Computation.

[61]  Sven Jahnke,et al.  A Unified Dynamic Model for Learning, Replay, and Sharp-Wave/Ripples , 2015, The Journal of Neuroscience.

[62]  Sven Jahnke,et al.  Propagating synchrony in feed-forward networks , 2013, Front. Comput. Neurosci..

[63]  A. Litwin-Kumar,et al.  Slow dynamics and high variability in balanced cortical networks with clustered connections , 2012, Nature Neuroscience.

[64]  Eran Stark,et al.  Local generation of multineuronal spike sequences in the hippocampal CA1 region , 2015, Proceedings of the National Academy of Sciences.

[65]  K. Lashley The problem of serial order in behavior , 1951 .

[66]  J. Hammersley,et al.  Diffusion Processes and Related Topics in Biology , 1977 .

[67]  Maxim Bazhenov,et al.  Feedback stabilizes propagation of synchronous spiking in cortical neural networks , 2015, Proceedings of the National Academy of Sciences.

[68]  W. Gerstner,et al.  Connectivity reflects coding: a model of voltage-based STDP with homeostasis , 2010, Nature Neuroscience.

[69]  P. J. Sjöström,et al.  Functional specificity of local synaptic connections in neocortical networks , 2011, Nature.

[70]  T. Fukai,et al.  A Lognormal Recurrent Network Model for Burst Generation during Hippocampal Sharp Waves , 2015, The Journal of Neuroscience.

[71]  N. Vladimirov,et al.  Synaptic gating at axonal branches, and sharp‐wave ripples with replay: a simulation study , 2013, The European journal of neuroscience.

[72]  David Kappel,et al.  STDP Installs in Winner-Take-All Circuits an Online Approximation to Hidden Markov Model Learning , 2014, PLoS Comput. Biol..

[73]  Christian Leibold,et al.  Inhibition enhances memory capacity: optimal feedback, transient replay and oscillations , 2012, Journal of Computational Neuroscience.

[74]  A. Litwin-Kumar,et al.  Formation and maintenance of neuronal assemblies through synaptic plasticity , 2014, Nature Communications.

[75]  Eran Stark,et al.  Excitation and Inhibition Compete to Control Spiking during Hippocampal Ripples: Intracellular Study in Behaving Mice , 2014, The Journal of Neuroscience.

[76]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.

[77]  P. Somogyi,et al.  Neuronal Diversity and Temporal Dynamics: The Unity of Hippocampal Circuit Operations , 2008, Science.

[78]  M. Wilson,et al.  Temporally Structured Replay of Awake Hippocampal Ensemble Activity during Rapid Eye Movement Sleep , 2001, Neuron.

[79]  P. Jonas,et al.  Symmetric spike timing-dependent plasticity at CA3–CA3 synapses optimizes storage and recall in autoassociative networks , 2016, Nature Communications.

[80]  Henning Sprekeler,et al.  Inhibitory Plasticity Balances Excitation and Inhibition in Sensory Pathways and Memory Networks , 2011, Science.

[81]  Giacomo Indiveri,et al.  Recurrent networks of coupled Winner-Take-All oscillators for solving constraint satisfaction problems , 2013, NIPS.

[82]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[83]  Andrew Philippides,et al.  Dual Coding with STDP in a Spiking Recurrent Neural Network Model of the Hippocampus , 2010, PLoS Comput. Biol..

[84]  Francesco Marrosu,et al.  Microdialysis measurement of cortical and hippocampal acetylcholine release during sleep-wake cycle in freely moving cats , 1995, Brain Research.

[85]  Szabolcs Káli,et al.  Mechanisms of Sharp Wave Initiation and Ripple Generation , 2014, The Journal of Neuroscience.

[86]  Isaac Meilijson,et al.  Distributed Synchrony of Spiking Neurons in a Hebbian Cell Assembly , 1999, NIPS.

[87]  G. Dragoi,et al.  Preplay of future place cell sequences by hippocampal cellular assemblies , 2011, Nature.

[88]  Tomoki Fukai,et al.  Fokker-Planck approach to the pulse packet propagation in synfire chain , 2001, Neural Networks.

[89]  D. K. Berg,et al.  A Novel Mechanism for Nicotinic Potentiation of Glutamatergic Synapses , 2014, The Journal of Neuroscience.

[90]  Adriano B. L. Tort,et al.  An investigation of Hebbian phase sequences as assembly graphs , 2014, Front. Neural Circuits.

[91]  R. Traub,et al.  Axo-Axonal Coupling A Novel Mechanism for Ultrafast Neuronal Communication , 2001, Neuron.

[92]  Michael Okun,et al.  Instantaneous correlation of excitation and inhibition during ongoing and sensory-evoked activities , 2008, Nature Neuroscience.

[93]  Giacomo Indiveri,et al.  Sequential Activity in Asymmetrically Coupled Winner-Take-All Circuits , 2014, Neural Computation.

[94]  W. Senn,et al.  Matching Recall and Storage in Sequence Learning with Spiking Neural Networks , 2013, The Journal of Neuroscience.

[95]  Alexander J. Sadovsky,et al.  Scaling of Topologically Similar Functional Modules Defines Mouse Primary Auditory and Somatosensory Microcircuitry , 2013, The Journal of Neuroscience.

[96]  Markus Diesmann,et al.  Spike-Timing-Dependent Plasticity in Balanced Random Networks , 2007, Neural Computation.

[97]  Moshe Abeles,et al.  Synfire waves in small balanced networks , 2004, Neurocomputing.

[98]  David J. Foster,et al.  Dissociation between the Experience-Dependent Development of Hippocampal Theta Sequences and Single-Trial Phase Precession , 2015, The Journal of Neuroscience.

[99]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[100]  Anoopum S. Gupta,et al.  Segmentation of spatial experience by hippocampal theta sequences , 2012, Nature Neuroscience.

[101]  W. Gerstner,et al.  Triplets of Spikes in a Model of Spike Timing-Dependent Plasticity , 2006, The Journal of Neuroscience.

[102]  Laurenz Wiskott,et al.  A computational model for preplay in the hippocampus , 2013, Front. Comput. Neurosci..

[103]  S. Thomas Neuromodulatory signaling in hippocampus‐dependent memory retrieval , 2015, Hippocampus.

[104]  R. Traub,et al.  Axonal properties determine somatic firing in a model of in vitro CA1 hippocampal sharp wave/ripples and persistent gamma oscillations , 2012, The European journal of neuroscience.

[105]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[106]  George Dragoi,et al.  Distinct preplay of multiple novel spatial experiences in the rat , 2013, Proceedings of the National Academy of Sciences.

[107]  Ole Paulsen,et al.  Priming of Hippocampal Population Bursts by Individual Perisomatic-Targeting Interneurons , 2010, The Journal of Neuroscience.

[108]  M. Scanziani,et al.  Equalizing Excitation-Inhibition Ratios across Visual Cortical Neurons , 2014, Nature.

[109]  D. Ji,et al.  Rigid firing sequences undermine spatial memory codes in a neurodegenerative mouse model , 2013, eLife.

[110]  Markus Diesmann,et al.  High-capacity embedding of synfire chains in a cortical network model , 2012, Journal of Computational Neuroscience.

[111]  R. Kempter,et al.  Sparseness constrains the prolongation of memory lifetime via synaptic metaplasticity. , 2008, Cerebral cortex.

[112]  A. Aertsen,et al.  Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding , 2010, Nature Reviews Neuroscience.

[113]  Wulfram Gerstner,et al.  Stochastic variational learning in recurrent spiking networks , 2014, Front. Comput. Neurosci..

[114]  S. Romani,et al.  Short‐term plasticity based network model of place cells dynamics , 2015, Hippocampus.

[115]  N. Brunel,et al.  Calcium-based plasticity model explains sensitivity of synaptic changes to spike pattern, rate, and dendritic location , 2012, Proceedings of the National Academy of Sciences.

[116]  A. Grinvald,et al.  Spontaneously emerging cortical representations of visual attributes , 2003, Nature.

[117]  J. Born,et al.  The memory function of sleep , 2010, Nature Reviews Neuroscience.

[118]  W. Gerstner,et al.  Time structure of the activity in neural network models. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[119]  Silvia Scarpetta,et al.  Alternation of up and down states at a dynamical phase-transition of a neural network with spatiotemporal attractors , 2014, Front. Syst. Neurosci..

[120]  M. Hasselmo,et al.  Dynamics of learning and recall at excitatory recurrent synapses and cholinergic modulation in rat hippocampal region CA3 , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[121]  M. Bear,et al.  LTP and LTD An Embarrassment of Riches , 2004, Neuron.

[122]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .

[123]  D. R. Muir,et al.  Functional organization of excitatory synaptic strength in primary visual cortex , 2015, Nature.

[124]  Richard Kempter,et al.  Memory Capacity for Sequences in a Recurrent Network with Biological Constraints , 2006, Neural Computation.

[125]  T. Bliss,et al.  Long‐lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path , 1973, The Journal of physiology.

[126]  J. Csicsvari,et al.  Ensemble Patterns of Hippocampal CA3-CA1 Neurons during Sharp Wave–Associated Population Events , 2000, Neuron.

[127]  H. Atwood,et al.  Silent synapses in neural plasticity: current evidence. , 1999, Learning & memory.

[128]  G. Buzsáki,et al.  Forward and reverse hippocampal place-cell sequences during ripples , 2007, Nature Neuroscience.

[129]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.