Fast and Flexible Sequence Induction In Spiking Neural Networks Via Rapid Excitability Changes

Cognitive flexibility likely depends on modulation of the dynamics underlying how biological neural networks process information. While dynamics can be reshaped by gradually modifying connectivity, less is known about mechanisms operating on faster timescales. A compelling entrypoint to this problem is the observation that exploratory behaviors can rapidly cause selective hippocampal sequences to “replay” during rest. Using a spiking network model, we asked whether simplified replay could arise from three biological components: fixed recurrent connectivity; stochastic “gating” inputs; and rapid gating input scaling via long-term potentiation of intrinsic excitability (LTP-IE). Indeed, these enabled both forward and reverse replay of recent sensorimotor-evoked sequences, despite unchanged recurrent weights. LTP-IE “tags” specific neurons with increased spiking probability under gating input, and ordering is reconstructed from recurrent connectivity. We further show how LTP-IE can implement temporary stimulus-response mappings. This elucidates a novel combination of mechanisms that might play a role in rapid cognitive flexibility.

[1]  Dean V. Buonomano,et al.  ROBUST TIMING AND MOTOR PATTERNS BY TAMING CHAOS IN RECURRENT NEURAL NETWORKS , 2012, Nature Neuroscience.

[2]  Wolfgang Maass,et al.  Emergence of Dynamic Memory Traces in Cortical Microcircuit Models through STDP , 2013, The Journal of Neuroscience.

[3]  A. Raffone,et al.  A Cortical Mechanism for Binding in Visual Working Memory , 2001, Journal of Cognitive Neuroscience.

[4]  Richard Hans Robert Hahnloser,et al.  Spike-Time-Dependent Plasticity and Heterosynaptic Competition Organize Networks to Produce Long Scale-Free Sequences of Neural Activity , 2010, Neuron.

[5]  M. Tsodyks,et al.  Synaptic Theory of Working Memory , 2008, Science.

[6]  Wulfram Gerstner,et al.  Variational Learning for Recurrent Spiking Networks , 2011, NIPS.

[7]  J E Lisman,et al.  Storage of 7 +/- 2 short-term memories in oscillatory subcycles , 1995, Science.

[8]  Demetris K. Roumis,et al.  Coordinated Excitation and Inhibition of Prefrontal Ensembles during Awake Hippocampal Sharp-Wave Ripple Events , 2016, Neuron.

[9]  Sonja Grün,et al.  Detecting synfire chain activity using massively parallel spike train recording. , 2008, Journal of neurophysiology.

[10]  Marc Timme,et al.  Dynamic information routing in complex networks , 2015, Nature Communications.

[11]  Adam Prügel-Bennett,et al.  Analysis of synfire chains , 1995 .

[12]  Garrett Swan,et al.  The binding pool: A model of shared neural resources for distinct items in visual working memory , 2014, Attention, perception & psychophysics.

[13]  C. Hansel,et al.  Synaptic Potential and Plasticity of an SK2 Channel Gate Regulate Spike Burst Activity in Cerebellar Purkinje Cells , 2018, iScience.

[14]  T. Cachero,et al.  Tyrosine Phosphorylation of Kv1.2 Modulates Its Interaction with the Actin-binding Protein Cortactin* , 2002, The Journal of Biological Chemistry.

[15]  P. J. Sjöström,et al.  Functional specificity of local synaptic connections in neocortical networks , 2011, Nature.

[16]  Terrence J. Sejnowski,et al.  Place Cell Rate Remapping by CA3 Recurrent Collaterals , 2014, PLoS Comput. Biol..

[17]  Kamran Diba,et al.  Activity dynamics and behavioral correlates of CA3 and CA1 hippocampal pyramidal neurons , 2012, Hippocampus.

[18]  K. D. Punta,et al.  An ultra-sparse code underlies the generation of neural sequences in a songbird , 2002 .

[19]  L. Frank,et al.  Awake Hippocampal Sharp-Wave Ripples Support Spatial Memory , 2012, Science.

[20]  Matthew Cook,et al.  Unsupervised learning of digit recognition using spike-timing-dependent plasticity , 2015, Front. Comput. Neurosci..

[21]  A. Koulakov,et al.  Correlated Connectivity and the Distribution of Firing Rates in the Neocortex , 2008, The Journal of Neuroscience.

[22]  Vladimir Itskov,et al.  Flexible Memory Networks , 2010, Bulletin of mathematical biology.

[23]  Matthieu Gilson,et al.  Frontiers in Computational Neuroscience Computational Neuroscience , 2022 .

[24]  Wulfram Gerstner,et al.  Neuronal Dynamics: From Single Neurons To Networks And Models Of Cognition , 2014 .

[25]  Matthijs A. A. van der Meer,et al.  Hippocampal Replay Is Not a Simple Function of Experience , 2010, Neuron.

[26]  J. O’Keefe,et al.  Dual phase and rate coding in hippocampal place cells: Theoretical significance and relationship to entorhinal grid cells , 2005, Hippocampus.

[27]  Kyu-Hee Lee,et al.  Kv1.2 mediates heterosynaptic modulation of direct cortical synaptic inputs in CA3 pyramidal cells , 2015, The Journal of physiology.

[28]  J. Lisman Relating Hippocampal Circuitry to Function Recall of Memory Sequences by Reciprocal Dentate–CA3 Interactions , 1999, Neuron.

[29]  Emilie Campanac,et al.  Spike timing‐dependent plasticity: a learning rule for dendritic integration in rat CA1 pyramidal neurons , 2008, The Journal of physiology.

[30]  C. Lebiere,et al.  Conditional routing of information to the cortex: a model of the basal ganglia's role in cognitive coordination. , 2010, Psychological review.

[31]  G. Buzsáki,et al.  Sequential structure of neocortical spontaneous activity in vivo , 2007, Proceedings of the National Academy of Sciences.

[32]  Mattias P. Karlsson,et al.  Awake replay of remote experiences in the hippocampus , 2009, Nature Neuroscience.

[33]  G. Buzsáki,et al.  tFast Network Oscillations in the Hippocampal CA1 Region of the Behaving Rat , 1999, The Journal of Neuroscience.

[34]  David J. Foster,et al.  Sequence learning and the role of the hippocampus in rodent navigation , 2012, Current Opinion in Neurobiology.

[35]  Mu-Ming Poo,et al.  Spike-Timing Dependent Plasticity Beyond Synapse – Pre- and Post-Synaptic Plasticity of Intrinsic Neuronal Excitability , 2010, Front. Syn. Neurosci..

[36]  Richard B. Reilly,et al.  Medial septum regulates the hippocampal spatial representation , 2015, Front. Behav. Neurosci..

[37]  Colin Molter,et al.  Reactivation of behavioral activity during sharp waves: A computational model for two stage hippocampal dynamics , 2007, Hippocampus.

[38]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[39]  Susumu Tonegawa,et al.  Direct Medial Entorhinal Cortex Input to Hippocampal CA1 Is Crucial for Extended Quiet Awake Replay , 2017, Neuron.

[40]  E. Salinas Context-dependent selection of visuomotor maps , 2004, BMC Neuroscience.

[41]  Woodrow L. Shew,et al.  Neuronal Avalanches Imply Maximum Dynamic Range in Cortical Networks at Criticality , 2009, The Journal of Neuroscience.

[42]  J. O’Keefe A review of the hippocampal place cells , 1979, Progress in Neurobiology.

[43]  Yuji Ikegaya,et al.  Synfire Chains and Cortical Songs: Temporal Modules of Cortical Activity , 2004, Science.

[44]  David J. Foster,et al.  Reverse replay of behavioural sequences in hippocampal place cells during the awake state , 2006, Nature.

[45]  Wilten Nicola,et al.  Supervised learning in spiking neural networks with FORCE training , 2016, Nature Communications.

[46]  M. Hasselmo,et al.  Graded persistent activity in entorhinal cortex neurons , 2002, Nature.

[47]  J. Csicsvari,et al.  Ensemble Patterns of Hippocampal CA3-CA1 Neurons during Sharp Wave–Associated Population Events , 2000, Neuron.

[48]  John M. Beggs,et al.  Behavioral / Systems / Cognitive Neuronal Avalanches Are Diverse and Precise Activity Patterns That Are Stable for Many Hours in Cortical Slice Cultures , 2004 .

[49]  P. Dayan,et al.  The Involvement of Recurrent Connections in Area CA3 in Establishing the Properties of Place Fields: a Model , 2000, The Journal of Neuroscience.

[50]  Tim Shallice,et al.  Neuropsychological impairments of short-term memory , 1992 .

[51]  Devika Narain,et al.  Flexible sensorimotor computations through rapid reconfiguration of cortical dynamics , 2018 .

[52]  T. Shallice,et al.  Comprar Neuropsychological Impairments of Short-Term Memory | Tim Shallice | 9780521042758 | Cambridge University Press , 2007 .

[53]  J. O’Keefe,et al.  Space in the brain: how the hippocampal formation supports spatial cognition , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[54]  M. Moser,et al.  Pattern Separation in the Dentate Gyrus and CA3 of the Hippocampus , 2007, Science.

[55]  Bruno B Averbeck,et al.  Rapid Sequences of Population Activity Patterns Dynamically Encode Task-Critical Spatial Information in Parietal Cortex , 2010, The Journal of Neuroscience.

[56]  Emilio Salinas,et al.  Fast Remapping of Sensory Stimuli onto Motor Actions on the Basis of Contextual Modulation , 2004, The Journal of Neuroscience.

[57]  Kartik K. Sreenivasan,et al.  Revisiting the role of persistent neural activity during working memory , 2014, Trends in Cognitive Sciences.

[58]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[59]  J. Isaac,et al.  Hippocampal Place Cell Firing Patterns Can Induce Long-Term Synaptic Plasticity In Vitro , 2009, The Journal of Neuroscience.

[60]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[61]  D. Debanne,et al.  Long-term plasticity of intrinsic excitability: learning rules and mechanisms. , 2003, Learning & memory.

[62]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[63]  Dimitri M. Kullmann,et al.  Oscillations and Filtering Networks Support Flexible Routing of Information , 2010, Neuron.

[64]  Matthijs A. A. van der Meer,et al.  Internally generated sequences in learning and executing goal-directed behavior , 2014, Trends in Cognitive Sciences.

[65]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[66]  Christopher D. Harvey,et al.  Recurrent Network Models of Sequence Generation and Memory , 2016, Neuron.

[67]  Emilio Kropff,et al.  Place cells, grid cells, and the brain's spatial representation system. , 2008, Annual review of neuroscience.

[68]  David J. Foster,et al.  Memory and Space: Towards an Understanding of the Cognitive Map , 2015, The Journal of Neuroscience.

[69]  Dominique Debanne,et al.  Bidirectional plasticity of excitatory postsynaptic potential (EPSP)-spike coupling in CA1 hippocampal pyramidal neurons , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[70]  K. Pang,et al.  Involvement of GABAergic and cholinergic medial septal neurons in hippocampal theta rhythm , 2005, Hippocampus.

[71]  G. Buzsáki Hippocampal sharp waves: Their origin and significance , 1986, Brain Research.

[72]  W. Penny,et al.  Theta-Coupled Periodic Replay in Working Memory , 2010, Current Biology.

[73]  David W. Nauen,et al.  Coactivation and timing-dependent integration of synaptic potentiation and depression , 2005, Nature Neuroscience.

[74]  C. Barry,et al.  The Role of Hippocampal Replay in Memory and Planning , 2018, Current Biology.

[75]  S. Scarpetta,et al.  Neural Avalanches at the Critical Point between Replay and Non-Replay of Spatiotemporal Patterns , 2013, PloS one.

[76]  Matthew Botvinick,et al.  From Numerosity to Ordinal Rank: A Gain-Field Model of Serial Order Representation in Cortical Working Memory , 2007, The Journal of Neuroscience.

[77]  C. Barry,et al.  Task Demands Predict a Dynamic Switch in the Content of Awake Hippocampal Replay , 2017, Neuron.

[78]  Michael McCloskey,et al.  Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem , 1989 .

[79]  Asohan Amarasingham,et al.  Internally Generated Cell Assembly Sequences in the Rat Hippocampus , 2008, Science.

[80]  N. Brunel,et al.  Toward a Neurocentric View of Learning , 2017, Neuron.

[81]  G. Buzsáki,et al.  Preconfigured, skewed distribution of firing rates in the hippocampus and entorhinal cortex. , 2013, Cell reports.

[82]  Zachary P. Kilpatrick,et al.  Networks that learn the precise timing of event sequences , 2014, bioRxiv.

[83]  Tomoki Fukai,et al.  Recurrent network model for learning goal-directed sequences through reverse replay , 2017, bioRxiv.

[84]  D. Linden,et al.  The other side of the engram: experience-driven changes in neuronal intrinsic excitability , 2003, Nature Reviews Neuroscience.

[85]  R. Yuste,et al.  Imprinting and recalling cortical ensembles , 2016, Science.

[86]  Nachum Ulanovsky,et al.  Representation of Three-Dimensional Space in the Hippocampus of Flying Bats , 2013, Science.

[87]  M Abeles,et al.  Synchronization in neuronal transmission and its importance for information processing. , 1994, Progress in brain research.

[88]  Pierre Yger,et al.  Fast Learning with Weak Synaptic Plasticity , 2015, The Journal of Neuroscience.

[89]  S Leutgeb,et al.  Convergence of Head Direction and Place Information in the Ca1 Region of Hippocampus Subjects and Behavioral Testing , 2000 .

[90]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[91]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[92]  G. Shepherd,et al.  Single‐axon action potentials in the rat hippocampal cortex , 2003, The Journal of physiology.

[93]  Kyu-Hee Lee,et al.  Activity‐dependent downregulation of D‐type K+ channel subunit Kv1.2 in rat hippocampal CA3 pyramidal neurons , 2013, The Journal of physiology.

[94]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[95]  Valentin Dragoi,et al.  Image sequence reactivation in awake V4 networks , 2012, Proceedings of the National Academy of Sciences.

[96]  D. Georgescauld Local Cortical Circuits, An Electrophysiological Study , 1983 .

[97]  Y. Dan,et al.  Spike timing-dependent plasticity: a Hebbian learning rule. , 2008, Annual review of neuroscience.

[98]  Y. Dan,et al.  Spike Timing-Dependent Plasticity of Neural Circuits , 2004, Neuron.

[99]  G. Buzsáki,et al.  Gamma Oscillation by Synaptic Inhibition in a Hippocampal Interneuronal Network Model , 1996, The Journal of Neuroscience.

[100]  E. Pastalkova,et al.  Clique topology reveals intrinsic geometric structure in neural correlations , 2015, Proceedings of the National Academy of Sciences.

[101]  Brad E. Pfeiffer,et al.  Hippocampal place cell sequences depict future paths to remembered goals , 2013, Nature.

[102]  D. Plenz,et al.  The organizing principles of neuronal avalanches: cell assemblies in the cortex? , 2007, Trends in Neurosciences.

[103]  J. Lisman Working Memory: The Importance of Theta and Gamma Oscillations , 2010, Current Biology.

[104]  Dean V. Buonomano,et al.  Unsupervised Formation of Vocalization-Sensitive Neurons: A Cortical Model Based on Short-Term and Homeostatic Plasticity , 2012, Neural Computation.

[105]  Christopher D. Harvey,et al.  Choice-specific sequences in parietal cortex during a virtual-navigation decision task , 2012, Nature.

[106]  M. Wilson,et al.  Disruption of ripple‐associated hippocampal activity during rest impairs spatial learning in the rat , 2009, Hippocampus.

[107]  L. Abbott,et al.  Cortical Development and Remapping through Spike Timing-Dependent Plasticity , 2001, Neuron.

[108]  Michele Pignatelli,et al.  Engram Cell Excitability State Determines the Efficacy of Memory Retrieval , 2019, Neuron.

[109]  Bruno Delord,et al.  Multiple forms of activity‐dependent intrinsic plasticity in layer V cortical neurones in vivo , 2009, The Journal of physiology.

[110]  B. McNaughton,et al.  The contributions of position, direction, and velocity to single unit activity in the hippocampus of freely-moving rats , 1983, Experimental Brain Research.

[111]  Christophe Mulle,et al.  Operation and plasticity of hippocampal CA3 circuits: implications for memory encoding , 2017, Nature Reviews Neuroscience.

[112]  Matthew A. Wilson,et al.  Hippocampal Replay of Extended Experience , 2009, Neuron.

[113]  Richard Kempter,et al.  Memory replay in balanced recurrent networks , 2016, bioRxiv.

[114]  Dominique Debanne,et al.  Long-Term Enhancement of Neuronal Excitability and Temporal Fidelity Mediated by Metabotropic Glutamate Receptor Subtype 5 , 2003, The Journal of Neuroscience.

[115]  G Horn,et al.  An analysis of spontaneous impulse activity of units in the striate cortex of unrestrained cats , 1966, The Journal of physiology.

[116]  S. Thorpe,et al.  Spike Timing Dependent Plasticity Finds the Start of Repeating Patterns in Continuous Spike Trains , 2008, PloS one.

[117]  Richard Hans Robert Hahnloser,et al.  An ultra-sparse code underliesthe generation of neural sequences in a songbird , 2002, Nature.

[118]  Shantanu P. Jadhav,et al.  The role of replay and theta sequences in mediating hippocampal‐prefrontal interactions for memory and cognition , 2020, Hippocampus.

[119]  Margaret F. Carr,et al.  Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval , 2011, Nature Neuroscience.

[120]  C. Stark,et al.  Pattern Separation in the Human Hippocampal CA3 and Dentate Gyrus , 2008, Science.

[121]  Nikos K. Logothetis,et al.  Dissecting the Synapse- and Frequency-Dependent Network Mechanisms of In Vivo Hippocampal Sharp Wave-Ripples , 2018, Neuron.