Fast and flexible sequence induction in spiking neural networks via rapid excitability changes

Cognitive flexibility likely depends on modulation of the dynamics underlying how biological neural networks process information. While dynamics can be reshaped by gradually modifying connectivity, less is known about mechanisms operating on faster timescales. A compelling entrypoint to this problem is the observation that exploratory behaviors can rapidly cause selective hippocampal sequences to ‘replay’ during rest. Using a spiking network model, we asked whether simplified replay could arise from three biological components: fixed recurrent connectivity; stochastic ‘gating’ inputs; and rapid gating input scaling via long-term potentiation of intrinsic excitability (LTP-IE). Indeed, these enabled both forward and reverse replay of recent sensorimotor-evoked sequences, despite unchanged recurrent weights. LTP-IE ‘tags’ specific neurons with increased spiking probability under gating input, and ordering is reconstructed from recurrent connectivity. We further show how LTP-IE can implement temporary stimulus-response mappings. This elucidates a novel combination of mechanisms that might play a role in rapid cognitive flexibility.

[1]  W. Penny,et al.  Theta-Coupled Periodic Replay in Working Memory , 2010, Current Biology.

[2]  David W. Nauen,et al.  Coactivation and timing-dependent integration of synaptic potentiation and depression , 2005, Nature Neuroscience.

[3]  S. Scarpetta,et al.  Neural Avalanches at the Critical Point between Replay and Non-Replay of Spatiotemporal Patterns , 2013, PloS one.

[4]  C. Barry,et al.  Task Demands Predict a Dynamic Switch in the Content of Awake Hippocampal Replay , 2017, Neuron.

[5]  Tomoki Fukai,et al.  Recurrent network model for learning goal-directed sequences through reverse replay , 2017, bioRxiv.

[6]  Sonja Grün,et al.  Detecting synfire chain activity using massively parallel spike train recording. , 2008, Journal of neurophysiology.

[7]  Zachary P. Kilpatrick,et al.  Networks that learn the precise timing of event sequences , 2014, bioRxiv.

[8]  L. Frank,et al.  Awake Hippocampal Sharp-Wave Ripples Support Spatial Memory , 2012, Science.

[9]  D. Linden,et al.  The other side of the engram: experience-driven changes in neuronal intrinsic excitability , 2003, Nature Reviews Neuroscience.

[10]  R. Yuste,et al.  Imprinting and recalling cortical ensembles , 2016, Science.

[11]  Kartik K. Sreenivasan,et al.  Revisiting the role of persistent neural activity during working memory , 2014, Trends in Cognitive Sciences.

[12]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[13]  J. Isaac,et al.  Hippocampal Place Cell Firing Patterns Can Induce Long-Term Synaptic Plasticity In Vitro , 2009, The Journal of Neuroscience.

[14]  Matthew Cook,et al.  Unsupervised learning of digit recognition using spike-timing-dependent plasticity , 2015, Front. Comput. Neurosci..

[15]  A. Koulakov,et al.  Correlated Connectivity and the Distribution of Firing Rates in the Neocortex , 2008, The Journal of Neuroscience.

[16]  G. Buzsáki Hippocampal sharp waves: Their origin and significance , 1986, Brain Research.

[17]  Vladimir Itskov,et al.  Flexible Memory Networks , 2010, Bulletin of mathematical biology.

[18]  Matthijs A. A. van der Meer,et al.  Hippocampal Replay Is Not a Simple Function of Experience , 2010, Neuron.

[19]  Matthieu Gilson,et al.  Frontiers in Computational Neuroscience Computational Neuroscience , 2022 .

[20]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[21]  J. O’Keefe,et al.  Dual phase and rate coding in hippocampal place cells: Theoretical significance and relationship to entorhinal grid cells , 2005, Hippocampus.

[22]  E. Salinas Context-dependent selection of visuomotor maps , 2004, BMC Neuroscience.

[23]  Woodrow L. Shew,et al.  Neuronal Avalanches Imply Maximum Dynamic Range in Cortical Networks at Criticality , 2009, The Journal of Neuroscience.

[24]  J. O’Keefe A review of the hippocampal place cells , 1979, Progress in Neurobiology.

[25]  C. Barry,et al.  The Role of Hippocampal Replay in Memory and Planning , 2018, Current Biology.

[26]  Yuji Ikegaya,et al.  Synfire Chains and Cortical Songs: Temporal Modules of Cortical Activity , 2004, Science.

[27]  David J. Foster,et al.  Reverse replay of behavioural sequences in hippocampal place cells during the awake state , 2006, Nature.

[28]  Devika Narain,et al.  Flexible Sensorimotor Computations through Rapid Reconfiguration of Cortical Dynamics , 2018, Neuron.

[29]  E. Vaadia,et al.  Synchronization in neuronal transmission and its importance for information processing. , 1994 .

[30]  M. Moser,et al.  Pattern Separation in the Dentate Gyrus and CA3 of the Hippocampus , 2007, Science.

[31]  Nachum Ulanovsky,et al.  Representation of Three-Dimensional Space in the Hippocampus of Flying Bats , 2013, Science.

[32]  M. Tsodyks,et al.  Synaptic Theory of Working Memory , 2008, Science.

[33]  J E Lisman,et al.  Storage of 7 +/- 2 short-term memories in oscillatory subcycles , 1995, Science.

[34]  D. Debanne,et al.  Long-term plasticity of intrinsic excitability: learning rules and mechanisms. , 2003, Learning & memory.

[35]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[36]  Y. Dan,et al.  Spike timing-dependent plasticity: a Hebbian learning rule. , 2008, Annual review of neuroscience.

[37]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[38]  Christopher D. Harvey,et al.  Recurrent Network Models of Sequence Generation and Memory , 2016, Neuron.

[39]  Y. Dan,et al.  Spike Timing-Dependent Plasticity of Neural Circuits , 2004, Neuron.

[40]  Mattias P. Karlsson,et al.  Awake replay of remote experiences in the hippocampus , 2009, Nature Neuroscience.

[41]  G. Buzsáki,et al.  tFast Network Oscillations in the Hippocampal CA1 Region of the Behaving Rat , 1999, The Journal of Neuroscience.

[42]  Wilten Nicola,et al.  Supervised learning in spiking neural networks with FORCE training , 2016, Nature Communications.

[43]  Matthew Botvinick,et al.  From Numerosity to Ordinal Rank: A Gain-Field Model of Serial Order Representation in Cortical Working Memory , 2007, The Journal of Neuroscience.

[44]  Michael McCloskey,et al.  Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem , 1989 .

[45]  Asohan Amarasingham,et al.  Internally Generated Cell Assembly Sequences in the Rat Hippocampus , 2008, Science.

[46]  N. Brunel,et al.  Toward a Neurocentric View of Learning , 2017, Neuron.

[47]  Brad E. Pfeiffer,et al.  Hippocampal place cell sequences depict future paths to remembered goals , 2013, Nature.

[48]  M. Hasselmo,et al.  Graded persistent activity in entorhinal cortex neurons , 2002, Nature.

[49]  J. O’Keefe,et al.  Space in the brain: how the hippocampal formation supports spatial cognition , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[50]  Bruno B Averbeck,et al.  Rapid Sequences of Population Activity Patterns Dynamically Encode Task-Critical Spatial Information in Parietal Cortex , 2010, The Journal of Neuroscience.

[51]  Emilio Salinas,et al.  Fast Remapping of Sensory Stimuli onto Motor Actions on the Basis of Contextual Modulation , 2004, The Journal of Neuroscience.

[52]  M. Wilson,et al.  Disruption of ripple‐associated hippocampal activity during rest impairs spatial learning in the rat , 2009, Hippocampus.

[53]  L. Abbott,et al.  Cortical Development and Remapping through Spike Timing-Dependent Plasticity , 2001, Neuron.

[54]  Michele Pignatelli,et al.  Engram Cell Excitability State Determines the Efficacy of Memory Retrieval , 2019, Neuron.

[55]  Susumu Tonegawa,et al.  Direct Medial Entorhinal Cortex Input to Hippocampal CA1 Is Crucial for Extended Quiet Awake Replay , 2017, Neuron.

[56]  J. Lisman Relating Hippocampal Circuitry to Function Recall of Memory Sequences by Reciprocal Dentate–CA3 Interactions , 1999, Neuron.

[57]  Kyu-Hee Lee,et al.  Activity‐dependent downregulation of D‐type K+ channel subunit Kv1.2 in rat hippocampal CA3 pyramidal neurons , 2013, The Journal of physiology.

[58]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[59]  Valentin Dragoi,et al.  Image sequence reactivation in awake V4 networks , 2012, Proceedings of the National Academy of Sciences.

[60]  Richard B. Reilly,et al.  Medial septum regulates the hippocampal spatial representation , 2015, Front. Behav. Neurosci..

[61]  Emilio Kropff,et al.  Place cells, grid cells, and the brain's spatial representation system. , 2008, Annual review of neuroscience.

[62]  S Leutgeb,et al.  Convergence of Head Direction and Place Information in the Ca1 Region of Hippocampus Subjects and Behavioral Testing , 2000 .

[63]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[64]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[65]  D. Plenz,et al.  The organizing principles of neuronal avalanches: cell assemblies in the cortex? , 2007, Trends in Neurosciences.

[66]  J. Lisman Working Memory: The Importance of Theta and Gamma Oscillations , 2010, Current Biology.

[67]  Dean V. Buonomano,et al.  Unsupervised Formation of Vocalization-Sensitive Neurons: A Cortical Model Based on Short-Term and Homeostatic Plasticity , 2012, Neural Computation.

[68]  Emilie Campanac,et al.  Spike timing‐dependent plasticity: a learning rule for dendritic integration in rat CA1 pyramidal neurons , 2008, The Journal of physiology.

[69]  Colin Molter,et al.  Reactivation of behavioral activity during sharp waves: A computational model for two stage hippocampal dynamics , 2007, Hippocampus.

[70]  J. Csicsvari,et al.  Ensemble Patterns of Hippocampal CA3-CA1 Neurons during Sharp Wave–Associated Population Events , 2000, Neuron.

[71]  John M. Beggs,et al.  Behavioral / Systems / Cognitive Neuronal Avalanches Are Diverse and Precise Activity Patterns That Are Stable for Many Hours in Cortical Slice Cultures , 2004 .

[72]  P. Dayan,et al.  The Involvement of Recurrent Connections in Area CA3 in Establishing the Properties of Place Fields: a Model , 2000, The Journal of Neuroscience.

[73]  Professor Moshe Abeles,et al.  Local Cortical Circuits , 1982, Studies of Brain Function.

[74]  Tim Shallice,et al.  Neuropsychological impairments of short-term memory , 1992 .

[75]  Richard Kempter,et al.  Memory replay in balanced recurrent networks , 2016, bioRxiv.

[76]  Christopher D. Harvey,et al.  Choice-specific sequences in parietal cortex during a virtual-navigation decision task , 2012, Nature.

[77]  C. Hansel,et al.  Synaptic Potential and Plasticity of an SK2 Channel Gate Regulate Spike Burst Activity in Cerebellar Purkinje Cells , 2018, iScience.

[78]  G. Buzsáki,et al.  Preconfigured, skewed distribution of firing rates in the hippocampus and entorhinal cortex. , 2013, Cell reports.

[79]  T. Cachero,et al.  Tyrosine Phosphorylation of Kv1.2 Modulates Its Interaction with the Actin-binding Protein Cortactin* , 2002, The Journal of Biological Chemistry.

[80]  P. J. Sjöström,et al.  Functional specificity of local synaptic connections in neocortical networks , 2011, Nature.

[81]  Terrence J. Sejnowski,et al.  Place Cell Rate Remapping by CA3 Recurrent Collaterals , 2014, PLoS Comput. Biol..

[82]  Kamran Diba,et al.  Activity dynamics and behavioral correlates of CA3 and CA1 hippocampal pyramidal neurons , 2012, Hippocampus.

[83]  Dean V. Buonomano,et al.  ROBUST TIMING AND MOTOR PATTERNS BY TAMING CHAOS IN RECURRENT NEURAL NETWORKS , 2012, Nature Neuroscience.

[84]  Wolfgang Maass,et al.  Emergence of Dynamic Memory Traces in Cortical Microcircuit Models through STDP , 2013, The Journal of Neuroscience.

[85]  A. Raffone,et al.  A Cortical Mechanism for Binding in Visual Working Memory , 2001, Journal of Cognitive Neuroscience.

[86]  E. Pastalkova,et al.  Clique topology reveals intrinsic geometric structure in neural correlations , 2015, Proceedings of the National Academy of Sciences.

[87]  Dominique Debanne,et al.  Long-Term Enhancement of Neuronal Excitability and Temporal Fidelity Mediated by Metabotropic Glutamate Receptor Subtype 5 , 2003, The Journal of Neuroscience.

[88]  G Horn,et al.  An analysis of spontaneous impulse activity of units in the striate cortex of unrestrained cats , 1966, The Journal of physiology.

[89]  S. Thorpe,et al.  Spike Timing Dependent Plasticity Finds the Start of Repeating Patterns in Continuous Spike Trains , 2008, PloS one.

[90]  Richard Hans Robert Hahnloser,et al.  An ultra-sparse code underliesthe generation of neural sequences in a songbird , 2002, Nature.

[91]  Pierre Yger,et al.  Fast Learning with Weak Synaptic Plasticity , 2015, The Journal of Neuroscience.

[92]  Bruno Delord,et al.  Multiple forms of activity‐dependent intrinsic plasticity in layer V cortical neurones in vivo , 2009, The Journal of physiology.

[93]  Christophe Mulle,et al.  Operation and plasticity of hippocampal CA3 circuits: implications for memory encoding , 2017, Nature Reviews Neuroscience.

[94]  Shantanu P. Jadhav,et al.  The role of replay and theta sequences in mediating hippocampal‐prefrontal interactions for memory and cognition , 2020, Hippocampus.

[95]  Margaret F. Carr,et al.  Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval , 2011, Nature Neuroscience.

[96]  C. Stark,et al.  Pattern Separation in the Human Hippocampal CA3 and Dentate Gyrus , 2008, Science.

[97]  Nikos K. Logothetis,et al.  Dissecting the Synapse- and Frequency-Dependent Network Mechanisms of In Vivo Hippocampal Sharp Wave-Ripples , 2018, Neuron.

[98]  Matthew A. Wilson,et al.  Hippocampal Replay of Extended Experience , 2009, Neuron.

[99]  David J. Foster,et al.  Memory and Space: Towards an Understanding of the Cognitive Map , 2015, The Journal of Neuroscience.

[100]  Dominique Debanne,et al.  Bidirectional plasticity of excitatory postsynaptic potential (EPSP)-spike coupling in CA1 hippocampal pyramidal neurons , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[101]  K. Pang,et al.  Involvement of GABAergic and cholinergic medial septal neurons in hippocampal theta rhythm , 2005, Hippocampus.

[102]  Adam Prügel-Bennett,et al.  Analysis of synfire chains , 1995 .

[103]  Garrett Swan,et al.  The binding pool: A model of shared neural resources for distinct items in visual working memory , 2014, Attention, perception & psychophysics.

[104]  Kyu-Hee Lee,et al.  Kv1.2 mediates heterosynaptic modulation of direct cortical synaptic inputs in CA3 pyramidal cells , 2015, The Journal of physiology.

[105]  Richard Hans Robert Hahnloser,et al.  Spike-Time-Dependent Plasticity and Heterosynaptic Competition Organize Networks to Produce Long Scale-Free Sequences of Neural Activity , 2010, Neuron.

[106]  Wulfram Gerstner,et al.  Variational Learning for Recurrent Spiking Networks , 2011, NIPS.

[107]  G. Buzsáki,et al.  Sequential structure of neocortical spontaneous activity in vivo , 2007, Proceedings of the National Academy of Sciences.

[108]  David J. Foster,et al.  Sequence learning and the role of the hippocampus in rodent navigation , 2012, Current Opinion in Neurobiology.

[109]  Mu-Ming Poo,et al.  Spike-Timing Dependent Plasticity Beyond Synapse – Pre- and Post-Synaptic Plasticity of Intrinsic Neuronal Excitability , 2010, Front. Syn. Neurosci..