Strong inhibitory signaling underlies stable temporal dynamics and working memory in spiking neural networks

Cortical neurons process information on multiple timescales, and areas important for working memory (WM) contain neurons capable of integrating information over a long timescale. However, the underlying mechanisms for the emergence of neuronal timescales stable enough to support WM are unclear. By analyzing a spiking recurrent neural network (RNN) model trained on a WM task and activity of single neurons in the primate prefrontal cortex, we show that the temporal properties of our model and the neural data are remarkably similar. Dissecting our RNN model revealed strong inhibitory-to-inhibitory connections underlying a disinhibitory microcircuit as a critical component for long neuronal timescales and WM maintenance. We also found that enhancing inhibitory-to-inhibitory connections led to more stable temporal dynamics and improved task performance. Finally, we show that a network with such microcircuitry can perform other tasks without disrupting its pre-existing timescale architecture, suggesting that strong inhibitory signaling underlies a flexible WM network.

[1]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[2]  R. Desimone,et al.  Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque , 1996, The Journal of Neuroscience.

[3]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[4]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[5]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[6]  C. Constantinidis,et al.  Persistent discharges in the prefrontal cortex of monkeys naive to working memory tasks. , 2007, Cerebral cortex.

[7]  H. Barbas,et al.  Synapses with Inhibitory Neurons Differentiate Anterior Cingulate from Dorsolateral Prefrontal Pathways Associated with Cognitive Control , 2009, Neuron.

[8]  T. Stanford,et al.  Changes in prefrontal neuronal activity after learning to perform a spatial working memory task. , 2011, Cerebral cortex.

[9]  T. Stanford,et al.  Stimulus Selectivity in Dorsal and Ventral Prefrontal Cortex after Training in Working Memory Tasks , 2011, The Journal of Neuroscience.

[10]  Joshua I. Sanders,et al.  Cortical interneurons that specialize in disinhibitory control , 2013, Nature.

[11]  N. Sigala,et al.  Dynamic Coding for Cognitive Control in Prefrontal Cortex , 2013, Neuron.

[12]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[13]  M. Scanziani,et al.  Inhibition of Inhibition in Visual Cortex: The Logic of Connections Between Molecularly Distinct Interneurons , 2013, Nature Neuroscience.

[14]  A. Compte,et al.  Bump attractor dynamics in prefrontal cortex explains behavioral precision in spatial working memory , 2014, Nature Neuroscience.

[15]  David J. Freedman,et al.  A hierarchy of intrinsic timescales across primate cortex , 2014, Nature Neuroscience.

[16]  G. Fishell,et al.  Interneuron cell types are fit to function , 2014, Nature.

[17]  H. Kennedy,et al.  A Large-Scale Circuit Mechanism for Hierarchical Dynamical Processing in the Primate Cortex , 2015, Neuron.

[18]  Guangyu R. Yang,et al.  Training Excitatory-Inhibitory Recurrent Neural Networks for Cognitive Tasks: A Simple and Flexible Framework , 2016, PLoS Comput. Biol..

[19]  R. Yuste,et al.  Opening Holes in the Blanket of Inhibition: Localized Lateral Disinhibition by VIP Interneurons , 2016, The Journal of Neuroscience.

[20]  Dohoung Kim,et al.  Distinct Roles of Parvalbumin- and Somatostatin-Expressing Interneurons in Working Memory , 2016, Neuron.

[21]  Xiao-Jing Wang,et al.  A dendritic disinhibitory circuit mechanism for pathway-specific gating , 2016, Nature Communications.

[22]  S. Cavanagh,et al.  Autocorrelation structure at rest predicts value correlates of single neurons during reward-guided choice , 2016, eLife.

[23]  R. Tremblay,et al.  GABAergic Interneurons in the Neocortex: From Cellular Properties to Circuits , 2016, Neuron.

[24]  Thomas Miconi,et al.  Biologically plausible learning in recurrent neural networks reproduces neural dynamics observed during cognitive tasks , 2016, bioRxiv.

[25]  Jessica A. Cardin,et al.  Developmental Dysfunction of VIP Interneurons Impairs Cortical Circuits , 2016, Neuron.

[26]  S. Cavanagh,et al.  Reconciling persistent and dynamic hypotheses of working memory coding in prefrontal cortex , 2017, bioRxiv.

[27]  M. Medalla,et al.  Strength and Diversity of Inhibitory Signaling Differentiates Primate Anterior Cingulate from Lateral Prefrontal Cortex , 2017, The Journal of Neuroscience.

[28]  Miao He,et al.  Brain-wide Maps Reveal Stereotyped Cell-Type-Based Cortical Architecture and Subcortical Sexual Dimorphism , 2017, Cell.

[29]  Y. Dan,et al.  Delay Activity of Specific Prefrontal Interneuron Subtypes Modulates Memory-Guided Behavior , 2017, Nature Neuroscience.

[30]  Thomas Miconi Biologically plausible learning in recurrent neural networks reproduces neural dynamics observed during cognitive tasks , 2017 .

[31]  S. Funahashi,et al.  Stable and Dynamic Coding for Working Memory in Primate Prefrontal Cortex , 2017, The Journal of Neuroscience.

[32]  G. Mongillo,et al.  Inhibitory connectivity defines the realm of excitatory plasticity , 2018, Nature Neuroscience.

[33]  Xiao-Jing Wang,et al.  A disinhibitory circuit motif and flexible information routing in the brain , 2018, Current Opinion in Neurobiology.

[34]  Flora Bouchacourt,et al.  A flexible model of working memory , 2018 .

[35]  Steven W Kennerley,et al.  Reconciling persistent and dynamic hypotheses of working memory coding in prefrontal cortex , 2017, Nature Communications.

[36]  E. Miller,et al.  Intrinsic neuronal dynamics predict distinct functional roles during working memory , 2017, Nature Communications.

[37]  Jan Gründemann,et al.  Adaptive disinhibitory gating by VIP interneurons permits associative learning , 2018, bioRxiv.

[38]  Jan Gründemann,et al.  Adaptive disinhibitory gating by VIP interneurons permits associative learning , 2019, Nature Neuroscience.

[39]  Terrence J. Sejnowski,et al.  Simple framework for constructing functional spiking recurrent neural networks , 2019, Proceedings of the National Academy of Sciences.

[40]  Xiao-Jing Wang,et al.  Task representations in neural networks trained to perform many cognitive tasks , 2019, Nature Neuroscience.

[41]  Miao He,et al.  A Disinhibitory Microcircuit Mediates Conditioned Social Fear in the Prefrontal Cortex , 2019, Neuron.

[42]  Terrence J Sejnowski,et al.  Simple framework for constructing functional spiking recurrent neural networks , 2019, Proceedings of the National Academy of Sciences.

[43]  V. Fascianelli,et al.  Autocorrelation Structure in the Macaque Dorsolateral, But not Orbital or Polar, Prefrontal Cortex Predicts Response-Coding Strength in a Visually Cued Strategy Task , 2019, Cerebral cortex.

[44]  Wei Ji Ma,et al.  A diverse range of factors affect the nature of neural representations underlying short-term memory , 2018, Nature Neuroscience.

[45]  Kirstie A. Cummings,et al.  Prefrontal somatostatin interneurons encode fear memory , 2019, Nature Neuroscience.

[46]  Kirstie A. Cummings,et al.  Prefrontal somatostatin interneurons encode fear memory , 2019, bioRxiv.