Strong inhibitory signaling underlies stable temporal dynamics and working memory in spiking neural networks

Cortical neurons process information on multiple timescales, and areas important for working memory (WM) contain neurons capable of integrating information over a long timescale. However, the underlying mechanisms for the emergence of neuronal timescales stable enough to support WM are unclear. By analyzing a spiking recurrent neural network model trained on a WM task and activity of single neurons in the primate prefrontal cortex, we show that the temporal properties of our model and the neural data are remarkably similar. Dissecting our recurrent neural network model revealed strong inhibitory-to-inhibitory connections underlying a disinhibitory microcircuit as a critical component for long neuronal timescales and WM maintenance. We also found that enhancing inhibitory-to-inhibitory connections led to more stable temporal dynamics and improved task performance. Finally, we show that a network with such microcircuitry can perform other tasks without disrupting its pre-existing timescale architecture, suggesting that strong inhibitory signaling underlies a flexible WM network. By analyzing computational models and neural data from the primate prefrontal cortex, the authors show that inhibitory-to-inhibitory signaling is critical for the stable temporal dynamics required for performing working memory tasks.

[1]  H. Barbas,et al.  Synapses with Inhibitory Neurons Differentiate Anterior Cingulate from Dorsolateral Prefrontal Pathways Associated with Cognitive Control , 2009, Neuron.

[2]  M. Scanziani,et al.  Inhibition of Inhibition in Visual Cortex: The Logic of Connections Between Molecularly Distinct Interneurons , 2013, Nature Neuroscience.

[3]  Jan Gründemann,et al.  Adaptive disinhibitory gating by VIP interneurons permits associative learning , 2019, Nature Neuroscience.

[4]  Wei Ji Ma,et al.  A diverse range of factors affect the nature of neural representations underlying short-term memory , 2018, Nature Neuroscience.

[5]  C. Constantinidis,et al.  Persistent discharges in the prefrontal cortex of monkeys naive to working memory tasks. , 2007, Cerebral cortex.

[6]  S. Cavanagh,et al.  Autocorrelation structure at rest predicts value correlates of single neurons during reward-guided choice , 2016, eLife.

[7]  T. Stanford,et al.  Changes in prefrontal neuronal activity after learning to perform a spatial working memory task. , 2011, Cerebral cortex.

[8]  Xiao-Jing Wang,et al.  Task representations in neural networks trained to perform many cognitive tasks , 2019, Nature Neuroscience.

[9]  G. Mongillo,et al.  Inhibitory connectivity defines the realm of excitatory plasticity , 2018, Nature Neuroscience.

[10]  Flora Bouchacourt,et al.  A Flexible Model of Working Memory , 2019, Neuron.

[11]  R. Desimone,et al.  Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque , 1996, The Journal of Neuroscience.

[12]  T. Stanford,et al.  Stimulus Selectivity in Dorsal and Ventral Prefrontal Cortex after Training in Working Memory Tasks , 2011, The Journal of Neuroscience.

[13]  Joshua I. Sanders,et al.  Cortical interneurons that specialize in disinhibitory control , 2013, Nature.

[14]  Terrence J Sejnowski,et al.  Simple framework for constructing functional spiking recurrent neural networks , 2019, Proceedings of the National Academy of Sciences.

[15]  N. Sigala,et al.  Dynamic Coding for Cognitive Control in Prefrontal Cortex , 2013, Neuron.

[16]  S. Funahashi,et al.  Stable and Dynamic Coding for Working Memory in Primate Prefrontal Cortex , 2017, The Journal of Neuroscience.

[17]  Jessica A. Cardin,et al.  Developmental Dysfunction of VIP Interneurons Impairs Cortical Circuits , 2016, Neuron.

[18]  M. Medalla,et al.  Strength and Diversity of Inhibitory Signaling Differentiates Primate Anterior Cingulate from Lateral Prefrontal Cortex , 2017, The Journal of Neuroscience.

[19]  Y. Dan,et al.  Delay Activity of Specific Prefrontal Interneuron Subtypes Modulates Memory-Guided Behavior , 2017, Nature Neuroscience.

[20]  Steven W Kennerley,et al.  Reconciling persistent and dynamic hypotheses of working memory coding in prefrontal cortex , 2017, Nature Communications.

[21]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[22]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[23]  Thomas Miconi,et al.  Biologically plausible learning in recurrent neural networks reproduces neural dynamics observed during cognitive tasks , 2016, bioRxiv.

[24]  R. Tremblay,et al.  GABAergic Interneurons in the Neocortex: From Cellular Properties to Circuits , 2016, Neuron.

[25]  G. Fishell,et al.  Interneuron cell types are fit to function , 2014, Nature.

[26]  R. Yuste,et al.  Opening Holes in the Blanket of Inhibition: Localized Lateral Disinhibition by VIP Interneurons , 2016, The Journal of Neuroscience.

[27]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[28]  Xiao-Jing Wang,et al.  A dendritic disinhibitory circuit mechanism for pathway-specific gating , 2016, Nature Communications.

[29]  Miao He,et al.  A Disinhibitory Microcircuit Mediates Conditioned Social Fear in the Prefrontal Cortex , 2019, Neuron.

[30]  Xiao-Jing Wang,et al.  A disinhibitory circuit motif and flexible information routing in the brain , 2018, Current Opinion in Neurobiology.

[31]  Dohoung Kim,et al.  Distinct Roles of Parvalbumin- and Somatostatin-Expressing Interneurons in Working Memory , 2016, Neuron.

[32]  A. Compte,et al.  Bump attractor dynamics in prefrontal cortex explains behavioral precision in spatial working memory , 2014, Nature Neuroscience.

[33]  Guangyu R. Yang,et al.  Training Excitatory-Inhibitory Recurrent Neural Networks for Cognitive Tasks: A Simple and Flexible Framework , 2016, PLoS Comput. Biol..

[34]  Kirstie A. Cummings,et al.  Prefrontal somatostatin interneurons encode fear memory , 2019, Nature Neuroscience.

[35]  David J. Freedman,et al.  A hierarchy of intrinsic timescales across primate cortex , 2014, Nature Neuroscience.

[36]  V. Fascianelli,et al.  Autocorrelation Structure in the Macaque Dorsolateral, But not Orbital or Polar, Prefrontal Cortex Predicts Response-Coding Strength in a Visually Cued Strategy Task , 2019, Cerebral cortex.

[37]  E. Miller,et al.  Intrinsic neuronal dynamics predict distinct functional roles during working memory , 2017, Nature Communications.

[38]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[39]  H. Kennedy,et al.  A Large-Scale Circuit Mechanism for Hierarchical Dynamical Processing in the Primate Cortex , 2015, Neuron.

[40]  Miao He,et al.  Brain-wide Maps Reveal Stereotyped Cell-Type-Based Cortical Architecture and Subcortical Sexual Dimorphism , 2017, Cell.

[41]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.