Constraints on persistent activity in a biologically detailed network model of the prefrontal cortex with heterogeneities

Persistent activity, the maintenance of neural activation over short periods of time in cortical networks, is widely thought to underlie the cognitive function of working memory. A large body of modeling studies has reproduced this kind of activity using cell assemblies with strengthened synaptic connections. However, almost all of these studies have considered persistent activity within networks with homogeneous neurons and synapses, making it difficult to judge the validity of such model results for cortical dynamics, which is based on highly heterogeneous neurons. Here, we consider persistent activity in a detailed, strongly data-driven network model of the prefrontal cortex with heterogeneous neuron and synapse parameters. Surprisingly, persistent activity could not be reproduced in this model without incorporating further constraints. We identified three factors that prevent successful persistent activity: heterogeneity in the cell parameters of interneurons, heterogeneity in the parameters of short-term synaptic plasticity and heterogeneity in the synaptic weights. Our model predicts that persistent activity is recovered if the heterogeneity in the activity of individual interneurons is diminished, which could be achieved by a homeostatic plasticity mechanism. Such a plasticity scheme could also compensate the heterogeneities in the synaptic weights and short-term plasticity when applied to the inhibitory synapses. Cell assemblies shaped in this way may be potentially targeted by distinct inputs or become more responsive to specific tuning or spectral properties. Furthermore, the model predicts that a network that exhibits persistent activity is not able to dynamically produce intrinsic in vivo-like irregular activity at the same time, because heterogeneous synaptic connections are required for these dynamics. Thus, the background noise in such a network must either be produced by external input or constitutes an entirely different state of the network, which is brought about, e.g., by neuromodulation. Author summary To operate effectively in a constantly changing world, it is crucial to keep relevant information in mind for short periods of time. This ability, called working memory, is commonly assumed to rest on reverberating activity among members of cell assemblies. While effective in reproducing key results of working memory, most cell assembly models rest on major simplifications such as using the same parameters for all neurons and synapses, i.e., assuming homogeneity in these parameters. Here, we show that this homogeneity assumption is necessary for persistent activity to arise, specifically for inhibitory interneurons and synapses. Using a strongly data-driven network model of the prefrontal cortex, we show that the heterogeneities in the above parameters that are implied by in vitro studies prevent persistent activity. When homogeneity is imposed on inhibitory neurons and synapses, persistent activity is recovered. We propose that the homogeneity constraints can be implemented in the brain by means of homeostatic plasticity, a form of learning that keeps the activity of a network in a constant, homeostatic state. The model makes a number of predictions for biological networks, including a structural separation of networks responsible for generating persistent activity and spontaneous, noise-like activity.

[1]  Y. Dan,et al.  Delay Activity of Specific Prefrontal Interneuron Subtypes Modulates Memory-Guided Behavior , 2017, Nature Neuroscience.

[2]  T. Sejnowski,et al.  Neurocomputational models of working memory , 2000, Nature Neuroscience.

[3]  Joachim Haß,et al.  An Approximation to the Adaptive Exponential Integrate-and-Fire Neuron Model Allows Fast and Predictive Fitting to Physiological Data , 2012, Front. Comput. Neurosci..

[4]  A. Baddeley Working memory: theories, models, and controversies. , 2012, Annual review of psychology.

[5]  Niraj S. Desai,et al.  Activity-dependent scaling of quantal amplitude in neocortical neurons , 1998, Nature.

[6]  Brent Doiron,et al.  Optimizing Working Memory with Heterogeneity of Recurrent Cortical Excitation , 2013, The Journal of Neuroscience.

[7]  H. Markram,et al.  Organizing principles for a diversity of GABAergic interneurons and synapses in the neocortex. , 2000, Science.

[8]  Henry Markram,et al.  Synapses as dynamic memory buffers , 2002, Neural Networks.

[9]  Daeyeol Lee,et al.  Beyond working memory: the role of persistent activity in decision making , 2010, Trends in Cognitive Sciences.

[10]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[11]  Joachim Haß,et al.  A Detailed Data-Driven Network Model of Prefrontal Cortex Reproduces Key Features of In Vivo Activity , 2016, PLoS Comput. Biol..

[12]  G. Turrigiano Too many cooks? Intrinsic and synaptic homeostatic mechanisms in cortical circuit refinement. , 2011, Annual review of neuroscience.

[13]  Xiao-Jing Wang,et al.  Erratum to: Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition , 2014, Journal of Computational Neuroscience.

[14]  M. Stokes ‘Activity-silent’ working memory in prefrontal cortex: a dynamic coding framework , 2015, Trends in Cognitive Sciences.

[15]  H. Markram,et al.  Differential signaling via the same axon of neocortical pyramidal neurons. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Alison L. Barth,et al.  Experimental evidence for sparse firing in the neocortex , 2012, Trends in Neurosciences.

[17]  Joachim Haß,et al.  Models of dopaminergic modulation , 2011, Scholarpedia.

[18]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[19]  P. Goldman-Rakic,et al.  Prefrontal Microcircuits: Membrane Properties and Excitatory Input of Local, Medium, and Wide Arbor Interneurons , 2001, The Journal of Neuroscience.

[20]  A. Destexhe,et al.  The high-conductance state of neocortical neurons in vivo , 2003, Nature Reviews Neuroscience.

[21]  Katsuyuki Sakai,et al.  The prefrontal cortex and working memory: physiology and brain imaging , 2004, Current Opinion in Neurobiology.

[22]  P. Goldman-Rakic,et al.  Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. , 2000, Cerebral cortex.

[23]  J. Fuster Unit activity in prefrontal cortex during delayed-response performance: neuronal correlates of transient memory. , 1973, Journal of neurophysiology.

[24]  E. Marder Variability, compensation, and modulation in neurons and circuits , 2011, Proceedings of the National Academy of Sciences.

[25]  Wulfram Gerstner,et al.  Adaptive exponential integrate-and-fire model as an effective description of neuronal activity. , 2005, Journal of neurophysiology.

[26]  Marc-Oliver Gewaltig,et al.  Dynamics of self-sustained asynchronous-irregular activity in random networks of spiking neurons with strong synapses , 2014, Front. Comput. Neurosci..

[27]  E. Miller,et al.  Gamma and Beta Bursts Underlie Working Memory , 2016, Neuron.

[28]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[29]  P. Goldman-Rakic Cellular basis of working memory , 1995, Neuron.

[30]  A. Compte Computational and in vitro studies of persistent activity: Edging towards cellular and synaptic mechanisms of working memory , 2006, Neuroscience.

[31]  Kartik K. Sreenivasan,et al.  Revisiting the role of persistent neural activity during working memory , 2014, Trends in Cognitive Sciences.

[32]  Anders Lansner,et al.  Bistable, Irregular Firing and Population Oscillations in a Modular Attractor Memory Network , 2010, PLoS Comput. Biol..

[33]  G. Buzsáki,et al.  The log-dynamic brain: how skewed distributions affect network operations , 2014, Nature Reviews Neuroscience.

[34]  A. Lansner Associative memory models: from the cell-assembly theory to biophysically detailed cortex simulations , 2009, Trends in Neurosciences.

[35]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[36]  T. Sejnowski,et al.  Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex. , 2000, Journal of neurophysiology.

[37]  R Huerta,et al.  Dynamical encoding by networks of competing neuron groups: winnerless competition. , 2001, Physical review letters.

[38]  Daniel Durstewitz,et al.  Self-Organizing Neural Integrator Predicts Interval Times through Climbing Activity , 2003, The Journal of Neuroscience.

[39]  Daniel Durstewitz,et al.  Successful choice behavior is associated with distinct and coherent network states in anterior cingulate cortex , 2008, Proceedings of the National Academy of Sciences.

[40]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[41]  Daniel Durstewitz,et al.  Cell assemblies at multiple time scales with arbitrary lag constellations , 2017, eLife.

[42]  Daniel Durstewitz,et al.  Implications of synaptic biophysics for recurrent network dynamics and active memory , 2009, Neural Networks.

[43]  M. R. Riley,et al.  Role of Prefrontal Persistent Activity in Working Memory , 2016, Front. Syst. Neurosci..

[44]  Markus Siegel,et al.  Phase-dependent neuronal coding of objects in short-term memory , 2009, Proceedings of the National Academy of Sciences.

[45]  Misha Tsodyks,et al.  Short-Term Facilitation may Stabilize Parametric Working Memory Trace , 2011, Front. Comput. Neurosci..

[46]  H. Markram,et al.  Interneurons of the neocortical inhibitory system , 2004, Nature Reviews Neuroscience.

[47]  A. Meyer-Lindenberg,et al.  Intermediate phenotypes and genetic mechanisms of psychiatric disorders , 2006, Nature Reviews Neuroscience.

[48]  Anders Lansner,et al.  Theta and Gamma Power Increases and Alpha/Beta Power Decreases with Memory Load in an Attractor Network Model , 2011, Journal of Cognitive Neuroscience.

[49]  P. Goldman-Rakic,et al.  The physiological approach: functional architecture of working memory and disordered cognition in schizophrenia , 1999, Biological Psychiatry.

[50]  Xiao-Jing Wang Synaptic reverberation underlying mnemonic persistent activity , 2001, Trends in Neurosciences.

[51]  Thomas K. Berger,et al.  Heterogeneity in the pyramidal network of the medial prefrontal cortex , 2006, Nature Neuroscience.

[52]  Y. Goda,et al.  Homeostatic synaptic plasticity: from single synapses to neural circuits , 2012, Current Opinion in Neurobiology.

[53]  R. Romo,et al.  A recurrent network model of somatosensory parametric working memory in the prefrontal cortex. , 2003, Cerebral cortex.

[54]  Arvind Kumar,et al.  The High-Conductance State of Cortical Networks , 2008, Neural Computation.

[55]  R. Segev,et al.  How silent is the brain: is there a “dark matter” problem in neuroscience? , 2006, Journal of Comparative Physiology A.

[56]  S. Nelson,et al.  The NMDA-to-AMPA ratio at synapses onto layer 2/3 pyramidal neurons is conserved across prefrontal and visual cortices. , 2003, Journal of neurophysiology.

[57]  M. Sahani,et al.  Distinct learning-induced changes in stimulus selectivity and interactions of GABAergic interneuron classes in visual cortex , 2018, Nature Neuroscience.

[58]  Eric L. Denovellis,et al.  Synchronous Oscillatory Neural Ensembles for Rules in the Prefrontal Cortex , 2012, Neuron.

[59]  Huaixing Wang,et al.  A specialized NMDA receptor function in layer 5 recurrent microcircuitry of the adult rat prefrontal cortex , 2008, Proceedings of the National Academy of Sciences.

[60]  P. Goldman-Rakic,et al.  Temporally irregular mnemonic persistent activity in prefrontal neurons of monkeys during a delayed response task. , 2003, Journal of neurophysiology.

[61]  Xiao-Jing Wang,et al.  Robust Spatial Working Memory through Homeostatic Synaptic Scaling in Heterogeneous Cortical Networks , 2003, Neuron.

[62]  B. Sakmann,et al.  ‐Dynamic representation of whisker deflection by synaptic potentials in spiny stellate and pyramidal cells in the barrels and septa of layer 4 rat somatosensory cortex , 2002, The Journal of physiology.

[63]  M. Tsodyks,et al.  Synaptic Theory of Working Memory , 2008, Science.

[64]  David Hansel,et al.  Short-Term Plasticity Explains Irregular Persistent Activity in Working Memory Tasks , 2013, The Journal of Neuroscience.

[65]  Simon Kornblith,et al.  Stimulus Load and Oscillatory Activity in Higher Cortex. , 2015, Cerebral cortex.

[66]  S. Epstein,et al.  Background gamma rhythmicity and attention in cortical local circuits: a computational study. , 2005, Proceedings of the National Academy of Sciences of the United States of America.