Exact neural mass model for synaptic-based working memory

A synaptic theory of Working Memory (WM) has been developed in the last decade as a possible alternative to the persistent spiking paradigm. In this context, we have developed a neural mass model able to reproduce exactly the dynamics of heterogeneous spiking neural networks encompassing realistic cellular mechanisms for short-term synaptic plasticity. This population model reproduces the macroscopic dynamics of the network in terms of the firing rate and the mean membrane potential. The latter quantity allows us to get insigth on Local Field Potential and electroencephalographic signals measured during WM tasks to characterize the brain activity. More specifically synaptic facilitation and depression integrate each other to efficiently mimic WM operations via either synaptic reactivation or persistent activity. Memory access and loading are associated to stimulus-locked transient oscillations followed by a steady-state activity in the β-γ band, thus resembling what observed in the cortex during vibrotactile stimuli in humans and object recognition in monkeys. Memory juggling and competition emerge already by loading only two items. However more items can be stored in WM by considering neural architectures composed of multiple excitatory populations and a common inhibitory pool. Memory capacity depends strongly on the presentation rate of the items and it maximizes for an optimal frequency range. In particular we provide an analytic expression for the maximal memory capacity. Furthermore, the mean membrane potential turns out to be a suitable proxy to measure the memory load, analogously to event driven potentials in experiments on humans. Finally we show that the γ power increases with the number of loaded items, as reported in many experiments, while θ and β power reveal non monotonic behaviours. In particular, β and γ rhytms are crucially sustained by the inhibitory activity, while the θ rhythm is controlled by excitatory synapses. Author summary Working Memory (WM) is the ability to temporarily store and manipulate stimuli representations that are no longer available to the senses. We have developed an innovative coarse-grained population model able to mimic several operations associated to WM. The novelty of the model consists in reproducing exactly the dynamics of spiking neural networks with realistic synaptic plasticity composed of hundreds of thousands neurons in terms of a few macroscopic variables. These variables give access to experimentally measurable quantities such as local field potentials and electroencephalografic signals. Memory operations are joined to sustained or transient oscillations emerging in different frequency bands, in accordance with experimental results for primate and humans performing WM tasks. We have designed an architecture composed of many excitatory populations and a common inhibitory pool able to store and retain several memory items. The capacity of our multi-item architecture is around 3-5 items, a value corresponding to the WM capacities measured in many experiments. Furthermore, the maximal capacity is achievable only for presentation rates within an optimal frequency range. Finally, we have defined a measure of the memory load analogous to the event-related potentials employed to test humans’ WM capacity during visual memory tasks.

[1]  G. Buzsáki,et al.  Behavior-dependent short-term assembly dynamics in the medial prefrontal cortex , 2008, Nature Neuroscience.

[2]  Wolf Singer,et al.  Gamma-Band Activity in Human Prefrontal Cortex Codes for the Number of Relevant Items Maintained in Working Memory , 2012, The Journal of Neuroscience.

[3]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[4]  Randall W Engle,et al.  Working memory, short-term memory, and general fluid intelligence: a latent-variable approach. , 1999, Journal of experimental psychology. General.

[5]  R. Romo,et al.  Neuronal correlates of parametric working memory in the prefrontal cortex , 1999, Nature.

[6]  Mikhail Katkov,et al.  Synaptic Correlates of Working Memory Capacity , 2017, Neuron.

[7]  Thomas K. Berger,et al.  Heterogeneity in the pyramidal network of the medial prefrontal cortex , 2006, Nature Neuroscience.

[8]  L. Postman,et al.  Short-term Temporal Changes in Free Recall , 1965 .

[9]  C. Laing Phase Oscillator Network Models of Brain Dynamics , 2017 .

[10]  P. Goldman-Rakic,et al.  Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. , 2000, Cerebral cortex.

[11]  Alessandro Torcini,et al.  Transition from Asynchronous to Oscillatory Dynamics in Balanced Spiking Networks with Instantaneous Synapses. , 2018, Physical review letters.

[12]  Simon Kornblith,et al.  Stimulus Load and Oscillatory Activity in Higher Cortex. , 2015, Cerebral cortex.

[13]  E. Miller,et al.  Gamma and Beta Bursts Underlie Working Memory , 2016, Neuron.

[14]  T. Sejnowski,et al.  Cortical Enlightenment: Are Attentional Gamma Oscillations Driven by ING or PING? , 2009, Neuron.

[15]  Ranulfo Romo,et al.  Flexible Control of Mutual Inhibition: A Neural Model of Two-Interval Discrimination , 2005, Science.

[16]  Alessandro Torcini,et al.  Clique of Functional Hubs Orchestrates Population Bursts in Developmentally Regulated Neural Networks , 2014, PLoS Comput. Biol..

[17]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[18]  Felix Blankenburg,et al.  Oscillatory Correlates of Vibrotactile Frequency Processing in Human Working Memory , 2010, The Journal of Neuroscience.

[19]  N Kopell,et al.  Neuronal assembly dynamics in the beta1 frequency range permits short-term memory , 2011, Proceedings of the National Academy of Sciences.

[20]  Catherine Tallon-Baudry,et al.  Induced γ-Band Activity during the Delay of a Visual Short-Term Memory Task in Humans , 1998, The Journal of Neuroscience.

[21]  Ernest Montbri'o,et al.  Macroscopic description for networks of spiking neurons , 2015, 1506.06581.

[22]  Ernest Barreto,et al.  Complete Classification of the Macroscopic Behavior of a Heterogeneous Network of Theta Neurons , 2013, Neural Computation.

[23]  O Jensen,et al.  Novel lists of 7 +/- 2 known items can be reliably stored in an oscillatory short-term memory network: interaction with long-term memory. , 1996, Learning & memory.

[24]  Jarrod A. Lewis-Peacock,et al.  Competition between items in working memory leads to forgetting , 2014, Nature Communications.

[25]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[26]  Adam C. Riggall,et al.  Reactivation of latent working memories with transcranial magnetic stimulation , 2016, Science.

[27]  R. Desimone,et al.  Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque , 1996, The Journal of Neuroscience.

[28]  Daniele Avitabile,et al.  Network mechanisms underlying the role of oscillations in cognitive tasks , 2018, bioRxiv.

[29]  S. Coombes,et al.  Next Generation Neural Mass Models , 2016, Nonlinear Dynamics in Computational Neuroscience.

[30]  M. Tsodyks,et al.  Synaptic Theory of Working Memory , 2008, Science.

[31]  Marc W Howard,et al.  Gamma oscillations correlate with working memory load in humans. , 2003, Cerebral cortex.

[32]  Anders Lansner,et al.  Theta and Gamma Power Increases and Alpha/Beta Power Decreases with Memory Load in an Attractor Network Model , 2011, Journal of Cognitive Neuroscience.

[33]  Joel Nothman,et al.  SciPy 1.0-Fundamental Algorithms for Scientific Computing in Python , 2019, ArXiv.

[34]  Carson C. Chow,et al.  Variability in neuronal activity in primate cortex during working memory tasks , 2007, Neuroscience.

[35]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[36]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[37]  Mario Dipoppa,et al.  Controlling Working Memory Operations by Selective Gating: The Roles of Oscillations and Synchrony , 2016, Advances in cognitive psychology.

[38]  Boris Gutkin,et al.  Macroscopic phase resetting-curves determine oscillatory coherence and signal transfer in inter-coupled neural circuits , 2018, PLoS Comput. Biol..

[39]  H. Markram,et al.  t Synchrony Generation in Recurrent Networks with Frequency-Dependent Synapses , 2000, The Journal of Neuroscience.

[40]  Markus Siegel,et al.  Phase-dependent neuronal coding of objects in short-term memory , 2009, Proceedings of the National Academy of Sciences.

[41]  Simona Olmi,et al.  Stability of the splay state in networks of pulse-coupled neurons , 2012, Journal of mathematical neuroscience.

[42]  Maro G. Machizawa,et al.  Neural measures reveal individual differences in controlling access to working memory , 2005, Nature.

[43]  J E Lisman,et al.  Storage of 7 +/- 2 short-term memories in oscillatory subcycles , 1995, Science.

[44]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[45]  R. Yuste,et al.  Dense Inhibitory Connectivity in Neocortex , 2011, Neuron.

[46]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[47]  J. Wallis,et al.  The Role of Prefrontal Cortex in Working Memory: A Mini Review , 2015, Front. Syst. Neurosci..

[48]  Bijan Pesaran,et al.  Temporal structure in neuronal activity during working memory in macaque parietal cortex , 2000, Nature Neuroscience.

[49]  H. Markram,et al.  The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[50]  Ying-Cheng Lai,et al.  Transient Chaos: Complex Dynamics on Finite Time Scales , 2011 .

[51]  Daphne N. Yu,et al.  High-resolution EEG mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice. , 1997, Cerebral cortex.

[52]  Federico Devalle,et al.  Dynamics of a large system of spiking neurons with synaptic delay , 2018, Physical Review E.

[53]  Brian Litt,et al.  Behavioral / Systems / Cognitive Hippocampal Gamma Oscillations Increase with Memory Load , 2010 .

[54]  Michael Okun,et al.  The Subthreshold Relation between Cortical Local Field Potential and Neuronal Firing Unveiled by Intracellular Recordings in Awake Rats , 2010, The Journal of Neuroscience.

[55]  Wulfram Gerstner,et al.  Mesoscopic population equations for spiking neural networks with synaptic short-term plasticity , 2018, The Journal of Mathematical Neuroscience.

[56]  Nicolas Brunel,et al.  Encoding of Naturalistic Stimuli by Local Field Potential Spectra in Networks of Excitatory and Inhibitory Neurons , 2008, PLoS Comput. Biol..

[57]  H. Markram,et al.  Differential signaling via the same axon of neocortical pyramidal neurons. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[58]  A. Karim,et al.  Brain Oscillatory Substrates of Visual Short-Term Memory Capacity , 2009, Current Biology.

[59]  A. Torcini,et al.  Coexistence of fast and slow gamma oscillations in one population of inhibitory spiking neurons , 2019, bioRxiv.

[60]  Henry Markram,et al.  Neural Networks with Dynamic Synapses , 1998, Neural Computation.

[61]  Antonio Politi,et al.  Synchronous dynamics in the presence of short-term plasticity , 2013 .

[62]  Christos Constantinidis,et al.  Stable population coding for working memory coexists with heterogeneous neural dynamics in prefrontal cortex , 2016, Proceedings of the National Academy of Sciences.

[63]  E. Ott,et al.  Low dimensional behavior of large systems of globally coupled oscillators. , 2008, Chaos.

[64]  Romain Veltz,et al.  Short-term synaptic plasticity in the deterministic Tsodyks–Markram model leads to unpredictable network dynamics , 2013, Proceedings of the National Academy of Sciences.

[65]  Mario Dipoppa,et al.  Flexible frequency control of cortical oscillations enables computations required for working memory , 2013, Proceedings of the National Academy of Sciences.

[66]  O. Jensen,et al.  Frontal theta activity in humans increases with memory load in a working memory task , 2002, The European journal of neuroscience.

[67]  Earl K. Miller,et al.  Working Memory 2.0 , 2018, Neuron.

[68]  Albert Compte,et al.  Transitions between Multiband Oscillatory Patterns Characterize Memory-Guided Perceptual Decisions in Prefrontal Circuits , 2016, The Journal of Neuroscience.

[69]  A. Ceni,et al.  Cross frequency coupling in next generation inhibitory neural mass models , 2019, bioRxiv.

[70]  Alex Roxin,et al.  Firing rate equations require a spike synchrony mechanism to correctly describe fast oscillations in inhibitory networks , 2017, PLoS computational biology.

[71]  G. Ermentrout,et al.  Parabolic bursting in an excitable system coupled with a slow oscillation , 1986 .

[72]  Jane S. Paulsen Memory in the Cerebral Cortex: An Empirical Approach to Neural Networks in the Human and Nonhuman Primate , 1996 .

[73]  Maro G. Machizawa,et al.  Neural activity predicts individual differences in visual working memory capacity , 2004, Nature.

[74]  P. Goldman-Rakic Cellular basis of working memory , 1995, Neuron.

[75]  Christopher H Chatham,et al.  Multiple gates on working memory , 2015, Current Opinion in Behavioral Sciences.

[76]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[77]  Carlo R Laing,et al.  Derivation of a neural field model from a network of theta neurons. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[78]  Alessandro Torcini,et al.  Theta-Nested Gamma Oscillations in Next Generation Neural Mass Models , 2020, bioRxiv.

[79]  Tatiana Pasternak,et al.  Memory-Guided Sensory Comparisons in the Prefrontal Cortex: Contribution of Putative Pyramidal Cells and Interneurons , 2012, The Journal of Neuroscience.

[80]  Christos Constantinidis,et al.  Persistent Spiking Activity Underlies Working Memory , 2018, The Journal of Neuroscience.

[81]  Jason M. Chein,et al.  Primacy and recency effects as indices of the focus of attention , 2014, Front. Hum. Neurosci..