Synaptic mechanisms of interference in working memory

Information from preceding trials of cognitive tasks can bias performance in the current trial, a phenomenon referred to as interference. Subjects performing visual working memory tasks exhibit interference in their responses: the recalled target location is biased in the direction of the target presented on the previous trial. We present modeling work that develops a probabilistic inference model of this history-dependent bias, and links our probabilistic model to computations of a recurrent network wherein short-term facilitation accounts for the observed bias. Network connectivity is reshaped dynamically during each trial, generating predictions from prior trial observations. Applying timescale separation methods, we obtain a low-dimensional description of the trial-to-trial bias based on the history of target locations. Furthermore, we demonstrate task protocols for which our model with facilitation performs better than a model with static connectivity: repetitively presented targets are better retained in working memory than targets drawn from uncorrelated sequences.

[1]  J. Wolfowitz,et al.  Optimum Character of the Sequential Probability Ratio Test , 1948 .

[2]  Wade G. Regehr,et al.  The calcium sensor synaptotagmin 7 is required for synaptic facilitation , 2015, Nature.

[3]  T. Klingberg Training and plasticity of working memory , 2010, Trends in Cognitive Sciences.

[4]  R. Engle,et al.  Working-memory capacity, proactive interference, and divided attention: limits on long-term memory retrieval. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[5]  J. Jonides,et al.  Brain mechanisms of proactive interference in working memory , 2006, Neuroscience.

[6]  E. Rolls,et al.  Holding Multiple Items in Short Term Memory: A Neural Mechanism , 2013, PloS one.

[7]  Joshua K. Hartshorne Visual Working Memory Capacity and Proactive Interference , 2008, PloS one.

[8]  Luigi Acerbi,et al.  On the Origins of Suboptimality in Human Probabilistic Inference , 2014, PLoS Comput. Biol..

[9]  Misha Tsodyks,et al.  Persistent Activity in Neural Networks with Dynamic Synapses , 2007, PLoS Comput. Biol..

[10]  Paul M Bays,et al.  Dynamic Shifts of Limited Working Memory Resources in Human Vision , 2008, Science.

[11]  N. Cowan What are the differences between long-term, short-term, and working memory? , 2008, Progress in brain research.

[12]  W. Gerstner,et al.  Hebbian plasticity requires compensatory processes on multiple timescales , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[13]  P. Bressloff Spatiotemporal dynamics of continuum neural fields , 2012 .

[14]  W. Ma,et al.  Changing concepts of working memory , 2014, Nature Neuroscience.

[15]  P. Goldman-Rakic,et al.  Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. , 2000, Cerebral cortex.

[16]  Yoram Burak,et al.  Slow diffusive dynamics in a chaotic balanced neural network , 2017, PLoS Comput. Biol..

[17]  Joshua I. Gold,et al.  Bayesian Online Learning of the Hazard Rate in Change-Point Problems , 2010, Neural Computation.

[18]  Xiao-Jing Wang,et al.  A Model of Visuospatial Working Memory in Prefrontal Cortex: Recurrent Network and Cellular Bistability , 1998, Journal of Computational Neuroscience.

[19]  J. Gold,et al.  Coupled Decision Processes Update and Maintain Saccadic Priors in a Dynamic Environment , 2017, The Journal of Neuroscience.

[20]  C. Summerfield,et al.  Do humans make good decisions? , 2015, Trends in Cognitive Sciences.

[21]  W. Abraham,et al.  Mechanisms of heterosynaptic metaplasticity , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[22]  J. Cowan,et al.  A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue , 1973, Kybernetik.

[23]  Miao‐kun Sun,et al.  Trends in cognitive sciences , 2012 .

[24]  Stefano Fusi,et al.  Computational principles of synaptic memory consolidation , 2016, Nature Neuroscience.

[25]  M. Tsodyks,et al.  Working models of working memory , 2014, Current Opinion in Neurobiology.

[26]  Christos Constantinidis,et al.  The sensory nature of mnemonic representation in the primate prefrontal cortex , 2001, Nature Neuroscience.

[27]  Simon J. Bennett,et al.  Combined smooth and saccadic ocular pursuit during the transient occlusion of a moving visual object , 2005, Experimental Brain Research.

[28]  Adam C. Riggall,et al.  Reactivation of latent working memories with transcranial magnetic stimulation , 2016, Science.

[29]  Michael J. Frank,et al.  Chunking as a rational strategy for lossy data compression in visual working memory tasks , 2017 .

[30]  Charalampos Papadimitriou,et al.  Ghosts in the machine: memory interference from the previous trial. , 2015, Journal of neurophysiology.

[31]  S B Dunnett,et al.  Proactive interference effects on short-term memory in rats: I. Basic parameters and drug effects. , 1990, Behavioral neuroscience.

[32]  Wade G. Regehr,et al.  The Mechanisms and Functions of Synaptic Facilitation , 2017, Neuron.

[33]  Ranulfo Romo,et al.  Basic mechanisms for graded persistent activity: discrete attractors, continuous attractors, and dynamic representations , 2003, Current Opinion in Neurobiology.

[34]  David Hansel,et al.  Short-Term Plasticity Explains Irregular Persistent Activity in Working Memory Tasks , 2013, The Journal of Neuroscience.

[35]  P. Goldman-Rakic Cellular basis of working memory , 1995, Neuron.

[36]  Y Agid,et al.  Temporal limits of spatial working memory in humans , 1998, The European journal of neuroscience.

[37]  Yuhong Jiang,et al.  Proactive interference from items previously stored in visual working memory , 2008, Memory & cognition.

[38]  Henry Markram,et al.  Neural Networks with Dynamic Synapses , 1998, Neural Computation.

[39]  Ben R. Newell,et al.  Information versus reward in a changing world , 2014, CogSci.

[40]  P. Glimcher,et al.  The Neurobiology of Decision: Consensus and Controversy , 2009, Neuron.

[41]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[42]  Xiao-Jing Wang,et al.  From Distributed Resources to Limited Slots in Multiple-Item Working Memory: A Spiking Network Model with Normalization , 2012, The Journal of Neuroscience.

[43]  Zachary P. Kilpatrick,et al.  Encoding certainty in bump attractors , 2013, Journal of Computational Neuroscience.

[44]  Joseph L. Austerweil,et al.  Structure and Flexibility in Bayesian Models of Cognition , 2015 .

[45]  Bijan Pesaran,et al.  Temporal structure in neuronal activity during working memory in macaque parietal cortex , 2000, Nature Neuroscience.

[46]  Christian K. Machens,et al.  Predictive Coding of Dynamical Variables in Balanced Spiking Networks , 2013, PLoS Comput. Biol..

[47]  Michelle Becker The Probabilistic Mind Prospects For Bayesian Cognitive Science , 2016 .

[48]  Brent Doiron,et al.  Optimizing Working Memory with Heterogeneity of Recurrent Cortical Excitation , 2013, The Journal of Neuroscience.

[49]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[50]  Ryan P. Adams,et al.  Bayesian Online Changepoint Detection , 2007, 0710.3742.

[51]  Gerd Gigerenzer,et al.  Heuristic decision making. , 2011, Annual review of psychology.

[52]  Maro G. Machizawa,et al.  Neural measures reveal individual differences in controlling access to working memory , 2005, Nature.

[53]  R. Romo,et al.  Neuronal correlates of parametric working memory in the prefrontal cortex , 1999, Nature.

[54]  Mikhail Katkov,et al.  Synaptic Correlates of Working Memory Capacity , 2017, Neuron.

[55]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[56]  P. Diaconis,et al.  Conjugate Priors for Exponential Families , 1979 .

[57]  Yoram Burak,et al.  Fundamental limits on persistent activity in networks of noisy neurons , 2012, Proceedings of the National Academy of Sciences.

[58]  A. Baddeley,et al.  Short Term Forgetting in the Absence of Proactive Interference , 1971 .

[59]  Ranulfo Romo,et al.  Flexible Control of Mutual Inhibition: A Neural Model of Two-Interval Discrimination , 2005, Science.

[60]  W. Abraham Metaplasticity: tuning synapses and networks for plasticity , 2008, Nature Reviews Neuroscience.

[61]  Misha Tsodyks,et al.  Short-Term Facilitation may Stabilize Parametric Working Memory Trace , 2011, Front. Comput. Neurosci..

[62]  CE Jahr,et al.  NMDA channel behavior depends on agonist affinity , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[63]  Charalampos Papadimitriou,et al.  Ghosts in the Machine II: Neural Correlates of Memory Interference from the Previous Trial , 2016, Cerebral cortex.

[64]  B. Underwood,et al.  Proactive inhibition in short-term retention of single items , 1962 .

[65]  A. Pouget,et al.  Not Noisy, Just Wrong: The Role of Suboptimal Inference in Behavioral Variability , 2012, Neuron.

[66]  H. Risken Fokker-Planck Equation , 1996 .

[67]  Sukbin Lim,et al.  Balanced cortical microcircuitry for maintaining information in working memory , 2013, Nature Neuroscience.

[68]  A. Compte,et al.  Bump attractor dynamics in prefrontal cortex explains behavioral precision in spatial working memory , 2014, Nature Neuroscience.

[69]  E. Vogel,et al.  Visual working memory capacity: from psychophysics and neurobiology to individual differences , 2013, Trends in Cognitive Sciences.

[70]  Mark C. W. van Rossum,et al.  Recurrent networks with short term synaptic depression , 2009, Journal of Computational Neuroscience.

[71]  C. H. Donahue,et al.  Metaplasticity as a Neural Substrate for Adaptive Learning and Choice under Uncertainty , 2017, Neuron.

[72]  L Hasher,et al.  Working memory span and the role of proactive interference. , 2001, Journal of experimental psychology. General.

[73]  Yee Whye Teh,et al.  Bayesian Nonparametric Models , 2010, Encyclopedia of Machine Learning.

[74]  David L. Sparks,et al.  Saccades to remembered target locations: an analysis of systematic and variable errors , 1994, Vision Research.

[75]  U. Bhalla Molecular computation in neurons: a modeling perspective , 2014, Current Opinion in Neurobiology.

[76]  Henry Brighton amp Gigerenzer,et al.  Probabilistic minds, Bayesian brains, and cognitive mechanisms: harmony or dissonance , 2008 .

[77]  Timothy D. Hanks,et al.  Probabilistic Population Codes for Bayesian Decision Making , 2008, Neuron.

[78]  C. Constantinidis,et al.  The neuroscience of working memory capacity and training , 2016, Nature Reviews Neuroscience.

[79]  Xiao-Jing Wang,et al.  Robust Spatial Working Memory through Homeostatic Synaptic Scaling in Heterogeneous Cortical Networks , 2003, Neuron.

[80]  H. Markram,et al.  The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[81]  S. Sharma,et al.  The Fokker-Planck Equation , 2010 .

[82]  M. Shadlen,et al.  Decision-making with multiple alternatives , 2008, Nature Neuroscience.

[83]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[84]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[85]  Julie C. Helmers,et al.  Chunking as a rational strategy for lossy data compression in visual working memory , 2017, bioRxiv.

[86]  P. Bays Spikes not slots: noise in neural populations limits working memory , 2015, Trends in Cognitive Sciences.

[87]  A. Compte,et al.  Neural circuit basis of visuo-spatial working memory precision: a computational and behavioral study. , 2015, Journal of neurophysiology.

[88]  M. Tsodyks,et al.  Synaptic Theory of Working Memory , 2008, Science.

[89]  Zachary P. Kilpatrick,et al.  Stochastic models of evidence accumulation in changing environments , 2015, bioRxiv.

[90]  T. Stanford,et al.  Stimulus Selectivity in Dorsal and Ventral Prefrontal Cortex after Training in Working Memory Tasks , 2011, The Journal of Neuroscience.

[91]  J. Gold,et al.  Banburismus and the Brain Decoding the Relationship between Sensory Stimuli, Decisions, and Reward , 2002, Neuron.

[92]  N. Sigala,et al.  Dynamic Coding for Cognitive Control in Prefrontal Cortex , 2013, Neuron.

[93]  S. Nelson,et al.  Multiple forms of short-term plasticity at excitatory synapses in rat medial prefrontal cortex. , 2000, Journal of neurophysiology.

[94]  M. Häusser,et al.  Estimating the Time Course of the Excitatory Synaptic Conductance in Neocortical Pyramidal Cells Using a Novel Voltage Jump Method , 1997, The Journal of Neuroscience.

[95]  H. Markram,et al.  Redistribution of synaptic efficacy between neocortical pyramidal neurons , 1996, Nature.

[96]  Zachary P. Kilpatrick,et al.  Wandering Bumps in Stochastic Neural Fields , 2012, SIAM J. Appl. Dyn. Syst..

[97]  Paul C. Bressloff,et al.  Stability of bumps in piecewise smooth neural fields with nonlinear adaptation , 2010 .

[98]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[99]  Christos Constantinidis,et al.  Incorporation of new information into prefrontal cortical activity after learning working memory tasks , 2012, Proceedings of the National Academy of Sciences.

[100]  C. Curtis,et al.  Multiple component networks support working memory in prefrontal cortex , 2015, Proceedings of the National Academy of Sciences.

[101]  Michael Breakspear,et al.  Subdiffusive Dynamics of Bump Attractors: Mechanisms and Functional Roles , 2015, Neural Computation.

[102]  C. Honey,et al.  Hierarchical process memory: memory as an integral component of information processing , 2015, Trends in Cognitive Sciences.

[103]  P. Roelfsema,et al.  The Distributed Nature of Working Memory , 2017, Trends in Cognitive Sciences.

[104]  Z. Pylyshyn,et al.  Tracking Multiple Items Through Occlusion: Clues to Visual Objecthood , 1999, Cognitive Psychology.

[105]  Joseph W Kable,et al.  Normative evidence accumulation in unpredictable environments , 2015, eLife.

[106]  Thomas K. Berger,et al.  Heterogeneity in the pyramidal network of the medial prefrontal cortex , 2006, Nature Neuroscience.