Strategic allocation of working memory resource

Visual working memory (VWM), the brief retention of past visual information, supports a range of cognitive functions. One of the defining, and largely studied, characteristics of VWM is how resource-limited it is, raising questions about how this resource is shared or split across memoranda. Since objects are rarely equally important in the real world, we ask how people split this resource in settings where objects have different levels of importance. In a psychophysical experiment, participants remembered the location of four targets with different probabilities of being tested after a delay. We then measured their memory accuracy of one of the targets. We found that participants allocated more resource to memoranda with higher priority, but underallocated resource to high- and overallocated to low-priority targets relative to the true probability of being tested. These results are well explained by a computational model in which resource is allocated to minimize expected estimation error. We replicated this finding in a second experiment in which participants bet on their memory fidelity after making the location estimate. The results of this experiment show that people have access to and utilize the quality of their memory when making decisions. Furthermore, people again allocate resource in a way that minimizes memory errors, even in a context in which an alternative strategy was incentivized. Our study not only shows that people are allocating resource according to behavioral relevance, but suggests that they are doing so with the aim of maximizing memory accuracy.

[1]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[2]  Frank Tong,et al.  Accounting for Stimulus-Specific Variation in Precision Reveals a Discrete Capacity Limit in Visual Working Memory , 2017, Journal of experimental psychology. Human perception and performance.

[3]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[4]  Zuzanna Klyszejko,et al.  Attentional priority determines working memory precision , 2014, Vision Research.

[5]  R. Engle,et al.  Individual differences in working memory capacity and what they tell us about controlled attention, general fluid intelligence, and functions of the prefrontal cortex. , 1999 .

[6]  L. Maloney,et al.  Explicit estimation of visual uncertainty in human motion processing , 2005, Vision Research.

[7]  O. Hikosaka,et al.  Modulation of saccadic eye movements by predicted reward outcome , 2001, Experimental Brain Research.

[8]  Stephen M. Emrich,et al.  More Than a Filter: Feature-Based Attention Regulates the Distribution of Visual Working Memory Resources , 2017, Journal of experimental psychology. Human perception and performance.

[9]  George A Alvarez,et al.  Looking Inward and Back: Real-Time Monitoring of Visual Working Memories , 2017, Journal of experimental psychology. Learning, memory, and cognition.

[10]  S. Appelle Perception and discrimination as a function of stimulus orientation: the "oblique effect" in man and animals. , 1972, Psychological bulletin.

[11]  Wei Ji Ma,et al.  Optimal allocation of attentional resource to multiple items with unequal relevance , 2018 .

[12]  Maro G. Machizawa,et al.  Neural measures reveal individual differences in controlling access to working memory , 2005, Nature.

[13]  Aspen H. Yoo,et al.  Fechner’s Law in Metacognition: A Quantitative Model of Visual Working Memory Confidence , 2017, Psychological review.

[14]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[15]  Stephen M. Emrich,et al.  Attention Mediates the Flexible Allocation of Visual Working Memory Resources , 2017, Journal of experimental psychology. Human perception and performance.

[16]  Frank Tong,et al.  Introspective judgments predict the precision and likelihood of successful maintenance of visual working memory. , 2012, Journal of vision.

[17]  Clifford M. Hurvich,et al.  Regression and time series model selection in small samples , 1989 .

[18]  Eero P. Simoncelli,et al.  Cardinal rules: Visual orientation perception reflects knowledge of environmental statistics , 2011, Nature Neuroscience.

[19]  Raymond J. Shaw,et al.  Effects of adult age on structural and operational capacities in working memory. , 1991, Psychology and aging.

[20]  W. Ma,et al.  Humans incorporate trial-to-trial working memory uncertainty into rewarded decisions , 2018, Proceedings of the National Academy of Sciences.

[21]  Braden A. Purcell,et al.  Homologous Mechanisms of Visuospatial Working Memory Maintenance in Macaque and Human: Properties and Sources , 2012, Journal of Neuroscience.

[22]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[23]  O. Hikosaka,et al.  Eye movements in monkeys with local dopamine depletion in the caudate nucleus. I. Deficits in spontaneous saccades , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  Maro G. Machizawa,et al.  Neural activity predicts individual differences in visual working memory capacity , 2004, Nature.

[25]  Wei Ji Ma,et al.  Variability in encoding precision accounts for visual short-term memory limitations , 2012, Proceedings of the National Academy of Sciences.

[26]  Luigi Acerbi,et al.  Practical Bayesian Optimization for Model Fitting with Bayesian Adaptive Direct Search , 2017, NIPS.

[27]  Paul M Bays,et al.  Noise in Neural Populations Accounts for Errors in Working Memory , 2014, The Journal of Neuroscience.

[28]  Paul M Bays,et al.  Dynamic Shifts of Limited Working Memory Resources in Human Vision , 2008, Science.

[29]  Chris R Sims,et al.  The cost of misremembering: Inferring the loss function in visual working memory. , 2015, Journal of vision.

[30]  Edward K. Vogel,et al.  Contralateral Delay Activity Tracks Fluctuations in Working Memory Performance , 2018, Journal of Cognitive Neuroscience.

[31]  George A. Alvarez,et al.  Variability in the quality of visual working memory , 2012, Nature Communications.

[32]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[33]  Alexander Strashny Asymmetric loss utility: an analysis of decision under risk , 2004 .

[34]  Klaus Oberauer,et al.  An Interference Model of Visual Working Memory , 2017, Psychological review.

[35]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[36]  C. Furmanski,et al.  An oblique effect in human primary visual cortex , 2000, Nature Neuroscience.

[37]  Wu Zhou,et al.  Monetary reward speeds up voluntary saccades , 2014, Front. Integr. Neurosci..