Evidence of Gradual Loss of Precision for Simple Features and Complex Objects in Visual Working Memory

Previous studies have suggested that people can maintain prioritized items in visual working memory for many seconds, with negligible loss of information over time. Such findings imply that working memory representations are robust to the potential contaminating effects of internal noise. However, once visual information is encoded into working memory, one might expect it to inevitably begin degrading over time, as this actively maintained information is no longer tethered to the original perceptual input. Here, we examined this issue by evaluating working memory for single central presentations of an oriented grating, color patch, or face stimulus, across a range of delay periods (1, 3, 6, or 12 s). We applied a mixture-model analysis to distinguish changes in memory precision over time from changes in the frequency of outlier responses that resemble random guesses. For all 3 types of stimuli, participants exhibited a clear and consistent decline in the precision of working memory as a function of temporal delay, as well as a modest increase in guessing-related responses for colored patches and face stimuli. We observed a similar loss of precision over time while controlling for temporal distinctiveness. Our results demonstrate that visual working memory is far from lossless: while basic visual features and complex objects can be maintained in a quite stable manner over time, these representations are still subject to noise accumulation and complete termination.

[1]  Philipp Berens,et al.  CircStat: AMATLABToolbox for Circular Statistics , 2009, Journal of Statistical Software.

[2]  Frank Tong,et al.  Expertise for upright faces improves the precision but not the capacity of visual working memory , 2014, Attention, perception & psychophysics.

[3]  S. McKee,et al.  The use of an implicit standard for measuring discrimination thresholds , 2000, Vision Research.

[4]  Gordon D. A. Brown,et al.  A temporal ratio model of memory. , 2007, Psychological review.

[5]  Kartik K. Sreenivasan,et al.  Revisiting the role of persistent neural activity during working memory , 2014, Trends in Cognitive Sciences.

[6]  H. Akaike A new look at the statistical model identification , 1974 .

[7]  Frank Tong,et al.  Introspective judgments predict the precision and likelihood of successful maintenance of visual working memory. , 2012, Journal of vision.

[8]  M. Greenlee,et al.  Retention and disruption of motion information in visual short-term memory. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[9]  J P Thomas,et al.  Parallel processing in visual short-term memory. , 1996, Journal of experimental psychology. Human perception and performance.

[10]  Martin Lages,et al.  Visual long-term memory for spatial frequency? , 2004, Psychonomic bulletin & review.

[11]  Paul M. Bays,et al.  Rapid Forgetting Prevented by Retrospective Attention Cues , 2012, Journal of experimental psychology. Human perception and performance.

[12]  E. Vogel,et al.  PSYCHOLOGICAL SCIENCE Research Article Visual Working Memory Represents a Fixed Number of Items Regardless of Complexity , 2022 .

[13]  W. A. Phillips On the distinction between sensory storage and short-term visual memory , 1974 .

[14]  G. Orban,et al.  Decision processes in visual discrimination of line orientation. , 1986, Journal of experimental psychology. Human perception and performance.

[15]  Frank Tong,et al.  Reprioritization of Features of Multidimensional Objects Stored in Visual Working Memory , 2017, Psychological science.

[16]  D. Bates,et al.  Mixed-Effects Models in S and S-PLUS , 2001 .

[17]  Mark W. Greenlee,et al.  Stimulus-specific mechanisms of visual short-term memory , 1991, Vision Research.

[18]  Bernt Christian Skottun,et al.  On the use of discrimination to assess memory , 2004, Perception & psychophysics.

[19]  Mary Hayhoe,et al.  Visual short-term memory and motor planning. , 2002, Progress in brain research.

[20]  Billy Lee,et al.  Contrast Transfer Characteristics of Visual Short-term Memory , 1996, Vision Research.

[21]  P. Cavanagh,et al.  The Capacity of Visual Short-Term Memory is Set Both by Visual Information Load and by Number of Objects , 2004, Psychological science.

[22]  Tom Mercer,et al.  The loss of short-term visual representations over time: decay or temporal distinctiveness? , 2014, Journal of experimental psychology. Human perception and performance.

[23]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[24]  Paul M Bays,et al.  Dynamic Shifts of Limited Working Memory Resources in Human Vision , 2008, Science.

[25]  W. Ma,et al.  Changing concepts of working memory , 2014, Nature Neuroscience.

[26]  Zoltán Vidnyánszky,et al.  Flawless visual short-term memory for facial emotional expressions. , 2009, Journal of vision.

[27]  Xiao-Jing Wang Synaptic reverberation underlying mnemonic persistent activity , 2001, Trends in Neurosciences.

[28]  R. Sekuler,et al.  Distortions in recall from visual memory: two classes of attractors at work. , 2010, Journal of vision.

[29]  R. Blake,et al.  Memory for visual motion. , 1997, Journal of experimental psychology. Human perception and performance.

[30]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[31]  S Magnussen,et al.  Visual Half-Field Symmetry in Orientation Perception , 1985, Perception.

[32]  Ranulfo Romo,et al.  Basic mechanisms for graded persistent activity: discrete attractors, continuous attractors, and dynamic representations , 2003, Current Opinion in Neurobiology.

[33]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[34]  Paul M Bays,et al.  The precision of visual working memory is set by allocation of a shared resource. , 2009, Journal of vision.

[35]  M. Fahle,et al.  Visual memory for vernier offsets , 1992, Vision Research.

[36]  Klaus Oberauer,et al.  Time-based forgetting in visual working memory reflects temporal distinctiveness, not decay , 2015, Psychonomic bulletin & review.

[37]  Paul M Bays,et al.  Noise in Neural Populations Accounts for Errors in Working Memory , 2014, The Journal of Neuroscience.

[38]  S. Luck,et al.  Sudden Death and Gradual Decay in Visual Working Memory , 2009, Psychological science.

[39]  Christopher L. Asplund,et al.  What are the units of storage in visual working memory? , 2010, Journal of vision.

[40]  T. M. Nelson,et al.  Delayed monochromatic hue matches indicate characteristics of visual memory. , 1981, Journal of experimental psychology. Human perception and performance.

[41]  G. Alvarez,et al.  Object features fail independently in visual working memory: evidence for a probabilistic feature-store model. , 2011, Journal of vision.

[42]  Wei Ji Ma,et al.  Variability in encoding precision accounts for visual short-term memory limitations , 2012, Proceedings of the National Academy of Sciences.

[43]  Frank Tong,et al.  Accounting for Stimulus-Specific Variation in Precision Reveals a Discrete Capacity Limit in Visual Working Memory , 2017, Journal of experimental psychology. Human perception and performance.

[44]  D. Regan,et al.  Postadaptation orientation discrimination. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[45]  Chris Donkin,et al.  Verbal labeling, gradual decay, and sudden death in visual short-term memory , 2015, Psychonomic bulletin & review.

[46]  W. Ma,et al.  A detection theory account of change detection. , 2004, Journal of vision.

[47]  Martin Lages,et al.  Spatial frequency discrimination: Visual long-term memory or criterion setting? , 1998, Vision Research.

[48]  P. Bays Spikes not slots: noise in neural populations limits working memory , 2015, Trends in Cognitive Sciences.

[49]  Anne R. Schutte,et al.  Generalizing the dynamic field theory of spatial cognition across real and developmental time scales , 2008, Brain Research.

[50]  Jonathan I. Flombaum,et al.  Why some colors appear more memorable than others: A model combining categories and particulars in color working memory. , 2015, Journal of experimental psychology. General.

[51]  Patrick J. Bennett,et al.  Masking of spatial frequency in visual memory depends on distal, not retinal, frequency , 1996, Vision Research.

[52]  D. Regan Storage of spatial-frequency information and spatial-frequency discrimination , 1985 .

[53]  George A. Alvarez,et al.  Variability in the quality of visual working memory , 2012, Nature Communications.

[54]  Ashleigh M. Richard,et al.  Understanding the function of visual short-term memory: transsaccadic memory, object correspondence, and gaze correction. , 2008, Journal of experimental psychology. General.

[55]  Paul M Bays,et al.  Working memory retrieval as a decision process. , 2014, Journal of vision.

[56]  Rosanne L Rademaker,et al.  The impact of interference on short-term memory for visual orientation. , 2015, Journal of experimental psychology. Human perception and performance.

[57]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[58]  Xiao-Jing Wang,et al.  From Distributed Resources to Limited Slots in Multiple-Item Working Memory: A Spiking Network Model with Normalization , 2012, The Journal of Neuroscience.

[59]  Mary M Hayhoe,et al.  Visual memory and motor planning in a natural task. , 2003, Journal of vision.