The reliability and internal consistency of one-shot and flicker change detection for measuring individual differences in visual working memory capacity

We investigated the psychometric properties of the one-shot change detection task for estimating visual working memory (VWM) storage capacity—and also introduced and tested an alternative flicker change detection task for estimating these limits. In three experiments, we found that the one-shot whole-display task returns estimates of VWM storage capacity (K) that are unreliable across set sizes—suggesting that the whole-display task is measuring different things at different set sizes. In two additional experiments, we found that the one-shot single-probe variant shows improvements in the reliability and consistency of K estimates. In another additional experiment, we found that a one-shot whole-display-with-click task (requiring target localization) also showed improvements in reliability and consistency. The latter results suggest that the one-shot task can return reliable and consistent estimates of VWM storage capacity (K), and they highlight the possibility that the requirement to localize the changed target is what engenders this enhancement. Through a final series of four experiments, we introduced and tested an alternative flicker change detection method that also requires the observer to localize the changing target and that generates, from response times, an estimate of VWM storage capacity (K). We found that estimates of K from the flicker task correlated with estimates from the traditional one-shot task and also had high reliability and consistency. We highlight the flicker method’s ability to estimate executive functions as well as VWM storage capacity, and discuss the potential for measuring multiple abilities with the one-shot and flicker tasks.

[1]  Ronald A. Rensink.  Visual Search for Change: A Probe into the Nature of Attentional Processing , 2000 .

[2]  Jeffrey N Rouder,et al.  An assessment of fixed-capacity models of visual working memory , 2008, Proceedings of the National Academy of Sciences.

[3]  E. Vogel,et al.  Quantity, not quality: the relationship between fluid intelligence and working memory capacity , 2010, Psychonomic bulletin & review.

[4]  G. Woodman,et al.  Voluntary and automatic attentional control of visual working memory , 2002 .

[5]  E. Vogel,et al.  PSYCHOLOGICAL SCIENCE Research Article Visual Working Memory Represents a Fixed Number of Items Regardless of Complexity , 2022 .

[6]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[7]  X. Tolsa.  The capacity γ , 2014 .

[8]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[9]  Maro G. Machizawa,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004 .

[10]  Timothy F. Brady,et al.  A review of visual memory capacity: Beyond individual items and toward structured representations. , 2011, Journal of vision.

[11]  Andrew R. A. Conway,et al.  On the capacity of attention: Its estimation and its role in working memory and cognitive aptitudes , 2005, Cognitive Psychology.

[12]  M. Osaka,et al.  Age and individual differences in visual working memory deficit induced by overload , 2014, Front. Psychol..

[13]  Timothy F. Brady,et al.  Compression in visual working memory: using statistical regularities to form more efficient memory representations. , 2009, Journal of experimental psychology. General.

[14]  Timothy F. Brady,et al.  Hierarchical Encoding in Visual Working Memory , 2010, Psychological science.

[15]  Punit Shah.  Toward a Neurobiology of Unrealistic Optimism , 2012, Front. Psychology.

[16]  L. Feigenson,et al.  Multiple Spatially Overlapping Sets Can Be Enumerated in Parallel , 2006, Psychological science.

[17]  Patryk A. Laurent,et al.  Value-driven attentional capture , 2011, Proceedings of the National Academy of Sciences.

[18]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[19]  V. Simmering.  The development of visual working memory capacity during early childhood. , 2012, Journal of experimental child psychology.

[20]  Yuhong Jiang,et al.  Method matters: systematic effects of testing procedure on visual working memory sensitivity. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[21]  A. Baddeley,et al.  Attention : selection, awareness, and control : a tribute to Donald Broadbent , 1996 .

[22]  Maro G. Machizawa,et al.  Neural measures reveal individual differences in controlling access to working memory , 2005, Nature.

[23]  Jeffrey N. Rouder,et al.  How to measure working memory capacity in the change detection paradigm , 2011, Psychonomic bulletin & review.

[24]  Ronald A. Rensink,et al.  On the Failure to Detect Changes in Scenes Across Brief Interruptions , 2000 .

[25]  H Pashler,et al.  Familiarity and visual change detection , 1988, Perception & psychophysics.

[26]  A. Treisman.  Visual Attention and the Perception of Features and Objects , 1994 .

[27]  Z W Pylyshyn,et al.  Tracking multiple independent targets: evidence for a parallel tracking mechanism. , 1988, Spatial vision.

[28]  Norman L. Johnson,et al.  Urn models and their application , 1977 .

[29]  Amanda L. Gilchrist,et al.  Age differences in visual working memory capacity: not based on encoding limitations. , 2011, Developmental science.

[30]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[31]  P. Cavanagh,et al.  The Capacity of Visual Short-Term Memory is Set Both by Visual Information Load and by Number of Objects , 2004, Psychological science.

[32]  E. Vogel,et al.  CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE How to Exploit Diversity for Scientific Gain Using Individual Differences to Constrain Cognitive Theory , 2022 .

[33]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[34]  Paul M Bays,et al.  Dynamic Shifts of Limited Working Memory Resources in Human Vision , 2008, Science.

[35]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[36]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[37]  Maro G. Machizawa,et al.  Neural activity predicts individual differences in visual working memory capacity , 2004, Nature.

[38]  W. Ma,et al.  A detection theory account of change detection. , 2004, Journal of vision.

[39]  W. Brown.  SOME EXPERIMENTAL RESULTS IN THE CORRELATION OF MENTAL ABILITIES1 , 1910 .

[40]  N. Cowan.  The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[41]  E. Vogel,et al.  Individual Differences in Recovery Time From Attentional Capture , 2011, Psychological science.

[42]  George A. Alvarez,et al.  Compression in visual short-term memory: Using statistical regularities to form more efficient memory representations , 2010 .

[43]  Jeremy M. Wolfe,et al.  Memory for rejected distractors in visual search? , 2003 .

[44]  A. Anastasi.  Individual differences. , 2020, Annual review of psychology.

[45]  A. Baddeley,et al.  Word length and the structure of short-term memory , 1975 .

[46]  A. Baddeley.  The episodic buffer: a new component of working memory? , 2000, Trends in Cognitive Sciences.

[47]  A. Baddeley,et al.  The Psychology of Learning and Motivation , 1974 .

[48]  Timothy F. Brady,et al.  A probabilistic model of visual working memory: Incorporating higher order regularities into working memory capacity estimates. , 2013, Psychological review.

[49]  G. Alvarez.  Representing multiple objects as an ensemble enhances visual cognition , 2011, Trends in Cognitive Sciences.

[50]  C. Spearman.  CORRELATION CALCULATED FROM FAULTY DATA , 1910 .

[51]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[52]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.

[53]  C. Bundesen,et al.  Changing change detection: Improving the reliability of measures of visual short-term memory capacity , 2009, Psychonomic bulletin & review.

[54]  S. Luck,et al.  The Oxford handbook of event-related potential components , 2011 .

[55]  Todd S. Horowitz,et al.  Visual search has no memory , 1998, Nature.

[56]  Ole Jensen,et al.  Oxford handbook of event-related potential components. , 2011 .

[57]  G. Woodman,et al.  The comparison of visual working memory representations with perceptual inputs. , 2009, Journal of experimental psychology. Human perception and performance.

[58]  A. Baddeley.  Working memory: theories, models, and controversies. , 2012, Annual review of psychology.

[59]  N. Cowan,et al.  Scope of attention, control of attention, and intelligence in children and adults , 2006, Memory & cognition.

[60]  Daniel J. Mitchell,et al.  Encoding strategy accounts for individual differences in change detection measures of VSTM , 2011, Neuropsychologia.

[61]  Kevin J. Riggs,et al.  Changes in the capacity of visual working memory in 5- to 10-year-olds. , 2006, Journal of experimental child psychology.

[62]  Jeremy M Wolfe,et al.  Modeling the role of parallel processing in visual search , 1990, Cognitive Psychology.

[63]  W. A. Phillips.  On the distinction between sensory storage and short-term visual memory , 1974 .

[64]  Leo Poom,et al.  Visual working memory capacity and stimulus categories: a behavioral and electrophysiological investigation , 2011, Experimental Brain Research.

[65]  R. Marois,et al.  Posterior parietal cortex activity predicts individual differences in visual short-term memory capacity , 2005, Cognitive, affective & behavioral neuroscience.

[66]  Melissa E. Libertus,et al.  Visual working memory capacity increases between ages 3 and 8 years, controlling for gains in attention, perception, and executive control , 2016, Attention, Perception, & Psychophysics.

[67]  Ekaterina P. Volkova,et al.  Emotion categorization of body expressions in narrative scenarios , 2014, Front. Psychol..

[68]  Edward Awh,et al.  RETRACTED: A Common Discrete Resource for Visual Working Memory and Visual Search , 2013, Psychological science.

[69]  M. D’Esposito.  Working memory. , 2008, Handbook of clinical neurology.

[70]  G. Woodman,et al.  The time course of consolidation in visual working memory. , 2006, Journal of experimental psychology. Human perception and performance.

[71]  Edward K. Vogel,et al.  What ERPs Can Tell Us about Working Memory , 2011 .

[72]  L. R. Peterson,et al.  Short-term retention of individual verbal items. , 1959, Journal of experimental psychology.

[73]  Amanda L. Gilchrist,et al.  Seven-year-olds allocate attention like adults unless working memory is overloaded. , 2010, Developmental science.

[74]  David J. Therriault,et al.  A latent variable analysis of working memory capacity, short-term memory capacity, processing speed, and general fluid intelligence , 2002 .