Set-size effects in change detection depend on failures of retrieval and/or comparison and not on perception, encoding or storage

Set-size effects in change detection is often used to investigate the capacity limits of dividing attention. Such capacity limits have been attributed to a variety of processes including perception, memory encoding, memory storage, memory retrieval, comparison and decision. In this study, we investigated the locus of the effect of increasing set size from 1 to 2. To measure purely attentional effects and not other phenomena such as crowding, a precue was used to manipulate relevant set size and keep the display constant across conditions. The task was to detect a change in the orientation of 1 or 2 Gabor patterns. The locus of the capacity limits was determined by varying when observers were cued to the only stimulus that was relevant. We began by measuring the baseline set-size effect in an initial experiment. In the next experiment, a 100% valid postcue was added to test for an effect of decision. This postcue did not change the set-size effects. In the critical experiments, a 100% valid cue was provided during the retention interval between displays, or only one stimulus was presented in the second display (local recognition). For both of these conditions, there was little or no set-size effect. This pattern of results was found for both hard-to-discriminate stimuli typical of perception experiments and easy-to-discriminate stimuli typical of memory experiments. These results are consistent with capacity limits in memory retrieval, and/or comparison. For these set sizes, the results are not consistent with capacity limits in perception, memory encoding or memory storage. Significance Section The change detection paradigm is often used to demonstrate effects of divided attention. But it is not clear whether these effects are due to perception, memory, or judgment and decision. In this article, we present new evidence that the divided attention effect in change detection is due to limits in memory retrieval or comparison processes. These results are not consistent with limits in perception, memory encoding or memory storage.

[1]  Melonie Williams,et al.  Directed forgetting and directed remembering in visual working memory. , 2012, Journal of experimental psychology. Learning, memory, and cognition.

[2]  Melissa R. Beck,et al.  Accessing long-term memory representations during visual change detection , 2011, Memory & cognition.

[3]  H Pashler,et al.  Attentional limits in memory retrieval. , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[4]  J. Palmer Set-size effects in visual search: The effect of attention is independent of the stimulus for simple tasks , 1994, Vision Research.

[5]  N. Cowan The focus of attention as observed in visual working memory tasks: Making sense of competing claims , 2011, Neuropsychologia.

[6]  Simon Farrell,et al.  The Playing Field : Findings for Evaluating Hypotheses About WM Capacity , 2016 .

[7]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[8]  Alex L. White,et al.  Evidence of Serial Processing in Visual Word Recognition , 2018, Psychological science.

[9]  Mark W. Becker,et al.  Parallel consolidation of simple features into visual short-term memory. , 2012, Journal of experimental psychology. Human perception and performance.

[10]  Gary J. Gargano,et al.  Directed forgetting in implicit and explicit memory tests: A comparison of methods. , 1993 .

[11]  G. Woodman,et al.  The comparison of visual working memory representations with perceptual inputs. , 2009, Journal of experimental psychology. Human perception and performance.

[12]  Wei Ji Ma,et al.  Bayesian microsaccade detection , 2017, Journal of vision.

[13]  Jeffrey N Rouder,et al.  An assessment of fixed-capacity models of visual working memory , 2008, Proceedings of the National Academy of Sciences.

[14]  J. Deutsch Perception and Communication , 1958, Nature.

[15]  Alessandra S. Souza,et al.  In search of the focus of attention in working memory: 13 years of the retro-cue effect , 2016, Attention, perception & psychophysics.

[16]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[17]  Anna Christina Nobre,et al.  Orienting attention to locations in mental representations , 2012, Attention, perception & psychophysics.

[18]  John Palmer,et al.  Extending the simultaneous-sequential paradigm to measure perceptual capacity for features and words. , 2011, Journal of experimental psychology. Human perception and performance.

[19]  Bonnie L. Angelone,et al.  The Relationship between Change Detection and Recognition of Centrally Attended Objects in Motion Pictures , 2003, Perception.

[20]  Michael J. Wright,et al.  Limitations for Change Detection in Multiple Gabor Targets , 2000 .

[21]  A. Treisman,et al.  Binding in short-term visual memory. , 2002, Journal of experimental psychology. General.

[22]  H. Nothdurft The role of features in preattentive vision: Comparison of orientation, motion and color cues , 1993, Vision Research.

[23]  D. Pelli,et al.  Crowding is unlike ordinary masking: distinguishing feature integration from detection. , 2004, Journal of vision.

[24]  B. Farell,et al.  Same-different judgments: a review of current controversies in perceptual comparisons. , 1985, Psychological bulletin.

[25]  R. Rosenholtz Visual search for orientation among heterogeneous distractors: experimental results and implications for signal-detection theory models of search. , 2001, Journal of experimental psychology. Human perception and performance.

[26]  Daniel Gopher,et al.  On the Economy of the Human Processing System: A Model of Multiple Capacity. , 1977 .

[27]  J. Enns,et al.  Object Substitution: A New Form of Masking in Unattended Visual Locations , 1997 .

[28]  A. Hollingworth Failures of retrieval and comparison constrain change detection in natural scenes. , 2003, Journal of experimental psychology. Human perception and performance.

[29]  Klaus Oberauer,et al.  An Interference Model of Visual Working Memory , 2017, Psychological review.

[30]  J. Lund,et al.  Compulsory averaging of crowded orientation signals in human vision , 2001, Nature Neuroscience.

[31]  George Sperling,et al.  The information available in brief visual presentations. , 1960 .

[32]  Timothy F. Brady,et al.  A review of visual memory capacity: Beyond individual items and toward structured representations. , 2011, Journal of vision.

[33]  Reuben Rideaux,et al.  The cost of parallel consolidation into visual working memory. , 2016, Journal of vision.

[34]  J. Palmer Attentional limits on the perception and memory of visual information. , 1990, Journal of experimental psychology. Human perception and performance.

[35]  Alex L. White,et al.  Evidence for unlimited capacity processing of simple features in visual cortex , 2017, Journal of vision.

[36]  Peter E. Keller,et al.  The ADaptation and Anticipation Model (ADAM) of sensorimotor synchronization , 2013, Front. Hum. Neurosci..

[37]  Theron Alexander Same or different , 1971 .

[38]  Victor A. F. Lamme,et al.  Are There Multiple Visual Short-Term Memory Stores? , 2008, PloS one.

[39]  C. L. M. The Psychology of Attention , 1890, Nature.

[40]  D. Navon,et al.  Role of outcome conflict in dual-task interference. , 1987, Journal of experimental psychology. Human perception and performance.

[41]  J F Stein,et al.  Does Attention Modulate the Perception of Luminance Changes? , 1992, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[42]  Preeti Verghese,et al.  The psychophysics of visual search , 2000, Vision Research.

[43]  Wei Ji Ma,et al.  Probabilistic Computation in Human Perception under Variability in Encoding Precision , 2012, PloS one.

[44]  Daniel T. Levin,et al.  Evidence for Preserved Representations in Change Blindness , 2002, Consciousness and Cognition.

[45]  Klaus Oberauer,et al.  On the Automaticity of Familiarity in Short-term Recognition: A Test of the Dual-Process Assumption with the PRP Paradigm , 2018, Journal of cognition.

[46]  B. McElree,et al.  Attended and Non-Attended States in Working Memory: Accessing Categorized Structures , 1998 .

[47]  Colin M. Macleod,et al.  Directed forgetting of visual symbols: Evidence for nonverbal selective rehearsal , 2009, Memory & cognition.

[48]  W. Ma,et al.  A detection theory account of change detection. , 2004, Journal of vision.

[49]  Nancy B. Carlisle,et al.  The benefit of forgetting , 2012, Psychonomic Bulletin & Review.

[50]  J. Palmer,et al.  Very short-term visual memory for size and shape , 1988, Perception & psychophysics.

[51]  B. Julesz,et al.  Withdrawing attention at little or no cost: Detection and discrimination tasks , 1998, Perception & psychophysics.

[52]  K. Oberauer The focus of attention in working memory—from metaphors to mechanisms , 2013, Front. Hum. Neurosci..

[53]  Mark W. Becker,et al.  Serial Consolidation of Orientation Information Into Visual Short-Term Memory , 2013, Psychological science.

[54]  Evie Vergauwe,et al.  Attentional refreshing of information in working memory: Increased immediate accessibility of just-refreshed representations☆ , 2017 .

[55]  D. Heeger,et al.  Attentional Enhancement via Selection and Pooling of Early Sensory Responses in Human Visual Cortex , 2011, Neuron.

[56]  Wei Ji Ma,et al.  No Evidence for an Item Limit in Change Detection , 2013, PLoS Comput. Biol..

[57]  D. Kahneman Attention and Effort , 1973 .

[58]  Won Mok Shim,et al.  Interference from filled delays on visual change detection. , 2006, Journal of vision.

[59]  H. Spekreijse,et al.  Large capacity storage of integrated objects before change blindness , 2003, Vision Research.

[60]  B. G. Rosenthal Hypnotic recall of material learned under anxiety- and non-anxiety-producing conditions. , 1944 .

[61]  J SWETS,et al.  Decision processes in perception. , 1961, Psychological review.

[62]  Melissa R. Beck,et al.  The roles of encoding, retrieval, and awareness , 2007, Memory & cognition.

[63]  N. Cowan Evolving conceptions of memory storage, selective attention, and their mutual constraints within the human information-processing system. , 1988, Psychological bulletin.

[64]  William Epstein,et al.  Selective search in directed forgetting. , 1972 .

[65]  W. P. Tanner PHYSIOLOGICAL IMPLICATIONS OF PSYCHOPHYSICAL DATA * , 1961, Annals of the New York Academy of Sciences.

[66]  Jesse S. Husk,et al.  The effect of motion on crowding: zooming text. , 2015, Journal of vision.

[67]  Yuhong Jiang,et al.  Distributing versus focusing attention in visual short-term memory , 2007, Psychonomic bulletin & review.

[68]  Jonathan I. Flombaum,et al.  Two Items Remembered as Precisely as One , 2013, Psychological science.

[69]  R M Shiffrin,et al.  Forgetting: Trace Erosion or Retrieval Failure? , 1970, Science.

[70]  B. Dosher,et al.  Serial Retrieval Processes in the Recovery of Order Information , 1993 .

[71]  Rachel S. Sussman,et al.  Orienting attention in visual working memory reduces interference from memory probes. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[72]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[73]  Benjamin J. Tamber-Rosenau,et al.  Crowding in Visual Working Memory Reveals Its Spatial Resolution and the Nature of Its Representations , 2015, Psychological science.

[74]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[75]  Kimron L. Shapiro,et al.  Spatiotemporal configuration of memory arrays as a component of VWM representations , 2014 .

[76]  Reuben Rideaux,et al.  Evidence for parallel consolidation of motion direction and orientation into visual short-term memory. , 2015, Journal of vision.

[77]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[78]  Stephen R Mitroff,et al.  Nothing compares 2 views: Change blindness can occur despite preserved access to the changed information , 2004, Perception & psychophysics.

[79]  H. Orbach,et al.  Contrast discrimination, non–uniform patterns and change blindness , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[80]  S. Luck,et al.  The influence of similarity on visual working memory representations , 2009, Visual cognition.

[81]  Jeffrey N. Rouder,et al.  Evidence for discrete-state processing in recognition memory , 2012, Proceedings of the National Academy of Sciences.

[82]  D. Levi,et al.  Visual crowding: a fundamental limit on conscious perception and object recognition , 2011, Trends in Cognitive Sciences.

[83]  G. Rhodes,et al.  Sex-specific norms code face identity. , 2011, Journal of vision.

[84]  I. Thornton,et al.  Change Detection Without Awareness: Do Explicit Reports Underestimate the Representation of Change in the Visual System? , 2000 .

[85]  H. Hawkins,et al.  Visual attention modulates signal detectability. , 1990, Journal of experimental psychology. Human perception and performance.

[86]  A. Hollingworth,et al.  Journal of Experimental Psychology : Human Perception and Performance Selective Maintenance in Visual Working Memory Does Not Require Sustained Visual Attention , 2012 .

[87]  Mark W. Becker,et al.  The bandwidth of consolidation into visual short-term memory depends on the visual feature , 2014, Visual cognition.

[88]  Françoise Viénot,et al.  A study on chromatic contrast regulation , 2004 .

[89]  Klaus Oberauer,et al.  Getting more from visual working memory: Retro-cues enhance retrieval and protect from visual interference. , 2015, Journal of experimental psychology. Human perception and performance.

[90]  Mark W. Becker,et al.  A severe capacity limit in the consolidation of orientation information into visual short-term memory , 2012, Attention, Perception, & Psychophysics.

[91]  Ryan V. Ringer,et al.  Impairing the useful field of view in natural scenes: Tunnel vision versus general interference. , 2016, Journal of vision.

[92]  A. Nobre,et al.  Orienting Attention to Locations in Internal Representations , 2003, Journal of Cognitive Neuroscience.

[93]  M. Chun,et al.  Organization of visual short-term memory. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[94]  E. Vogel,et al.  PSYCHOLOGICAL SCIENCE Research Article Visual Working Memory Represents a Fixed Number of Items Regardless of Complexity , 2022 .

[95]  K. Forster,et al.  Forty-five years after Broadbent (1958): still no identification without attention. , 2004, Psychological review.

[96]  J E Hoffman,et al.  A two-stage model of visual search , 1979, Perception & psychophysics.

[97]  B. Dosher,et al.  Serial position and set size in short-term memory: The time course of recognition , 1989 .

[98]  Mark W. Becker,et al.  The Role of Iconic Memory in Change-Detection Tasks , 2000, Perception.

[99]  H. BOUMA,et al.  Interaction Effects in Parafoveal Letter Recognition , 1970, Nature.

[100]  Andrew R. A. Conway,et al.  On the capacity of attention: Its estimation and its role in working memory and cognitive aptitudes , 2005, Cognitive Psychology.

[101]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[102]  Jonathan E. Thiele,et al.  Recognition Decisions From Visual Working Memory Are Mediated by Continuous Latent Strengths , 2017, Cogn. Sci..

[103]  Edward K Vogel,et al.  Flexibility in visual working memory: Accurate change detection in the face of irrelevant variations in position , 2012, Visual cognition.