Time Limits During Visual Foraging Reveal Flexible Working Memory Templates

During difficult foraging tasks, humans rarely switch between target categories, but switch frequently during easier foraging. Does this reflect fundamental limits on visual working memory (VWM) capacity or simply strategic choice due to effort? Our participants performed time-limited or unlimited foraging tasks where they tapped stimuli from 2 target categories while avoiding items from 2 distractor categories. These time limits should have no effect if capacity imposes limits on VWM representations but more flexible VWM could allow observers to use VWM according to task demands in each case. We found that with time limits, participants switched more frequently and switch-costs became much smaller than during unlimited foraging. Observers can therefore switch between complex (conjunction) target categories when needed. We propose that while maintaining many complex templates in working memory is effortful and observers avoid this, they can do so if this fits task demands, showing the flexibility of working memory representations used for visual exploration. This is in contrast with recent proposals, and we discuss the implications of these findings for theoretical accounts of working memory.

[1]  Valerie M. Beck,et al.  Simultaneous Control of Attention by Multiple Working Memory Representations , 2012, Psychological science.

[2]  Arni Kristjánsson,et al.  The boundary conditions of priming of visual search: From passive viewing through task-relevant working memory load , 2013, Psychonomic bulletin & review.

[3]  H. Müller,et al.  Searching for unknown feature targets on more than one dimension: Investigating a “dimension-weighting” account , 1996, Perception & psychophysics.

[4]  V. Lamme,et al.  Forgotten but not gone: Retro-cue costs and benefits in a double-cueing paradigm suggest multiple states in visual short-term memory. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[5]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[6]  Edward F. Ester,et al.  PSYCHOLOGICAL SCIENCE Research Article Stimulus-Specific Delay Activity in Human Primary Visual Cortex , 2022 .

[7]  B. Hood,et al.  Is Visual Search Really like Foraging? , 2001, Perception.

[8]  A. Treisman Focused attention in the perception and retrieval of multidimensional stimuli , 1977 .

[9]  Edward Vul,et al.  A Bayesian Optimal Foraging Model of Human Visual Search , 2012, Psychological science.

[10]  S Magnussen,et al.  The psychophysics of perceptual memory , 1999, Psychological research.

[11]  K. Oberauer Access to information in working memory: exploring the focus of attention. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[12]  M. Dawkins Shifts of ‘attention’ in chicks during feeding , 1971 .

[13]  Árni Kristjánsson,et al.  Visual Foraging With Fingers and Eye Gaze , 2016, i-Perception.

[14]  J. Wolfe,et al.  What Can 1 Million Trials Tell Us About Visual Search? , 1998 .

[15]  H. Egeth,et al.  Overriding stimulus-driven attentional capture , 1994, Perception & psychophysics.

[16]  P. Cavanagh,et al.  The Capacity of Visual Short-Term Memory is Set Both by Visual Information Load and by Number of Objects , 2004, Psychological science.

[17]  A. Bond,et al.  Visual search and selection of natural stimuli in the pigeon: the attention threshold hypothesis. , 1983, Journal of experimental psychology. Animal behavior processes.

[18]  D. A. Riley,et al.  Visual search for natural grains in pigeons (Columba livia): search images and selective attention. , 1996, Journal of experimental psychology. Animal behavior processes.

[19]  Jeremy M Wolfe,et al.  When is it time to move to the next raspberry bush? Foraging rules in human visual search. , 2013, Journal of vision.

[20]  C. Bundesen A theory of visual attention. , 1990, Psychological review.

[21]  Thomas T. Hills,et al.  Adaptive Lévy Processes and Area-Restricted Search in Human Foraging , 2013, PloS one.

[22]  G. Woodman,et al.  The time course of consolidation in visual working memory. , 2006, Journal of experimental psychology. Human perception and performance.

[23]  F. Tong,et al.  Decoding reveals the contents of visual working memory in early visual areas , 2009, Nature.

[24]  P. Cavanagh,et al.  Flexible cognitive resources: competitive content maps for attention and memory , 2013, Trends in Cognitive Sciences.

[25]  R W Remington,et al.  The structure of attentional control: contingent attentional capture by apparent motion, abrupt onset, and color. , 1994, Journal of experimental psychology. Human perception and performance.

[26]  C M Moore,et al.  Looking for two targets at the same time: One search or two? , 1993, Perception & psychophysics.

[27]  Paul M Bays,et al.  Dynamic Shifts of Limited Working Memory Resources in Human Vision , 2008, Science.

[28]  P. Roelfsema,et al.  The Distributed Nature of Working Memory , 2017, Trends in Cognitive Sciences.

[29]  Irida Mance,et al.  Visual working memory. , 2013, Wiley interdisciplinary reviews. Cognitive science.

[30]  Martin Eimer,et al.  Qualitative differences in the guidance of attention during single-color and multiple-color visual search: behavioral and electrophysiological evidence. , 2013, Journal of experimental psychology. Human perception and performance.

[31]  G. Woodman,et al.  Do the contents of visual working memory automatically influence attentional selection during visual search? , 2007, Journal of experimental psychology. Human perception and performance.

[32]  Árni Kristjánsson,et al.  Common Attentional Constraints in Visual Foraging , 2014, PloS one.

[33]  G. Humphreys,et al.  Automatic guidance of attention from working memory , 2008, Trends in Cognitive Sciences.

[34]  Árni Kristjánsson,et al.  Priming in visual search: Separating the effects of target repetition, distractor repetition and role-reversal , 2008, Vision Research.

[35]  S. Shettleworth,et al.  Detection of cryptic prey: search image or search rate? , 1992, Journal of experimental psychology. Animal behavior processes.

[36]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[37]  J. Jonides,et al.  Overlapping mechanisms of attention and spatial working memory , 2001, Trends in Cognitive Sciences.

[38]  Harold Pashler,et al.  A Boolean map theory of visual attention. , 2007, Psychological review.

[39]  B. Green,et al.  Color coding in a visual search task. , 1956, Journal of experimental psychology.

[40]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[41]  Jeremy M. Wolfe,et al.  Guided Search 4.0: Current Progress With a Model of Visual Search , 2007, Integrated Models of Cognitive Systems.

[42]  J. P. Cavanagh,et al.  The equivalence of target and nontarget processing in visual search , 1971 .

[43]  George A. Alvarez,et al.  The capacity of visual short-term memory is set by total information load, not number of objects , 2010 .

[44]  Yuhong Jiang,et al.  Setting up the target template in visual search. , 2005, Journal of vision.

[45]  P. Roelfsema,et al.  Different States in Visual Working Memory: When It Guides Attention and When It Does Not , 2022 .

[46]  Christian N L Olivers,et al.  Attentional guidance by salient feature singletons depends on intertrial contingencies. , 2003, Journal of experimental psychology. Human perception and performance.

[47]  Á. Kristjánsson,et al.  Understanding visual attention in childhood: Insights from a new visual foraging task , 2016, Cognitive research: principles and implications.

[48]  Árni Kristjánsson,et al.  Are Foraging Patterns in Humans Related to Working Memory and Inhibitory Control , 2017 .

[49]  Todd S Horowitz,et al.  The multi-item localization (MILO) task: Measuring the spatiotemporal context of vision for action , 2004, Perception & psychophysics.

[50]  Mark W. Greenlee,et al.  Stimulus-specific mechanisms of visual short-term memory , 1991, Vision Research.

[51]  Pieter R Roelfsema,et al.  Matching of visual input to only one item at any one time , 2009, Psychological research.

[52]  Chen Shuo The Capacity of Visual Working Memory for Motion Direction of Objects , 2006 .

[53]  Nancy B. Carlisle,et al.  How visual working memory contents influence priming of visual attention , 2018, Psychological research.

[54]  Geoffrey F. Woodman,et al.  Attentional Templates in Visual Working Memory , 2011, The Journal of Neuroscience.

[55]  Jan Theeuwes,et al.  In competition for the attentional template: can multiple items within visual working memory guide attention? , 2014, Journal of experimental psychology. Human perception and performance.

[56]  Christian N. L. Olivers,et al.  The costs of switching attentional sets , 2011, Attention, perception & psychophysics.