The role of visual attention in multiple object tracking: Evidence from ERPs

We examined the role of visual attention in the multiple object tracking (MOT) task by measuring the amplitude of the N1 component of the event-related potential to probe flashes presented on targets, distractors, or empty background areas. We found evidence that visual attention enhances targets and suppresses distractors (Experiments 1 and 3). However, we also found that when tracking load was light (two targets and two distractors), accurate tracking could be carried out without any apparent contribution from the visual attention system (Experiment 2). Our results suggest that attentional selection during MOT is flexibly determined by task demands, as well as tracking load, and that visual attention may not always be necessary for accurate tracking.

[1]  H Pashler,et al.  Familiarity and visual change detection , 1988, Perception & psychophysics.

[2]  S. Hillyard,et al.  Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. , 1991, Journal of experimental psychology. Human perception and performance.

[3]  E. Viding,et al.  Load theory of selective attention and cognitive control. , 2004, Journal of experimental psychology. General.

[4]  G. Alvarez,et al.  How many locations can be selected at once? , 2007, Journal of experimental psychology. Human perception and performance.

[5]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[6]  James E. Reilly,et al.  Selective Nontarget Inhibition in Multiple Object Tracking (MOT) , 2008 .

[7]  Z. Pylyshyn Visual indexes, preconceptual objects, and situated vision , 2001, Cognition.

[8]  Z. Pylyshyn,et al.  What is a visual object? Evidence from target merging in multiple object tracking , 2001, Cognition.

[9]  P. Cavanagh,et al.  The Spatial Resolution of Visual Attention , 2001, Cognitive Psychology.

[10]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[11]  Z. Pylyshyn,et al.  Selective nontarget inhibition in Multiple Object Tracking , 2008 .

[12]  Nancy Kanwisher,et al.  fMRI evidence for objects as the units of attentional selection , 1999, Nature.

[13]  S. Hillyard,et al.  Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. , 1991, Journal of experimental psychology. Human perception and performance.

[14]  S. A. Hillyard,et al.  Sustained division of the attentional spotlight , 2003, Nature.

[15]  Z. Pylyshyn,et al.  Dynamics of target selection in multiple object tracking (MOT). , 2006, Spatial vision.

[16]  H. Egeth,et al.  Overriding stimulus-driven attentional capture , 1994, Perception & psychophysics.

[17]  G. McCarthy,et al.  Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. , 1977, Science.

[18]  C. Eriksen,et al.  Allocation of attention in the visual field. , 1985, Journal of experimental psychology. Human perception and performance.

[19]  S. Hillyard,et al.  Selective attention to color and location: An analysis with event-related brain potentials , 1984, Perception & psychophysics.

[20]  C. Eriksen,et al.  Visual attention within and around the field of focal attention: A zoom lens model , 1986, Perception & psychophysics.

[21]  Antígona Martínez,et al.  Spatial attention facilitates selection of illusory objects: Evidence from event-related brain potentials , 2007, Brain Research.

[22]  Bruno G. Breitmeyer,et al.  Visual masking : an integrative approach , 1984 .

[23]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[24]  Martin Eimer,et al.  Uninformative symbolic cues may bias visual-spatial attention: behavioral and electrophysiological evidence , 1997, Biological Psychology.

[25]  P. Cavanagh,et al.  Cortical fMRI activation produced by attentive tracking of moving targets. , 1998, Journal of neurophysiology.

[26]  J. Hoffman,et al.  Spatial selectivity in visual search , 1981, Perception & psychophysics.

[27]  Matthias M. Müller,et al.  Sustained division of spatial attention to multiple locations within one hemifield , 2007, Neuroscience Letters.

[28]  J. Hoffman,et al.  Multiple Object Tracking in People With Williams Syndrome and in Normally Developing Children , 2005, Psychological science.

[29]  Z. Pylyshyn Some puzzling findings in multiple object tracking (MOT): II. Inhibition of moving nontargets , 2006 .

[30]  Antigona Martínez,et al.  Source analysis of event-related cortical activity during visuo-spatial attention. , 2003, Cerebral cortex.

[31]  T. Horowitz,et al.  Attentional enhancement during multiple-object tracking , 2009, Psychonomic bulletin & review.

[32]  Jeremy M Wolfe,et al.  How do we track invisible objects? , 2006, Psychonomic bulletin & review.

[33]  S. Luck,et al.  Attention-Related Modulation of Sensory-Evoked Brain Activity in a Visual Search Task , 1993, Journal of Cognitive Neuroscience.

[34]  Z. Pylyshyn,et al.  Tracking Multiple Items Through Occlusion: Clues to Visual Objecthood , 1999, Cognitive Psychology.

[35]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[36]  M. Posner,et al.  Attention and the detection of signals. , 1980, Journal of experimental psychology.

[37]  Joan López-Moliner,et al.  Motion signal and the perceived positions of moving objects. , 2007, Journal of vision.

[38]  C. Eriksen,et al.  Temporal and spatial characteristics of selective encoding from visual displays , 1972 .

[39]  A. Imai,et al.  Event-related potential correlates of judgment categories and detection sensitivity in a visual detection task , 2004, Vision Research.

[40]  E. Vogel,et al.  Neural Measures of Individual Differences in Selecting and Tracking Multiple Moving Objects , 2008, The Journal of Neuroscience.

[41]  Jonathan I. Flombaum,et al.  Attentional resources in visual tracking through occlusion: The high-beams effect , 2008, Cognition.

[42]  S. Hillyard,et al.  Cortical sources of the early components of the visual evoked potential , 2002, Human brain mapping.

[43]  Z. Pylyshyn Some puzzling findings in multiple object tracking: I. Tracking without keeping track of object identities , 2004 .

[44]  E. Donchin,et al.  On quantifying surprise: the variation of event-related potentials with subjective probability. , 1977, Psychophysiology.

[45]  S A Hillyard,et al.  Spatial gradients of visual attention: behavioral and electrophysiological evidence. , 1988, Electroencephalography and clinical neurophysiology.

[46]  R. Cardinal,et al.  ANOVA for the Behavioral Sciences Researcher , 2005 .

[47]  J. Duncan Selective attention and the organization of visual information. , 1984, Journal of experimental psychology. General.

[48]  Steven B. Most,et al.  What you see is what you set: sustained inattentional blindness and the capture of awareness. , 2005, Psychological review.

[49]  B. Scholl,et al.  PSYCHOLOGICAL SCIENCE Research Article ATTENTIVE TRACKING OF OBJECTS VERSUS SUBSTANCES , 2022 .

[50]  G. Alvarez,et al.  Spatial separation between targets constrains maintenance of attention on multiple objects , 2008, Psychonomic bulletin & review.

[51]  B. Scholl Objects and attention: the state of the art , 2001, Cognition.

[52]  Steven A. Hillyard,et al.  Objects Are Highlighted by Spatial Attention , 2006 .

[53]  B. Gillam,et al.  Stereomotion perception for a monocularly camouflaged stimulus. , 2007, Journal of vision.

[54]  Brian D. Fisher,et al.  Evidence against a speed limit in multiple-object tracking , 2008, Psychonomic bulletin & review.

[55]  Z. Pylyshyn,et al.  Why are small and large numbers enumerated differently? A limited-capacity preattentive stage in vision. , 1994, Psychological review.

[56]  P. Cavanagh,et al.  Tracking multiple targets with multifocal attention , 2005, Trends in Cognitive Sciences.

[57]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[58]  Edgar Erdfelder,et al.  G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences , 2007, Behavior research methods.

[59]  Z W Pylyshyn,et al.  Tracking multiple independent targets: evidence for a parallel tracking mechanism. , 1988, Spatial vision.

[60]  Erik Blaser,et al.  Tracking an object through feature space , 2000, Nature.

[61]  George A Alvarez,et al.  How many objects can you track? Evidence for a resource-limited attentive tracking mechanism. , 2007, Journal of vision.

[62]  Richard B Buxton,et al.  Putting spatial attention on the map: timing and localization of stimulus selection processes in striate and extrastriate visual areas , 2001, Vision Research.

[63]  R. Rafal,et al.  Shifting visual attention between objects and locations: evidence from normal and parietal lesion subjects. , 1994, Journal of experimental psychology. General.

[64]  G. Mandler,et al.  Subitizing: an analysis of its component processes. , 1982, Journal of experimental psychology. General.

[65]  G. Woodman,et al.  Event-related potential studies of attention , 2000, Trends in Cognitive Sciences.

[66]  Z. Pylyshyn,et al.  Multiple object tracking and attentional processing. , 2000, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[67]  C. Eriksen,et al.  Effects of noise letters upon the identification of a target letter in a nonsearch task , 1974 .

[68]  N. Lavie Distracted and confused?: Selective attention under load , 2005, Trends in Cognitive Sciences.

[69]  Charles Curtis Eriksen,et al.  The extent of processing of noise elements during selective encoding from visual displays , 1973 .

[70]  S J Luck,et al.  Spatial filtering during visual search: evidence from human electrophysiology. , 1994, Journal of experimental psychology. Human perception and performance.

[71]  George Sperling,et al.  The information available in brief visual presentations. , 1960 .

[72]  E. Donchin Presidential address, 1980. Surprise!...Surprise? , 1981, Psychophysiology.

[73]  E. Averbach,et al.  Short-term memory in vision , 1961 .

[74]  S. Luck,et al.  Electrophysiological correlates of feature analysis during visual search. , 1994, Psychophysiology.

[75]  M. Valdés-Sosa,et al.  Switching Attention without Shifting the Spotlight: Object-Based Attentional Modulation of Brain Potentials , 1998, Journal of Cognitive Neuroscience.

[76]  Helga C. Arsenio,et al.  Do multielement visual tracking and visual search draw continuously on the same visual attention resources? , 2005, Journal of experimental psychology. Human perception and performance.

[77]  J. Coull Neural correlates of attention and arousal: insights from electrophysiology, functional neuroimaging and psychopharmacology , 1998, Progress in Neurobiology.

[78]  N. Kanwisher,et al.  The lateral occipital complex and its role in object recognition , 2001, Vision Research.

[79]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[80]  M. Chun,et al.  Selecting and perceiving multiple visual objects , 2009, Trends in Cognitive Sciences.

[81]  Edward K. Vogel,et al.  Pushing around the Locus of Selection: Evidence for the Flexible-selection Hypothesis , 2005, Journal of Cognitive Neuroscience.

[82]  D. Somers,et al.  Multiple Spotlights of Attentional Selection in Human Visual Cortex , 2004, Neuron.

[83]  S. Hillyard,et al.  Event-related brain potentials in the study of visual selective attention. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[84]  Steven A. Hillyard,et al.  The Role of Spatial Attention in the Selection of Real and Illusory Objects , 2007, The Journal of Neuroscience.

[85]  H. Pashler,et al.  Evidence for split attentional foci. , 2000, Journal of Experimental Psychology: Human Perception and Performance.

[86]  J. Hulleman The mathematics of multiple object tracking: From proportions correct to number of objects tracked , 2005, Vision Research.

[87]  J. Polich,et al.  Cognitive and biological determinants of P300: an integrative review , 1995, Biological Psychology.

[88]  Catharine Abell,et al.  Seeing and Visualizing: It's Not What You Think , 2005 .

[89]  L. M. Ward,et al.  Orienting of Attention , 2008 .