Eye fixation-related potentials in free viewing identify encoding failures in change detection

We considered the hypothesis that spontaneous dissociation between the direction of attention and eye movement causes encoding failure in change detection. We tested this hypothesis by analyzing eye fixation-related potentials (EFRP) at the encoding stage of a change blindness task; when participants freely inspect a scene containing an unmarked target region, in which a change will occur in a subsequent presentation. We measured EFRP amplitude prior to the execution of a saccade, depending on its starting or landing position relative to the target region. For those landings inside the target region, we found a difference in EFRP between correct detection and failure. Overall, correspondence between EFRP amplitude and the size of the saccade predicted successful detection of change; lack of correspondence was followed by change blindness. By contrast, saccade sizes and fixation durations around the target region were unrelated to subsequent change detection. Since correspondence between EFRP and eye movement indicates that overt attention was given to the target region, we concluded that overt attention is needed for successful encoding and that dissociation between eye movement and attention leads to change blindness.

[1]  Andrea Schankin,et al.  Electrophysiological correlates of stimulus processing in change blindness , 2007, Experimental Brain Research.

[2]  J. Henderson,et al.  The effects of semantic consistency on eye movements during complex scene viewing , 1999 .

[3]  G R Loftus,et al.  The functional visual field during picture viewing. , 1980, Journal of experimental psychology. Human learning and memory.

[4]  H. Pashler,et al.  Evidence for split attentional foci. , 2000, Journal of Experimental Psychology: Human Perception and Performance.

[5]  Takashi R Sato,et al.  Neuronal Basis of Covert Spatial Attention in the Frontal Eye Field , 2005, The Journal of Neuroscience.

[6]  B. Dosher,et al.  The role of attention in the programming of saccades , 1995, Vision Research.

[7]  Ian M. Thornton,et al.  Representation of Change: Separate Electrophysiological Markers of Attention, Awareness, and Implicit Processing , 2003, Journal of Cognitive Neuroscience.

[8]  Melissa R. Beck,et al.  The roles of encoding, retrieval, and awareness , 2007, Memory & cognition.

[9]  D. Melcher Selective attention and the active remapping of object features in trans-saccadic perception , 2009, Vision Research.

[10]  Jeffrey D Schall,et al.  On the role of frontal eye field in guiding attention and saccades , 2004, Vision Research.

[11]  J. Henderson Regarding Scenes , 2007 .

[12]  M. Corbetta,et al.  A Common Network of Functional Areas for Attention and Eye Movements , 1998, Neuron.

[13]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[14]  G J Zelinsky,et al.  Eye movements during change detection: Implications for search constraints, memory limitations, and scanning strategies , 2001, Perception & psychophysics.

[15]  Bradley S Gibson,et al.  Directing spatial attention within an object: altering the functional equivalence of shape descriptions. , 1991, Journal of experimental psychology. Human perception and performance.

[16]  J. Hoffman,et al.  The role of visual attention in saccadic eye movements , 1995, Perception & psychophysics.

[17]  C. J. Downing Expectancy and visual-spatial attention: effects on perceptual quality. , 1988, Journal of experimental psychology. Human perception and performance.

[18]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[19]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[20]  Katsumi Aoki,et al.  Recent development of flow visualization , 2004, J. Vis..

[21]  P. Cavanagh,et al.  Visual stability based on remapping of attention pointers , 2010, Trends in Cognitive Sciences.

[22]  G. Underwood,et al.  Low-level visual saliency does not predict change detection in natural scenes. , 2007, Journal of vision.

[23]  Diane Kurtzberg,et al.  Topographic analysis of human cortical potentials preceding self-initiated and visually triggered saccades , 1982, Brain Research.

[24]  Ronald A. Rensink,et al.  Change blindness: past, present, and future , 2005, Trends in Cognitive Sciences.

[25]  Katherine M. Armstrong,et al.  Visual and oculomotor selection: links, causes and implications for spatial attention , 2006, Trends in Cognitive Sciences.

[26]  John E Richards,et al.  Cortical sources of event-related potentials in the prosaccade and antisaccade task. , 2003, Psychophysiology.

[27]  J. Richards Cortical Indexes of Saccade Planning Following Covert Orienting in 20-Week-Old Infants , 2001 .

[28]  Peter W Dicke,et al.  Neuron-specific contribution of the superior colliculus to overt and covert shifts of attention , 2004, Nature Neuroscience.

[29]  J. Henderson,et al.  Accurate visual memory for previously attended objects in natural scenes , 2002 .

[30]  G. Goldberg,et al.  Topography of scalp potentials preceding self‐initiated saccades , 1990, Neurology.

[31]  P. Cavanagh,et al.  Tracking multiple targets with multifocal attention , 2005, Trends in Cognitive Sciences.

[32]  T. Moore,et al.  The neurobiology of visual attention: finding sources , 2006, Current Opinion in Neurobiology.

[33]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[34]  G. Rizzolatti,et al.  Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory of attention , 1987, Neuropsychologia.

[35]  Takashi R Sato,et al.  Effects of Stimulus-Response Compatibility on Neural Selection in Frontal Eye Field , 2003, Neuron.

[36]  P. Corballis,et al.  Electrophysiological correlates of presaccadic remapping in humans. , 2008, Psychophysiology.

[37]  Bonnie L. Angelone,et al.  Memory for centrally attended changing objects in an incidental real-world change detection paradigm. , 2002, British journal of psychology.

[38]  M. Eimer,et al.  Electrophysiological correlates of change detection. , 2005, Psychophysiology.

[39]  T. Sejnowski,et al.  Removal of eye activity artifacts from visual event-related potentials in normal and clinical subjects , 2000, Clinical Neurophysiology.

[40]  J. Henderson,et al.  The Role of Fixation Position in Detecting Scene Changes Across Saccades , 1999 .

[41]  D. Ballard,et al.  What you see is what you need. , 2003, Journal of vision.

[42]  C. Colby,et al.  Trans-saccadic perception , 2008, Trends in Cognitive Sciences.

[43]  Jan Theeuwes,et al.  When Are Attention and Saccade Preparation Dissociated? , 2009, Psychological science.

[44]  Gergely Csibra,et al.  Attention and oculomotor control: A high-density ERP study of the gap effect , 1997, Neuropsychologia.

[45]  M. Koivisto,et al.  An ERP study of change detection, change blindness, and visual awareness. , 2003, Psychophysiology.

[46]  Xin Chen,et al.  Real-world visual search is dominated by top-down guidance , 2006, Vision Research.

[47]  G. R. Mangun,et al.  PII: S0042-6989(01)00046-3 , 2001 .

[48]  F Jagla,et al.  Saccadic eye movement related potentials. , 2007, Physiological research.

[49]  D L Sparks,et al.  Translation of sensory signals into commands for control of saccadic eye movements: role of primate superior colliculus. , 1986, Physiological reviews.

[50]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.