Fixation-related potentials in visual search: a combined EEG and eye tracking study.

We report a study of concurrent eye movements and electroencephalographic (EEG) recordings while subjects freely explored a search array looking for hidden targets. We describe a sequence of fixation-event related potentials (fERPs) that unfolds during ∼ 400 ms following each fixation. This sequence highly resembles the event-related responses in a replay experiment, in which subjects kept fixation while a sequence of images occurred around the fovea simulating the spatial and temporal patterns during the free viewing experiment. Similar responses were also observed in a second control experiment where the appearance of stimuli was controlled by the experimenters and presented at the center of the screen. We also observed a relatively early component (∼150 ms) that distinguished between targets and distractors only in the freeviewing condition. We present a novel approach to match the critical properties of two conditions (targets/distractors), which can be readily adapted to other paradigms to investigate EEG components during free eye-movements.

[1]  G. Woodman,et al.  Event-related potential studies of attention , 2000, Trends in Cognitive Sciences.

[2]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[3]  Wilson S. Geisler,et al.  Natural systems analysis , 2008, Electronic Imaging.

[4]  A. Jacobs,et al.  Coregistration of eye movements and EEG in natural reading: analyses and review. , 2011, Journal of experimental psychology. General.

[5]  S. Thorpe,et al.  Speed of processing in the human visual system , 1996, Nature.

[6]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[7]  G. W. Thickbroom,et al.  Premotor negativity associated with saccadic eye movement and finger movement: a comparative study , 1990, Brain Research.

[8]  Bruno A Olshausen,et al.  Timecourse of neural signatures of object recognition. , 2003, Journal of vision.

[9]  Richard M. Leahy,et al.  Brainstorm: A User-Friendly Application for MEG/EEG Analysis , 2011, Comput. Intell. Neurosci..

[10]  Ralf Engbert,et al.  Microsaccade dynamics during covert attention , 2005, Vision Research.

[11]  Friedemann Pulvermüller,et al.  Neuromagnetic evidence for early semantic access in word recognition , 2001, The European journal of neuroscience.

[12]  F. Møller,et al.  Binocular quantification and characterization of microsaccades , 2002, Graefe’s Archive for Clinical and Experimental Ophthalmology.

[13]  Ralf Engbert,et al.  Microsaccades are triggered by low retinal image slip. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[14]  E. John,et al.  Evoked-Potential Correlates of Stimulus Uncertainty , 1965, Science.

[15]  M. Posner,et al.  Establishing a time‐line of word recognition: evidence from eye movements and event‐related potentials , 1998, Neuroreport.

[16]  John J. Foxe,et al.  Visuo-spatial neural response interactions in early cortical processing during a simple reaction time task: a high-density electrical mapping study , 2001, Neuropsychologia.

[17]  J. Lupiáñez,et al.  Temporal attention enhances early visual processing: A review and new evidence from event-related potentials , 2006, Brain Research.

[18]  K. Rayner,et al.  Measuring word recognition in reading: eye movements and event-related potentials , 2003, Trends in Cognitive Sciences.

[19]  E Gordon,et al.  Is the target-to-target interval a critical determinant of P3 amplitude? , 1999, Psychophysiology.

[20]  D. Levi,et al.  The two-dimensional shape of spatial interaction zones in the parafovea , 1992, Vision Research.

[21]  R. Kliegl,et al.  Shortening and prolongation of saccade latencies following microsaccades , 2006, Experimental Brain Research.

[22]  Xoana G. Troncoso,et al.  Saccades and microsaccades during visual fixation, exploration, and search: foundations for a common saccadic generator. , 2008, Journal of vision.

[23]  Yosef Grodzinsky,et al.  Neuroimaging of syntax and syntactic processing , 2006, Current Opinion in Neurobiology.

[24]  S. Dehaene,et al.  Unconscious Masked Priming Depends on Temporal Attention , 2002, Psychological science.

[25]  S. Hillyard,et al.  Selective attention to stimulus location modulates the steady-state visual evoked potential. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[26]  S. Liversedge,et al.  Saccadic eye movements and cognition , 2000, Trends in Cognitive Sciences.

[27]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[28]  H. Basford,et al.  Optimal eye movement strategies in visual search , 2005 .

[29]  An Luo,et al.  We find before we Look: Neural signatures of target detection preceding saccades during visual search , 2010 .

[30]  J. Henderson.  Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[31]  A. Yagi,et al.  Eye fixation related potentials in a proof reading task. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[32]  Ralf Engbert,et al.  SWIFT explorations of age differences in eye movements during reading , 2006, Neuroscience & Biobehavioral Reviews.

[33]  Shlomit Yuval-Greenberg,et al.  Saccadic spike potentials in gamma-band EEG: Characterization, detection and suppression , 2010, NeuroImage.

[34]  J B Poline,et al.  Cerebral mechanisms of word masking and unconscious repetition priming , 2001, Nature Neuroscience.

[35]  F Jagla,et al.  Saccadic eye movement related potentials. , 2007, Physiological research.

[36]  G. Karmos,et al.  Transient cortical excitation at the onset of visual fixation. , 2008, Cerebral cortex.

[37]  Ralf Engbert,et al.  Toward a model of microsaccade generation: the case of microsaccadic inhibition. , 2008, Journal of vision.

[38]  Dario Ringach,et al.  Natural systems analysis. Introduction. , 2009, Visual Neuroscience.

[39]  Stephen L Macknik,et al.  Microsaccades counteract perceptual filling-in. , 2008, Journal of vision.

[40]  A Yagi,et al.  Integrated effect of stimulation at fixation points on EFRP (eye-fixation related brain potentials). , 1999, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[41]  Christopher K. Kovach,et al.  Rapid Interactions between the Ventral Visual Stream and Emotion-Related Structures Rely on a Two-Pathway Architecture , 2008, The Journal of Neuroscience.

[42]  A. Nobre,et al.  Orienting attention in time. Modulation of brain potentials. , 1999, Brain : a journal of neurology.

[43]  C. Colby,et al.  Trans-saccadic perception , 2008, Trends in Cognitive Sciences.

[44]  Marcia Grabowecky,et al.  Attention induces synchronization-based response gain in steady-state visual evoked potentials , 2007, Nature Neuroscience.

[45]  Paul M. Corballis,et al.  Human transsaccadic visual processing: Presaccadic remapping and postsaccadic updating , 2010, Neuropsychologia.

[46]  S. Dehaene,et al.  Brain Dynamics Underlying the Nonlinear Threshold for Access to Consciousness , 2007, PLoS biology.

[47]  C. Schroeder,et al.  Low-frequency neuronal oscillations as instruments of sensory selection , 2009, Trends in Neurosciences.

[48]  W Skrandies,et al.  Evoked potential correlates of semantic meaning--A brain mapping study. , 1998, Brain research. Cognitive brain research.

[49]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[50]  J. Polich,et al.  P300 amplitude is determined by target-to-target interval. , 2002, Psychophysiology.

[51]  M. Sigman,et al.  Dynamics of the Central Bottleneck: Dual-Task and Task Uncertainty , 2006, PLoS biology.

[52]  Richard M. Leahy,et al.  Electromagnetic brain mapping , 2001, IEEE Signal Process. Mag..

[53]  M. Gazzaniga,et al.  Combined spatial and temporal imaging of brain activity during visual selective attention in humans , 1994, Nature.

[54]  G. Karmos,et al.  Entrainment of Neuronal Oscillations as a Mechanism of Attentional Selection , 2008, Science.

[55]  Sara C. Sereno,et al.  Early emotion word processing: Evidence from event-related potentials , 2009, Biological Psychology.

[56]  M. Marton,et al.  Saccade-related brain potentials during reading correct and incorrect versions of proverbs. , 1988, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[57]  Ralf Engbert,et al.  Microsaccades uncover the orientation of covert attention , 2003, Vision Research.

[58]  A. Yagi.  Visual signal detection and lambda responses. , 1981, Electroencephalography and clinical neurophysiology.

[59]  J. Polich.  Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[60]  P. Maldonado,et al.  Superposition Model Predicts EEG Occipital Activity during Free Viewing of Natural Scenes , 2010, The Journal of Neuroscience.

[61]  S. Sereno,et al.  Context Effects in Word Recognition , 2003, Psychological science.

[62]  R. Kliegl,et al.  Human Microsaccade-Related Visual Brain Responses , 2009, The Journal of Neuroscience.

[63]  Bruno A Olshausen,et al.  The earliest EEG signatures of object recognition in a cued-target task are postsensory. , 2005, Journal of vision.

[64]  M. Posner,et al.  Frontal and inferior temporal cortical activity in visual target detection: Evidence from high spatially sampled event-related potentials , 1996, Brain Topography.

[65]  G. Sperling,et al.  Attentional modulation of SSVEP power depends on the network tagged by the flicker frequency. , 2006, Cerebral cortex.

[66]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[67]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[68]  G. Thickbroom,et al.  Presaccadic ‘spike’ potential: Investigation of topography and source , 1985, Brain Research.

[69]  Thierry Baccino,et al.  Eye fixation–related potentials (EFRPs) during object identification , 2010, Visual Neuroscience.

[70]  M. Corbetta,et al.  A Common Network of Functional Areas for Attention and Eye Movements , 1998, Neuron.

[71]  Yoshiki Uchikawa,et al.  Fundamental research for EEG interface: EEG and auditory/visual stimulus during eye-movements , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[72]  Sven-Thomas Graupner,et al.  Surprise, surprise: two distinct components in the visually evoked distractor effect. , 2007, Psychophysiology.

[73]  M. Marton,et al.  Context effects on saccade-related brain potentials to words during reading , 1988, Neuropsychologia.

[74]  W. Singer,et al.  Synchronization of neuronal responses in primary visual cortex of monkeys viewing natural images. , 2008, Journal of neurophysiology.

[75]  I. Nelken,et al.  Transient Induced Gamma-Band Response in EEG as a Manifestation of Miniature Saccades , 2008, Neuron.

[76]  G. Thickbroom,et al.  Saccade onset and offset lambda waves: relation to pattern movement visually evoked potentials , 1991, Brain Research.

[77]  R M Leahy,et al.  A sensor-weighted overlapping-sphere head model and exhaustive head model comparison for MEG. , 1999, Physics in medicine and biology.

[78]  S. Thorpe,et al.  The Time Course of Visual Processing: From Early Perception to Decision-Making , 2001, Journal of Cognitive Neuroscience.

[79]  C Miniussi,et al.  Orienting attention in time. , 2001, Frontiers in bioscience : a journal and virtual library.

[80]  Guillaume A. Rousselet,et al.  Parallel processing in high-level categorization of natural images , 2002, Nature Neuroscience.

[81]  Patrick Cavanagh,et al.  The extent of crowding in peripheral vision does not scale with target size , 2002, Vision Research.