Combining EEG and eye tracking: identification, characterization, and correction of eye movement artifacts in electroencephalographic data

Eye movements introduce large artifacts to electroencephalographic recordings (EEG) and thus render data analysis difficult or even impossible. Trials contaminated by eye movement and blink artifacts have to be discarded, hence in standard EEG-paradigms subjects are required to fixate on the screen. To overcome this restriction, several correction methods including regression and blind source separation have been proposed. Yet, there is no automated standard procedure established. By simultaneously recording eye movements and 64-channel-EEG during a guided eye movement paradigm, we investigate and review the properties of eye movement artifacts, including corneo-retinal dipole changes, saccadic spike potentials and eyelid artifacts, and study their interrelations during different types of eye- and eyelid movements. In concordance with earlier studies our results confirm that these artifacts arise from different independent sources and that depending on electrode site, gaze direction, and choice of reference these sources contribute differently to the measured signal. We assess the respective implications for artifact correction methods and therefore compare the performance of two prominent approaches, namely linear regression and independent component analysis (ICA). We show and discuss that due to the independence of eye artifact sources, regression-based correction methods inevitably over- or under-correct individual artifact components, while ICA is in principle suited to address such mixtures of different types of artifacts. Finally, we propose an algorithm, which uses eye tracker information to objectively identify eye-artifact related ICA-components (ICs) in an automated manner. In the data presented here, the algorithm performed very similar to human experts when those were given both, the topographies of the ICs and their respective activations in a large amount of trials. Moreover it performed more reliable and almost twice as effective than human experts when those had to base their decision on IC topographies only. Furthermore, a receiver operating characteristic (ROC) analysis demonstrated an optimal balance of false positive and false negative at an area under curve (AUC) of more than 0.99. Removing the automatically detected ICs from the data resulted in removal or substantial suppression of ocular artifacts including microsaccadic spike potentials, while the relevant neural signal remained unaffected. In conclusion the present work aims at a better understanding of individual eye movement artifacts, their interrelations and the respective implications for eye artifact correction. Additionally, the proposed ICA-procedure provides a tool for optimized detection and correction of eye movement-related artifact components.

[1]  G. Thickbroom,et al.  Presaccadic spike potential. Relation to eye movement direction. , 1986, Electroencephalography and clinical neurophysiology.

[2]  Diane Kurtzberg,et al.  Topographic analysis of human cortical potentials preceding self-initiated and visually triggered saccades , 1982, Brain Research.

[3]  P. Maldonado,et al.  Superposition Model Predicts EEG Occipital Activity during Free Viewing of Natural Scenes , 2010, The Journal of Neuroscience.

[4]  Armando Malanda,et al.  Independent Component Analysis as a Tool to Eliminate Artifacts in EEG: A Quantitative Study , 2003, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[5]  T. Gasser,et al.  Correction of EOG artifacts in event-related potentials of the EEG: aspects of reliability and validity. , 1982, Psychophysiology.

[6]  Shlomit Yuval-Greenberg,et al.  Saccadic spike potentials in gamma-band EEG: Characterization, detection and suppression , 2010, NeuroImage.

[7]  R. Barry,et al.  EOG correction: a new aligned-artifact average solution. , 1998, Electroencephalography and clinical neurophysiology.

[8]  Ralf Engbert,et al.  Microsaccades are triggered by low retinal image slip. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[9]  M. Aramideh,et al.  Eyelid movements: behavioral studies of blinking in humans under different stimulus conditions. , 2003, Journal of neurophysiology.

[10]  L. Bour,et al.  Neurophysiological aspects of eye and eyelid movements during blinking in humans. , 2000, Journal of neurophysiology.

[11]  Dominik Straumann,et al.  Ocular torsion during voluntary blinks in humans. , 2002, Investigative ophthalmology & visual science.

[12]  Martina Poletti,et al.  Miniature eye movements enhance fine spatial detail , 2007, Nature.

[13]  B. Bridgeman,et al.  The role of microsaccades in high acuity observational tasks , 1980, Vision Research.

[14]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[15]  Hellmuth Obrig,et al.  Stimulus-Induced and State-Dependent Sustained Gamma Activity Is Tightly Coupled to the Hemodynamic Response in Humans , 2009, The Journal of Neuroscience.

[16]  T. Sejnowski,et al.  Removing electroencephalographic artifacts by blind source separation. , 2000, Psychophysiology.

[17]  D Guitton,et al.  Upper eyelid movements measured with a search coil during blinks and vertical saccades. , 1991, Investigative ophthalmology & visual science.

[18]  P. Berg,et al.  Ocular artifacts in EEG and event-related potentials I: Scalp topography , 2005, Brain Topography.

[19]  Ralf Engbert Microsaccades: A microcosm for research on oculomotor control, attention, and visual perception. , 2006, Progress in brain research.

[20]  J. C. Corby,et al.  Differential contributions of blinks and vertical eye movements as artifacts in EEG recording. , 1972, Psychophysiology.

[21]  H. Huddleston Electronystagmographic studies of small vertical fixation movements. , 1970, The British journal of ophthalmology.

[22]  C. Helmchen,et al.  The eyelid and its contribution to eye movements. , 2007, Developments in ophthalmology.

[23]  R. Hari,et al.  Magnetic fields produced by eye blinking. , 1985, Electroencephalography and clinical neurophysiology.

[24]  宁北芳,et al.  疟原虫var基因转换速率变化导致抗原变异[英]/Paul H, Robert P, Christodoulou Z, et al//Proc Natl Acad Sci U S A , 2005 .

[25]  C. Evinger,et al.  Eyelid movements. Mechanisms and normal data. , 1991, Investigative ophthalmology & visual science.

[26]  F. Riemslag,et al.  On the origin of the presaccadic spike potential. , 1988, Electroencephalography and clinical neurophysiology.

[27]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[28]  Daniel P. Ferris,et al.  Removal of movement artifact from high-density EEG recorded during walking and running. , 2010, Journal of neurophysiology.

[29]  Daniel P. Ferris,et al.  Visual Evoked Responses During Standing and Walking , 2010, Front. Hum. Neurosci..

[30]  Jonathan S. A. Carriere,et al.  Out of Mind, Out of Sight , 2010, Psychological science.

[31]  Terence W. Picton,et al.  Ocular artifacts in recording EEGs and event-related potentials II: Source dipoles and source components , 2005, Brain Topography.

[32]  S. Gong,et al.  Cerebral cortical control of orbicularis oculi motoneurons. Brain Res , 2005 .

[33]  F. Matsuo,et al.  Electrical phenomena associated with movements of the eyelid. , 1975, Electroencephalography and clinical neurophysiology.

[34]  J M Weinstein,et al.  Human presaccadic spike potentials. Of central or peripheral origin? , 1990, Investigative ophthalmology & visual science.

[35]  A. Fuchs,et al.  Lid-eye coordination during vertical gaze changes in man and monkey. , 1988, Journal of neurophysiology.

[36]  M. B. Bender,et al.  Recovery of the electro-oculogram after total ablation of the retina in monkeys. , 1965, Electroencephalography and clinical neurophysiology.

[37]  R. Yee,et al.  Analysis of electro-oculographic artifact during vertical saccadic eye movements , 2004, Graefe's Archive for Clinical and Experimental Ophthalmology.

[38]  Barbara J. Winterson,et al.  Microsaccades during finely guided visuomotor tasks , 1976, Vision Research.

[39]  P. Berg,et al.  The correction of ocular artifacts: a topographic perspective , 2000, Clinical Neurophysiology.

[40]  Ralf Engbert,et al.  Microsaccades uncover the orientation of covert attention , 2003, Vision Research.

[41]  Ziad M. Hafed,et al.  A Neural Mechanism for Microsaccade Generation in the Primate Superior Colliculus , 2009, Science.

[42]  Jun-Young Chung,et al.  Event related fMRI studies of voluntary and inhibited eye blinking using a time marker of EOG , 2006, Neuroscience Letters.

[43]  P. Corballis,et al.  Electrophysiological correlates of presaccadic remapping in humans. , 2008, Psychophysiology.

[44]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[45]  J. Stern,et al.  Blinks as an index of cognitive activity during reading , 1991, Integrative physiological and behavioral science : the official journal of the Pavlovian Society.

[46]  W BARRY,et al.  INFLUENCE OF EYE LID MOVEMENT UPON ELECTRO-OCULOGRAPHIC RECORDING OF VERTICAL EYE MOVEMENTS. , 1965, Aerospace medicine.

[47]  R. Reber,et al.  The feeling of fluent perception: A single experience from multiple asynchronous sources , 2008, Consciousness and Cognition.

[48]  P Berg,et al.  Dipole modelling of eye activity and its application to the removal of eye artefacts from the EEG and MEG. , 1991, Clinical physics and physiological measurement : an official journal of the Hospital Physicists' Association, Deutsche Gesellschaft fur Medizinische Physik and the European Federation of Organisations for Medical Physics.

[49]  R. Barry,et al.  EOG correction: a comparison of four methods. , 2005, Psychophysiology.

[50]  Shigeru Kitazawa,et al.  Eyeblink entrainment at breakpoints of speech , 2010, Neuroscience Research.

[51]  E Donchin,et al.  A new method for off-line removal of ocular artifact. , 1983, Electroencephalography and clinical neurophysiology.

[52]  Sven Hoffmann,et al.  The Correction of Eye Blink Artefacts in the EEG: A Comparison of Two Prominent Methods , 2008, PloS one.

[53]  Yanda Li,et al.  Automatic removal of the eye blink artifact from EEG using an ICA-based template matching approach , 2006, Physiological measurement.

[54]  R. Oostenveld,et al.  Finding Gamma , 2008, Neuron.

[55]  J. Kamiya,et al.  A simple on-line technique for removing eye movement artifacts from the EEG. , 1973, Electroencephalography and clinical neurophysiology.

[56]  Makoto Kato,et al.  Functional MRI of brain activation evoked by intentional eye blinking , 2003, NeuroImage.

[57]  A W NORTH,et al.  ACCURACY AND PRECISION OF ELECTRO-OCULOGRAPHIC RECORDING. , 1965, Investigative Ophthalmology.

[58]  R. Kliegl,et al.  Human Microsaccade-Related Visual Brain Responses , 2009, The Journal of Neuroscience.

[59]  I. Nelken,et al.  Transient Induced Gamma-Band Response in EEG as a Manifestation of Miniature Saccades , 2008, Neuron.

[60]  G. Thickbroom,et al.  Presaccadic ‘spike’ potential: Investigation of topography and source , 1985, Brain Research.

[61]  C. Joyce,et al.  Automatic removal of eye movement and blink artifacts from EEG data using blind component separation. , 2004, Psychophysiology.

[62]  S. Steinhauer,et al.  Blink before and after you think: blinks occur prior to and following cognitive load indexed by pupillary responses. , 2008, Psychophysiology.

[63]  N. Miller,et al.  THE CORNEO-RETINAL POTENTIAL DIFFERENCE AS THE BASIS OF THE GALVANOMETRIC METHOD OF RECORDING EYE MOVEMENTS , 1935 .

[64]  A. Jacobs,et al.  Coregistration of eye movements and EEG in natural reading: analyses and review. , 2011, Journal of experimental psychology. General.

[65]  Paul A. Constable,et al.  The electro-oculogram , 2006, Progress in Retinal and Eye Research.

[66]  M. Bradley,et al.  Emotion, attention, and the startle reflex. , 1990, Psychological review.

[67]  B. Rockstroh,et al.  Removal of ocular artifacts from the EEG--a biophysical approach to the EOG. , 1985, Electroencephalography and clinical neurophysiology.

[68]  Scott Makeig,et al.  ERP Features and EEG Dynamics : An ICA Perspective , 2009 .

[69]  Robert Oostenveld,et al.  Localizing human visual gamma-band activity in frequency, time and space , 2006, NeuroImage.

[70]  P. Glimcher The neurobiology of visual-saccadic decision making. , 2003, Annual review of neuroscience.

[71]  G. Pfurtscheller,et al.  A fully automated correction method of EOG artifacts in EEG recordings , 2007, Clinical Neurophysiology.

[72]  R. Barry,et al.  Removal of ocular artifact from the EEG: a review , 2000, Neurophysiologie Clinique/Clinical Neurophysiology.

[73]  J. Fermaglich Electric Fields of the Brain: The Neurophysics of EEG , 1982 .

[74]  Jun-Young Chung,et al.  Neural correlates of eye blinking; improved by simultaneous fMRI and EOG measurement , 2005, Neuroscience Letters.

[75]  Jan W. M. Bergmans,et al.  Using an Eye Tracker for Accurate Eye Movement Artifact Correction , 2007, IEEE Transactions on Biomedical Engineering.

[76]  R. Müri,et al.  MRI and fMRI analysis of oculomotor function. , 2006, Progress in brain research.

[77]  M. Corbetta,et al.  The Reorienting System of the Human Brain: From Environment to Theory of Mind , 2008, Neuron.

[78]  D. Hubel,et al.  The role of fixational eye movements in visual perception , 2004, Nature Reviews Neuroscience.

[79]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[80]  John C. Armington,et al.  29 – Potentials That Precede Small Saccades1 , 1978 .

[81]  R. Barry,et al.  EOG correction: a new perspective. , 1998, Electroencephalography and clinical neurophysiology.

[82]  J. Kelsey,et al.  Changes produced by light in the standing potential of the human eye , 1962, The Journal of physiology.

[83]  Geraint Rees,et al.  Blinking Suppresses the Neural Response to Unchanging Retinal Stimulation , 2005, Current Biology.

[84]  Robert K. Moore,et al.  Eyeblinks and visual suppression. , 1980, Science.

[85]  Kunkel Jm,et al.  Spontaneous subclavain vein thrombosis: a successful combined approach of local thrombolytic therapy followed by first rib resection. , 1989 .

[86]  Andreas K. Engel,et al.  The saccadic spike artifact in MEG , 2012, NeuroImage.

[87]  S. Gong,et al.  Cerebral cortical control of orbicularis oculi motoneurons , 2005, Brain Research.

[88]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[89]  R. Barry,et al.  EOG correction: which regression should we use? , 2000, Psychophysiology.

[90]  P Berg,et al.  Eyeblink-related potentials. , 1988, Electroencephalography and clinical neurophysiology.

[91]  S. Hillyard,et al.  Eye movement artifact in the CNV. , 1970, Electroencephalography and clinical neurophysiology.