A crucial temporal accuracy test of combining EEG and Tobii eye tracker

Abstract Eye tracking and event-related potentials have been widely used in the field of cognitive psychology and neuroscience. Both techniques have the ability to refine cognitive models through a precise timeline description; nevertheless, they also have severe limitations. Combining measures of event-related potentials and eye movements can contribute to cognitive process capture, which provides the possibility to determine precisely when and in which order different cognitive operations occur. Combining of event-related potentials and eye movements has been recently conducted by synchronizing measures from an infrared eye tracker with an electroencephalograph to allow simultaneous data recording. Here, we describe in detail 4 types of co-registration methods for event-related potentials and eye movements on the Tobii platform. Moreover, the present investigation was designed to evaluate the temporal accuracy of data obtained using the 4 methods. We found that the method based on the Tobii Pro Analytics software development kit had a higher degree of temporal accuracy than the other co-registration methods. Furthermore, the reasons for the different temporal accuracies were assessed, and potential measures to correct clock drift were taken. General suggestions are made regarding timing in the co-registration of the electroencephalograph and eye tracker.

[1]  R. Kass,et al.  Automatic correction of ocular artifacts in the EEG: a comparison of regression-based and component-based methods. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[2]  Kelly S. Hale,et al.  Combining EEG and Eye Tracking: Using Fixation-Locked Potentials in Visual Search , 2013 .

[3]  T. Sejnowski,et al.  Removing electroencephalographic artifacts by blind source separation. , 2000, Psychophysiology.

[4]  Scott P. Johnson,et al.  Location, location, location: development of spatiotemporal sequence learning in infancy. , 2007, Child development.

[5]  Scott P. Johnson,et al.  A Critical Test of Temporal and Spatial Accuracy of the Tobii T60XL Eye Tracker. , 2012, Infancy : the official journal of the International Society on Infant Studies.

[6]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  T. Baccino,et al.  A NEW COGNITIVE ENGINEERING TECHNIQUE : EYE-FIXATION-RELATED POTENTIALS , 2011 .

[8]  Charles A Nelson,et al.  Relational memory during infancy: evidence from eye tracking. , 2009, Developmental science.

[9]  S Kanaya,et al.  Brain potentials associated with eye fixations during visual tasks under different lighting systems. , 1998, Ergonomics.

[10]  P Berg,et al.  A multiple source approach to the correction of eye artifacts. , 1994, Electroencephalography and clinical neurophysiology.

[11]  Tommy Strandvall,et al.  The Fixation Distance to the Stimulus Influences ERP Quality: An EEG and Eye Tracking N400 Study , 2015, PloS one.

[12]  Alan F. Smeaton,et al.  Eye fixation related potentials in a target search task , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  David C. Banks,et al.  Analysis of eye-tracking experiments performed on a Tobii T60 , 2008, Electronic Imaging.

[14]  T. R. Jordan,et al.  An ERP Assessment of Hemispheric Projections in Foveal and Extrafoveal Word Recognition , 2011, PloS one.

[15]  Michael C. Frank,et al.  Development of perceptual completion originates in information acquisition. , 2008, Developmental psychology.

[16]  A Yagi,et al.  Integrated effect of stimulation at fixation points on EFRP (eye-fixation related brain potentials). , 1999, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[17]  Scott P. Johnson,et al.  ACritical Test of Temporal and Spatial Accuracy of the Tobii T 60 XL Eye Tracker , 2011 .

[18]  Nathalie Guyader,et al.  An eye fixation-related potentials analysis of the P300 potential for fixations onto a target object when exploring natural scenes. , 2015, Journal of vision.

[19]  Krzysztof Pancerz,et al.  Toward Synchronization of EEG and Eye-tracking Data Using an Expert System , 2015, CS&P.

[20]  Mariano Sigman,et al.  Fixation-related potentials in visual search: a combined EEG and eye tracking study. , 2012, Journal of vision.

[21]  Claes von Hofsten,et al.  Sensitivity to second-order motion in 10-month-olds , 2008, Vision Research.

[22]  Katsumi Aoki,et al.  Flying characteristics of the new official rubber baseball , 2009, J. Vis..

[23]  Thierry Baccino,et al.  Eye movements and concurrent event-related potentials: Eye fixation-related potential investigations in reading , 2011 .

[24]  J. Clarke,et al.  Medicine , 1907, Bristol medico-chirurgical journal.

[25]  Michael C. Frank,et al.  Development of infants’ attention to faces during the first year , 2009, Cognition.

[26]  Thierry Baccino,et al.  Eye-Fixation-Related Potentials: Insight into Parafoveal Processing , 2005 .

[27]  Looking Forward: Comment on Morgante, Zolfaghari, and Johnson. , 2012, Infancy : the official journal of the International Society on Infant Studies.

[28]  Wael El-Deredy,et al.  Covert Tracking: A Combined ERP and Fixational Eye Movement Study , 2012, PloS one.

[29]  Reinhold Kliegl,et al.  Synchronizing timelines: Relations between fixation durations and N400 amplitudes during sentence reading , 2007, Brain Research.

[30]  A. Jacobs,et al.  Coregistration of eye movements and EEG in natural reading: analyses and review. , 2011, Journal of experimental psychology. General.

[31]  K. Holmqvist,et al.  Right visual field advantage in parafoveal processing: Evidence from eye-fixation-related potentials , 2009, Brain and Language.

[32]  Mario Braun,et al.  Welcome to the real world: Validating fixation-related brain potentials for ecologically valid settings , 2007, Brain Research.

[33]  Reinhold Kliegl,et al.  Eye movements and brain electric potentials during reading , 2012, Psychological research.

[34]  Björn Peters,et al.  Hearing loss and a supportive tactile signal in a navigation system : effects on driving behavior and eye movements , 2013 .

[35]  Andrew T Duchowski,et al.  A breadth-first survey of eye-tracking applications , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[36]  C. Hofsten,et al.  Infants predict other people's action goals , 2006, Nature Neuroscience.

[37]  Matthew M. Doran,et al.  Time course of visual attention in infant categorization of cats versus dogs: evidence for a head bias as revealed through eye tracking. , 2009, Child development.

[38]  C. Von Hofsten,et al.  Predictive tracking over occlusions by 4-month-old infants. , 2007, Developmental science.

[39]  Scott P. Johnson,et al.  Selection and inhibition in infancy: evidence from the spatial negative priming paradigm , 2005, Cognition.

[40]  M. Posner,et al.  Establishing a time‐line of word recognition: evidence from eye movements and event‐related potentials , 1998, Neuroreport.