In the twinkling of an eye: Synchronization of EEG and eye tracking based on blink signatures

Achieving robust adaptive synchronization of multimodal biometric inputs: The recent arrival of wireless EEG headsets that enable mobile real-time 3D brain imaging on smartphones, and low cost eye trackers that provide gaze control of tablets, will radically change how biometric sensors might be integrated into next generation user interfaces. In experimental lab settings EEG neuroimaging and eye tracking data are traditionally combined using external triggers to synchronize the signals. However, with biometric sensors increasingly being applied in everyday usage scenarios, there will be a need for solutions providing a continuous alignment of signals. In the present paper we propose using spontaneous eye blinks, as a means to achieve near real-time synchronization of EEG and eye tracking. Analyzing key parameters that define eye blink signatures across the two domains, we outline a probability function based algorithm to correlate the signals. Comparing the accuracy of the method against a state of the art EYE-EEG plug-in for offline analysis of EEG and eye tracking data, we propose our approach could be applied for robust synchronization of biometric sensor data collected in a mobile context.

[1]  P. Caffier,et al.  Experimental evaluation of eye-blink parameters as a drowsiness measure , 2003, European Journal of Applied Physiology.

[2]  T. Sejnowski,et al.  Removal of eye activity artifacts from visual event-related potentials in normal and clinical subjects , 2000, Clinical Neurophysiology.

[3]  Stefan Debener,et al.  Mobile EEG: towards brain activity monitoring during natural action and cognition. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[4]  Ricardo Nuno Vig Extraction of' ocular artefacts from EEG using independent component analysis , 1997 .

[5]  Sven Hoffmann,et al.  The Correction of Eye Blink Artefacts in the EEG: A Comparison of Two Prominent Methods , 2008, PloS one.

[6]  R. Barry,et al.  Removal of ocular artifact from the EEG: a review , 2000, Neurophysiologie Clinique/Clinical Neurophysiology.

[7]  G. Sjøgaard,et al.  Eye blink frequency during different computer tasks quantified by electrooculography , 2006, European Journal of Applied Physiology.

[8]  Aga Bojko,et al.  Eye Tracking the User Experience: A Practical Guide to Research , 2013 .

[9]  J. Stern,et al.  The endogenous eyeblink. , 1984, Psychophysiology.

[10]  T. Sejnowski,et al.  Linking brain, mind and behavior. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[11]  Kelvin S. Oie,et al.  Cognition in action: imaging brain/body dynamics in mobile humans , 2011, Reviews in the neurosciences.

[12]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[13]  Lars Kai Hansen,et al.  The Smartphone Brain Scanner: A Portable Real-Time Neuroimaging System , 2013, PloS one.

[14]  Michael Kai Petersen,et al.  Smartphones as pocketable labs: visions for mobile brain imaging and neurofeedback. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[15]  Mauro Barbieri,et al.  Synchronization of multi-camera video recordings based on audio , 2007, ACM Multimedia.

[16]  Terrence J. Sejnowski,et al.  Enhanced detection of artifacts in EEG data using higher-order statistics and independent component analysis , 2007, NeuroImage.

[17]  M. Bradley,et al.  Emotion and the motivational brain , 2010, Biological Psychology.

[18]  John A. Stern,et al.  Blinks, saccades, and fixation pauses during vigilance task performance. II., Gender and time of day. , 1996 .

[19]  A. Jacobs,et al.  Coregistration of eye movements and EEG in natural reading: analyses and review. , 2011, Journal of experimental psychology. General.