Bayesian identification of fixations, saccades, and smooth pursuits

Smooth pursuit eye movements provide meaningful insights and information on subject's behavior and health and may, in particular situations, disturb the performance of typical fixation/saccade classification algorithms. Thus, an automatic and efficient algorithm to identify these eye movements is paramount for eye-tracking research involving dynamic stimuli. In this paper, we propose the Bayesian Decision Theory Identification (I-BDT) algorithm, a novel algorithm for ternary classification of eye movements that is able to reliably separate fixations, saccades, and smooth pursuits in an online fashion, even for low-resolution eye trackers. The proposed algorithm is evaluated on four datasets with distinct mixtures of eye movements, including fixations, saccades, as well as straight and circular smooth pursuits; data was collected with a sample rate of 30 Hz from six subjects, totaling 24 evaluation datasets. The algorithm exhibits high and consistent performance across all datasets and movements relative to a manual annotation by a domain expert (recall: μ = 91.42%, σ = 9.52%; precision: μ = 95.60%, σ = 5.29%; specificity μ = 95.41%, σ = 7.02%) and displays a significant improvement when compared to I-VDT, an state-of-the-art algorithm (recall: μ = 87.67%, σ = 14.73%; precision: μ = 89.57%, σ = 8.05%; specificity μ = 92.10%, σ = 11.21%). Algorithm implementation and annotated datasets are openly available at www.ti.uni-tuebingen.de/perception

[1]  G. O'driscoll,et al.  Smooth pursuit in schizophrenia: A meta-analytic review of research since 1993 , 2008, Brain and Cognition.

[2]  Mélodie Vidal,et al.  Analysing EOG signal features for the discrimination of eye movements with wearable devices , 2011, PETMEI '11.

[3]  Marcus Nyström,et al.  Detection of Saccades and Postsaccadic Oscillations in the Presence of Smooth Pursuit , 2013, IEEE Transactions on Biomedical Engineering.

[4]  C. Vomscheid,et al.  Analysis of eye tracking movements using innovations generated by a Kalman filter , 2006, Medical and Biological Engineering and Computing.

[5]  Linnéa Larsson,et al.  Event Detection in Eye-Tracking Data for Use in Applications with Dynamic Stimuli , 2016 .

[6]  Wolfgang Rosenstiel,et al.  Driver-Activity Recognition in the Context of Conditionally Autonomous Driving , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[7]  Francisco Herrera,et al.  An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes , 2011, Pattern Recognit..

[8]  Arie Ben-David,et al.  A lot of randomness is hiding in accuracy , 2007, Eng. Appl. Artif. Intell..

[9]  Hans-Werner Gellersen,et al.  Pursuits: spontaneous interaction with displays based on smooth pursuit eye movement and moving targets , 2013, UbiComp.

[10]  Hans-Werner Gellersen,et al.  Detection of smooth pursuits using eye movement shape features , 2012, ETRA.

[11]  R. Leigh,et al.  The neurology of eye movements , 1984 .

[12]  Oleg V. Komogortsev,et al.  Kalman Filtering in the Design of Eye-Gaze-Guided Computer Interfaces , 2007, HCI.

[13]  Wolfgang Rosenstiel,et al.  ExCuSe: Robust Pupil Detection in Real-World Scenarios , 2015, CAIP.

[14]  W A Fletcher,et al.  Smooth pursuit dysfunction in Alzheimer's disease , 1988, Neurology.

[15]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[16]  Donald E. Knuth Two notes on notation , 1992 .

[17]  Robert A. Marino,et al.  Free viewing of dynamic stimuli by humans and monkeys. , 2009, Journal of vision.

[18]  Ollanta Cuba Gyllensten Evaluation of classification algorithms for smooth pursuit eye movements : Evaluating current algorithms for smooth pursuit detection on Tobii Eye Trackers , 2014 .

[19]  Dave M. Stampe,et al.  Heuristic filtering and reliable calibration methods for video-based pupil-tracking systems , 1993 .

[20]  Thomas C. Kübler,et al.  Online Recognition of Fixations, Saccades and Smooth Pursuits for Automated Analysis of Traffic Hazard Perception , 2015 .

[21]  Oleg V. Komogortsev,et al.  Standardization of Automated Analyses of Oculomotor Fixation and Saccadic Behaviors , 2010, IEEE Transactions on Biomedical Engineering.

[22]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[23]  Wolfgang Rosenstiel,et al.  Bayesian online clustering of eye movement data , 2012, ETRA.

[24]  Marcus Nyström,et al.  Detection of fixations and smooth pursuit movements in high-speed eye-tracking data , 2015, Biomed. Signal Process. Control..

[25]  D. Robinson,et al.  The upper limit of human smooth pursuit velocity , 1985, Vision Research.

[26]  Oleg V Komogortsev,et al.  Automated classification and scoring of smooth pursuit eye movements in the presence of fixations and saccades , 2013, Behavior research methods.

[27]  Thiago Santini,et al.  EyeRec: An Open-source Data Acquisition Software for Head-mounted Eye-tracking , 2016, VISIGRAPP.

[28]  Javier San Agustin Off-the-Shelf Gaze Interaction , 2010 .

[29]  Enkelejda Kasneci,et al.  Towards the automated recognition of assistance need for drivers with impaired visual field , 2013 .

[30]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[31]  N. Shimizu [Neurology of eye movements]. , 2000, Rinsho shinkeigaku = Clinical neurology.