Histogram of oriented velocities for eye movement detection

Research in various fields including psychology, cognition, and medical science deal with eye tracking data to extract information about the intention and cognitive state of a subject. For the extraction of this information, the detection of eye movement types is an important task. Modern eye tracking data is noisy and most of the state-of-the-art algorithms are not developed for all types of eye movements since they are still under research. We propose a novel feature for eye movement detection, which is called histogram of oriented velocities. The construction of the feature is similar to the well known histogram of oriented gradients from computer vision. Since the detector is trained using machine learning, it can always be extended to new eye movement types. We evaluate our feature against the state-of-the-art on publicly available data. The evaluation includes different machine learning approaches such as support vector machines, regression trees, and k nearest neighbors. We evaluate our feature together with the machine learning approaches for different parameter sets. We provide a matlab script for the computation and evaluation as well as an integration in EyeTrace which can be downloaded at http://www.ti.uni-tuebingen.de/Eyetrace.1751.0.html.

[1]  Oleg V. Komogortsev,et al.  Standardization of Automated Analyses of Oculomotor Fixation and Saccadic Behaviors , 2010, IEEE Transactions on Biomedical Engineering.

[2]  J. Barbur,et al.  Exploring Eye Movements in Patients with Glaucoma When Viewing a Driving Scene , 2010, PloS one.

[3]  Thiago Santini,et al.  Bayesian identification of fixations, saccades, and smooth pursuits , 2015, ETRA.

[4]  Raimondas Zemblys,et al.  Eye-movement event detection meets machine learning , 2017, BioMed 2017.

[5]  J. May,et al.  Eye movement indices of mental workload. , 1990, Acta psychologica.

[6]  B. Bridgeman,et al.  Immediate post-saccadic information mediates space constancy , 1998, Vision Research.

[7]  N. Shimizu [Neurology of eye movements]. , 2000, Rinsho shinkeigaku = Clinical neurology.

[8]  Wolfgang Rosenstiel,et al.  SubsMatch 2.0: Scanpath comparison and classification based on subsequence frequencies , 2016, Behavior Research Methods.

[9]  Ralf Engbert,et al.  Microsaccades uncover the orientation of covert attention , 2003, Vision Research.

[10]  S. Moss One algorithm to rule them all , 2017 .

[11]  Wolfgang Rosenstiel,et al.  The applicability of probabilistic methods to the online recognition of fixations and saccades in dynamic scenes , 2014, ETRA.

[12]  Alan Kennedy,et al.  Book Review: Eye Tracking: A Comprehensive Guide to Methods and Measures , 2016, Quarterly journal of experimental psychology.

[13]  Marcus Nyström,et al.  Detection of Saccades and Postsaccadic Oscillations in the Presence of Smooth Pursuit , 2013, IEEE Transactions on Biomedical Engineering.

[14]  W. Rosenstiel,et al.  Driving with Binocular Visual Field Loss? A Study on a Supervised On-Road Parcours with Simultaneous Eye and Head Tracking , 2014, PloS one.

[15]  Michel Wedel,et al.  Defining eye-fixation sequences across individuals and tasks: the Binocular-Individual Threshold (BIT) algorithm , 2010, Behavior research methods.

[16]  H. Widdel Operational Problems in Analysing Eye Movements , 1984 .

[17]  S. Blakemore,et al.  The application of eye‐tracking technology in the study of autism , 2007, The Journal of physiology.

[18]  Zhiwei Zhu,et al.  Real-time nonintrusive monitoring and prediction of driver fatigue , 2004, IEEE Transactions on Vehicular Technology.

[19]  Marcus Nyström,et al.  An adaptive algorithm for fixation, saccade, and glissade detection in eyetracking data , 2010, Behavior research methods.

[20]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[21]  Wolfgang Rosenstiel,et al.  Online Recognition of Driver-Activity Based on Visual Scanpath Classification , 2017, IEEE Intelligent Transportation Systems Magazine.

[22]  Oleg V. Komogortsev,et al.  Eye movement prediction by oculomotor plant Kalman filter with brainstem control , 2009 .

[23]  Marcus Nyström,et al.  Detection of fixations and smooth pursuit movements in high-speed eye-tracking data , 2015, Biomed. Signal Process. Control..

[24]  Giacomo Veneri,et al.  Eye fixations identification based on statistical analysis - Case study , 2010, 2010 2nd International Workshop on Cognitive Information Processing.

[25]  S. B. Hutton,et al.  Eye Tracking Methodology , 2019, Eye Movement Research.

[26]  Mei-Chen Yeh,et al.  Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[27]  Ralf Engbert,et al.  Microsaccades are triggered by low retinal image slip. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Giacomo Veneri,et al.  Automatic eye fixations identification based on analysis of variance and covariance , 2011, Pattern Recognition Letters.

[29]  Diederick C. Niehorster,et al.  Noise-robust fixation detection in eye movement data: Identification by two-means clustering (I2MC) , 2016, Behavior Research Methods.

[30]  Wolfgang Rosenstiel,et al.  Eye movement simulation and detector creation to reduce laborious parameter adjustments , 2018, ArXiv.

[31]  Wolfgang Rosenstiel,et al.  Bayesian online clustering of eye movement data , 2012, ETRA.