Eye tracker data quality: what it is and how to measure it

Data quality is essential to the validity of research results and to the quality of gaze interaction. We argue that the lack of standard measures for eye data quality makes several aspects of manufacturing and using eye trackers, as well as researching eye movements and vision, more difficult than necessary. Uncertainty regarding the comparability of research results is a considerable impediment to progress in the field. In this paper, we illustrate why data quality matters and review previous work on how eye data quality has been measured and reported. The goal is to achieve a common understanding of what data quality is and how it can be defined, measured, evaluated, and reported.

[1]  McGraw-Hill Yearbook of Science and Technology , 2004 .

[2]  F. Hutzler,et al.  Systematic influence of gaze position on pupil size measurement: analysis and correction , 2011, Behavior research methods.

[3]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[4]  M. Holland,et al.  Blinking and Mental Load , 1972, Psychological reports.

[5]  Marcus Nyström,et al.  The influence of calibration method and eye physiology on eyetracking data quality , 2013, Behavior research methods.

[6]  Tim Halverson,et al.  Cleaning up systematic error in eye-tracking data by using required fixation locations , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[7]  R. Groner Eye Movements and Psychological Functions: International Views , 1983 .

[8]  Mick Donegan Participatory Design: The Story of Jayne and Other Complex Cases , 2012 .

[9]  Tobii ® Technology Accuracy and precision test method for remote eye trackers , 2022 .

[10]  Dan Witzner Hansen,et al.  Introduction to Eye and Gaze Trackers , 2012 .

[11]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[12]  Jan Drewes,et al.  Effects of pupil size on recorded gaze position: a live comparison of two eyetracking systems , 2011 .

[13]  Susan K. Schnipke,et al.  Trials and tribulations of using an eye-tracking system , 2000, CHI Extended Abstracts.

[14]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[15]  Brian Scassellati,et al.  The incomplete fixation measure , 2008, ETRA.

[16]  Päivi Majaranta,et al.  Gaze Interaction and Applications of Eye Tracking - Advances in Assistive Technologies , 2011 .

[17]  Oleg V. Komogortsev,et al.  Standardization of Automated Analyses of Oculomotor Fixation and Saccadic Behaviors , 2010, IEEE Transactions on Biomedical Engineering.

[18]  Marcus Nyström,et al.  Sampling frequency and eye-tracking measures: how speed affects durations, latencies, and more , 2010 .

[19]  Anne H. Anderson,et al.  Eye-Tracking Explorations in Multimedia Communications , 2001, BCS HCI/IHM.

[20]  Marcus Nyström,et al.  An adaptive algorithm for fixation, saccade, and glissade detection in eyetracking data , 2010, Behavior research methods.

[21]  Michael Burmester,et al.  Repeated Web Page Visits and the Scanpath Theory: A Recurrent Pattern Detection Approach , 2010 .