A study of artificial eyes for the measurement of precision in eye-trackers

The precision of an eye-tracker is critical to the correct identification of eye movements and their properties. To measure a system’s precision, artificial eyes (AEs) are often used, to exclude eye movements influencing the measurements. A possible issue, however, is that it is virtually impossible to construct AEs with sufficient complexity to fully represent the human eye. To examine the consequences of this limitation, we tested currently used AEs from three manufacturers of eye-trackers and compared them to a more complex model, using 12 commercial eye-trackers. Because precision can be measured in various ways, we compared different metrics in the spatial domain and analyzed the power-spectral densities in the frequency domain. To assess how precision measurements compare in artificial and human eyes, we also measured precision using human recordings on the same eye-trackers. Our results show that the modified eye model presented can cope with all eye-trackers tested and acts as a promising candidate for further development of a set of AEs with varying pupil size and pupil–iris contrast. The spectral analysis of both the AE and human data revealed that human eye data have different frequencies that likely reflect the physiological characteristics of human eye movements. We also report the effects of sample selection methods for precision calculations. This study is part of the EMRA/COGAIN Eye Data Quality Standardization Project.

[1]  Pieter J. Blignaut,et al.  The precision of eye-trackers: a case for a new measure , 2012, ETRA.

[2]  H D Crane,et al.  Generation-V dual-Purkinje-image eyetracker. , 1985, Applied optics.

[3]  Chris Harris,et al.  Artificial eye for assessing corneal-reflection eye trackers , 1984 .

[4]  P. Artal,et al.  The human eye is an example of robust optical design. , 2006, Journal of vision.

[5]  N. Lomb Least-squares frequency analysis of unequally spaced data , 1976 .

[6]  Marcus Nyström,et al.  Eye tracker data quality: what it is and how to measure it , 2012, ETRA.

[7]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[8]  Michael J Richardson,et al.  Cue predictability changes scaling in eye-movement fluctuations , 2015, Attention, perception & psychophysics.

[9]  Jonathan W. Peirce,et al.  PsychoPy—Psychophysics software in Python , 2007, Journal of Neuroscience Methods.

[10]  Michael J. Richardson,et al.  On the Structure of Measurement Noise in Eye-Tracking , 2012 .

[11]  Marcus Nyström,et al.  The influence of calibration method and eye physiology on eyetracking data quality , 2013, Behavior research methods.

[12]  D. W. Allan,et al.  A statistical model of flicker noise , 1966 .

[13]  J. Scargle Studies in astronomical time series analysis. II - Statistical aspects of spectral analysis of unevenly spaced data , 1982 .

[14]  J. Findlay Frequency analysis of human involuntary eye movement , 1971, Kybernetik.

[15]  E. Reingold Eye Tracking Research and Technology: Towards Objective Measurement of Data Quality , 2014, Visual cognition.