Accuracy and precision of fixation locations recorded with the low-cost Eye Tribe tracker in different experimental set- ups

This article compares the accuracy and precision of the low-cost Eye Tribe tracker and a well-established comparable eye tracker: SMI RED 250. Participants were instructed to fixate on predefined point locations on a screen. The accuracy is measured by the distance between the recorded fixation locations and the actual location. Precision is represented by the standard deviation of these measurements. Furthermore, the temporal precision of both eye tracking devices (sampling rate) is evaluated as well. The obtained results illustrate that a correct set-up and selection of software to record and process the data are of utmost importance to obtain acceptable results with the low-cost device. Nevertheless, with careful selections in each of these steps, the quality (accuracy and precision) of the recorded data can be considered comparable.

[1]  Susann Fiedler,et al.  Eye-tracking study , 2016 .

[2]  E. Reingold.  Eye Tracking Research and Technology: Towards Objective Measurement of Data Quality , 2014, Visual cognition.

[3]  John M. Findlay,et al.  Eye guidance and visual search , 1998 .

[4]  Sandra P. Marshall,et al.  Measuring cognitive workload across different eye tracking hardware platforms , 2012, ETRA.

[5]  Greet Cardon,et al.  The visual control of bicycle steering: The effects of speed and path width. , 2013, Accident; analysis and prevention.

[6]  André P. Calitz,et al.  The added value of eye tracking in the usability evaluation of a network management tool , 2005 .

[7]  Marcus Nyström,et al.  Eye tracker data quality: what it is and how to measure it , 2012, ETRA.

[8]  Jeremy M. Wolfe,et al.  Guided Search 4.0: Current Progress With a Model of Visual Search , 2007, Integrated Models of Cognitive Systems.

[9]  Carlo Robino,et al.  Eye Tracking Analysis in Reading Online Newspapers , 2008 .

[10]  Sebastiaan Mathôt,et al.  PyGaze: An open-source, cross-platform toolbox for minimal-effort programming of eyetracking experiments , 2014, Behavior research methods.

[11]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[12]  A. L. Yarbus.  Eye Movements During Perception of Complex Objects , 1967 .

[13]  Robert J. K. Jacob,et al.  Eye tracking in human-computer interaction and usability research : Ready to deliver the promises , 2002 .

[14]  Nancy Millette,et al.  How People Look at Pictures , 1935 .

[15]  Edwin S. Dalmaijer,et al.  Is the low-cost EyeTribe eye tracker any good for research? , 2014 .

[16]  Alan Kennedy,et al.  Book Review: Eye Tracking: A Comprehensive Guide to Methods and Measures , 2016, Quarterly journal of experimental psychology.

[17]  THE ANGLE VELOCITY OF EYE MOVEMENTS , 2004 .

[18]  Laura Chamberlain.  Eye Tracking Methodology; Theory and Practice , 2007 .

[19]  Rico Fischer,et al.  Eye tracking and its application in usability and media research , 2003, MMI Interakt..

[20]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[21]  A. V. D. Heijden,et al.  Eye Movements and Attention , 1997, Consciousness and Cognition.

[22]  L. Itti,et al.  Defending Yarbus: eye movements reveal observers' task. , 2014, Journal of vision.

[23]  Byron Nakos,et al.  EyeMMV toolbox: An eye movement post-analysis tool based on a two-step spatial dispersion threshold for fixation identification , 2014 .

[24]  Alexander Pollatsek,et al.  Eye Movements During Reading , 2008 .

[25]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[26]  Radoslaw Mantiuk,et al.  Do-It-Yourself Eye Tracker: Low-Cost Pupil-Based Eye Tracker for Computer Graphics Applications , 2012, MMM.

[27]  Eyad Elyan,et al.  The cognitive benefits of dynamic representations in the acquisition of spatial navigation skills , 2014, Comput. Hum. Behav..

[28]  Frank Witlox,et al.  Interpreting maps through the eyes of expert and novice users , 2012, Int. J. Geogr. Inf. Sci..

[29]  Michael Heubner,et al.  Eye Movements and Attention , 2012 .

[30]  Alzbeta Brychtova,et al.  Eye-tracking Study on Different Perception of 2D and 3D Terrain Visualisation , 2013 .

[31]  Linden J. Ball,et al.  Eye Tracking in Human-Computer Interaction and Usability Research : Current Status and Future Prospects , 2004 .

[32]  J. Findlay,et al.  Eye guidance and visual search , 1998 .

[33]  Marc Antrop,et al.  Does landscape related expertise influence the visual perception of landscape photographs? : implications for participatory landscape planning and management , 2015 .

[34]  M. Tinker,et al.  The study of eye movements in reading. , 1946, Psychological bulletin.

[35]  Herve Gazel.  La sémiologie graphique sort du cadre , 2014 .

[36]  Marcus Nyström,et al.  Improving the Accuracy of Video-Based Eye-Tracking in Real-Time through Post-Calibration Regression , 2014 .

[37]  R. Dodge,et al.  The angular velocity of eye movements , 1901 .

[38]  R. Pieters,et al.  A Review of Eye-Tracking Research in Marketing , 2008 .

[39]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[40]  Jukka M. Leppänen,et al.  Robustness and Precision : How Data Quality May Influence Key Dependent Variables in Infant Eye-Tracker Analyses , 2014 .

[41]  K. Rayner.  The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[42]  Stanislav Popelka.  OPTIMAL EYE FIXATION DETECTION SETTINGS FOR CARTOGRAPHIC PURPOSES , 2014 .

[43]  Richard S. Koplin,et al.  Setting Up in the OR , 2013 .

[44]  Marc Antrop,et al.  Eye-tracking Analysis in Landscape Perception Research: Influence of Photograph Properties and Landscape Characteristics , 2014 .

[45]  Philippe De Maeyer,et al.  Combining user logging with eye tracking for interactive and dynamic applications , 2015, Behavior research methods.

[46]  Philippe De Maeyer,et al.  Comparing Paper and Digital Topographic Maps Using Eye Tracking , 2014, CARTOCON.

[47]  P. Blignaut.  Fixation identification: The optimum threshold for a dispersion algorithm , 2009, Attention, perception & psychophysics.

[48]  Vittorio Murino,et al.  Custom Pictorial Structures for Re-identification , 2011, BMVC.

[49]  Arthur M. Jacobs,et al.  OGAMA (Open Gaze and Mouse Analyzer): Open-source software designed to analyze eye and mouse movements in slideshow study designs , 2008, Behavior research methods.

[50]  Marcus Nyström,et al.  The influence of calibration method and eye physiology on eyetracking data quality , 2013, Behavior research methods.

[51]  Werner Van Belle,et al.  Anchoring gaze when categorizing faces’ sex: Evidence from eye-tracking data , 2009, Vision Research.

[52]  Alzbeta Brychtova,et al.  Discriminating classes of sequential and qualitative colour schemes , 2015 .