Threats to the validity of eye-movement research in psychology

Eyetracking research in psychology has grown exponentially over the past decades, as equipment has become cheaper and easier to use. The surge in eyetracking research has not, however, been equaled by a growth in methodological awareness, and practices that are best avoided have become commonplace. We describe nine threats to the validity of eyetracking research and provide, whenever possible, advice on how to avoid or mitigate these challenges. These threats concern both internal and external validity and relate to the design of eyetracking studies, to data preprocessing, to data analysis, and to the interpretation of eyetracking data.

[1]  Jacob L. Orquin,et al.  Effects of salience are both short- and long-lived. , 2015, Acta psychologica.

[2]  Jacob L. Orquin,et al.  Areas of Interest as a Signal Detection Problem in Behavioral Eye-Tracking Research , 2016 .

[3]  H. Deubel.  The time course of presaccadic attention shifts , 2008, Psychological research.

[4]  Robbie C. M. van Aert,et al.  Degrees of Freedom in Planning, Running, Analyzing, and Reporting Psychological Studies: A Checklist to Avoid p-Hacking , 2016, Front. Psychol..

[5]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[6]  P. Devine.  Stereotypes and prejudice: Their automatic and controlled components. , 1989 .

[7]  Diederick C. Niehorster,et al.  What to expect from your remote eye-tracker when participants are unrestrained , 2017, Behavior Research Methods.

[8]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[9]  E. Gordon,et al.  Defining the temporal threshold for ocular fixation in free-viewing visuocognitive tasks , 2003, Journal of Neuroscience Methods.

[10]  D. Ballard,et al.  Task constraints in visual working memory , 1997, Vision Research.

[11]  Dean R. Melmoth,et al.  Scaling of letter size and contrast equalises perception across eccentricities and set sizes , 2003, Vision Research.

[12]  Jacob L. Orquin,et al.  Eye Tracking and Nutrition Label Use: A Review of the Literature and Recommendations for Label Enhancement , 2012 .

[13]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.

[14]  R. Nagel,et al.  Search Dynamics in Consumer Choice under Time Pressure: An Eye-Tracking Study , 2011 .

[15]  K. Rayner.  The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[16]  Damien Litchfield,et al.  Looking for Cancer: Expertise Related Differences in Searching and Decision Making , 2013 .

[17]  Titus von der Malsburg,et al.  False Positives and Other Statistical Errors in Standard Analyses of Eye Movements in Reading. , 2015, Journal of memory and language.

[18]  Jonathan M. Chambers,et al.  Response times for visually guided saccades in persons with Parkinson's disease: A meta-analytic review , 2010, Neuropsychologia.

[19]  E. Reingold.  Eye Tracking Research and Technology: Towards Objective Measurement of Data Quality , 2014, Visual cognition.

[20]  C. Koch,et al.  Simultaneous modeling of visual saliency and value computation improves predictions of economic choice , 2013, Proceedings of the National Academy of Sciences.

[21]  P. Zwitserlood,et al.  Processing Nasals with and without Consecutive Context Phonemes: Evidence from Explicit Categorization and the N100 , 2013, Front. Psychology.

[22]  Jacob L. Orquin,et al.  A review of the findings and theories on surface size effects on visual attention , 2013, Front. Psychol..

[23]  J. E. Russo.  Eye Fixations as a Process Trace , 2019, A Handbook of Process Tracing Methods.

[24]  R A Monty,et al.  An advanced eye-movement measuring and recording system. , 1975, The American psychologist.

[25]  N. Charness,et al.  Visual Span in Expert Chess Players: Evidence From Eye Movements , 2001, Psychological science.

[26]  Gerald L. Lohse,et al.  Consumer Eye Movement Patterns on Yellow Pages Advertising , 1997 .

[27]  Yongqin Cui,et al.  Gaze tracking accuracy in humans: Two eyes are better than one , 2006, Neuroscience Letters.

[28]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[29]  H. Hartridge,et al.  METHODS OF INVESTIGATING EYE MOVEMENTS , 1948, The British journal of ophthalmology.

[30]  L. Hedges,et al.  The Handbook of Research Synthesis and Meta-Analysis , 2009 .

[31]  C. Nederkoorn,et al.  Selective visual attention for ugly and beautiful body parts in eating disorders. , 2005, Behaviour research and therapy.

[32]  Lucía Antúnez,et al.  How do design features influence consumer attention when looking for nutritional information on food labels? Results from an eye-tracking study on pan bread labels , 2013, International journal of food sciences and nutrition.

[33]  Jukka Hyönä,et al.  The effects of eye movements, spatial attention, and stimulus features on inattentional blindness , 2004, Vision Research.

[34]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[35]  J. Clement.  Visual influence on in-store buying decisions: an eye-track experiment on the visual influence of packaging design , 2007 .

[36]  S. Shimojo,et al.  Gaze bias both reflects and influences preference , 2003, Nature Neuroscience.

[37]  Michael D. Dodd,et al.  The political left rolls with the good and the political right confronts the bad: connecting physiology and cognition to preferences , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[38]  Andreas Glöckner,et al.  An eye‐tracking study on information processing in risky decisions: Evidence for compensatory strategies based on automatic processes , 2011 .

[39]  Evan F. Risko,et al.  Visual Attention and the Neuroimage Bias , 2013, PloS one.

[40]  O. Svenson.  Process descriptions of decision making. , 1979 .

[41]  Jacob L. Orquin,et al.  Attention and choice: a review on eye movements in decision making. , 2013, Acta psychologica.

[42]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[43]  J. Hyönä,et al.  Eye movement assessment of selective attentional capture by emotional pictures. , 2006, Emotion.

[44]  T. Foulsham,et al.  The where, what and when of gaze allocation in the lab and the natural environment , 2011, Vision Research.

[45]  Liangyan Wang,et al.  Idleness Aversion and the Need for Justifiable Busyness , 2010, Psychological science.

[46]  P. Shah,et al.  Review of Graph Comprehension Research: Implications for Instruction , 2002 .

[47]  D. Levi,et al.  Visual crowding: a fundamental limit on conscious perception and object recognition , 2011, Trends in Cognitive Sciences.