Eye Movement Monitoring as a Process Tracing Methodology in Decision Making Research

Over the past half century, research on human decision making has expanded from a purely behaviorist approach that focuses on decision outcomes, to include a more cognitive approach that focuses on the decision processes that occur prior to the response. This newer approach, known as process tracing, has employed various methods, such as verbal protocols, information search displays, and eye movement monitoring, to identify and track psychological events that occur prior to the response (such as cognitive states, stages, or processes). In the present article, we review empirical studies that have employed eye movement monitoring as a process tracing method in decision making research, and we examine the potential of eye movement monitoring as a process tracing methodology. We also present an experiment that further illustrates the experimental manipulations and analysis techniques that are possible with modern eye tracking technology. In this experiment, a gaze-contingent display was used to manipulate stimulus exposure during decision making, which allowed us to test a specific hypothesis about the role of eye movements in preference decisions (the Gaze Cascade model; Shimojo, Simion, Shimojo, & Scheier, 2003). The results of the experiment did not confirm the predictions of the Gaze Cascade model, but instead support the idea that eye movements in these decisions reflect the screening and evaluation of decision alternatives. In summary, we argue that eye movement monitoring is a valuable tool for capturing decision makers’ information search behaviors, and that modern eye tracking technology is highly compatible with other process tracing methods such as retrospective verbal protocols and neuroimaging techniques, and hence it is poised to be an integral part of the next wave of decision research.

[1]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[2]  J. P. Hansen The use of eye mark recordings to support verbal retrospection in software testing , 1991 .

[3]  Elizabeth R Schotter,et al.  Gaze bias: Selective encoding and liking effects , 2010 .

[4]  R. Held,et al.  Preferential-looking assessment of fusion and stereopsis in infants aged 1-6 months. , 1985, Investigative Ophthalmology and Visual Science.

[5]  F. Paas,et al.  Uncovering the problem-solving process: cued retrospective reporting versus concurrent and retrospective reporting. , 2005, Journal of experimental psychology. Applied.

[6]  Robin Walker Object-based neglect: An investigation of the contributions of eye movements and perceptual completion , 1997 .

[7]  Pieter Koele,et al.  A Comparison of Different Methods for the Elicitation of Attribute Weights: Structural Modeling, Process Tracing, and Self-Reports , 1995 .

[8]  Eyal M Reingold,et al.  Evidence for top-down control of eye movements during visual decision making. , 2010, Journal of vision.

[9]  Christopher T. Ball,et al.  A Comparison of Single-Step and Multiple-Step Transition Analyses of Multiattribute Decision Strategies , 1997 .

[10]  E. Aronson,et al.  Theory and method , 1985 .

[11]  Andrew J. Stewart,et al.  Integrating text and pictorial information: eye movements when looking at print advertisements. , 2001, Journal of experimental psychology. Applied.

[12]  Lester C. Loschky,et al.  Gaze-Contingent Multiresolutional Displays: An Integrative Review , 2003, Hum. Factors.

[13]  Shinsuke Shimojo,et al.  Interrupting the cascade: Orienting contributes to decision making even in the absence of visual stimulation , 2007, Perception & psychophysics.

[14]  K. Rayner The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[15]  R. Pieters,et al.  Visual Attention to Repeated Print Advertising: A Test of Scanpath Theory , 1999 .

[16]  Eric J. Johnson,et al.  The validity of verbal protocols , 1989, Memory & cognition.

[17]  Eyal M Reingold,et al.  Stimulus exposure and gaze bias: A further test of the gaze cascade model , 2009, Attention, perception & psychophysics.

[18]  Corina Sas,et al.  People and Computers XXI - HCI... but not as we know it: Proceedings of HCI. , 2007 .

[19]  Ulrich Hoffrage,et al.  Identifying decision strategies in a consumer choice situation , 2008, Judgment and Decision Making.

[20]  R. Wurtz,et al.  Activity of superior colliculus in behaving monkey. I. Visual receptive fields of single neurons. , 1972, Journal of neurophysiology.

[21]  B. Dosher,et al.  Strategies for multiattribute binary choice. , 1983, Journal of experimental psychology. Learning, memory, and cognition.

[22]  Wen-Hung Huang,et al.  Effects of music tempo and task difficulty on multi-attribute decision-making: An eye-tracking approach , 2009, Comput. Hum. Behav..

[23]  Klaus Opwis,et al.  Eye-tracking the cancellation and focus model for preference judgments , 2008 .

[24]  R. Zajonc Attitudinal effects of mere exposure. , 1968 .

[25]  R. Pieters,et al.  Goal Control of Attention to Advertising: The Yarbus Implication , 2007 .

[26]  Eyal M. Reingold,et al.  Predicting preference from fixations , 2009, PsychNology J..

[27]  L. Beach Broadening the Definition of Decision Making: The Role of Prechoice Screening of Options , 1993 .

[28]  K Rayner,et al.  Reading without a fovea. , 1979, Science.

[29]  M. Pomplun,et al.  Investigating the visual span in comparative search: the effects of task difficulty and divided attention , 2001, Cognition.

[30]  P. Glimcher The neurobiology of visual-saccadic decision making. , 2003, Annual review of neuroscience.

[31]  L. Diller,et al.  Exploratory eye movements and visual hemi-neglect. , 1986, Journal of clinical and experimental neuropsychology.

[32]  Andrew T Duchowski,et al.  A breadth-first survey of eye-tracking applications , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[33]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[34]  W. Fred van Raaij,et al.  Consumer Information Processing For Different Information Structures and Formats , 1977 .

[35]  Rik Pieters,et al.  Attention Capture and Transfer in Advertising: Brand, Pictorial, and Text-Size Effects , 2004 .

[36]  K. Rayner,et al.  Eye Movements When Looking at Print Advertisements: The Goal of the Viewer Matters. , 2008, Applied cognitive psychology.

[37]  Ralph Radach,et al.  Eye Movements in the Processing of Print Advertisements , 2003 .

[38]  R H Wurtz,et al.  Organization of monkey superior colliculus: intermediate layer cells discharging before eye movements. , 1976, Journal of neurophysiology.

[39]  Larry D. Rosen,et al.  An eye fixation analysis of multialternative choice , 1975, Memory & cognition.

[40]  K. Rayner The perceptual span and peripheral cues in reading , 1975, Cognitive Psychology.

[41]  Michel Wedel,et al.  Visual Marketing: From Attention to Action , 2007 .

[42]  M. Posner,et al.  Attention and the detection of signals. , 1980, Journal of experimental psychology.

[43]  Richard L. Moreland,et al.  Exposure effects in person perception: Familiarity, similarity, and attraction , 1982 .

[44]  L. Ball,et al.  Effects of belief and logic on syllogistic reasoning: Eye-movement evidence for selective processing models. , 2006, Experimental psychology.

[45]  J. Ford,et al.  Process tracing methods: Contributions, problems, and neglected research questions , 1989 .

[46]  Eric J. Johnson,et al.  The adaptive decision maker , 1993 .

[47]  Alan G. Sanfey,et al.  Decision Neuroscience , 2007 .

[48]  Michel Wedel,et al.  Eye Fixations on Advertisements and Memory for Brands: A Model and Findings , 2000 .

[49]  Robert S. Billings,et al.  Measures of compensatory and noncompensatory models of decision behavior: Process tracing versus policy capturing , 1983 .

[50]  Aaron B. Hoffman,et al.  Thirty-something categorization results explained: selective attention, eyetracking, and models of category learning. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[51]  Linden J. Ball,et al.  Cueing retrospective verbal reports in usability testing through eye-movement replay , 2007, BCS HCI.

[52]  Stephanie Wilson,et al.  Identifying web usability problems from eye-tracking data , 2007, BCS HCI.

[53]  M. Pomplun,et al.  Peripheral and parafoveal cueing and masking effects on saccadic selectivity in a gaze-contingent window paradigm , 2001, Vision Research.

[54]  O. Svenson Process descriptions of decision making. , 1979 .

[55]  Joseph H. Goldberg,et al.  Visual Search of Food Nutrition Labels , 1999, Hum. Factors.

[56]  S. Senter,et al.  Information presentation constraints and the adaptive decision maker hypothesis , 1999 .

[57]  Colin Camerer,et al.  A framework for studying the neurobiology of value-based decision making , 2008, Nature Reviews Neuroscience.

[58]  R. Pieters,et al.  Visual attention during brand choice : The impact of time pressure and task motivation , 1999 .

[59]  Eyal M. Reingold,et al.  The time course of gaze bias in visual decision tasks , 2009 .

[60]  Cathy Frey,et al.  Investigative Ophthalmology and Visual Science , 2010 .

[61]  J. Edward Russo,et al.  Eye Fixations Can Save the World: a Critical Evaluation and a Comparison Between Eye Fixations and Other Information Processing Methodologies , 1978 .

[62]  Stuart M. Senter,et al.  Organizational Behavior and Human Decision Processes Looking and Weighting in Judgment and Choice Performed without Ever Forming an Overall Integrated , 2022 .

[63]  Eyal M. Reingold,et al.  Eye movements reveal solution knowledge prior to insight , 2011, Consciousness and Cognition.

[64]  N. Charness,et al.  Visual Span in Expert Chess Players: Evidence From Eye Movements , 2001, Psychological science.

[65]  K. Takemura,et al.  The influence of decision heuristics and overconfidence on multiattribute choice: A process-tracing study , 2006 .

[66]  Levin,et al.  Information Processing at Successive Stages of Decision Making: Need for Cognition and Inclusion-Exclusion Effects. , 2000, Organizational behavior and human decision processes.

[67]  Heiner Deubel,et al.  The mind's eye : cognitive and applied aspects of eye movement research , 2003 .

[68]  R. Kronauer,et al.  Affective Discrimination of Stimuli That Cannot Be Recognized , 2022 .

[69]  D. Robinson,et al.  Shared neural control of attentional shifts and eye movements , 1996, Nature.

[70]  Larry D. Rosen,et al.  An eye fixation analysis of choice and judgment with multiattribute stimuli , 1976, Memory & cognition.

[71]  O. Svenson Decision Making and the Search for Fundamental Psychological Regularities: What Can Be Learned from a Process Perspective? , 1996 .

[72]  R. Pieters,et al.  Attention switching during scene perception: how goals influence the time course of eye movements across advertisements. , 2008, Journal of experimental psychology. Applied.

[73]  John W. Payne,et al.  Task complexity and contingent processing in decision making: An information search and protocol analysis☆ , 1976 .

[74]  Alastair G Gale,et al.  Inspection Times and the Selection Task: What do Eye-Movements Reveal about Relevance Effects? , 2003, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[75]  Kang Chen,et al.  Visual Attention and Eye Movements , 2008 .

[76]  Gerald L. Lohse,et al.  A Comparison of Two Process Tracing Methods for Choice Tasks , 1996 .

[77]  J. E. Russo,et al.  An Eye-Fixation Analysis of Choice Processes for Consumer Nondurables , 1994 .

[78]  R. Moreland,et al.  Is stimulus recognition a necessary condition for the occurrence of exposure effects? , 1977, Journal of personality and social psychology.

[79]  S. Shimojo,et al.  Early interactions between orienting, visual sampling and decision making in facial preference , 2006, Vision Research.

[80]  Aaron B. Hoffman,et al.  Eyetracking and selective attention in category learning , 2005, Cognitive Psychology.

[81]  J. O'Doherty,et al.  Toward a Mechanistic Understanding of Human Decision Making , 2008 .

[82]  R. Abelson Decision making and decision theory , 1985 .

[83]  G. McConkie,et al.  The span of the effective stimulus during a fixation in reading , 1975 .

[84]  René Riedl,et al.  Identifying decision strategies: A process- and outcome-based classification method , 2008, Behavior research methods.

[85]  J. Payne,et al.  Exploring predecisional behavior: An alternative approach to decision research , 1978 .

[86]  H. J. Einhorn,et al.  Linear regression and process-tracing models of judgment. , 1979 .

[87]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[88]  R. Wurtz,et al.  Organization of monkey superior colliculus: enhanced visual response of superficial layer cells. , 1976, Journal of neurophysiology.

[89]  S. Shimojo,et al.  Gaze bias both reflects and influences preference , 2003, Nature Neuroscience.