Eye tracking measures of uncertainty during perceptual decision making.

Perceptual decision making involves gathering and interpreting sensory information to effectively categorize the world and inform behavior. For instance, a radiologist distinguishing the presence versus absence of a tumor, or a luggage screener categorizing objects as threatening or non-threatening. In many cases, sensory information is not sufficient to reliably disambiguate the nature of a stimulus, and resulting decisions are done under conditions of uncertainty. The present study asked whether several oculomotor metrics might prove sensitive to transient states of uncertainty during perceptual decision making. Participants viewed images with varying visual clarity and were asked to categorize them as faces or houses, and rate the certainty of their decisions, while we used eye tracking to monitor fixations, saccades, blinks, and pupil diameter. Results demonstrated that decision certainty influenced several oculomotor variables, including fixation frequency and duration, the frequency, peak velocity, and amplitude of saccades, and phasic pupil diameter. Whereas most measures tended to change linearly along with decision certainty, pupil diameter revealed more nuanced and dynamic information about the time course of perceptual decision making. Together, results demonstrate robust alterations in eye movement behavior as a function of decision certainty and attention demands, and suggest that monitoring oculomotor variables during applied task performance may prove valuable for identifying and remediating transient states of uncertainty.

[1]  L. Jacoby,et al.  Prejudice and perception: the role of automatic and controlled processes in misperceiving a weapon. , 2001, Journal of personality and social psychology.

[2]  S. Liversedge,et al.  Saccadic eye movements and cognition , 2000, Trends in Cognitive Sciences.

[3]  Scott Makeig,et al.  Eye Activity Correlates of Workload during a Visuospatial Memory Task , 2001, Hum. Factors.

[4]  J. Cohen,et al.  The role of locus coeruleus in the regulation of cognitive performance. , 1999, Science.

[5]  L. Stark,et al.  The main sequence, a tool for studying human eye movements , 1975 .

[6]  Anne E. Urai,et al.  Pupil-linked arousal is driven by decision uncertainty and alters serial choice bias , 2017, Nature Communications.

[7]  Ezgi Mercan,et al.  Pupil diameter changes reflect difficulty and diagnostic accuracy during medical image interpretation , 2016, BMC Medical Informatics and Decision Making.

[8]  Y. Nakayama,et al.  Memorial message for the 10th anniversary of journal of visualization , 2007, J. Vis..

[9]  Joy J. Geng,et al.  Pupil diameter reflects uncertainty in attentional selection during visual search , 2015, Front. Hum. Neurosci..

[10]  T. Knapen,et al.  Decision-related pupil dilation reflects upcoming choice and individual bias , 2014, Proceedings of the National Academy of Sciences.

[11]  H. Heekeren,et al.  Perceptual decision making: a bidirectional link between mind and motion. , 2009, Progress in brain research.

[12]  Joachim Vandekerckhove,et al.  Pupil-Linked Arousal Determines Variability in Perceptual Decision Making , 2014, PLoS Comput. Biol..

[13]  Andreas Glöckner,et al.  The Dynamics of Decision Making in Risky Choice: An Eye-Tracking Analysis , 2012, Front. Psychology.

[14]  A. Rangel,et al.  Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisions , 2011, Proceedings of the National Academy of Sciences.

[15]  G. Zelinsky,et al.  Eye movements during parallel-serial visual search. , 1997 .

[16]  Jonathan D. Cohen,et al.  An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. , 2005, Annual review of neuroscience.

[17]  Thierry Baccino,et al.  Automatic Stress Classification With Pupil Diameter Analysis , 2014, Int. J. Hum. Comput. Interact..

[18]  R. Ratcliff,et al.  Neural Representation of Task Difficulty and Decision Making during Perceptual Categorization: A Timing Diagram , 2006, The Journal of Neuroscience.

[19]  P. Sajda,et al.  Temporal characterization of the neural correlates of perceptual decision making in the human brain. , 2006, Cerebral cortex.

[20]  Mark S. Gilzenrat,et al.  Pupil diameter tracks changes in control state predicted by the adaptive gain theory of locus coeruleus function , 2010, Cognitive, affective & behavioral neuroscience.

[21]  S. Martinez-Conde,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[22]  Thierry Baccino,et al.  Approximation of on-line mental workload index in ATC simulated multitasks , 2010 .

[23]  S. Klein,et al.  Pupil dilation during visual target detection. , 2010, Journal of vision.

[24]  C. J. Erkelens,et al.  Control of fixation duration in a simple search task , 1996, Perception & psychophysics.

[25]  F. Hutzler,et al.  Systematic influence of gaze position on pupil size measurement: analysis and correction , 2011, Behavior research methods.

[26]  David A. Medler,et al.  Neural correlates of sensory and decision processes in auditory object identification , 2004, Nature Neuroscience.

[27]  Ian Krajbich,et al.  Visual fixations and the computation and comparison of value in simple choice , 2010, Nature Neuroscience.

[28]  Leslie G. Ungerleider,et al.  The neural systems that mediate human perceptual decision making , 2008, Nature Reviews Neuroscience.

[29]  Ezgi Mercan,et al.  Accuracy is in the eyes of the pathologist: The visual interpretive process and diagnostic accuracy with digital whole slide images , 2017, J. Biomed. Informatics.

[30]  Niels A. Kloosterman,et al.  Dynamic modulation of decision biases by brainstem arousal systems , 2017, eLife.

[31]  S. Sirois,et al.  Pupillometry , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[32]  Peter Bossaerts,et al.  Do not Bet on the Unknown Versus Try to Find Out More: Estimation Uncertainty and “Unexpected Uncertainty” Both Modulate Exploration , 2012, Front. Neurosci..

[33]  M. Shadlen,et al.  Decision Making as a Window on Cognition , 2013, Neuron.

[34]  J. Gold,et al.  Arousal-related adjustments of perceptual biases optimize perception in dynamic environments , 2017, Nature Human Behaviour.

[35]  C. Bruce,et al.  Neural circuitry of judgment and decision mechanisms , 2005, Brain Research Reviews.

[36]  A. Jacobs,et al.  Spatial and/or temporal adjustments of scanning behavior to visibility changes. , 1987, Acta psychologica.

[37]  Jacob L. Orquin,et al.  Attention and choice: a review on eye movements in decision making. , 2013, Acta psychologica.

[38]  S. Hackley,et al.  Accessory Stimulus Effects on Response Selection: Does Arousal Speed Decision Making? , 1999, Journal of Cognitive Neuroscience.

[39]  C. Koch,et al.  Pupil dilation reflects perceptual selection and predicts subsequent stability in perceptual rivalry , 2008, Proceedings of the National Academy of Sciences.

[40]  J. Beatty Task-evoked pupillary responses, processing load, and the structure of processing resources. , 1982 .

[41]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[42]  Jonathan D. Nelson,et al.  How Embodied Is Perceptual Decision Making? Evidence for Separate Processing of Perceptual and Motor Decisions , 2013, The Journal of Neuroscience.

[43]  Wayne D. Gray,et al.  The Eye Blink as a Physiological Indicator of Cognitive Workload , 2000 .

[44]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[45]  Arthur F Kramer,et al.  Visual Skills in Airport-Security Screening , 2004, Psychological science.

[46]  Adoración Antolí,et al.  Main sequence: an index for detecting mental workload variation in complex tasks. , 2011, Applied ergonomics.

[47]  Nadir Weibel,et al.  Let's look at the cockpit: exploring mobile eye-tracking for observational research on the flight deck , 2012, ETRA.

[48]  Isabell Wartenburger,et al.  Resource allocation and fluid intelligence: insights from pupillometry. , 2010, Psychophysiology.

[49]  Robert C. Wilson,et al.  Rational regulation of learning dynamics by pupil–linked arousal systems , 2012, Nature Neuroscience.

[50]  Jay A. Edelman,et al.  The dependence of visual scanning performance on search direction and difficulty , 2008, Vision Research.

[51]  S. Steinhauer,et al.  Blink before and after you think: blinks occur prior to and following cognitive load indexed by pupillary responses. , 2008, Psychophysiology.