Pupil Dilation and Eye Tracking

A video-based eye-tracker (e.g., the mobile Eyelink II or Eyelink Remote of SR research, Osgoode, Ontario, Canada) uses video cameras to rec ord the eye position of human subjects, and hence, record pupil dilation and eye movements. Th e eyetracker puts a video cameras and infrared illuminators in front of the eye to record the position of the eye, cornea reflections, and the size of the pupil. Using the movements of one’ s pupil (with respect to cornea reflections), the eye-tracker tracks the movement of one’s eyes, which is then mapped into locations on the screen by calibration and adjustments for head move ents. With the eyetracker, we can measure gaze locations, the time length of fixations, and pupil dilation. Hence, using the eyetracker, we can inve stigate how fixations (looking at the same place for a while), saccades (fast eye movements) a d pupil dilation responses (changes in pupil sizes) are related to the information on the screen and behavioral choices during an experiment. Understanding the relationship between these observ ables can help us understand how human behavior in the economy can be affected by what inf ormation people acquire, where their attention is focused on, what emotional state they ar in, and even what brain activity they are engaged in. This is because fixations and saccades (matched with information shown on screen) indicate how people acquire information (and what t ey see), time lengths of fixations indicate attention, and pupil dilation responses indicate em otion, arousal, stress, pain, or cognitive load.

[1]  Navin Kartik,et al.  Strategic Communication with Lying Costs , 2009 .

[2]  Colin Camerer,et al.  Pinocchio's Pupil: Using Eyetracking and Pupil Dilation to Understand Truth-Telling and Deception in Sender-Receiver Game , 2009 .

[3]  Tao Lin,et al.  Using multiple data sources to get closer insights into user cost and task performance , 2008, Interact. Comput..

[4]  Colin Camerer,et al.  A Cognitive Hierarchy Model of Games , 2004 .

[5]  M. Just,et al.  The intensity dimension of thought: pupillometric indices of sentence processing. , 1993, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[6]  David I. Laibson,et al.  Costly Information Acquisition: Experimental Analysis of a Boundedly Rational Model , 2006 .

[7]  Ying Chen Perturbed communication games with honest senders and naive receivers , 2011, J. Econ. Theory.

[8]  Navin Kartik,et al.  Would I lie to you? On social preferences and lying aversion , 2009 .

[9]  A. Kramer,et al.  Physiological metrics of mental workload: A review of recent progress , 1990, Multiple-task performance.

[10]  R A Hicks,et al.  Effects of Pupil Size and Facial Angle on Preference for Photographs of a Young Woman , 1967, Perceptual and motor skills.

[11]  R. Jacobson,et al.  Phasic Pupil Dilation Response to Noxious Stimulation , 2000 .

[12]  Andrew T. Duchowski,et al.  Eye Tracking Methodology - Theory and Practice, Third Edition , 2003 .

[13]  Joseph Tao-Yi Wang,et al.  Overcommunication in strategic information transmission games , 2006, Games Econ. Behav..

[14]  R. Bull,et al.  Pupil Dilation, Sex of Stimulus, and Age and Sex of Observer , 1979, Perceptual and motor skills.

[15]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[16]  F. Paas,et al.  Cognitive Load Measurement as a Means to Advance Cognitive Load Theory , 2003 .

[17]  Brian P. Bailey,et al.  Understanding changes in mental workload during execution of goal-directed tasks and its application for interruption management , 2008, TCHI.

[18]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[19]  M. A. Recarte,et al.  Mental workload while driving: effects on visual search, discrimination, and decision making. , 2003, Journal of experimental psychology. Applied.

[20]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[21]  Greg J Siegle,et al.  Use of concurrent pupil dilation assessment to inform interpretation and analysis of fMRI data , 2003, NeuroImage.

[22]  J Hyönä,et al.  Pupil Dilation as a Measure of Processing Load in Simultaneous Interpretation and Other Language Tasks , 1995, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[23]  Miguel A. Costa-Gomes,et al.  Cognition and Behavior in Two-Person Guessing Games: An Experimental Study , 2003 .

[24]  Tjerk de Greef,et al.  Eye Movement as Indicators of Mental Workload to Trigger Adaptive Automation , 2009, HCI.

[25]  Navin Kartik,et al.  Credulity, Lies, and Costly Talk , 2007, J. Econ. Theory.

[26]  Vicnent P. Crawford Look-ups as the Windows of the Strategic Soul: Studying Cognition via Information Search in Game Experiments , 2006 .

[27]  Eric J. Johnson,et al.  Detecting Failures of Backward Induction: Monitoring Information Search in Sequential Bargaining , 2002, J. Econ. Theory.

[28]  F. K. Berrien,et al.  An exploratory study of pupillary responses during deception , 1943 .

[29]  David E. Kieras,et al.  The GOMS family of user interface analysis techniques: comparison and contrast , 1996, TCHI.

[30]  J. Sobel,et al.  STRATEGIC INFORMATION TRANSMISSION , 1982 .

[31]  Bonnie E. John Why GOMS? , 1995, INTR.

[32]  Uri Gneezy,et al.  Deception: The Role of Consequences , 2005 .

[33]  Gerald L. Lohse,et al.  Organizational Behavior and Human Decision Processes a Comparison of Two Process Tracing Methods for Choice Tasks , 2022 .

[34]  E. Hess,et al.  Pupillometry: The Psychology of the Pupillary Response , 1978 .

[35]  M. A. Recarte,et al.  Mental Workload and Visual Impairment: Differences between Pupil, Blink, and Subjective Rating , 2008, The Spanish Journal of Psychology.

[36]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[37]  E. Hess,et al.  Pupil Size in Relation to Mental Activity during Simple Problem-Solving , 1964, Science.

[38]  Tao Lin,et al.  Combined User Physical, Physiological and Subjective Measures for Assessing User Cost , 2006, Universal Access in Ambient Intelligence Environments.

[39]  Brian P. Bailey,et al.  TAPRAV: An interactive analysis tool for exploring workload aligned to models of task execution , 2007, Interact. Comput..

[40]  M. T. Bradley,et al.  DECEPTION, INFORMATION AND THE PUPILLARY RESPONSE , 1980 .

[41]  R. E. Lubow,et al.  Pupillary size in response to a visual guilty knowledge test: New technique for the detection of deception , 1996 .

[42]  Samuel M. McClure,et al.  The Wick in the Candle of Learning: Epistemic Curiosity Activates Reward Circuitry and Enhances Memory , 2008 .

[43]  M. T. Bradley,et al.  Accuracy demonstrations, threat, and the detection of deception: cardiovascular, electrodermal, and pupillary measures. , 1981, Psychophysiology.

[44]  Frans W Cornelissen,et al.  The Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[45]  J. Beatty,et al.  The pupillary system. , 2000 .

[46]  M. P. Janisse,et al.  Pupil size and affect: A critical review of the literature since 1960. , 1973 .

[47]  Colin Camerer,et al.  Cognition and framing in sequential bargaining for gains and losses , 1993 .

[48]  James D. Hamilton A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle , 1989 .

[49]  K. Rayner Eye movements in reading and information processing. , 1978, Psychological bulletin.

[50]  Veikko Surakka,et al.  Pupil size variation as an indication of affective processing , 2003, Int. J. Hum. Comput. Stud..

[51]  I Heilveil Deception and pupil size. , 1976, Journal of clinical psychology.

[52]  Cristina Conati,et al.  Eye-tracking for user modeling in exploratory learning environments: An empirical evaluation , 2007, Knowl. Based Syst..

[53]  Miguel A. Costa-Gomes,et al.  Cognition and Behavior in Normal-Form Games: An Experimental Study , 1998 .

[54]  E. Granholm,et al.  Differentiation of deception using pupillary responses as an index of cognitive processing. , 2001, Psychophysiology.

[55]  Andrew T. Duchowski,et al.  Proceedings of the 2006 symposium on Eye tracking research & applications , 2000 .

[56]  B. Goldwater Psychological significance of pupillary movements. , 1972, Psychological bulletin.

[57]  D. Kahneman,et al.  Pupillary, heart rate, and skin resistance changes during a mental task. , 1969, Journal of experimental psychology.

[58]  Mickaël Causse,et al.  Embedded eye tracker in a real aircraft: new perspectives on pilot/aircraft interaction monitoring , 2008 .

[59]  Pat Hanrahan,et al.  Measuring the task-evoked pupillary response with a remote eye tracker , 2008, ETRA.

[60]  E. Hess,et al.  Pupil Size as Related to Interest Value of Visual Stimuli , 1960, Science.

[61]  S. Shimojo,et al.  Gaze bias both reflects and influences preference , 2003, Nature Neuroscience.

[62]  Mitsuru Ishizuka,et al.  AutoSelect: What You Want Is What You Get: Real-Time Processing of Visual Attention and Affect , 2006, PIT.

[63]  M. Just,et al.  Brain Activation Modulated by Sentence Comprehension , 1996, Science.

[64]  Antti Poikola,et al.  Invisible eni: using gaze and pupil size to control a game , 2008, CHI Extended Abstracts.

[65]  Kasia Muldner,et al.  Investigating the Utility of Eye-Tracking Information on Affect and Reasoning for User Modeling , 2009, UMAP.

[66]  Marc Vorsatz,et al.  An experimental study of truth-telling in a sender-receiver game , 2007, Games Econ. Behav..

[67]  Miguel A. Costa-Gomes,et al.  Cognition and Behavior in Normal-Form Games: An Experimental Study , 1998 .

[68]  Perttu Hämäläinen,et al.  Voluntary pupil size change as control in eyes only interaction , 2008, ETRA.

[69]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[70]  J. Beatty Task-evoked pupillary responses, processing load, and the structure of processing resources. , 1982, Psychological bulletin.

[71]  I. Wilkinson,et al.  Behavioural and functional anatomical correlates of deception in humans , 2001, Neuroreport.

[72]  M. Pomplun,et al.  Pupil Dilation as an Indicator of Cognitive Workload in Human-Computer Interaction , 2003 .

[73]  Daniel M. Russell,et al.  Discriminating the relevance of web search results with measures of pupil size , 2009, CHI.

[74]  U. Fischbacher z-Tree: Zurich toolbox for ready-made economic experiments , 1999 .

[75]  D Kahneman,et al.  Pupil Diameter and Load on Memory , 1966, Science.

[76]  C. Chapman,et al.  Phasic pupil dilation response to noxious stimulation in normal volunteers: relationship to brain evoked potentials and pain report. , 1999, Psychophysiology.

[77]  Jonathan D. Cohen,et al.  An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. , 2005, Annual review of neuroscience.

[78]  James M. Dabbs,et al.  The Hess pupil dilation findings: Sex or novelty? , 1998 .