Preprocessing pupil size data: Guidelines and code

Pupillometry has been one of the most widely used response systems in psychophysiology. Changes in pupil size can reflect diverse cognitive and emotional states, ranging from arousal, interest and effort to social decisions, but they are also widely used in clinical practice to assess patients’ brain functioning. As a result, research involving pupil size measurements has been reported in practically all psychology, psychiatry, and psychophysiological research journals, and now it has found its way into the primatology literature as well as into more practical applications, such as using pupil size as a measure of fatigue or a safety index during driving. The different systems used for recording pupil size are almost as variable as its applications, and all yield, as with many measurement techniques, a substantial amount of noise in addition to the real pupillometry data. Before analyzing pupil size, it is therefore of crucial importance first to detect this noise and deal with it appropriately, even prior to (if need be) resampling and baseline-correcting the data. In this article we first provide a short review of the literature on pupil size measurements, then we highlight the most important sources of noise and show how these can be detected. Finally, we provide step-by-step guidelines that will help those interested in pupil size to preprocess their data correctly. These guidelines are accompanied by an open source MATLAB script (available at https://github.com/ElioS-S/pupil-size). Given that pupil diameter is easily measured by standard eyetracking technologies and can provide fundamental insights into cognitive and emotional processes, it is hoped that this article will further motivate scholars from different disciplines to study pupil size.

[1]  Sylvain Sirois,et al.  Infant cognition: going full factorial with pupil dilation. , 2009, Developmental science.

[2]  S. Wass,et al.  Tonic and phasic co-variation of peripheral arousal indices in infants , 2015, Biological Psychology.

[3]  G. Thierry,et al.  ERP-pupil size correlations reveal how bilingualism enhances cognitive flexibility , 2013, Cortex.

[4]  Douglas P Munoz,et al.  A circuit for pupil orienting responses: implications for cognitive modulation of pupil size , 2015, Current Opinion in Neurobiology.

[5]  Bernhard Hommel,et al.  Threat But Not Arousal Narrows Attention: Evidence from Pupil Dilation and Saccade Control , 2011, Front. Psychology.

[6]  A. Iriki,et al.  Attention-induced neuronal activity in the monkey somatosensory cortex revealed by pupillometrics , 1996, Neuroscience Research.

[7]  Tobias Otto,et al.  What our eyes tell us about feelings: Tracking pupillary responses during emotion regulation processes. , 2017, Psychophysiology.

[8]  Giuliano Geminiani,et al.  Unseen facial and bodily expressions trigger fast emotional reactions , 2009, Proceedings of the National Academy of Sciences.

[9]  T. Yoshitomi,et al.  Adrenergic excitatory and cholinergic inhibitory innervations in the human iris dilator. , 1985, Experimental eye research.

[10]  N. Emery,et al.  The eyes have it: the neuroethology, function and evolution of social gaze , 2000, Neuroscience & Biobehavioral Reviews.

[11]  D. Amaral,et al.  Social and Nonsocial Content Differentially Modulates Visual Attention and Autonomic Arousal in Rhesus Macaques , 2011, PloS one.

[12]  S. Steinhauer,et al.  The Pupillary Response in Cognitive Psychophysiology and Schizophrenia a , 1992, Annals of the New York Academy of Sciences.

[13]  L Weiskrantz,et al.  Learning from the pupil: a spatial visual channel in the absence of V1 in monkey and human. , 1998, Brain : a journal of neurology.

[14]  Amitash Ojha,et al.  Modulation of resource allocation by intelligent individuals in linguistic, mathematical and visuo-spatial tasks. , 2015, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[15]  Ronen Hershman,et al.  A novel blink detection method based on pupillometry noise , 2018, Behavior Research Methods.

[16]  Sven-Thomas Graupner,et al.  Virtual friend or threat? The effects of facial expression and gaze interaction on psychophysiological responses and emotional experience. , 2009, Psychophysiology.

[17]  M. Koss Pupillary dilation as an index of central nervous system α2-adrenoceptor activation , 1986 .

[18]  M. Koss,et al.  Pupillary dilation as an index of central nervous system alpha 2-adrenoceptor activation. , 1986, Journal of pharmacological methods.

[19]  M. Kret Emotional expressions beyond facial muscle actions. A call for studying autonomic signals and their impact on social perception , 2015, Front. Psychol..

[20]  F. Hutzler,et al.  Systematic influence of gaze position on pupil size measurement: analysis and correction , 2011, Behavior research methods.

[21]  J. Martineau,et al.  Can pupil size and pupil responses during visual scanning contribute to the diagnosis of autism spectrum disorder in children? , 2011, Journal of psychiatric research.

[22]  H. Critchley,et al.  Pupillary contagion: central mechanisms engaged in sadness processing. , 2006, Social cognitive and affective neuroscience.

[23]  Beatrice de Gelder,et al.  Emotional signals from faces, bodies and scenes influence observers' face expressions, fixations and pupil-size , 2013, Front. Hum. Neurosci..

[24]  M. Bradley,et al.  The pupil as a measure of emotional arousal and autonomic activation. , 2008, Psychophysiology.

[25]  C. D. De Dreu,et al.  Pupil Mimicry Correlates With Trust in In-Group Partners With Dilating Pupils , 2015, Psychological science.

[26]  Mark H. Johnson,et al.  Eye contact detection in humans from birth , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Jonathan D. Cohen,et al.  Adaptive gain and the role of the locus coeruleus–norepinephrine system in optimal performance , 2005, The Journal of comparative neurology.

[28]  Sebastiaan Mathôt,et al.  Safe and sensible preprocessing and baseline correction of pupil-size data , 2018, Behavior Research Methods.

[29]  Yongxin Yu,et al.  Pharmacological studies of 8-OH-DPAT-induced pupillary dilation in anesthetized rats. , 2004, European journal of pharmacology.

[30]  G. Pari,et al.  Disruption of pupil size modulation correlates with voluntary motor preparation deficits in Parkinson's disease , 2016, Neuropsychologia.

[31]  A. Dix,et al.  Arithmetic and algebraic problem solving and resource allocation: the distinct impact of fluid and numerical intelligence. , 2015, Psychophysiology.

[32]  G. Nappi,et al.  Disordered pupil reactivity in Parkinson's disease , 1991, Clinical Autonomic Research.

[33]  Christophe Ley,et al.  Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median , 2013 .

[34]  B. Tversky,et al.  Effects of visual and verbal presentation on cognitive load in vigilance, memory, and arithmetic tasks. , 2011, Psychophysiology.

[35]  A. Widmann,et al.  Infant and adult pupil dilation in response to unexpected sounds. , 2016, Developmental psychobiology.

[36]  Taylor R. Hayes,et al.  Mapping and correcting the influence of gaze position on pupil size measurements , 2015, Behavior Research Methods.

[37]  K. Roelofs,et al.  Perception of Face and Body Expressions Using Electromyography, Pupillometry and Gaze Measures , 2013, Front. Psychology.

[38]  L. Colzato,et al.  Spontaneous eye blink rate as predictor of dopamine-related cognitive function—A review , 2016, Neuroscience & Biobehavioral Reviews.

[39]  Maria K. Eckstein,et al.  Beyond eye gaze: What else can eyetracking reveal about cognition and cognitive development? , 2016, Developmental Cognitive Neuroscience.

[40]  J. Colombo,et al.  Pupil and salivary indicators of autonomic dysfunction in autism spectrum disorder. , 2013, Developmental psychobiology.

[41]  S. Sirois,et al.  Pupillometry , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[42]  D Kahneman,et al.  Pupil Diameter and Load on Memory , 1966, Science.

[43]  Jonathan D. Cohen,et al.  Decision making, the P3, and the locus coeruleus-norepinephrine system. , 2005, Psychological bulletin.

[44]  Laurent Itti,et al.  Transient Pupil Response Is Modulated by Contrast-Based Saliency , 2014, The Journal of Neuroscience.

[45]  Christine Fawcett,et al.  Pupillary Contagion in Infancy , 2016, Psychological science.

[46]  C. Bradshaw,et al.  Attenuation of the pupillary light reflex in anxious patients. , 1990, British journal of clinical pharmacology.

[47]  C. D. De Dreu,et al.  Pupil mimicry and trust - Implication for depression. , 2018, Journal of psychiatric research.

[48]  C. D. De Dreu,et al.  Pupil-mimicry conditions trust in partners: moderation by oxytocin and group membership , 2017, Proceedings of the Royal Society B: Biological Sciences.

[49]  Martina Zellin,et al.  In the eye of the listener: pupil dilation elucidates discourse processing. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[50]  B. Jennett,et al.  Assessment of coma and impaired consciousness. A practical scale. , 1974, Lancet.

[51]  T. Matsuzawa,et al.  Chimpanzees and Humans Mimic Pupil-Size of Conspecifics , 2014, PloS one.

[52]  E. Hess,et al.  Pupil Size in Relation to Mental Activity during Simple Problem-Solving , 1964, Science.