PUPILLOMETRY IN LINGUISTIC RESEARCH

Abstract It has been known since at least the 1960s that small changes in pupil diameter in response to a mental task are indicative of processing effort associated with this task. More recently, with the advent of modern eye-trackers, which also measure the pupil diameter, pupillometry has been “rediscovered” by language researchers and the method has since been used in many different subdisciplines of linguistics. This article gives a nonexhaustive overview about recent linguistic research with the purpose of introducing researchers in the field of second language acquisition (SLA) to pupillometry. In addition, the article discusses things to consider when designing an experiment and how pupil data can be analyzed. The range of possibilities in which pupillometry can be used in experimental SLA research makes it a welcome addition to other online methods such as eye-tracking and event-related potentials.

[1]  P. Ferré,et al.  Is pupillary response a reliable index of word recognition? Evidence from a delayed lexical decision task , 2017, Behavior research methods.

[2]  P. Ferré,et al.  Pupil dilation is sensitive to the cognate status of words: further evidence for non-selectivity in bilingual lexical access , 2017 .

[3]  Maria K. Eckstein,et al.  Beyond eye gaze: What else can eyetracking reveal about cognition and cognitive development? , 2016, Developmental Cognitive Neuroscience.

[4]  Sylvain Sirois,et al.  Pupil diameter measurement errors as a function of gaze direction in corneal reflection eyetrackers , 2013, Behavior research methods.

[5]  B. Vanpatten,et al.  APTITUDE AS GRAMMATICAL SENSITIVITY AND THE INITIAL STAGES OF LEARNING JAPANESE AS A L2 , 2014, Studies in Second Language Acquisition.

[6]  Stefanie E. Kuchinsky,et al.  Pupillometry reveals changes in physiological arousal during a sustained listening task. , 2017, Psychophysiology.

[7]  Torsten Dau,et al.  Impact of Background Noise and Sentence Complexity on Processing Demands during Sentence Comprehension , 2016, Front. Psychol..

[8]  Martina Zellin,et al.  In the eye of the listener: pupil dilation elucidates discourse processing. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[9]  James Emil Flege,et al.  Factors affecting the recognition of words in a second language , 2000, Bilingualism: Language and Cognition.

[10]  D Kahneman,et al.  Pupil Diameter and Load on Memory , 1966, Science.

[11]  Stefano Tamburin,et al.  Psychological Considerations in the Assessment and Treatment of Pain in Neurorehabilitation and Psychological Factors Predictive of Therapeutic Response: Evidence and Recommendations from the Italian Consensus Conference on Pain in Neurorehabilitation , 2016, Front. Psychol..

[12]  Michele Miozzo,et al.  Pupillary Stroop effects , 2010, Cognitive Processing.

[13]  Jill Jegerski,et al.  EXPERIMENTAL DESIGNS IN SENTENCE PROCESSING RESEARCH , 2014, Studies in Second Language Acquisition.

[14]  Barbara Höhle,et al.  Pupillometry registers toddlers’ sensitivity to degrees of mispronunciation , 2017, Journal of experimental child psychology.

[15]  J. Beatty.  Task-evoked pupillary responses, processing load, and the structure of processing resources. , 1982, Psychological bulletin.

[16]  M. Pomplun,et al.  Pupil Dilation as an Indicator of Cognitive Workload in Human-Computer Interaction , 2003 .

[17]  T. Sandoval,et al.  More use almost always a means a smaller frequency effect: Aging, bilingualism, and the weaker links hypothesis. , 2008, Journal of memory and language.

[18]  Douglas P Munoz,et al.  A circuit for pupil orienting responses: implications for cognitive modulation of pupil size , 2015, Current Opinion in Neurobiology.

[19]  S. Sara.  The locus coeruleus and noradrenergic modulation of cognition , 2009, Nature Reviews Neuroscience.

[20]  Albert Costa,et al.  Does bilingualism hamper lexical access in speech production? , 2008, Acta psychologica.

[21]  A. Zekveld,et al.  Pupil Response as an Indication of Effortful Listening: The Influence of Sentence Intelligibility , 2010, Ear and hearing.

[22]  Megan H. Papesh,et al.  Pupil-BLAH-metry: Cognitive effort in speech planning reflected by pupil dilation , 2012, Attention, perception & psychophysics.

[23]  A. Jacobs,et al.  Pupillary responses during lexical decisions vary with word frequency but not emotional valence. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[24]  Albert Costa,et al.  Lying in a native and foreign language , 2014, Psychonomic Bulletin & Review.

[25]  Esteban Buz,et al.  The concurrent use of three implicit measures (eye movements, pupillometry, and event-related potentials) to assess receptive vocabulary knowledge in normal adults , 2016, Behavior research methods.

[26]  E. Granholm,et al.  Pupillometric measures of cognitive and emotional processes. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[27]  F. Hutzler,et al.  Systematic influence of gaze position on pupil size measurement: analysis and correction , 2011, Behavior research methods.

[28]  N. Ellis.  AT THE INTERFACE: DYNAMIC INTERACTIONS OF EXPLICIT AND IMPLICIT LANGUAGE KNOWLEDGE , 2005, Studies in Second Language Acquisition.

[29]  Jason Geller,et al.  Eyes wide open: Pupil size as a proxy for inhibition in the masked-priming paradigm , 2015, Memory & Cognition.

[30]  Thomas A. Farmer,et al.  THE FINE-TUNING OF LINGUISTIC EXPECTATIONS OVER THE COURSE OF L2 LEARNING , 2016, Studies in Second Language Acquisition.

[31]  J. P. Hylan.  Die Aufmerksamkeit und die Funktion der Sinnesorgane. , 1896 .

[32]  A. Weber,et al.  Spoken Word Recognition in Second Language Acquisition , 2012 .

[33]  Albert Costa,et al.  On the Temporal and Functional Origin of L2 Disadvantages in Speech Production: A Critical Review , 2011, Front. Psychology.

[34]  S. Sirois,et al.  Pupillometry , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[35]  Marco Alberto Javarone,et al.  Modeling Radicalization Phenomena in Heterogeneous Populations , 2015, PloS one.

[36]  B. Vanpatten,et al.  APTITUDE AS GRAMMATICAL SENSITIVITY AND THE INITIAL STAGES OF LEARNING JAPANESE AS A L2: PARAMETRIC VARIATION AND CASE MARKING—CORRIGENDUM , 2014, Studies in Second Language Acquisition.

[37]  C. Chapman,et al.  Phasic pupil dilation response to noxious stimulation in normal volunteers: relationship to brain evoked potentials and pain report. , 1999, Psychophysiology.

[38]  P. Toffanin,et al.  The Timing and Effort of Lexical Access in Natural and Degraded Speech , 2016, Front. Psychol..

[39]  Aaron R. Seitz,et al.  Pupillometry as a Glimpse into the Neurochemical Basis of Human Memory Encoding , 2015, Journal of Cognitive Neuroscience.

[40]  B. Tversky,et al.  Effects of visual and verbal presentation on cognitive load in vigilance, memory, and arithmetic tasks. , 2011, Psychophysiology.

[41]  J. Gold,et al.  Relationships between Pupil Diameter and Neuronal Activity in the Locus Coeruleus, Colliculi, and Cingulate Cortex , 2016, Neuron.

[42]  Jonathan D. Cohen,et al.  An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. , 2005, Annual review of neuroscience.

[43]  Mark S. Gilzenrat,et al.  Pupil diameter tracks changes in control state predicted by the adaptive gain theory of locus coeruleus function , 2010, Cognitive, affective & behavioral neuroscience.

[44]  Taylor R. Hayes,et al.  Mapping and correcting the influence of gaze position on pupil size measurements , 2015, Behavior Research Methods.

[45]  Stefanie E. Kuchinsky,et al.  Pupil size varies with word listening and response selection difficulty in older adults with hearing loss. , 2013, Psychophysiology.

[46]  Y. Ben-nun.  The use of pupillometry in the study of on-line verbal processing: Evidence for depths of processing , 1986, Brain and Language.

[47]  Vera Demberg,et al.  The Frequency of Rapid Pupil Dilations as a Measure of Linguistic Processing Difficulty , 2016, PloS one.

[48]  Julie C. Sedivy,et al.  Subject Terms: Linguistics Language Eyes & eyesight Cognition & reasoning , 1995 .

[49]  M Clynes,et al.  COLOR DYNAMICS OF THE PUPIL , 1969, Annals of the New York Academy of Sciences.

[50]  Elena G. Patsenko,et al.  The Quarterly Journal of Experimental Psychology Pupillometry Reveals Processing Load during Spoken Language Comprehension , 2022 .

[51]  D. Pisoni,et al.  Recognition of spoken words by native and non-native listeners: talker-, listener-, and item-related factors. , 1999, The Journal of the Acoustical Society of America.

[52]  J Hyönä,et al.  Pupil Dilation as a Measure of Processing Load in Simultaneous Interpretation and Other Language Tasks , 1995, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[53]  Megan H. Papesh,et al.  Pupil Dilation Reflects the Creation and Retrieval of Memories , 2012 .

[54]  Jens Schmidtke.  Second language experience modulates word retrieval effort in bilinguals: evidence from pupillometry , 2014, Front. Psychol..

[55]  A. Wingfield,et al.  Pupillometry as a measure of cognitive effort in younger and older adults. , 2010, Psychophysiology.

[56]  E. Szabadi,et al.  Functional Neuroanatomy of the Noradrenergic Locus Coeruleus: Its Roles in the Regulation of Arousal and Autonomic Function Part II: Physiological and Pharmacological Manipulations and Pathological Alterations of Locus Coeruleus Activity in Humans , 2008, Current neuropharmacology.

[57]  D. Hardison.  Second-language spoken word identification: Effects of perceptual training, visual cues, and phonetic environment , 2005, Applied Psycholinguistics.

[58]  M. H. Fischer,et al.  Listening to Limericks: A Pupillometry Investigation of Perceivers’ Expectancy , 2013, PloS one.

[59]  R. Ellis,et al.  TIMED AND UNTIMED GRAMMATICALITY JUDGMENTS MEASURE DISTINCT TYPES OF KNOWLEDGE , 2015, Studies in Second Language Acquisition.

[60]  M. Just,et al.  The intensity dimension of thought: pupillometric indices of sentence processing. , 1993, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[61]  S. Sirois,et al.  Pupillometry , 2012, Eye Movement Research.

[62]  E. Hess,et al.  Pupil Size in Relation to Mental Activity during Simple Problem-Solving , 1964, Science.

[63]  Jonathan D. Cohen,et al.  Role of locus coeruleus in attention and behavioral flexibility , 1999, Biological Psychiatry.

[64]  R. Ellis.  MEASURING IMPLICIT AND EXPLICIT KNOWLEDGE OF A SECOND LANGUAGE: A Psychometric Study , 2005, Studies in Second Language Acquisition.

[65]  Rebecca Foote.  THE STORAGE AND PROCESSING OF MORPHOLOGICALLY COMPLEX WORDS IN L2 SPANISH , 2015, Studies in Second Language Acquisition.

[66]  Kathy Conklin,et al.  Using eye-tracking in applied linguistics and second language research , 2016 .

[67]  Peter Hagoort,et al.  The Quarterly Journal of Experimental Psychology Pupillometry Reveals Increased Pupil Size during Indirect Request Comprehension , 2022 .

[68]  Bill VanPatten,et al.  Research Methods in Second Language Psycholinguistics , 2013 .

[69]  Norbert Schmitt,et al.  Size and Depth of Vocabulary Knowledge: What the Research Shows , 2014 .

[70]  J. Beatty,et al.  The pupillary system. , 2000 .

[71]  Robert C. Wilson,et al.  Rational regulation of learning dynamics by pupil–linked arousal systems , 2012, Nature Neuroscience.

[72]  S. Sara,et al.  Orienting and Reorienting: The Locus Coeruleus Mediates Cognition through Arousal , 2012, Neuron.

[73]  Esther Janse,et al.  Speech rate effects on the processing of conversational speech across the adult life span. , 2016, The Journal of the Acoustical Society of America.

[74]  J. Bradshaw.  Background light intensity and the pupillary response in a reaction time task , 1969 .

[75]  E. Szabadi,et al.  Functional Neuroanatomy of the Noradrenergic Locus Coeruleus: Its Roles in the Regulation of Arousal and Autonomic Function Part I: Principles of Functional Organisation , 2008, Current neuropharmacology.

[76]  R. O’Connell,et al.  Pupil diameter covaries with BOLD activity in human locus coeruleus , 2014, Human brain mapping.

[77]  L. R. Chapman,et al.  A Novel Pupillometric Method for Indexing Word Difficulty in Individuals With and Without Aphasia. , 2015, Journal of speech, language, and hearing research : JSLHR.

[78]  Anna Piotrowska,et al.  Processing load during listening: The influence of task characteristics on the pupil response , 2013 .

[79]  Ekaterina P. Volkova,et al.  Emotion categorization of body expressions in narrative scenarios , 2014, Front. Psychol..