Pupil size signals mental effort deployed during multiple object tracking and predicts brain activity in the dorsal attention network and the locus coeruleus.

Attentional effort relates to the allocation of limited-capacity attentional resources to meet current task demands and involves the activation of top-down attentional systems in the brain. Pupillometry is a sensitive measure of this intensity aspect of top-down attentional control. Studies relate pupillary changes in response to cognitive processing to activity in the locus coeruleus (LC), which is the main hub of the brain's noradrenergic system and it is thought to modulate the operations of the brain's attentional systems. In the present study, participants performed a visual divided attention task known as multiple object tracking (MOT) while their pupil sizes were recorded by use of an infrared eye tracker and then were tested again with the same paradigm while brain activity was recorded using fMRI. We hypothesized that the individual pupil dilations, as an index of individual differences in mental effort, as originally proposed by Kahneman (1973), would be a better predictor of LC activity than the number of tracked objects during MOT. The current results support our hypothesis, since we observed pupil-related activity in the LC. Moreover, the changes in the pupil correlated with activity in the superior colliculus and the right thalamus, as well as cortical activity in the dorsal attention network, which previous studies have shown to be strongly activated during visual tracking of multiple targets. Follow-up pupillometric analyses of the MOT task in the same individuals also revealed that individual differences to cognitive load can be remarkably stable over a lag of several years. To our knowledge this is the first study using pupil dilations as an index of attentional effort in the MOT task and also relating these to functional changes in the brain that directly implicate the LC-NE system in the allocation of processing resources.

[1]  N. McGlynn Thinking fast and slow. , 2014, Australian veterinary journal.

[2]  R. O’Connell,et al.  Pupil diameter covaries with BOLD activity in human locus coeruleus , 2014, Human brain mapping.

[3]  Søren K. Andersen,et al.  Sustained Multifocal Attentional Enhancement of Stimulus Processing in Early Visual Areas Predicts Tracking Performance , 2013, The Journal of Neuroscience.

[4]  P. Cavanagh,et al.  Flexible cognitive resources: competitive content maps for attention and memory , 2013, Trends in Cognitive Sciences.

[5]  S. Sara,et al.  Orienting and Reorienting: The Locus Coeruleus Mediates Cognition through Arousal , 2012, Neuron.

[6]  A. Lundervold,et al.  Imaging and Cognitive Genetics: The Norwegian Cognitive NeuroGenetics Sample , 2012, Twin Research and Human Genetics.

[7]  Stefan M. Wierda,et al.  Pupil dilation deconvolution reveals the dynamics of attention at high temporal resolution , 2012, Proceedings of the National Academy of Sciences.

[8]  Brian J. White,et al.  Microstimulation of the Monkey Superior Colliculus Induces Pupil Dilation Without Evoking Saccades , 2012, The Journal of Neuroscience.

[9]  L. Yao,et al.  Causal Interactions in Attention Networks Predict Behavioral Performance , 2012, The Journal of Neuroscience.

[10]  M. Corbetta,et al.  Spatial neglect and attention networks. , 2011, Annual review of neuroscience.

[11]  Wim Fias,et al.  Salience maps in parietal cortex: Imaging and computational modeling , 2010, NeuroImage.

[12]  Mark S. Gilzenrat,et al.  Pupil diameter tracks changes in control state predicted by the adaptive gain theory of locus coeruleus function , 2010, Cognitive, affective & behavioral neuroscience.

[13]  A. Wingfield,et al.  Pupillometry as a measure of cognitive effort in younger and older adults. , 2010, Psychophysiology.

[14]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[15]  Richard J Krauzlis,et al.  Inactivation of primate superior colliculus impairs covert selection of signals for perceptual judgments , 2010, Nature Neuroscience.

[16]  Mark D'Esposito,et al.  Top-down flow of visual spatial attention signals from parietal to occipital cortex. , 2009, Journal of vision.

[17]  Paul S. Morgan,et al.  In vivo mapping of the human locus coeruleus , 2009, NeuroImage.

[18]  Karl J. Friston The free-energy principle: a rough guide to the brain? , 2009, Trends in Cognitive Sciences.

[19]  S. Sara The locus coeruleus and noradrenergic modulation of cognition , 2009, Nature Reviews Neuroscience.

[20]  Sabine Kastner,et al.  Effects of Sustained Spatial Attention in the Human Lateral Geniculate Nucleus and Superior Colliculus , 2009, The Journal of Neuroscience.

[21]  Brian D. Fisher,et al.  Evidence against a speed limit in multiple-object tracking , 2008, Psychonomic bulletin & review.

[22]  C. Berridge Noradrenergic modulation of arousal , 2008, Brain Research Reviews.

[23]  M. Corbetta,et al.  The Reorienting System of the Human Brain: From Environment to Theory of Mind , 2008, Neuron.

[24]  C. Koch,et al.  Pupil dilation reflects perceptual selection and predicts subsequent stability in perceptual rivalry , 2008, Proceedings of the National Academy of Sciences.

[25]  Jeffrey M. Zacks,et al.  Segmentation in the perception and memory of events , 2008, Trends in Cognitive Sciences.

[26]  Rajeev D. S. Raizada,et al.  Challenge-Driven Attention: Interacting Frontal and Brainstem Systems , 2007, Frontiers in human neuroscience.

[27]  George A Alvarez,et al.  How many objects can you track? Evidence for a resource-limited attentive tracking mechanism. , 2007, Journal of vision.

[28]  W. Gehring,et al.  More attention must be paid: The neurobiology of attentional effort , 2006, Brain Research Reviews.

[29]  Katherine M. Armstrong,et al.  Visual and oculomotor selection: links, causes and implications for spatial attention , 2006, Trends in Cognitive Sciences.

[30]  S. Yantis,et al.  Selective visual attention and perceptual coherence , 2006, Trends in Cognitive Sciences.

[31]  S. Sara,et al.  Network reset: a simplified overarching theory of locus coeruleus noradrenaline function , 2005, Trends in Neurosciences.

[32]  Jonathan D. Cohen,et al.  An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. , 2005, Annual review of neuroscience.

[33]  Patrick Cavanagh,et al.  Tracking multiple targets with multifocal attention , 2005, Trends in Cognitive Sciences.

[34]  J. Hyönä,et al.  Is multiple object tracking carried out automatically by an early vision mechanism independent of higher‐order cognition? An individual difference approach , 2004 .

[35]  Canan Karatekin,et al.  Attention allocation in the dual-task paradigm as measured through behavioral and psychophysiological responses. , 2004, Psychophysiology.

[36]  Greg J Siegle,et al.  Use of concurrent pupil dilation assessment to inform interpretation and analysis of fMRI data , 2003, NeuroImage.

[37]  A. Damasio,et al.  Neuroanatomical correlates of brainstem coma. , 2003, Brain : a journal of neurology.

[38]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[39]  P. Cavanagh,et al.  Attention Response Functions Characterizing Brain Areas Using fMRI Activation during Parametric Variations of Attentional Load , 2001, Neuron.

[40]  C. Koch,et al.  Brain Areas Specific for Attentional Load in a Motion-Tracking Task , 2001, Journal of Cognitive Neuroscience.

[41]  C. M. Bradshaw,et al.  Comparison of the effects of clonidine and yohimbine on spontaneous pupillary fluctuations in healthy human volunteers , 2000, Psychopharmacology.

[42]  Karl J. Friston,et al.  Noradrenergically Mediated Plasticity in a Human Attentional Neuronal Network , 1999, NeuroImage.

[43]  D. Somers,et al.  Functional MRI reveals spatially specific attentional modulation in human primary visual cortex. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[44]  P. Cavanagh,et al.  Cortical fMRI activation produced by attentive tracking of moving targets. , 1998, Journal of neurophysiology.

[45]  J. Coull Neural correlates of attention and arousal: insights from electrophysiology, functional neuroimaging and psychopharmacology , 1998, Progress in Neurobiology.

[46]  D. Munoz,et al.  Comparison of the discharge characteristics of brain stem omnipause neurons and superior colliculus fixation neurons in monkey: implications for control of fixation and saccade behavior. , 1998, Journal of neurophysiology.

[47]  J Hyönä,et al.  Pupil Dilation as a Measure of Processing Load in Simultaneous Interpretation and Other Language Tasks , 1995, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[48]  S. Sara,et al.  Response to Novelty and its Rapid Habituation in Locus Coeruleus Neurons of the Freely Exploring Rat , 1995, The European journal of neuroscience.

[49]  D. Altman,et al.  Calculating correlation coefficients with repeated observations: Part 2—correlation between subjects , 1995, BMJ.

[50]  Hans Jørgen G. Gundersen,et al.  Absolute number and size of pigmented locus coeruleus neurons in young and aged individuals , 1994, Journal of Chemical Neuroanatomy.

[51]  R. Wurtz,et al.  Fixation cells in monkey superior colliculus. I. Characteristics of cell discharge. , 1993, Journal of neurophysiology.

[52]  M. Just,et al.  The intensity dimension of thought: pupillometric indices of sentence processing. , 1993, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[53]  Z. Pylyshyn The role of location indexes in spatial perception: A sketch of the FINST spatial-index model , 1989, Cognition.

[54]  J. Talairach,et al.  Co-Planar Stereotaxic Atlas of the Human Brain: 3-Dimensional Proportional System: An Approach to Cerebral Imaging , 1988 .

[55]  B. Cohen,et al.  Raphe nucleus of the pons containing omnipause neurons of the oculomotor system in the monkey, and Its homologue in man , 1988, The Journal of comparative neurology.

[56]  M. Koss Pupillary dilation as an index of central nervous system α2-adrenoceptor activation , 1986 .

[57]  J. Beatty,et al.  Pupillary dilations in movement preparation and execution. , 1985, Psychophysiology.

[58]  J. Beatty Task-evoked pupillary responses, processing load, and the structure of processing resources. , 1982, Psychological bulletin.

[59]  Robert F. Stanners,et al.  The pupillary response as an indicator of arousal and cognition , 1979 .

[60]  J. Beatty,et al.  Pupillary responses during information processing vary with Scholastic Aptitude Test scores. , 1979, Science.

[61]  J. Bradshaw Pupil Size and Problem Solving , 1968, The Quarterly journal of experimental psychology.

[62]  J. Beatty,et al.  Pupillary responses in a pitch-discrimination task , 1967 .

[63]  D. Kahneman,et al.  Pupillary changes in two memory tasks , 1966 .

[64]  E. Hess,et al.  Pupil Size in Relation to Mental Activity during Simple Problem-Solving , 1964, Science.

[65]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 2003 Neuroindices of cognitive workload : Neuroimaging , pupillometric , and event-related potential studies of brain work , 2016 .

[66]  P. De Weerd,et al.  Visual spatial attention to multiple locations at once: the jury is still out. , 2010, Psychological review.

[67]  B. Scholl What Have We Learned about Attention from Multiple-Object Tracking (and Vice Versa)? , 2009 .

[68]  T. A. Kelley,et al.  Cortical mechanisms for shifting and holding visuospatial attention. , 2008, Cerebral cortex.

[69]  David J Heeger,et al.  Neural correlates of sustained spatial attention in human early visual cortex. , 2007, Journal of neurophysiology.

[70]  S. Cottrell Intelligence and learning , 1999 .

[71]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[72]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[73]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[74]  J. Wolfe,et al.  Using Fmri to Distinguish Components of the Multiple Object Tracking Task , 1994 .

[75]  M. Segal,et al.  Plasticity of sensory responses of locus coeruleus neurons in the behaving rat: implications for cognition. , 1991, Progress in brain research.

[76]  Z W Pylyshyn,et al.  Tracking multiple independent targets: evidence for a parallel tracking mechanism. , 1988, Spatial vision.

[77]  S. Foote,et al.  Extrathalamic modulation of cortical function. , 1987, Annual review of neuroscience.

[78]  M. Koss,et al.  Pupillary dilation as an index of central nervous system alpha 2-adrenoceptor activation. , 1986, Journal of pharmacological methods.

[79]  Jackson Beatty,et al.  Physiological Evidence that Demand for Processing Capacity Varies with Intelligence , 1981 .

[80]  J. P. Das,et al.  Intelligence and learning , 1981 .

[81]  D. Kahneman Attention and Effort , 1973 .

[82]  D. Kahneman Pupillary Responses in a Pitch-Discrimination Task , 1967 .

[83]  S. Martinez-Conde,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[84]  Christof Koch,et al.  Fully Formatted Pdf and Full Text (html) Versions Will Be Made Available Soon. Pupil Dilation Betrays the Timing of Decisions , 2022 .