Tracking the allocation of attention using human pupillary oscillations

The muscles that control the pupil are richly innervated by the autonomic nervous system. While there are central pathways that drive pupil dilations in relation to arousal, there is no anatomical evidence that cortical centers involved with visual selective attention innervate the pupil. In this study, we show that such connections must exist. Specifically, we demonstrate a novel Pupil Frequency Tagging (PFT) method, where oscillatory changes in stimulus brightness over time are mirrored by pupil constrictions and dilations. We find that the luminance–induced pupil oscillations are enhanced when covert attention is directed to the flicker stimulus and when targets are correctly detected in an attentional tracking task. These results suggest that the amplitudes of pupil responses closely follow the allocation of focal visual attention and the encoding of stimuli. PFT provides a new opportunity to study top–down visual attention itself as well as identifying the pathways and mechanisms that support this unexpected phenomenon.

[1]  C. Eriksen,et al.  Effects of noise letters upon the identification of a target letter in a nonsearch task , 1974 .

[2]  D. Regan.  Human brain electrophysiology: Evoked potentials and evoked magnetic fields in science and medicine , 1989 .

[3]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.

[4]  E. Averbach,et al.  Short-term memory in vision , 1961 .

[5]  D. Heeger,et al.  The Normalization Model of Attention , 2009, Neuron.

[6]  J. Shaoul.  Human Error , 1973, Nature.

[7]  David J Heeger,et al.  Neural correlates of sustained spatial attention in human early visual cortex. , 2007, Journal of neurophysiology.

[8]  Paola Binda,et al.  Attention to Bright Surfaces Enhances the Pupillary Light Reflex , 2013, The Journal of Neuroscience.

[9]  E Alexandridis,et al.  [Frequency of the pupillary response following flicker stimuli (author's transl)]. , 1977, Albrecht von Graefes Archiv fur klinische und experimentelle Ophthalmologie. Albrecht von Graefe's archive for clinical and experimental ophthalmology.

[10]  B. Scholl.  Objects and attention: the state of the art , 2001, Cognition.

[11]  D. Spalding.  The Principles of Psychology , 1873, Nature.

[12]  J. Beatty,et al.  The pupillary system. , 2000 .

[13]  S. Treue.  Neural correlates of attention in primate visual cortex , 2001, Trends in Neurosciences.

[14]  B. C. Lacey,et al.  Pupillary and cardiac activity during visual attention. , 1973, Psychophysiology.

[15]  D. Somers,et al.  Functional MRI reveals spatially specific attentional modulation in human primary visual cortex. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[16]  M. Glickstein.  Subcortical projections of the parietal lobes. , 2003, Advances in neurology.

[17]  E. Vogel,et al.  Sensory gain control (amplification) as a mechanism of selective attention: electrophysiological and neuroimaging evidence. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[18]  D. Broadbent.  Perception and communication , 1958 .

[19]  Pieter R. Roelfsema,et al.  Object-based attention in the primary visual cortex of the macaque monkey , 1998, Nature.

[20]  T. Yin,et al.  Subcortical projections of the inferior parietal cortex (area 7) in the stump‐tailed monkey , 1984, The Journal of comparative neurology.

[21]  Stefan M. Wierda,et al.  Pupil dilation deconvolution reveals the dynamics of attention at high temporal resolution , 2012, Proceedings of the National Academy of Sciences.

[22]  S. A. Hillyard,et al.  Sustained division of the attentional spotlight , 2003, Nature.

[23]  J. Pratt,et al.  The Spatial Distribution of Inhibition of Return , 2001, Psychological science.

[24]  Søren K. Andersen,et al.  Sustained Multifocal Attentional Enhancement of Stimulus Processing in Early Visual Areas Predicts Tracking Performance , 2013, The Journal of Neuroscience.

[25]  J L Barbur,et al.  Visual processing levels revealed by response latencies to changes in different visual attributes , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[26]  John K. Tsotsos.  Analyzing vision at the complexity level , 1990, Behavioral and Brain Sciences.

[27]  Daniel J. Simons,et al.  Inattentional blindness , 2007, Scholarpedia.

[28]  K. Nakayama,et al.  Sustained and transient components of focal visual attention , 1989, Vision Research.

[29]  David F. Nichols,et al.  Changes in pupil diameter entrained by cortically initiated changes in attention , 2012, Visual Neuroscience.

[30]  K. Hoffmann,et al.  The pupillary light reflex in normal and innate microstrabismic cats, II: Retinal and cortical input to the nucleus praetectalis olivaris , 1989, Visual Neuroscience.

[31]  Canan Karatekin,et al.  Attention allocation in the dual-task paradigm as measured through behavioral and psychophysiological responses. , 2004, Psychophysiology.

[32]  George A. Alvarez,et al.  Natural-Scene Perception Requires Attention , 2011, Psychological science.

[33]  J L Barbur,et al.  Pupillary responses to stimulus structure, colour and movement , 1992, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[34]  D. Kahneman,et al.  Attention and Effort , 1973 .

[35]  E. Hess,et al.  Pupillometry: The Psychology of the Pupillary Response , 1978 .

[36]  A. Treisman.  Strategies and models of selective attention. , 1969, Psychological review.

[37]  D. Pelli,et al.  The information capacity of visual attention , 1992, Vision Research.

[38]  Christof Koch,et al.  Pupil responses allow communication in locked-in syndrome patients , 2013, Current Biology.

[39]  John H. R. Maunsell,et al.  Effects of spatial attention on contrast response functions in macaque area V4. , 2006, Journal of neurophysiology.

[40]  C. Eriksen,et al.  Some characteristics of selective attention in visual perception determined by vocal reaction time , 1972 .

[41]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[42]  G. Siegle,et al.  Pupillary Motility: Bringing Neuroscience to the Psychiatry Clinic of the Future , 2013, Current Neurology and Neuroscience Reports.

[43]  L O Harvey,et al.  Identification confusions among letters of the alphabet. , 1984, Journal of experimental psychology. Human perception and performance.

[44]  P. Cavanagh,et al.  Attentional resolution and the locus of visual awareness , 1996, Nature.

[45]  J. Duncan.  Selective attention and the organization of visual information. , 1984, Journal of experimental psychology. General.

[46]  Robin W. Prati.  Cognitive processing of uncertainty: Its effect on pupillary dilation and preference ratings , 1970 .

[47]  Paul D. Gamlin,et al.  The edinger‐westphal nucleus: Sources of input influencing accommodation, pupilloconstriction, and choroidal blood flow , 1991, The Journal of comparative neurology.

[48]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[49]  J. Cacioppo,et al.  Handbook Of Psychophysiology , 2019 .

[50]  J. Fleiss,et al.  Effect of stimulus uncertainty on the pupillary dilation response and the vertex evoked potential. , 1973, Electroencephalography and clinical neurophysiology.

[51]  S. Hillyard,et al.  Selective attention to stimulus location modulates the steady-state visual evoked potential. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[52]  Richard B Buxton,et al.  Putting spatial attention on the map: timing and localization of stimulus selection processes in striate and extrastriate visual areas , 2001, Vision Research.

[53]  Ken Nakayama,et al.  Pupil responses to high-level image content. , 2013, Journal of vision.

[54]  W. Einhäuser,et al.  Animal detection and identification in natural scenes: image statistics and emotional valence. , 2012, Journal of vision.

[55]  Walter Schneider,et al.  Controlled and Automatic Human Information Processing: 1. Detection, Search, and Attention. , 1977 .

[56]  M Clynes,et al.  COLOR DYNAMICS OF THE PUPIL , 1969, Annals of the New York Academy of Sciences.

[57]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.

[58]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[59]  S. Sutton,et al.  Pupillary Response at Visual Threshold , 1966, Nature.

[60]  M Corbetta,et al.  Attentional modulation of neural processing of shape, color, and velocity in humans. , 1990, Science.

[61]  S. Treue,et al.  Attentional Modulation Strength in Cortical Area MT Depends on Stimulus Contrast , 2002, Neuron.

[62]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[63]  H. Bouma.  Visual recognition of isolated lower-case letters. , 1971, Vision research.

[64]  F. Previc.  Functional specialization in the lower and upper visual fields in humans: Its ecological origins and neurophysiological implications , 1990, Behavioral and Brain Sciences.

[65]  D Kahneman,et al.  Pupil Diameter and Load on Memory , 1966, Science.

[66]  Steven B. Most,et al.  What you see is what you set: sustained inattentional blindness and the capture of awareness. , 2005, Psychological review.

[67]  Ueli Rutishauser,et al.  Pupil size signals novelty and predicts later retrieval success for declarative memories of natural scenes. , 2013, Journal of vision.

[68]  D L Sheinberg,et al.  PSYCHOLOGICAL SCIENCE Research Article ATTENTIONAL ENHANCEMENT OPPOSITE A PERIPHERAL FLASH REVEALED USING CHANGE BLINDNESS , 2022 .

[69]  Thomas A Carlson,et al.  Perceptual benefits of objecthood. , 2011, Journal of vision.

[70]  Christof Koch,et al.  Fully Formatted Pdf and Full Text (html) Versions Will Be Made Available Soon. Pupil Dilation Betrays the Timing of Decisions , 2022 .

[71]  J M Loomis,et al.  Analysis of tactile and visual confusion matrices , 1982, Perception & psychophysics.

[72]  Karen Holopigian,et al.  Multidimensional visual field maps: relationships among local psychophysical and local electrophysiological measures. , 2004, Journal of rehabilitation research and development.

[73]  Z W Pylyshyn,et al.  Tracking multiple independent targets: evidence for a parallel tracking mechanism. , 1988, Spatial vision.

[74]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[75]  B. C. Motter.  Focal attention produces spatially selective processing in visual cortical areas V1, V2, and V4 in the presence of competing stimuli. , 1993, Journal of neurophysiology.

[76]  J. Diamond,et al.  Sclerotomy complications following pars plana vitrectomy , 2000, The British journal of ophthalmology.