Differentiating between Models of Perceptual Decision Making Using Pupil Size Inferred Confidence

During perceptual decisions, subjects often rely more strongly on early, rather than late, sensory evidence, even in tasks when both are equally informative about the correct decision. This early psychophysical weighting has been explained by an integration-to-bound decision process, in which the stimulus is ignored after the accumulated evidence reaches a certain bound, or confidence level. Here, we derive predictions about how the average temporal weighting of the evidence depends on a subject's decision confidence in this model. To test these predictions empirically, we devised a method to infer decision confidence from pupil size in 2 male monkeys performing a disparity discrimination task. Our animals' data confirmed the integration-to-bound predictions, with different internal decision bounds and different levels of correlation between pupil size and decision confidence accounting for differences between animals. However, the data were less compatible with two alternative accounts for early psychophysical weighting: attractor dynamics either within the decision area or due to feedback to sensory areas, or a feedforward account due to neuronal response adaptation. This approach also opens the door to using confidence more broadly when studying the neural basis of decision making. SIGNIFICANCE STATEMENT An animal's ability to adjust decisions based on its level of confidence, sometimes referred to as “metacognition,” has generated substantial interest in neuroscience. Here, we show how measurements of pupil diameter in macaques can be used to infer their confidence. This technique opens the door to more neurophysiological studies of confidence because it eliminates the need for training on behavioral paradigms to evaluate confidence. We then use this technique to test predictions from competing explanations of why subjects in perceptual decision making often rely more strongly on early evidence: the way in which the strength of this effect should depend on a subject's decision confidence. We find that a bounded decision formation process best explains our empirical data.

[1]  Bingni W. Brunton,et al.  Rats and Humans Can Optimally Accumulate Evidence for Decision-Making , 2013, Science.

[2]  Adam Kepecs,et al.  Midbrain Dopamine Neurons Signal Belief in Choice Accuracy during a Perceptual Decision , 2017, Current Biology.

[3]  A. Koulakov,et al.  Orbitofrontal Cortex Is Required for Optimal Waiting Based on Decision Confidence , 2014, Neuron.

[4]  Markus H. Sneve,et al.  Pupil size signals mental effort deployed during multiple object tracking and predicts brain activity in the dorsal attention network and the locus coeruleus. , 2014, Journal of vision.

[5]  Timothy D. Hanks,et al.  Bounded Integration in Parietal Cortex Underlies Decisions Even When Viewing Duration Is Dictated by the Environment , 2008, The Journal of Neuroscience.

[6]  B. Cumming,et al.  Decision-Related Activity in Macaque V2 for Fine Disparity Discrimination Is Not Compatible with Optimal Linear Readout , 2017, The Journal of Neuroscience.

[7]  Masaki Tanaka,et al.  Correlation between Pupil Size and Subjective Passage of Time in Non-Human Primates , 2016, The Journal of Neuroscience.

[8]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[9]  Karen R Dobkins,et al.  The face inversion effect in infants is driven by high, and not low, spatial frequencies. , 2014, Journal of vision.

[10]  KongFatt Wong-Lin,et al.  Neural Circuit Dynamics Underlying Accumulation of Time-Varying Evidence During Perceptual Decision Making , 2007, Frontiers Comput. Neurosci..

[11]  Il Memming Park,et al.  Functional dissection of signal and noise in MT and LIP during decision-making , 2017, Nature Neuroscience.

[12]  Brian J. White,et al.  Microstimulation of the Monkey Superior Colliculus Induces Pupil Dilation Without Evoking Saccades , 2012, The Journal of Neuroscience.

[13]  Ethan S. Bromberg-Martin,et al.  Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards , 2009, Neuron.

[14]  B. Cumming,et al.  Psychophysically measured task strategy for disparity discrimination is reflected in V2 neurons , 2007, Nature Neuroscience.

[15]  Stephen M. Fleming,et al.  Relating Pupil Dilation and Metacognitive Confidence during Auditory Decision-Making , 2015, PloS one.

[16]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[17]  E. Hess,et al.  Pupil Size in Relation to Mental Activity during Simple Problem-Solving , 1964, Science.

[18]  Jan Drugowitsch,et al.  Computational Precision of Mental Inference as Critical Source of Human Choice Suboptimality , 2016, Neuron.

[19]  R. Dolan,et al.  Computations of uncertainty mediate acute stress responses in humans , 2016, Nature Communications.

[20]  William T. Adler,et al.  Limitations of proposed signatures of Bayesian confidence , 2017 .

[21]  M. Shadlen,et al.  Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex , 2009, Science.

[22]  Olympia Colizoli,et al.  Task-evoked pupil responses reflect internal belief states , 2018, Scientific Reports.

[23]  Hatim A. Zariwala,et al.  Neural correlates, computation and behavioural impact of decision confidence , 2008, Nature.

[24]  B. Cumming,et al.  Decision-related activity in sensory neurons reflects more than a neuron’s causal effect , 2009, Nature.

[25]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[26]  D. Wolpert,et al.  A common mechanism underlies changes of mind about decisions and confidence , 2015, eLife.

[27]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[28]  Wei Ji Ma,et al.  Limitations of proposed signatures of Bayesian confidence , 2017, bioRxiv.

[29]  Bruce G Cumming,et al.  Feedforward and Feedback Sources of Choice Probability in Neural Population Responses This Review Comes from a Themed Issue on Neurobiology of Cognitive Behavior Evidence for Feed-forward Models and Optimal Linear Readout? , 2022 .

[30]  C. Summerfield,et al.  Rhythmic Fluctuations in Evidence Accumulation during Decision Making in the Human Brain , 2012, Neuron.

[31]  Anne E. Urai,et al.  Task-evoked pupil responses reflect internal belief states , 2018, bioRxiv.

[32]  Colin Blakemore,et al.  Probing the human stereoscopic system with reverse correlation , 1999, Nature.

[33]  József Fiser,et al.  Perceptual Decision-Making as Probabilistic Inference by Neural Sampling , 2014, Neuron.

[34]  Ádám Kepecs,et al.  A mathematical framework for statistical decision confidence , 2015, bioRxiv.

[35]  M. Bradley,et al.  The pupil as a measure of emotional arousal and autonomic activation. , 2008, Psychophysiology.

[36]  M. Shadlen,et al.  Choice Certainty Is Informed by Both Evidence and Decision Time , 2014, Neuron.

[37]  C Daniel Salzman,et al.  Reward expectation differentially modulates attentional behavior and activity in visual area V4 , 2015, Nature Neuroscience.

[38]  R. B. Ebitz,et al.  Neuronal Activity in Primate Dorsal Anterior Cingulate Cortex Signals Task Conflict and Predicts Adjustments in Pupil-Linked Arousal , 2015, Neuron.

[39]  Anne E. Urai,et al.  Pupil-linked arousal is driven by decision uncertainty and alters serial choice bias , 2017, Nature Communications.

[40]  Jonathan D. Cohen,et al.  Adaptive gain and the role of the locus coeruleus–norepinephrine system in optimal performance , 2005, The Journal of comparative neurology.

[41]  G. DeAngelis,et al.  How Can Single Sensory Neurons Predict Behavior? , 2015, Neuron.

[42]  Robert C. Wilson,et al.  Rational regulation of learning dynamics by pupil–linked arousal systems , 2012, Nature Neuroscience.

[43]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[44]  A. Nieder,et al.  Serotonin Decreases the Gain of Visual Responses in Awake Macaque V1 , 2017, The Journal of Neuroscience.

[45]  B. Cumming,et al.  Decision-related activity in macaque V2 for fine disparity discrimination is not compatible with optimal linear read-out. , 2016, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[46]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[47]  D Kahneman,et al.  Pupil Diameter and Load on Memory , 1966, Science.

[48]  R. Hansen,et al.  Pupillary changes during dark adaptation in human infants. , 1986, Investigative ophthalmology & visual science.

[49]  T. Knapen,et al.  Decision-related pupil dilation reflects upcoming choice and individual bias , 2014, Proceedings of the National Academy of Sciences.

[50]  Matthew T. Kaufman,et al.  A category-free neural population supports evolving demands during decision-making , 2014, Nature Neuroscience.

[51]  Yutaka Komura,et al.  Responses of pulvinar neurons reflect a subject's confidence in visual categorization , 2013, Nature Neuroscience.

[52]  Bruce G Cumming,et al.  Reward modulates the effect of visual cortical microstimulation on perceptual decisions , 2015, eLife.

[53]  R. Gregory The Most Expensive Painting in the World , 2007, Perception.

[54]  Douglas P Munoz,et al.  A circuit for pupil orienting responses: implications for cognitive modulation of pupil size , 2015, Current Opinion in Neurobiology.

[55]  J. Gold,et al.  Arousal-related adjustments of perceptual biases optimize perception in dynamic environments , 2017, Nature Human Behaviour.

[56]  P. Golshani,et al.  Cellular mechanisms of brain-state-dependent gain modulation in visual cortex , 2013, Nature Neuroscience.

[57]  Peter Neri,et al.  Temporal dynamics of directional selectivity in human vision. , 2008, Journal of vision.

[58]  D. McCormick,et al.  Pupil fluctuations track rapid changes in adrenergic and cholinergic activity in cortex , 2016, Nature Communications.

[59]  Albert Compte,et al.  Sensory integration dynamics in a hierarchical network explains choice probabilities in cortical area MT , 2015, Nature Communications.

[60]  Ravi V. Chacko,et al.  Using pupil size and heart rate to infer affective states during behavioral neurophysiology and neuropsychology experiments , 2017, Journal of Neuroscience Methods.

[61]  Theodore D. Satterthwaite,et al.  Dissociable but inter-related systems of cognitive control and reward during decision making: Evidence from pupillometry and event-related fMRI , 2007, NeuroImage.

[62]  Ariel Zylberberg,et al.  The construction of confidence in a perceptual decision , 2012, Front. Integr. Neurosci..

[63]  S. Bouret,et al.  Noradrenaline and Dopamine Neurons in the Reward/Effort Trade-Off: A Direct Electrophysiological Comparison in Behaving Monkeys , 2015, The Journal of Neuroscience.

[64]  E. Murray,et al.  A role for primate subgenual cingulate cortex in sustaining autonomic arousal , 2014, Proceedings of the National Academy of Sciences.

[65]  J. Gold,et al.  Relationships between Pupil Diameter and Neuronal Activity in the Locus Coeruleus, Colliculi, and Cingulate Cortex , 2016, Neuron.