Changes in Neural Connectivity Underlie Decision Threshold Modulation for Reward Maximization

Using neuroimaging in combination with computational modeling, this study shows that decision threshold modulation for reward maximization is accompanied by a change in effective connectivity within corticostriatal and cerebellar–striatal brain systems. Research on perceptual decision making suggests that people make decisions by accumulating sensory evidence until a decision threshold is crossed. This threshold can be adjusted to changing circumstances, to maximize rewards. Decision making thus requires effectively managing the amount of accumulated evidence versus the amount of available time. Importantly, the neural substrate of this decision threshold modulation is unknown. Participants performed a perceptual decision-making task in blocks with identical duration but different reward schedules. Behavioral and modeling results indicate that human subjects modulated their decision threshold to maximize net reward. Neuroimaging results indicate that decision threshold modulation was achieved by adjusting effective connectivity within corticostriatal and cerebellar–striatal brain systems, the former being responsible for processing of accumulated sensory evidence and the latter being responsible for automatic, subsecond temporal processing. Participants who adjusted their threshold to a greater extent (and gained more net reward) also showed a greater modulation of effective connectivity. These results reveal a neural mechanism that underlies decision makers' abilities to adjust to changing circumstances to maximize reward.

[1]  J. Mink.  THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS , 1996, Progress in Neurobiology.

[2]  J. Dreher,et al.  Decision Threshold Modulation in the Human Brain , 2010, The Journal of Neuroscience.

[3]  R. Ratcliff,et al.  Estimating parameters of the diffusion model: Approaches to dealing with contaminant reaction times and parameter variability , 2002, Psychonomic bulletin & review.

[4]  Jonathon D. Crystal,et al.  The psychology of time , 2007, Behavioural Processes.

[5]  P. Goldman-Rakic,et al.  Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  Stephen M. Smith,et al.  General multilevel linear modeling for group analysis in FMRI , 2003, NeuroImage.

[7]  Michael X. Cohen,et al.  Connectivity-based segregation of the human striatum predicts personality characteristics , 2009, Nature Neuroscience.

[8]  Michael X. Cohen,et al.  Connectivity-based segregation of the human striatum predicts personality characteristics , 2009, Nature Neuroscience.

[9]  Francis Tuerlinckx,et al.  Diffusion model analysis with MATLAB: A DMAT primer , 2008, Behavior research methods.

[10]  Stephen M. Smith,et al.  Threshold-free cluster enhancement: Addressing problems of smoothing, threshold dependence and localisation in cluster inference , 2009, NeuroImage.

[11]  P. Strick,et al.  Anatomical evidence for cerebellar and basal ganglia involvement in higher cognitive function. , 1994, Science.

[12]  Xiao-Jing Wang,et al.  Cortico–basal ganglia circuit mechanism for a decision threshold in reaction time tasks , 2006, Nature Neuroscience.

[13]  M. Leek.  Adaptive procedures in psychophysical research , 2001, Perception & psychophysics.

[14]  R. Ivry,et al.  The neural representation of time , 2004, Current Opinion in Neurobiology.

[15]  Mingxiong Huang,et al.  Neural representation of interval encoding and decision making. , 2004, Brain research. Cognitive brain research.

[16]  P. Cisek,et al.  Decisions in Changing Conditions: The Urgency-Gating Model , 2009, The Journal of Neuroscience.

[17]  Emilio Salinas,et al.  So Many Choices: What Computational Models Reveal about Decision-Making Mechanisms , 2008, Neuron.

[18]  L. Pinneo.  On noise in the nervous system. , 1966, Psychological review.

[19]  Karl J. Friston.  Functional and Effective Connectivity: A Review , 2011, Brain Connect..

[20]  Scott D. Brown,et al.  Cortico-striatal connections predict control over speed and accuracy in perceptual decision making , 2010, Proceedings of the National Academy of Sciences.

[21]  Mark W. Woolrich,et al.  Multilevel linear modelling for FMRI group analysis using Bayesian inference , 2004, NeuroImage.

[22]  P. Fraisse.  The psychology of time , 1963 .

[23]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[24]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[25]  A. Nobre,et al.  The Cerebellum Predicts the Timing of Perceptual Events , 2008, The Journal of Neuroscience.

[26]  R. Romo,et al.  Neuronal Correlates of a Perceptual Decision in Ventral Premotor Cortex , 2004, Neuron.

[27]  Lars Chittka,et al.  Speed-accuracy tradeoffs in animal decision making. , 2009, Trends in ecology & evolution.

[28]  K. R. Ridderinkhof,et al.  Striatum and pre-SMA facilitate decision-making under time pressure , 2008, Proceedings of the National Academy of Sciences.

[29]  Gustavo Deco,et al.  Synaptic dynamics and decision making , 2010, Proceedings of the National Academy of Sciences.

[30]  F. Christian.  How the Brain Integrates Costs and Benefits During Decision Making , 2010 .

[31]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[32]  Francis Tuerlinckx,et al.  Fitting the ratcliff diffusion model to experimental data , 2007, Psychonomic bulletin & review.

[33]  Thomas V. Wiecki,et al.  Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold , 2011, Nature Neuroscience.

[34]  Leslie G. Ungerleider,et al.  The neural systems that mediate human perceptual decision making , 2008, Nature Reviews Neuroscience.

[35]  Richard B. Ivry,et al.  Neural mechanisms of timing , 1997, Trends in Cognitive Sciences.

[36]  Richard P. Heitz,et al.  Neurally constrained modeling of perceptual decision making. , 2010, Psychological review.

[37]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[38]  Colin Camerer,et al.  Transformation of stimulus value signals into motor commands during simple choice , 2011, Proceedings of the National Academy of Sciences.

[39]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[40]  R. Ratcliff,et al.  Neural Representation of Task Difficulty and Decision Making during Perceptual Categorization: A Timing Diagram , 2006, The Journal of Neuroscience.

[41]  N. Makris,et al.  MRI-Based Topographic Parcellation of Human Neocortex: An Anatomically Specified Method with Estimate of Reliability , 1996, Journal of Cognitive Neuroscience.

[42]  R. Miall,et al.  Brain activation patterns during measurement of sub- and supra-second intervals , 2003, Neuropsychologia.

[43]  Philip L. Smith,et al.  Psychology and neurobiology of simple decisions , 2004, Trends in Neurosciences.

[44]  Karl J. Friston,et al.  Time‐dependent changes in effective connectivity measured with PET , 1993 .

[45]  P. Strick,et al.  The cerebellum communicates with the basal ganglia , 2005, Nature Neuroscience.

[46]  H. Engeland,et al.  Basic Impairments in Regulating the Speed-Accuracy Tradeoff Predict Symptoms of Attention-Deficit/Hyperactivity Disorder , 2010, Biological Psychiatry.

[47]  B. Balleine,et al.  The Role of the Dorsal Striatum in Reward and Decision-Making , 2007, The Journal of Neuroscience.

[48]  F. Blankenburg,et al.  Causal Role of Dorsolateral Prefrontal Cortex in Human Perceptual Decision Making , 2011, Current Biology.

[49]  K. A. Hadland,et al.  Role of the human medial frontal cortex in task switching: a combined fMRI and TMS study. , 2002, Journal of neurophysiology.

[50]  Russell A. Poldrack,et al.  Six problems for causal inference from fMRI , 2010, NeuroImage.

[51]  Jonathan D. Cohen,et al.  The Quarterly Journal of Experimental Psychology Do Humans Produce the Speed–accuracy Trade-off That Maximizes Reward Rate? , 2022 .

[52]  J. Gold,et al.  Banburismus and the Brain Decoding the Relationship between Sensory Stimuli, Decisions, and Reward , 2002, Neuron.

[53]  Frances S. Chance,et al.  Gain Modulation from Background Synaptic Input , 2002, Neuron.

[54]  J. Grafman,et al.  The roles of the cerebellum and basal ganglia in timing and error prediction , 2002, The European journal of neuroscience.

[55]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[56]  S. Keele,et al.  Timing Functions of The Cerebellum , 1989, Journal of Cognitive Neuroscience.

[57]  M. Bauer,et al.  Neural Characterization of the Speed–Accuracy Tradeoff in a Perceptual Decision-Making Task , 2011, The Journal of Neuroscience.

[58]  Timothy D. Hanks,et al.  Elapsed Decision Time Affects the Weighting of Prior Probability in a Perceptual Decision Task , 2011, The Journal of Neuroscience.

[59]  R. Poldrack.  Region of interest analysis for fMRI. , 2007, Social cognitive and affective neuroscience.

[60]  Emilio Salinas,et al.  Gain Modulation A Major Computational Principle of the Central Nervous System , 2000, Neuron.

[61]  W. Meck,et al.  Neuroanatomical and Neurochemical Substrates of Timing , 2011, Neuropsychopharmacology.

[62]  A M Graybiel,et al.  The basal ganglia and adaptive motor control. , 1994, Science.

[63]  Karl J. Friston,et al.  Psychophysiological and Modulatory Interactions in Neuroimaging , 1997, NeuroImage.

[64]  Jörn Diedrichsen,et al.  A probabilistic MR atlas of the human cerebellum , 2009, NeuroImage.

[65]  Roger Ratcliff,et al.  The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks , 2008, Neural Computation.

[66]  D. Buonomano,et al.  The neural basis of temporal processing. , 2004, Annual review of neuroscience.

[67]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.