Cross-task contributions of fronto-basal ganglia circuitry in response inhibition and conflict-induced slowing

Why are we so slow in choosing the lesser of two evils? We considered whether such slowing relates to uncertainty about the value of these options, which arises from the tendency to avoid them during learning, and whether such slowing relates to fronto-subthalamic inhibitory control mechanisms. 49 participants performed a reinforcement-learning task and a stop-signal task while fMRI was recorded. A reinforcement-learning model was used to quantify learning strategies. Individual differences in lose-lose slowing related to information uncertainty due to sampling, and independently, to less efficient response inhibition in the stop-signal task. Neuroimaging analysis revealed an analogous dissociation: subthalamic nucleus (STN) BOLD activity related to variability in stopping latencies, whereas weaker fronto-subthalamic connectivity related to slowing and information sampling. Across tasks, fast inhibitors increased STN activity for successfully cancelled responses in the stop task, but decreased activity for lose-lose choices. These data support the notion that fronto-STN communication implements a rapid but transient brake on response execution, and that slowing due to decision uncertainty could result from an inefficient release of this “hold your horses” mechanism.

[1]  A. Aron,et al.  Causal role for the subthalamic nucleus in interrupting behavior , 2017, eLife.

[2]  B. Forstmann,et al.  Comparing functional MRI protocols for small, iron‐rich basal ganglia nuclei such as the subthalamic nucleus at 7 T and 3 T , 2017, Human brain mapping.

[3]  J. Rothwell,et al.  Inhibitory dysfunction contributes to some of the motor and non-motor symptoms of movement disorders and psychiatric disorders , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[4]  R. Schmidt,et al.  A Pause-then-Cancel model of stopping: evidence from basal ganglia neurophysiology , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[5]  John-Stuart Brittain,et al.  Distinct mechanisms mediate speed-accuracy adjustments in cortico-subthalamic networks , 2017, eLife.

[6]  Jan Theeuwes,et al.  Sensitivity to value-driven attention is predicted by how we learn from value , 2017, Psychonomic bulletin & review.

[7]  Jan R. Wessel,et al.  Stop‐related subthalamic beta activity indexes global motor suppression in Parkinson's disease , 2016, Movement disorders : official journal of the Movement Disorder Society.

[8]  B. Forstmann,et al.  Frontosubthalamic Circuits for Control of Action and Cognition , 2016, The Journal of Neuroscience.

[9]  P. Krack,et al.  Response inhibition rapidly increases single-neuron responses in the subthalamic nucleus of patients with Parkinson's disease , 2016, Cortex.

[10]  Rafal Bogacz,et al.  Neural Correlates of Decision Thresholds in the Human Subthalamic Nucleus , 2016, Current Biology.

[11]  Daniel K. Leventhal,et al.  Arkypallidal Cells Send a Stop Signal to Striatum , 2016, Neuron.

[12]  Gilles de Hollander Combining Computational Models of Cognition and Neural Data to Learn about Mixed Task Strategies , 2016 .

[13]  J. Rothwell,et al.  A fronto–striato–subthalamic–pallidal network for goal-directed and habitual inhibition , 2015, Nature Reviews Neuroscience.

[14]  Ludovica Labruna,et al.  Nonspecific Inhibition of the Motor System during Response Preparation , 2015, The Journal of Neuroscience.

[15]  Lourens J. Waldorp,et al.  Visual Information Shapes the Dynamics of Corticobasal Ganglia Pathways during Response Selection and Inhibition , 2015, Journal of Cognitive Neuroscience.

[16]  Peter Brown,et al.  The subthalamic nucleus, oscillations, and conflict , 2015, Movement disorders : official journal of the Movement Disorder Society.

[17]  Thomas V. Wiecki,et al.  fMRI and EEG Predictors of Dynamic Decision Parameters during Human Reinforcement Learning , 2015, The Journal of Neuroscience.

[18]  M. Frank,et al.  Conflict acts as an implicit cost in reinforcement learning , 2014, Nature Communications.

[19]  M. Bhattacharjee,et al.  Inhibitory control and error monitoring by human subthalamic neurons , 2014, Translational Psychiatry.

[20]  Russell A. Poldrack,et al.  Decomposing Decision Components in the Stop-signal Task: A Model-based Approach to Individual Differences in Inhibitory Control , 2014, Journal of Cognitive Neuroscience.

[21]  Mark A. Straccia,et al.  Anterior Cingulate Engagement in a Foraging Context Reflects Choice Difficulty, Not Foraging Value , 2014, Nature Neuroscience.

[22]  Max C. Keuken,et al.  Quantifying inter-individual anatomical variability in the subcortex using 7T structural MRI , 2014, NeuroImage.

[23]  Peter Brown,et al.  Midline Frontal Cortex Low-Frequency Activity Drives Subthalamic Nucleus Oscillations during Conflict , 2014, The Journal of Neuroscience.

[24]  M. Jahanshahi,et al.  The subthalamic nucleus and inhibitory control: impact of subthalamotomy in Parkinson's disease. , 2014, Brain : a journal of neurology.

[25]  Thomas V. Wiecki,et al.  Eye tracking and pupillometry are indicators of dissociable latent decision processes. , 2014, Journal of experimental psychology. General.

[26]  Andrew Gelman,et al.  The No-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo , 2011, J. Mach. Learn. Res..

[27]  Helen Steingroever,et al.  Validating the PVL-Delta model for the Iowa gambling task , 2013, Front. Psychol..

[28]  Andrea A. Kühn,et al.  Reduction of Influence of Task Difficulty on Perceptual Decision Making by STN Deep Brain Stimulation , 2013, Current Biology.

[29]  James F. Cavanagh,et al.  Stop! Stay tuned for more information , 2013, Experimental Neurology.

[30]  Daniel K. Leventhal,et al.  Canceling actions involves a race between basal ganglia pathways , 2013, Nature Neuroscience.

[31]  Thomas V. Wiecki,et al.  HDDM: Hierarchical Bayesian estimation of the Drift-Diffusion Model in Python , 2013, Front. Neuroinform..

[32]  E. Salinas,et al.  The Countermanding Task Revisited: Fast Stimulus Detection Is a Key Determinant of Psychophysical Performance , 2013, The Journal of Neuroscience.

[33]  Angela R. Laird,et al.  Is There “One” DLPFC in Cognitive Action Control? Evidence for Heterogeneity From Co-Activation-Based Parcellation , 2012, Cerebral cortex.

[34]  Thomas V. Wiecki,et al.  A computational model of inhibitory control in frontal cortex and basal ganglia. , 2011, Psychological review.

[35]  K. R. Ridderinkhof,et al.  How Preparation Changes the Need for Top–Down Control of the Basal Ganglia When Inhibiting Premature Actions , 2012, The Journal of Neuroscience.

[36]  Roger Ratcliff,et al.  Reinforcement-Based Decision Making in Corticostriatal Circuits: Mutual Constraints by Neurocomputational and Diffusion Models , 2012, Neural Computation.

[37]  M. Kahana,et al.  Neuronal Activity in the Human Subthalamic Nucleus Encodes Decision Conflict during Action Selection , 2012, The Journal of Neuroscience.

[38]  P. Dayan,et al.  Neural Prediction Errors Reveal a Risk-Sensitive Reinforcement-Learning Process in the Human Brain , 2012, The Journal of Neuroscience.

[39]  Woojae Kim,et al.  A Model-Based fMRI Analysis with Hierarchical Bayesian Parameter Estimation. , 2013, Journal of neuroscience, psychology, and economics.

[40]  Thomas V. Wiecki,et al.  Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold , 2011, Nature Neuroscience.

[41]  T. Robbins,et al.  Decision Making, Affect, and Learning: Attention and Performance XXIII , 2011 .

[42]  K. R. Ridderinkhof,et al.  Behavioral/systems/cognitive Effective Connectivity Reveals Important Roles for Both the Hyperdirect (fronto-subthalamic) and the Indirect (fronto-striatal-pallidal) Fronto-basal Ganglia Pathways during Response Inhibition , 2022 .

[43]  Nathaniel D. Daw,et al.  Trial-by-trial data analysis using computational models , 2011 .

[44]  Nicole C. Swann,et al.  Deep Brain Stimulation of the Subthalamic Nucleus Alters the Cortical Profile of Response Inhibition in the Beta Frequency Band: A Scalp EEG Study in Parkinson's Disease , 2011, The Journal of Neuroscience.

[45]  Lourens J. Waldorp,et al.  Effective connectivity of fMRI data using ancestral graph theory: Dealing with missing regions , 2011, NeuroImage.

[46]  M. Ullsperger,et al.  Dopamine-Mediated Reinforcement Learning Signals in the Striatum and Ventromedial Prefrontal Cortex Underlie Value-Based Choices , 2011, The Journal of Neuroscience.

[47]  M. Lee How cognitive modeling can benefit from hierarchical Bayesian models. , 2011 .

[48]  Michael X. Cohen,et al.  It's about Time , 2010, Front. Hum. Neurosci.

[49]  E. Wagenmakers,et al.  Bayesian parameter estimation in the Expectancy Valence model of the Iowa gambling task , 2010 .

[50]  Skipper Seabold,et al.  Statsmodels: Econometric and Statistical Modeling with Python , 2010, SciPy.

[51]  Michael X. Cohen,et al.  Dorsal Striatal–midbrain Connectivity in Humans Predicts How Reinforcements Are Used to Guide Decisions , 2009, Journal of Cognitive Neuroscience.

[52]  G. Logan,et al.  Models of response inhibition in the stop-signal and stop-change paradigms , 2009, Neuroscience & Biobehavioral Reviews.

[53]  A. Nambu [Functions of direct, indirect and hyperdirect pathways]. , 2009, Brain and nerve = Shinkei kenkyu no shinpo.

[54]  Jiji Zhang,et al.  On the completeness of orientation rules for causal discovery in the presence of latent confounders and selection bias , 2008, Artif. Intell..

[55]  G. Logan,et al.  Response inhibition in the stop-signal paradigm , 2008, Trends in Cognitive Sciences.

[56]  Rajita Sinha,et al.  Subcortical processes of motor response inhibition during a stop signal task , 2008, NeuroImage.

[57]  O. Hikosaka,et al.  Role for Subthalamic Nucleus Neurons in Switching from Automatic to Controlled Eye Movement , 2008, The Journal of Neuroscience.

[58]  Michael J. Frank,et al.  Hold Your Horses: Impulsivity, Deep Brain Stimulation, and Medication in Parkinsonism , 2007, Science.

[59]  Michael J. Frank,et al.  Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning , 2007, Proceedings of the National Academy of Sciences.

[60]  Angela J. Yu,et al.  Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[61]  Timothy Edward John Behrens,et al.  Triangulating a Cognitive Control Network Using Diffusion-Weighted Magnetic Resonance Imaging (MRI) and Functional MRI , 2007, The Journal of Neuroscience.

[62]  R. Bogacz Optimal decision-making theories: linking neurobiology with behaviour , 2007, Trends in Cognitive Sciences.

[63]  O. Hikosaka,et al.  Switching from automatic to controlled action by monkey medial frontal cortex , 2007, Nature Neuroscience.

[64]  Philip Holmes,et al.  Rapid decision threshold modulation by reward rate in a neural network , 2006, Neural Networks.

[65]  Michael J. Frank,et al.  Hold your horses: A dynamic computational role for the subthalamic nucleus in decision making , 2006, Neural Networks.

[66]  Geert J. M. van Boxtel,et al.  Stimulation of the Subthalamic Region Facilitates the Selection and Inhibition of Motor Responses in Parkinson's Disease , 2006, Journal of Cognitive Neuroscience.

[67]  R. Poldrack,et al.  Cortical and Subcortical Contributions to Stop Signal Response Inhibition: Role of the Subthalamic Nucleus , 2006, The Journal of Neuroscience.

[68]  Michael J. Frank,et al.  Error-Related Negativity Predicts Reinforcement Learning and Conflict Biases , 2005, Neuron.

[69]  Michael J. Frank,et al.  By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism , 2004, Science.

[70]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[71]  A. Nambu,et al.  Functional significance of the cortico–subthalamo–pallidal ‘hyperdirect’ pathway , 2002, Neuroscience Research.

[72]  Stephen M. Smith,et al.  Temporal Autocorrelation in Univariate Linear Modeling of FMRI Data , 2001, NeuroImage.

[73]  Ke-Hai Yuan,et al.  Mean and Covariance Structure Analysis: Theoretical and Practical Improvements , 1997 .

[74]  J. Mink THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS , 1996, Progress in Neurobiology.

[75]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[76]  G. Logan On the ability to inhibit thought and action , 1984 .

[77]  J. Gittins Bandit processes and dynamic allocation indices , 1979 .