The Subjective Value of Cognitive Effort is Encoded by a Domain-General Valuation Network

Cognitive control is necessary for goal-directed behavior, yet people treat cognitive control demand as a cost, which discounts the value of rewards in a similar manner as other costs, such as delay or risk. It is unclear, however, whether the subjective value (SV) of cognitive effort is encoded in the same putatively domain-general brain valuation network implicated in other cost domains, or instead engages a distinct frontoparietal network, as implied by recent studies. Here, we provide rigorous evidence that the valuation network, with core foci in the ventromedial prefrontal cortex and ventral striatum, also encodes SV during cognitive effort-based decision-making in healthy, male and female adult humans. We doubly dissociate this network from frontoparietal regions that are instead recruited as a function of decision difficulty. We show that the domain-general valuation network jointly and independently encodes both reward benefits and cognitive effort costs. We also demonstrate that cognitive effort SV signals predict choice and are influenced by state and trait motivation, including sensitivity to reward and anticipated task performance. These findings unify cognitive effort with other cost domains, and suggest candidate neural mechanisms underlying state and trait variation in willingness to expend cognitive effort. SIGNIFICANCE STATEMENT Subjective effort costs are increasingly understood to diminish cognitive control over task performance and can thus undermine functioning across health and disease. Yet, we are only beginning to understand how decisions about cognitive effort are made. A key question is how subjective values are computed. Recent work suggests that the value of cognitive effort might be computed by networks that are distinct from those involved in other domains like intertemporal and risky decision-making, implying distinct mechanisms. Here we demonstrate that the domain-general network also encodes effort-discounted value, linking cognitive effort closely with other domains. Our results thus elucidate key mechanisms supporting decisions about cognitive effort, and point to candidate neural targets for intervention in disorders involving impaired cognitive motivation.

[1]  Evan F. Risko,et al.  Anticipating cognitive effort: roles of perceived error-likelihood and time demands , 2019, Psychological research.

[2]  Russell A. Poldrack,et al.  Neural correlates of effort-based valuation with prospective choices , 2018, NeuroImage.

[3]  T. Braver,et al.  Intertemporal Decision-Making Involves Prefrontal Control Mechanisms Associated with Working Memory , 2018, Cerebral cortex.

[4]  K. Sakai,et al.  Neural Mechanisms for Adaptive Learned Avoidance of Mental Effort , 2018, The Journal of Neuroscience.

[5]  Jonathan D. Cohen,et al.  Constraints associated with cognitive control and the stability-flexibility dilemma , 2018, CogSci.

[6]  Mathias Pessiglione,et al.  Primate ventromedial prefrontal cortex neurons continuously encode the willingness to engage in reward directed behavior , 2016, bioRxiv.

[7]  V. Chib,et al.  Roles of Ventromedial Prefrontal Cortex and Anterior Cingulate in Subjective Valuation of Prospective Effort. , 2018, Cerebral cortex.

[8]  Jonathan D. Cohen,et al.  Toward a Rational and Mechanistic Account of Mental Effort. , 2017, Annual review of neuroscience.

[9]  M. Pessiglione,et al.  A Selective Role for Dopamine in Learning to Maximize Reward But Not to Minimize Effort: Evidence from Patients with Parkinson's Disease , 2017, The Journal of Neuroscience.

[10]  Elizabeth Tricomi,et al.  Modulation of ventral striatal activity by cognitive effort , 2017, NeuroImage.

[11]  M. Husain,et al.  Neurocomputational mechanisms underlying subjective valuation of effort costs , 2017, PLoS biology.

[12]  M. Smith,et al.  The Core System , 2017 .

[13]  Karl J. Friston,et al.  Neural Signatures of Value Comparison in Human Cingulate Cortex during Decisions Requiring an Effort-Reward Trade-off , 2016, The Journal of Neuroscience.

[14]  A. Harris,et al.  Temporal Dynamics of Sensorimotor Networks in Effort-Based Cost–Benefit Valuation: Early Emergence and Late Net Value Integration , 2016, The Journal of Neuroscience.

[15]  D. Barch,et al.  Negative symptoms are associated with an increased subjective cost of cognitive effort. , 2016, Journal of abnormal psychology.

[16]  M. Frank,et al.  Effort Cost Computation in Schizophrenia: A Commentary on the Recent Literature , 2015, Biological Psychiatry.

[17]  N. Daw,et al.  Deciding How To Decide: Self-Control and Meta-Decision Making , 2015, Trends in Cognitive Sciences.

[18]  Michael W. L. Chee,et al.  Separate and overlapping brain areas encode subjective value during delay and effort discounting , 2015, NeuroImage.

[19]  Michiel A. J. Kompier,et al.  The window of my eyes: Task disengagement and mental fatigue covary with pupil dynamics , 2015, Biological Psychology.

[20]  M. Husain,et al.  Reward Pays the Cost of Noise Reduction in Motor and Cognitive Control , 2015, Current Biology.

[21]  M. Botvinick,et al.  Cognitive effort avoidance and detection in people with schizophrenia , 2014, Cognitive, Affective, & Behavioral Neuroscience.

[22]  T. Braver,et al.  Cognitive effort: A neuroeconomic approach , 2015, Cognitive, affective & behavioral neuroscience.

[23]  M. Botvinick,et al.  A Computational Model of Control Allocation based on the Expected Value of Control , 2015 .

[24]  E. Murray,et al.  The Orbitofrontal Oracle: Cortical Mechanisms for the Prediction and Evaluation of Specific Behavioral Outcomes , 2014, Neuron.

[25]  T. Hare,et al.  Behavioral / Cognitive Interactions between Dorsolateral and Ventromedial Prefrontal Cortex Underlie Context-Dependent Stimulus Valuation in Goal-Directed Choice , 2017 .

[26]  M. Pessiglione,et al.  Learning To Minimize Efforts versus Maximizing Rewards: Computational Principles and Neural Correlates , 2014, The Journal of Neuroscience.

[27]  Mark A. Straccia,et al.  Anterior Cingulate Engagement in a Foraging Context Reflects Choice Difficulty, Not Foraging Value , 2014, Nature Neuroscience.

[28]  Jonathan D. Power,et al.  Statistical improvements in functional magnetic resonance imaging analyses produced by censoring high‐motion data points , 2014, Human brain mapping.

[29]  A. Rangel,et al.  Activity in dlPFC and its effective connectivity to vmPFC are associated with temporal discounting , 2014, Front. Neurosci..

[30]  W. Fias,et al.  Overlapping Neural Systems Represent Cognitive Effort and Reward Anticipation , 2014, PloS one.

[31]  Tobias Otto,et al.  Neural correlates of mental effort evaluation--involvement of structures related to self-awareness. , 2014, Social cognitive and affective neuroscience.

[32]  C. Winstanley,et al.  Dissociable Contributions of Anterior Cingulate Cortex and Basolateral Amygdala on a Rodent Cost/Benefit Decision-Making Task of Cognitive Effort , 2014, Neuropsychopharmacology.

[33]  K. R. Ridderinkhof,et al.  The Role of the Striatum in Effort-Based Decision-Making in the Absence of Reward , 2014, The Journal of Neuroscience.

[34]  Wim Notebaert,et al.  Context-specific control and context selection in conflict tasks. , 2014, Acta psychologica.

[35]  M. Botvinick,et al.  A labor/leisure tradeoff in cognitive control. , 2014, Journal of experimental psychology. General.

[36]  A. Scheres,et al.  Ventral–striatal responsiveness during reward anticipation in ADHD and its relation to trait impulsivity in the healthy population: A meta-analytic review of the fMRI literature , 2014, Neuroscience & Biobehavioral Reviews.

[37]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[38]  Angela L. Duckworth,et al.  An opportunity cost model of subjective effort and task performance. , 2013, The Behavioral and brain sciences.

[39]  P. Tobler,et al.  Parabolic discounting of monetary rewards by physical effort , 2013, Behavioural Processes.

[40]  Margot J. Taylor,et al.  Lateralization of affective processing in the insula , 2013, NeuroImage.

[41]  Masud Husain,et al.  Impulsivity and apathy in Parkinson's disease. , 2013, Journal of neuropsychology.

[42]  Joseph W. Kable,et al.  The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value , 2013, NeuroImage.

[43]  Jonathan D. Cohen,et al.  The Expected Value of Control: An Integrative Theory of Anterior Cingulate Cortex Function , 2013, Neuron.

[44]  T. Braver,et al.  What Is the Subjective Cost of Cognitive Effort? Load, Trait, and Aging Effects Revealed by Economic Preference , 2013, PloS one.

[45]  C. Libedinsky,et al.  Sleep deprivation alters effort discounting but not delay discounting of monetary rewards. , 2013, Sleep.

[46]  P. Dayan,et al.  Effort and Valuation in the Brain: The Effects of Anticipation and Execution , 2013, The Journal of Neuroscience.

[47]  Matthew L. Dixon,et al.  The Decision to Engage Cognitive Control Is Driven by Expected Reward-Value: Neural and Behavioral Evidence , 2012, PloS one.

[48]  Dino J. Levy,et al.  The root of all value: a neural common currency for choice , 2012, Current Opinion in Neurobiology.

[49]  Mark A. Elliott,et al.  Being right is its own reward: Load and performance related ventral striatum activation to correct responses during a working memory task in youth , 2012, NeuroImage.

[50]  Clay B. Holroyd,et al.  Motivation of extended behaviors by anterior cingulate cortex , 2012, Trends in Cognitive Sciences.

[51]  J. Daunizeau,et al.  Neural Mechanisms Underlying Motivation of Mental Versus Physical Effort , 2012, PLoS biology.

[52]  M. Woolrich,et al.  Mechanisms underlying cortical activity during value-guided choice , 2011, Nature Neuroscience.

[53]  Daeyeol Lee,et al.  Ubiquity and Specificity of Reinforcement Signals throughout the Human Brain , 2011, Neuron.

[54]  Timothy E. J. Behrens,et al.  Double dissociation of value computations in orbitofrontal and anterior cingulate neurons , 2011, Nature Neuroscience.

[55]  J. Malmaud,et al.  Focusing Attention on the Health Aspects of Foods Changes Value Signals in vmPFC and Improves Dietary Choice , 2011, The Journal of Neuroscience.

[56]  C. Padoa-Schioppa Neurobiology of economic choice: a good-based model. , 2011, Annual review of neuroscience.

[57]  D. Louis Collins,et al.  Unbiased average age-appropriate atlases for pediatric studies , 2011, NeuroImage.

[58]  Rita Z. Goldstein,et al.  Motivation Deficit in ADHD is Associated with Dysfunction of the Dopamine Reward Pathway , 2010, Molecular Psychiatry.

[59]  Ulrike Basten,et al.  How the brain integrates costs and bene fi ts during decision making , 2010 .

[60]  Joseph T. McGuire,et al.  Decision making and the avoidance of cognitive demand. , 2010, Journal of experimental psychology. General.

[61]  Mathias Pessiglione,et al.  Separate Valuation Subsystems for Delay and Effort Decision Costs , 2010, The Journal of Neuroscience.

[62]  B. Richmond,et al.  Ventromedial and Orbital Prefrontal Neurons Differentially Encode Internally and Externally Driven Motivational Values in Monkeys , 2010, The Journal of Neuroscience.

[63]  N. Chater,et al.  Choosing to Make an Effort: The Role of Striatum in Signaling Physical Effort of a Chosen Action , 2010, Journal of neurophysiology.

[64]  Brian Knutson,et al.  Ventral Striatal Activation During Reward Anticipation Correlates with Impulsivity in Alcoholics , 2009, Biological Psychiatry.

[65]  Ventral striatal activation during reward anticipation correlates with impulsivity in alcoholics , 2009, NeuroImage.

[66]  E. Koechlin,et al.  Motivation and cognitive control in the human prefrontal cortex , 2009, Nature Neuroscience.

[67]  A. Hariri The neurobiology of individual differences in complex behavioral traits. , 2009, Annual review of neuroscience.

[68]  Jonathan D. Wallis,et al.  Neurons in the Frontal Lobe Encode the Value of Multiple Decision Variables , 2009, Journal of Cognitive Neuroscience.

[69]  Colin Camerer,et al.  Self-control in decision-making involves modulation of the vmPFC valuation system , 2009, NeuroImage.

[70]  Timothy Edward John Behrens,et al.  Effort-Based Cost–Benefit Valuation and the Human Brain , 2009, The Journal of Neuroscience.

[71]  Joseph T. McGuire,et al.  Effort discounting in human nucleus accumbens , 2009, Cognitive, affective & behavioral neuroscience.

[72]  T. Braver,et al.  BOLD Correlates of Trial-by-Trial Reaction Time Variability in Gray and White Matter: A Multi-Study fMRI Analysis , 2009, PloS one.

[73]  Steven P. Wise,et al.  Forward frontal fields: phylogeny and fundamental function , 2008, Trends in Neurosciences.

[74]  Colin Camerer,et al.  A framework for studying the neurobiology of value-based decision making , 2008, Nature Reviews Neuroscience.

[75]  Jonathan D. Cohen,et al.  Functional Imaging of Decision Conflict , 2008, The Journal of Neuroscience.

[76]  M. Botvinick Conflict monitoring and decision making: Reconciling two perspectives on anterior cingulate function , 2007, Cognitive, affective & behavioral neuroscience.

[77]  Norbert Kathmann,et al.  Neural correlates of error awareness , 2007, NeuroImage.

[78]  L. Lenchik Functional imaging , 2007, Annals of Biomedical Engineering.

[79]  A. Hariri,et al.  Preference for Immediate over Delayed Rewards Is Associated with Magnitude of Ventral Striatal Activity , 2006, The Journal of Neuroscience.

[80]  Kristina M. Visscher,et al.  A Core System for the Implementation of Task Sets , 2006, Neuron.

[81]  Andrew Gelman,et al.  Data Analysis Using Regression and Multilevel/Hierarchical Models , 2006 .

[82]  T. Egner,et al.  Cognitive control mechanisms resolve conflict through cortical amplification of task-relevant information , 2005, Nature Neuroscience.

[83]  Simon B. Eickhoff,et al.  A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data , 2005, NeuroImage.

[84]  Elizabeth R. Chrastil,et al.  Sustained neural activity associated with cognitive control during temporally extended decision making. , 2005, Brain research. Cognitive brain research.

[85]  K. R. Ridderinkhof,et al.  The Role of the Medial Frontal Cortex in Cognitive Control , 2004, Science.

[86]  Jonathan D. Cohen,et al.  Anterior Cingulate Conflict Monitoring and Adjustments in Control , 2004, Science.

[87]  P. Sanberg,et al.  Neuroscience and Biobehavioral Reviews , 2002, Physiology & Behavior.

[88]  B. Everitt,et al.  Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex , 2002, Neuroscience & Biobehavioral Reviews.

[89]  L. Green,et al.  Area under the curve as a measure of discounting. , 2001, Journal of the experimental analysis of behavior.

[90]  Robert H. Paul,et al.  Impairments of attention and effort among patients with major affective disorders. , 2001, The Journal of neuropsychiatry and clinical neurosciences.

[91]  M. Botvinick,et al.  Conflict monitoring and cognitive control. , 2001, Psychological review.

[92]  E. Miller,et al.  The prefontral cortex and cognitive control , 2000, Nature Reviews Neuroscience.

[93]  S. Petersen,et al.  Characterizing the Hemodynamic Response: Effects of Presentation Rate, Sampling Procedure, and the Possibility of Ordering Brain Activity Based on Relative Timing , 2000, NeuroImage.

[94]  E. Miller,et al.  THE PREFRONTAL CORTEX AND COGNITIVE CONTROL , 2000 .

[95]  Eric J. Johnson,et al.  Anchoring, Activation, and the Construction of Values. , 1999, Organizational behavior and human decision processes.

[96]  Edward E. Smith,et al.  A Parametric Study of Prefrontal Cortex Involvement in Human Working Memory , 1996, NeuroImage.

[97]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[98]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[99]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[100]  V. Bowden,et al.  The Journal of Neuropsychiatry and Clinical Neurosciences , 1992 .

[101]  W. Kirchner Age differences in short-term retention of rapidly changing information. , 1958, Journal of experimental psychology.