Goal congruency dominates reward value in accounting for behavioral and neural correlates of value-based decision-making

When choosing between options, whether menu items or career paths, we can evaluate how rewarding each one will be, or how congruent each option is with our current choice goal (e.g., identifying the best or worst ones). Past decision-making research has interpreted findings through the former lens, but in these experiments the most rewarding option has always been most congruent with one’s goal (choosing the best option). It is therefore unclear to what extent expected reward versus goal congruency can account for a wide body of behavioral and neuroscientific research on choice value. Here, we deconfound these two variables. Contrary to prevailing accounts, we find that goal congruency dominates choice behavior and neural activity. We separately identify dissociable signals of expected reward. Our findings disentangle the roles of rewards and goals in how people consider their options, and call for a reinterpretation of previous research on value-based choice. Significance Statement Whether it is between restaurants or career paths, to make adaptive decisions we must evaluate our options and identify those that are most conducive to our current goal. Dysfunctional decision-making can therefore result from aberrant reward processing (e.g., impulse disorders) or from aberrant goal processing (e.g., OCD, ADHD). By focusing only on how people choose their favorite option in a choice set (when rewards and goals are aligned), past research has been unable to distinguish the degree to which behavior and neural activity are determined by reward versus goal processing. We disentangle these processes and show that behavior and fMRI activity are differentially influenced by the promised rewards versus the degree to which those rewards align with one’s current goal.

[1]  D. L. Hintzman,et al.  A congruity effect in the discrimination of presentation frequencies: Some data and a model , 1983 .

[2]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[3]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[4]  J. Cacioppo,et al.  Mind at ease puts a smile on the face: psychophysiological evidence that processing facilitation elicits positive affect. , 2001, Journal of personality and social psychology.

[5]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[6]  N. Schwarz,et al.  The hot fringes of consciousness: Perceptual fluency and affect , 2001 .

[7]  J B Poline,et al.  The neural system that bridges reward and cognition in humans: An fMRI study , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Jonathan D. Cohen,et al.  Reward and Decision , 2002, Neuron.

[9]  K. C. Klauer,et al.  The Psychology of Evaluation : Affective Processes in Cognition and Emotion , 2003 .

[10]  Michael J. Frank,et al.  By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism , 2004, Science.

[11]  M. Alexander,et al.  A role for right medial prefrontal cortex in accurate feeling-of-knowing judgments: evidence from patients with lesions to frontal cortex , 2004, Neuropsychologia.

[12]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[13]  Jörn Diedrichsen,et al.  Detecting and adjusting for artifacts in fMRI time series data , 2005, NeuroImage.

[14]  J. Morton,et al.  Choosing the Lesser of Two Evils, the Better of Two Goods: Specifying the Roles of Ventromedial Prefrontal Cortex and Dorsal Anterior Cingulate in Object Choice , 2006, The Journal of Neuroscience.

[15]  P. Dayan,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.8 Full text provided by www.sciencedirect.com A normative perspective on motivation , 2022 .

[16]  P. Dayan,et al.  Tonic dopamine: opportunity costs and the control of response vigor , 2007, Psychopharmacology.

[17]  J. O'Doherty,et al.  Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions , 2007, The Journal of Neuroscience.

[18]  G. Loewenstein,et al.  Neural Predictors of Purchases , 2007, Neuron.

[19]  Colin Camerer,et al.  Dissociating the Role of the Orbitofrontal Cortex and the Striatum in the Computation of Goal Values and Prediction Errors , 2008, The Journal of Neuroscience.

[20]  A. Rangel,et al.  Biasing simple choices by manipulating relative visual attention , 2008, Judgment and Decision Making.

[21]  Justin L. Vincent,et al.  Evidence for a frontoparietal control system revealed by intrinsic functional connectivity. , 2008, Journal of neurophysiology.

[22]  V. Michel,et al.  An Automatic Valuation System in the Human Brain: Evidence from Functional Neuroimaging , 2009, Neuron.

[23]  Jung Hoon Sul,et al.  Role of Striatum in Updating Values of Chosen Actions , 2009, The Journal of Neuroscience.

[24]  Ian Krajbich,et al.  Visual fixations and the computation and comparison of value in simple choice , 2010, Nature Neuroscience.

[25]  N. Volkow,et al.  Neurocircuitry of Addiction , 2010, Neuropsychopharmacology.

[26]  M. Walton,et al.  Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine , 2009, Nature Neuroscience.

[27]  Antonio Rangel,et al.  Neural computations associated with goal-directed choice , 2010, Current Opinion in Neurobiology.

[28]  Mathias Pessiglione,et al.  Separate Valuation Subsystems for Delay and Effort Decision Costs , 2010, The Journal of Neuroscience.

[29]  J. O'Doherty,et al.  Appetitive and Aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision-making , 2009, NeuroImage.

[30]  D. Zald,et al.  Dopaminergic Network Differences in Human Impulsivity , 2010, Science.

[31]  Ulrike Basten,et al.  How the brain integrates costs and bene fi ts during decision making , 2010 .

[32]  C. Büchel,et al.  Neural representations of subjective reward value , 2010, Behavioural Brain Research.

[33]  J. Haynes,et al.  Neural Responses to Unattended Products Predict Later Consumer Choices , 2010, The Journal of Neuroscience.

[34]  Marisa O. Hollinshead,et al.  The organization of the human cerebral cortex estimated by intrinsic functional connectivity. , 2011, Journal of neurophysiology.

[35]  Colin Camerer,et al.  Dynamic Construction of Stimulus Values in the Ventromedial Prefrontal Cortex , 2011, PloS one.

[36]  Dino J. Levy,et al.  Comparing Apples and Oranges: Using Reward-Specific and Reward-General Subjective Value Representation in the Brain , 2011, The Journal of Neuroscience.

[37]  E. Rolls,et al.  Value, Pleasure and Choice in the Ventral Prefrontal Cortex , 2022 .

[38]  A. Rangel,et al.  Dissociating valuation and saliency signals during decision-making. , 2011, Cerebral cortex.

[39]  P. Glimcher,et al.  Choice from Non-Choice: Predicting Consumer Preferences from Blood Oxygenation Level-Dependent Signals Obtained during Passive Viewing , 2011, The Journal of Neuroscience.

[40]  A. Rangel,et al.  Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisions , 2011, Proceedings of the National Academy of Sciences.

[41]  Michael B. Miller,et al.  Parietal cortex tracks the amount of information retrieved even when it is not the basis of a memory decision , 2011, NeuroImage.

[42]  Dino J. Levy,et al.  The root of all value: a neural common currency for choice , 2012, Current Opinion in Neurobiology.

[43]  R. Buckner,et al.  The organization of the human striatum estimated by intrinsic functional connectivity. , 2012, Journal of neurophysiology.

[44]  M. Woolrich,et al.  Mechanisms underlying cortical activity during value-guided choice , 2011, Nature Neuroscience.

[45]  M. Roesch,et al.  Reward Prediction Error Signaling in Posterior Dorsomedial Striatum Is Action Specific , 2012, The Journal of Neuroscience.

[46]  Raymond J. Dolan,et al.  Go and no-go learning in reward and punishment: Interactions between affect and effect , 2012, NeuroImage.

[47]  Caroline R. Lavelock,et al.  Processing fluency, positive affect, and judgments of meaning in life , 2013 .

[48]  Samuel M. McClure,et al.  Towards a general model of temporal discounting. , 2013, Journal of the experimental analysis of behavior.

[49]  Christian Büchel,et al.  Classic EEG motor potentials track the emergence of value-based decisions , 2013, NeuroImage.

[50]  Joseph W. Kable,et al.  The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value , 2013, NeuroImage.

[51]  Ian W. Eisenberg,et al.  Frontal Theta Overrides Pavlovian Learning Biases , 2013, The Journal of Neuroscience.

[52]  Mel W. Khaw,et al.  Normalization is a general neural mechanism for context-dependent decision making , 2013, Proceedings of the National Academy of Sciences.

[53]  R. Dolan,et al.  Confidence in value-based choice , 2012, Nature Neuroscience.

[54]  Jonathan D. Cohen,et al.  The Computational and Neural Basis of Cognitive Control: Charted Territory and New Frontiers , 2014, Cogn. Sci..

[55]  Timothy Edward John Behrens,et al.  Dissociable contributions of ventromedial prefrontal and posterior parietal cortex to value-guided choice , 2014, NeuroImage.

[56]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[57]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[58]  Brian Knutson,et al.  Dissociating Motivation from Reward in Human Striatal Activity , 2014, Journal of Cognitive Neuroscience.

[59]  Jordan J. Louviere,et al.  The Best of Times and the Worst of Times Are Interchangeable , 2014 .

[60]  M. Potenza,et al.  Addictions and Personality Traits: Impulsivity and Related Constructs , 2014, Current Behavioral Neuroscience Reports.

[61]  R. Buckner,et al.  Neural correlates of dueling affective reactions to win–win choices , 2014, Proceedings of the National Academy of Sciences.

[62]  M. Grueschow,et al.  The precision of value-based choices depends causally on fronto-parietal phase coupling , 2015, Nature Communications.

[63]  D. Bates,et al.  Parsimonious Mixed Models , 2015, 1506.04967.

[64]  W. Schultz Neuronal Reward and Decision Signals: From Theories to Data. , 2015, Physiological reviews.

[65]  M. Delgado,et al.  The good, the bad and the brain: neural correlates of appetitive and aversive values underlying decision making , 2015, Current Opinion in Behavioral Sciences.

[66]  K. Doya,et al.  Distinct Neural Representation in the Dorsolateral, Dorsomedial, and Ventral Parts of the Striatum during Fixed- and Free-Choice Tasks , 2015, The Journal of Neuroscience.

[67]  D. Bates,et al.  Balancing Type I Error and Power in Linear Mixed Models , 2015, 1511.01864.

[68]  Nicolas W. Schuck,et al.  Human Orbitofrontal Cortex Represents a Cognitive Map of State Space , 2016, Neuron.

[69]  Mark A. Straccia,et al.  Dorsal anterior cingulate and ventromedial prefrontal cortex have inverse roles in both foraging and economic choice , 2016, Cognitive, Affective, & Behavioral Neuroscience.

[70]  N. Daw,et al.  Characterizing a psychiatric symptom dimension related to deficits in goal-directed control , 2016, eLife.

[71]  P. Sterzer,et al.  Mesolimbic confidence signals guide perceptual learning in the absence of external feedback , 2016, eLife.

[72]  M. Usher,et al.  Absolutely relative or relatively absolute: violations of value invariance in human decision making , 2016, Psychonomic bulletin & review.

[73]  M. A. Pisauro,et al.  Neural correlates of evidence accumulation during value-based decisions revealed via simultaneous EEG-fMRI , 2017, Nature Communications.

[74]  J. Colas Value-based decision making via sequential sampling with hierarchical competition and attentional modulation , 2017, PloS one.

[75]  T. Kahnt,et al.  Identity-Specific Reward Representations in Orbitofrontal Cortex Are Modulated by Selective Devaluation , 2017, The Journal of Neuroscience.

[76]  Adrian G. Fischer,et al.  Short-term reward experience biases inference despite dissociable neural correlates , 2017, Nature Communications.

[77]  T. Robbins,et al.  Fractionating impulsivity: neuropsychiatric implications , 2017, Nature Reviews Neuroscience.

[78]  Mel W. Khaw,et al.  Normalized value coding explains dynamic adaptation in the human valuation process , 2017, Proceedings of the National Academy of Sciences.

[79]  B. Hayden,et al.  A distributed, hierarchical and recurrent framework for reward-based choice , 2017, Nature Reviews Neuroscience.

[80]  Dan Bang,et al.  Distinct encoding of decision confidence in human medial prefrontal cortex , 2018, Proceedings of the National Academy of Sciences.

[81]  James A. R. Marshall,et al.  Evidence for the Speed–Value Trade-Off: Human and Monkey Decision Making Is Magnitude Sensitive , 2017, Decision.

[82]  U. Karmarkar,et al.  The Evil of Banality: When Choosing Between the Mundane Feels Like Choosing Between the Worst , 2018, Journal of experimental psychology. General.

[83]  Dan Bang,et al.  Distinct encoding of decision confidence in human medial prefrontal cortex , 2018, bioRxiv.

[84]  U. Karmarkar,et al.  Dissociable components of the reward circuit are involved in appraisal versus choice , 2017, Scientific Reports.

[85]  I. Krajbich,et al.  Gaze Amplifies Value in Decision Making , 2018, Psychological science.

[86]  A. Shenhav,et al.  Spatiotemporally distinct neural mechanisms underlie our reactions to and comparison between value-based options , 2019, bioRxiv.