Distributed Value Representation in the Medial Prefrontal Cortex during Intertemporal Choices

The ability to resist current temptations in favor of long-term benefits is a critical human capacity. Despite the extensive studies on the neural mechanisms of intertemporal choices, how the subjective value of immediate and delayed rewards is represented and compared in the brain remains to be elucidated. The present fMRI study addressed this question by simultaneously and independently manipulating the magnitude of immediate and delayed rewards in an intertemporal decision task, combined with univariate analysis and multiple voxel pattern analysis. We found that activities in the posterior portion of the dorsal medial prefrontal cortex (DmPFC) were modulated by the value of immediate options, whereas activities in the adjacent anterior DmPFC were modulated by the subjective value of delayed options. Brain signal change in the ventral mPFC was positively correlated with the “relative value” (the absolute difference of subjective value between two intertemporal alternatives). In contrast, the dorsal anterior cingulate cortex activity was negatively correlated with the relative value. These results suggest that immediate and delayed rewards are separately represented in the dorsal mPFC and compared in the ventral mPFC to guide decisions. The functional dissociation of posterior and anterior DmPFC in representing immediate and delayed reward is consistent with the general structural and functional architecture of the prefrontal cortex and may provide a neural basis for human's unique capacity to delayed gratification.

[1]  Samuel M. McClure,et al.  Time Discounting for Primary Rewards , 2007, The Journal of Neuroscience.

[2]  Jordan Grafman,et al.  Damage to the Fronto-Polar Cortex Is Associated with Impaired Multitasking , 2008, PloS one.

[3]  P. Glimcher,et al.  An "as soon as possible" effect in human intertemporal decision making: behavioral evidence and neural mechanisms. , 2010, Journal of neurophysiology.

[4]  P. Montague,et al.  Neural Economics and the Biological Substrates of Valuation , 2002, Neuron.

[5]  Daeyeol Lee,et al.  Neural Dissociation of Delay and Uncertainty in Intertemporal Choice , 2008, The Journal of Neuroscience.

[6]  Lin Xiao,et al.  Processing of time within the prefrontal cortex: Recent time engages posterior areas whereas distant time engages anterior areas , 2013, NeuroImage.

[7]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[8]  David Badre,et al.  Cognitive control, hierarchy, and the rostro–caudal organization of the frontal lobes , 2008, Trends in Cognitive Sciences.

[9]  M. Rabin,et al.  A Model of Reference-Dependent Preferences , 2006 .

[10]  Jan Peters,et al.  Episodic Future Thinking Reduces Reward Delay Discounting through an Enhancement of Prefrontal-Mediotemporal Interactions , 2010, Neuron.

[11]  C. Büchel,et al.  Overlapping and Distinct Neural Systems Code for Subjective Value during Intertemporal and Risky Decision Making , 2009, The Journal of Neuroscience.

[12]  E. Rolls,et al.  The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology , 2004, Progress in Neurobiology.

[13]  G. Xue,et al.  Decoding the Neuroanatomical Basis of Reading Ability: A Multivoxel Morphometric Study , 2013, The Journal of Neuroscience.

[14]  J. Monterosso,et al.  An Argument Against Dual Valuation System Competition: Cognitive Capacities Supporting Future Orientation Mediate Rather Than Compete With Visceral Motivations. , 2010, Journal of neuroscience, psychology, and economics.

[15]  John-Dylan Haynes,et al.  Disentangling neural representations of value and salience in the human brain , 2014, Proceedings of the National Academy of Sciences.

[16]  P. Glimcher,et al.  The neural correlates of subjective value during intertemporal choice , 2007, Nature Neuroscience.

[17]  D. V. van Essen,et al.  A Population-Average, Landmark- and Surface-based (PALS) atlas of human cerebral cortex. , 2005, NeuroImage.

[18]  Brian Knutson,et al.  Neural Antecedents of Financial Decisions , 2007, The Journal of Neuroscience.

[19]  Russell A. Poldrack,et al.  Analyses of regional-average activation and multivoxel pattern information tell complementary stories , 2012, Neuropsychologia.

[20]  L. Green,et al.  Rate of temporal discounting decreases with amount of reward , 1997, Memory & cognition.

[21]  Stefan Pollmann,et al.  PyMVPA: a Python Toolbox for Multivariate Pattern Analysis of fMRI Data , 2009, Neuroinformatics.

[22]  Jakob Heinzle,et al.  Decoding different roles for vmPFC and dlPFC in multi-attribute decision making , 2011, NeuroImage.

[23]  Steven P. Wise,et al.  Forward frontal fields: phylogeny and fundamental function , 2008, Trends in Neurosciences.

[24]  A. Owen,et al.  Anterior prefrontal cortex: insights into function from anatomy and neuroimaging , 2004, Nature Reviews Neuroscience.

[25]  J. O'Doherty,et al.  Evidence for a Common Representation of Decision Values for Dissimilar Goods in Human Ventromedial Prefrontal Cortex , 2009, The Journal of Neuroscience.

[26]  Thomas H. B. FitzGerald,et al.  The Role of Human Orbitofrontal Cortex in Value Comparison for Incommensurable Objects , 2009, The Journal of Neuroscience.

[27]  J. O'Doherty,et al.  Decoding the neural substrates of reward-related decision making with functional MRI , 2007, Proceedings of the National Academy of Sciences.

[28]  C. Summerfield,et al.  An information theoretical approach to prefrontal executive function , 2007, Trends in Cognitive Sciences.

[29]  Colin Camerer,et al.  Dissociating the Role of the Orbitofrontal Cortex and the Striatum in the Computation of Goal Values and Prediction Errors , 2008, The Journal of Neuroscience.

[30]  Israel Liberzon,et al.  The neural correlates of intertemporal decision‐making: Contributions of subjective value, stimulus type, and trait impulsivity , 2011, Human brain mapping.

[31]  G. V. Van Hoesen,et al.  Prefrontal cortex in humans and apes: a comparative study of area 10. , 2001, American journal of physical anthropology.

[32]  Timothy E. J. Behrens,et al.  Functional organization of the medial frontal cortex , 2007, Current Opinion in Neurobiology.

[33]  J. Dreher,et al.  Processing of primary and secondary rewards: A quantitative meta-analysis and review of human functional neuroimaging studies , 2013, Neuroscience & Biobehavioral Reviews.

[34]  J. Dreher,et al.  The Architecture of Reward Value Coding in the Human Orbitofrontal Cortex , 2010, The Journal of Neuroscience.

[35]  M. Kringelbach.  The human orbitofrontal cortex: linking reward to hedonic experience , 2005, Nature Reviews Neuroscience.

[36]  Daniel C. McNamee,et al.  Category-dependent and category-independent goal-value codes in human ventromedial prefrontal cortex , 2013, Nature Neuroscience.

[37]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[38]  Sabrina M. Tom,et al.  The Neural Basis of Loss Aversion in Decision-Making Under Risk , 2007, Science.

[39]  Antonio Rangel,et al.  The Decision Value Computations in the vmPFC and Striatum Use a Relative Value Code That is Guided by Visual Attention , 2011, The Journal of Neuroscience.

[40]  T. Braver,et al.  Impulsivity and Self-Control during Intertemporal Decision Making Linked to the Neural Dynamics of Reward Value Representation , 2013, The Journal of Neuroscience.

[41]  A. Hariri,et al.  Preference for Immediate over Delayed Rewards Is Associated with Magnitude of Ventral Striatal Activity , 2006, The Journal of Neuroscience.

[42]  R. Benoit,et al.  A Neural Mechanism Mediating the Impact of Episodic Prospection on Farsighted Decisions , 2011, The Journal of Neuroscience.

[43]  J. Kable,et al.  Brain Activity in Valuation Regions while Thinking about the Future Predicts Individual Discount Rates , 2013, The Journal of Neuroscience.

[44]  Antonio Damasio,et al.  The somatic marker hypothesis: A neural theory of economic decision , 2005, Games Econ. Behav..

[45]  Colin Camerer,et al.  Self-control in decision-making involves modulation of the vmPFC valuation system , 2009, NeuroImage.

[46]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[47]  P. Glimcher,et al.  The Neurobiology of Decision: Consensus and Controversy , 2009, Neuron.

[48]  S. Huettel,et al.  A Distinct Role of the Temporal-Parietal Junction in Predicting Socially Guided Decisions , 2012, Science.

[49]  E. Rolls,et al.  Value, Pleasure and Choice in the Ventral Prefrontal Cortex , 2022 .

[50]  Scott A. Huettel,et al.  Local pattern classification differentiates processes of economic valuation , 2009, NeuroImage.

[51]  W. Bickel,et al.  Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. , 1999, Journal of experimental psychology. General.

[52]  George Ainslie,et al.  Behavioral and Neural Evidence of Incentive Bias for Immediate Rewards Relative to Preference-Matched Delayed Rewards , 2009, The Journal of Neuroscience.

[53]  Karl J. Friston,et al.  Encoding of Marginal Utility across Time in the Human Brain , 2009, The Journal of Neuroscience.

[54]  P. Shizgal,et al.  On the Neural Computation of Utility , 1996 .

[55]  Soyoung Q. Park,et al.  The neural code of reward anticipation in human orbitofrontal cortex , 2010, Proceedings of the National Academy of Sciences.

[56]  Colin Camerer,et al.  A framework for studying the neurobiology of value-based decision making , 2008, Nature Reviews Neuroscience.

[57]  Jan Peters,et al.  The neural mechanisms of inter-temporal decision-making: understanding variability , 2011, Trends in Cognitive Sciences.

[58]  A M Dale,et al.  Optimal experimental design for event‐related fMRI , 1999, Human brain mapping.

[59]  G. Ainslie.  Specious reward: a behavioral theory of impulsiveness and impulse control. , 1975, Psychological bulletin.

[60]  A. Bechara,et al.  Cerebral Cortex doi:10.1093/cercor/bhn147 Functional Dissociations of Risk and Reward Processing in the Medial Prefrontal Cortex , 2008 .

[61]  M. Walton,et al.  Action sets and decisions in the medial frontal cortex , 2004, Trends in Cognitive Sciences.

[62]  G. Loewenstein.  Frames of mind in intertemporal choice , 1988 .

[63]  Eric J. Johnson,et al.  Lateral prefrontal cortex and self-control in intertemporal choice , 2010, Nature Neuroscience.

[64]  Brian Knutson,et al.  Dissociable neural representations of future reward magnitude and delay during temporal discounting , 2009, NeuroImage.

[65]  Nikolaus Kriegeskorte,et al.  Comparison of multivariate classifiers and response normalizations for pattern-information fMRI , 2010, NeuroImage.

[66]  Glenn W. Harrison,et al.  Latent process heterogeneity in discounting behavior , 2012 .

[67]  J. O'Doherty,et al.  Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions , 2007, The Journal of Neuroscience.

[68]  S. Huettel,et al.  Resolving Response, Decision, and Strategic Control: Evidence for a Functional Topography in Dorsomedial Prefrontal Cortex , 2009, The Journal of Neuroscience.