Activity in human reward-sensitive brain areas is strongly context dependent

Functional neuroimaging research in humans has identified a number of brain areas that are activated by the delivery of primary and secondary reinforcers. The present study investigated how activity in these reward-sensitive regions is modulated by the context in which rewards and punishments are experienced. Fourteen healthy volunteers were scanned during the performance of a simple monetary gambling task that involved a "win" condition (in which the possible outcomes were a large monetary gain, a small gain, or no gain of money) and a "lose" condition (in which the possible outcomes were a large monetary loss, a small loss, or no loss of money). We observed reward-sensitive activity in a number of brain areas previously implicated in reward processing, including the striatum, prefrontal cortex, posterior cingulate, and inferior parietal lobule. Critically, activity in these reward-sensitive areas was highly sensitive to the range of possible outcomes from which an outcome was selected. In particular, these regions were activated to a comparable degree by the best outcomes in each condition-a large gain in the win condition and no loss of money in the lose condition-despite the large difference in the objective value of these outcomes. In addition, some reward-sensitive brain areas showed a binary instead of graded sensitivity to the magnitude of the outcomes from each distribution. These results provide important evidence regarding the way in which the brain scales the motivational value of events by the context in which these events occur.

[1]  Brian Knutson,et al.  Neurally reconstructing expected utility , 2005, Games Econ. Behav..

[2]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[3]  W. Schultz Getting Formal with Dopamine and Reward , 2002, Neuron.

[4]  Karl J. Friston,et al.  Event‐related f MRI , 1997, Human brain mapping.

[5]  Karl J. Friston,et al.  Dissociable Neural Responses in Human Reward Systems , 2000, The Journal of Neuroscience.

[6]  Karl J. Friston,et al.  Event-related fMRI , 1997 .

[7]  Jonathan D. Cohen,et al.  Improved Assessment of Significant Activation in Functional Magnetic Resonance Imaging (fMRI): Use of a Cluster‐Size Threshold , 1995, Magnetic resonance in medicine.

[8]  P. Montague,et al.  Neural Economics and the Biological Substrates of Valuation , 2002, Neuron.

[9]  A. Rodríguez-Fornells,et al.  Brain potentials related to self-generated and external information used for performance monitoring , 2005, Clinical Neurophysiology.

[11]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[12]  Clay B. Holroyd,et al.  ERP correlates of feedback and reward processing in the presence and absence of response choice. , 2005, Cerebral cortex.

[13]  Clay B. Holroyd,et al.  Dorsal anterior cingulate cortex shows fMRI response to internal and external error signals , 2004, Nature Neuroscience.

[14]  A. Sanfey,et al.  Independent Coding of Reward Magnitude and Valence in the Human Brain , 2004, The Journal of Neuroscience.

[15]  Samuel M. McClure,et al.  Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum , 2003, Neuron.

[16]  Samuel M. McClure,et al.  Predictability Modulates Human Brain Response to Reward , 2001, The Journal of Neuroscience.

[17]  Cameron S. Carter,et al.  Errors without conflict: Implications for performance monitoring theories of anterior cingulate cortex , 2004, Brain and Cognition.

[18]  O. Hikosaka,et al.  Dopamine Neurons Can Represent Context-Dependent Prediction Error , 2004, Neuron.

[19]  M. Delgado,et al.  Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations , 2003, Cognitive, affective & behavioral neuroscience.

[20]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[21]  M. Roesch,et al.  Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex , 2004, Science.

[22]  Jobu Watanabe,et al.  Context-dependent cortical activation in response to financial reward and penalty: an event-related fMRI study , 2003, NeuroImage.

[23]  Gregor Thut,et al.  Activation of the human brain by monetary reward , 1997, Neuroreport.

[24]  M. Delgado,et al.  Motivation-dependent responses in the human caudate nucleus. , 2004, Cerebral cortex.

[25]  Clay B. Holroyd,et al.  Reinforcement-related brain potentials from medial frontal cortex: origins and functional significance , 2004, Neuroscience & Biobehavioral Reviews.

[26]  R. Elliott,et al.  Differential Response Patterns in the Striatum and Orbitofrontal Cortex to Financial Reward in Humans: A Parametric Functional Magnetic Resonance Imaging Study , 2003, The Journal of Neuroscience.

[27]  E. Rolls,et al.  Abstract reward and punishment representations in the human orbitofrontal cortex , 2001, Nature Neuroscience.

[28]  J. Talairach,et al.  Co-Planar Stereotaxic Atlas of the Human Brain: 3-Dimensional Proportional System: An Approach to Cerebral Imaging , 1988 .

[29]  D. Kahneman,et al.  Functional Imaging of Neural Responses to Expectancy and Experience of Monetary Gains and Losses tasks with monetary payoffs , 2001 .

[30]  K. R. Ridderinkhof,et al.  The Role of the Medial Frontal Cortex in Cognitive Control , 2004, Science.

[31]  A. Sirigu,et al.  Differential amygdala responses to winning and losing: a functional magnetic resonance imaging study in humans , 2000, The European journal of neuroscience.

[32]  K. Hikosaka,et al.  Coding and Monitoring of Motivational Context in the Primate Prefrontal Cortex , 2002, The Journal of Neuroscience.

[33]  A M Dale,et al.  Randomized event‐related experimental designs allow for extremely rapid presentation rates using functional MRI , 1998, Neuroreport.

[34]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[35]  M. Delgado,et al.  Modulation of Caudate Activity by Action Contingency , 2004, Neuron.

[36]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[37]  Jeff T. Larsen,et al.  Context dependence of the event-related brain potential associated with reward and punishment. , 2004, Psychophysiology.

[38]  M. Walton,et al.  Interactions between decision making and performance monitoring within prefrontal cortex , 2004, Nature Neuroscience.