The Neural Substrates of Reward Processing in Humans: The Modern Role of fMRI

Experimental work in animals has identified numerous neural structures involved in reward processing and reward-dependent learning. Until recently, this work provided the primary basis for speculations about the neural substrates of human reward processing. The widespread use of neuroimaging technology has changed this situation dramatically over the past decade through the use of PET and fMRI. Here, the authors focus on the role played by fMRI studies, where recent work has replicated the animal results in human subjects and has extended the view of putative reward-processing neural structures. In particular, fMRI work has identified a set of reward-related brain structures including the orbitofrontal cortex, amygdala, ventral striatum, and medial prefrontal cortex. Moreover, the human experiments have probed the dependence of human reward responses on learned expectations, context, timing, and the reward dimension. Current experiments aim to assess the function of human reward-processing structures to determine how they allow us to predict, assess, and act in response to rewards. The authors review current accomplishments in the study of human reward processing and focus their discussion on explanations directed particularly at the role played by the ventral striatum. They discuss how these findings may contribute to a better understanding of deficits associated with Parkinson’s disease.

[1]  L. Weiskrantz,et al.  Behavioral changes associated with ablation of the amygdaloid complex in monkeys. , 1956, Journal of comparative and physiological psychology.

[2]  R. Bellman Dynamic programming. , 1957, Science.

[3]  A. Lees Cognitive Deficits in Parkinson’s Disease , 1985 .

[4]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[5]  F. Bloom,et al.  Cellular and molecular mechanisms of drug dependence. , 1988, Science.

[6]  R. Robinson,et al.  Cognitive impairments in different stages of Parkinson's disease. , 1989, The Journal of neuropsychiatry and clinical neurosciences.

[7]  D. Tank,et al.  Brain magnetic resonance imaging with contrast dependent on blood oxygenation. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[8]  J. Saint-Cyr,et al.  Memory and learning in early Parkinson's disease: Evidence for a “frontal lobe syndrome” , 1990, Brain and Cognition.

[9]  C. Marsden,et al.  Cognitive function in Parkinson's disease: From description to theory , 1990, Trends in Neurosciences.

[10]  B. Rosen,et al.  Functional mapping of the human visual cortex by magnetic resonance imaging. , 1991, Science.

[11]  E. Sullivan,et al.  Cognitive impairment in early, untreated Parkinson's disease and its relationship to motor disability. , 1991, Brain : a journal of neurology.

[12]  E. Rolls,et al.  Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage. , 1994, Journal of neurology, neurosurgery, and psychiatry.

[13]  A. Damasio,et al.  Insensitivity to future consequences following damage to human prefrontal cortex , 1994, Cognition.

[14]  A. Damasio Descartes’ Error. Emotion, Reason and the Human Brain. New York (Grosset/Putnam) 1994. , 1994 .

[15]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[17]  P. Shizgal Neural basis of utility estimation , 1997, Current Opinion in Neurobiology.

[18]  M. Piccirilli,et al.  Early frontal impairment as a predictor of dementia in Parkinson's disease , 1997, Neurology.

[19]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[20]  Anders M. Dale,et al.  Event-related fMRI: Past, Present, and Future , 1998 .

[21]  A M Dale,et al.  Event-related functional MRI: past, present, and future. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[22]  R A Bakay,et al.  Ablative surgery and deep brain stimulation for Parkinson's disease. , 1999, Neurosurgery.

[23]  K. Berridge,et al.  What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? , 1998, Brain Research Reviews.

[24]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[25]  S. Ikemoto,et al.  The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking , 1999, Brain Research Reviews.

[26]  E. Rolls The orbitofrontal cortex and reward. , 2000, Cerebral cortex.

[27]  Brian Knutson,et al.  FMRI Visualization of Brain Activity during a Monetary Incentive Delay Task , 2000, NeuroImage.

[28]  Joseph E LeDoux Emotion Circuits in the Brain , 2000 .

[29]  Karl J. Friston,et al.  Dissociable Neural Responses in Human Reward Systems , 2000, The Journal of Neuroscience.

[30]  R. Elliott,et al.  Dissociable functions in the medial and lateral orbitofrontal cortex: evidence from human neuroimaging studies. , 2000, Cerebral cortex.

[31]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[32]  Samuel M. McClure,et al.  Predictability Modulates Human Brain Response to Reward , 2001, The Journal of Neuroscience.

[33]  D. Ariely,et al.  Beautiful Faces Have Variable Reward Value fMRI and Behavioral Evidence , 2001, Neuron.

[34]  E. Rolls,et al.  Abstract reward and punishment representations in the human orbitofrontal cortex , 2001, Nature Neuroscience.

[35]  H. Breiter,et al.  Reward Circuitry Activation by Noxious Thermal Stimuli , 2001, Neuron.

[36]  A. Young,et al.  Neuropsychology of fear and loathing , 2001 .

[37]  E. Rolls,et al.  Representation of pleasant and aversive taste in the human brain. , 2001, Journal of neurophysiology.

[38]  Brian Knutson,et al.  Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens , 2001, The Journal of Neuroscience.

[39]  E. Murray,et al.  The amygdala and reward , 2002, Nature Reviews Neuroscience.

[40]  J. O'Doherty,et al.  Neural Responses during Anticipation of a Primary Taste Reward , 2002, Neuron.

[41]  J. O'Doherty,et al.  Appetitive and Aversive Olfactory Learning in Humans Studied Using Event-Related Functional Magnetic Resonance Imaging , 2002, The Journal of Neuroscience.

[42]  S. Hamann,et al.  Positive and negative emotional verbal stimuli elicit activity in the left amygdala , 2002, Neuroreport.

[43]  P. Montague,et al.  Activity in human ventral striatum locked to errors of reward prediction , 2002, Nature Neuroscience.

[44]  P. Montague,et al.  Neural Economics and the Biological Substrates of Valuation , 2002, Neuron.

[45]  G. Pagnoni,et al.  A Neural Basis for Social Cooperation , 2002, Neuron.

[46]  J. Desmond,et al.  Brain activation and sexual arousal in healthy, heterosexual males. , 2002, Brain : a journal of neurology.

[47]  Brian Knutson,et al.  A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI , 2003, NeuroImage.

[48]  G. Glover,et al.  Dissociated neural representations of intensity and valence in human olfaction , 2003, Nature Neuroscience.

[49]  D. V. von Cramon,et al.  Error Monitoring Using External Feedback: Specific Roles of the Habenular Complex, the Reward System, and the Cingulate Motor Area Revealed by Functional Magnetic Resonance Imaging , 2003, The Journal of Neuroscience.

[50]  J. O'Doherty,et al.  Encoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex , 2003, Science.

[51]  A. Tröster,et al.  Prodromal frontal/executive dysfunction predicts incident dementia in Parkinson’s disease , 2003, Journal of the International Neuropsychological Society.

[52]  M. Mesulam,et al.  Dissociation of Neural Representation of Intensity and Affective Valuation in Human Gustation , 2003, Neuron.

[53]  Samuel M. McClure,et al.  A computational substrate for incentive salience , 2003, Trends in Neurosciences.

[54]  E T Rolls,et al.  Representations of pleasant and painful touch in the human orbitofrontal and cingulate cortices. , 2003, Cerebral cortex.

[55]  Samuel M. McClure,et al.  Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum , 2003, Neuron.

[56]  R. Wightman,et al.  Subsecond dopamine release promotes cocaine seeking , 2003, Nature.

[57]  Karl J. Friston,et al.  Temporal Difference Models and Reward-Related Learning in the Human Brain , 2003, Neuron.

[58]  J. O'Doherty,et al.  Dissociating Valence of Outcome from Behavioral Control in Human Orbital and Ventral Prefrontal Cortices , 2003, The Journal of Neuroscience.

[59]  Brian Knutson,et al.  Amygdalar Recruitment during Anticipation of Monetary Rewards , 2003, Annals of the New York Academy of Sciences.

[60]  Jonathan D. Cohen,et al.  The Neural Basis of Economic Decision-Making in the Ultimatum Game , 2003, Science.

[61]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.