Reward‐Related Responses in the Human Striatum

Abstract:  Much of our knowledge of how reward information is processed in the brain comes from a rich animal literature. Recently, the advancement of neuroimaging techniques has allowed researchers to extend such investigations to the human brain. A common finding across species and methodologies is the involvement of the striatum, the input structure of the basal ganglia, in a circuit responsible for mediating goal‐directed behavior. Central to this idea is the role of the striatum in the processing of affective stimuli, such as rewards and punishments. The goal of this article is to probe the human reward circuit, specifically the striatum and its subdivisions, with an emphasis on how the affective properties of outcomes or feedback influence the underlying neural activity and subsequent decision making. Discussion will first focus on anatomical and functional considerations regarding the striatum that have emerged from animal models. The rest of the article will center on how human neuroimaging studies map to findings from the animal literature, and how more recently, this research can be extended into the social and economic domains.

[1]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[2]  G. Di Chiara,et al.  Drugs abused by humans preferentially increase synaptic dopamine concentrations in the mesolimbic system of freely moving rats. , 1988, Proceedings of the National Academy of Sciences of the United States of America.

[3]  O. Hikosaka,et al.  Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. , 1989, Journal of neurophysiology.

[4]  T. Robbins,et al.  Limbic-striatal interactions in reward-related processes , 1989, Neuroscience & Biobehavioral Reviews.

[5]  G. E. Alexander,et al.  Functional architecture of basal ganglia circuits: neural substrates of parallel processing , 1990, Trends in Neurosciences.

[6]  T. Robbins,et al.  Functions of dopamine in the dorsal and ventral striatum , 1992 .

[7]  W. Schultz,et al.  Neuronal activity in monkey striatum related to the expectation of predictable environmental events. , 1992, Journal of neurophysiology.

[8]  S. N. Haber,et al.  The organization of midbrain projections to the ventral striatum in the primate , 1994, Neuroscience.

[9]  A M Graybiel,et al.  The basal ganglia and adaptive motor control. , 1994, Science.

[10]  A. Graybiel,et al.  Role of Basal Ganglia in Sensory Motor Association Learning , 1995 .

[11]  A. Graybiel,et al.  Functions of the Cortico-Basal Ganglia Loop , 1995, Springer Japan.

[12]  A. Barto,et al.  Adaptive Critics and the Basal Ganglia , 1994 .

[13]  Joel L. Davis,et al.  Adaptive Critics and the Basal Ganglia , 1995 .

[14]  T. Robbins,et al.  Neurobehavioural mechanisms of reward and motivation , 1996, Current Opinion in Neurobiology.

[15]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[16]  R. J. Dolan,et al.  Differential neural response to positive and negative feedback in planning and guessing tasks , 1997, Neuropsychologia.

[17]  P. Strick,et al.  New concepts about the organization of basal ganglia output. , 1997, Advances in neurology.

[18]  S. Hyman,et al.  Acute Effects of Cocaine on Human Brain Activity and Emotion , 1997, Neuron.

[19]  Gregor Thut,et al.  Activation of the human brain by monetary reward , 1997, Neuroreport.

[20]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[21]  D. Brooks,et al.  Evidence for striatal dopamine release during a video game , 1998, Nature.

[22]  J. Hollerman,et al.  Reward prediction in primate basal ganglia and frontal cortex , 1998, Neuropharmacology.

[23]  W. Schultz,et al.  The phasic reward signal of primate dopamine neurons. , 1998, Advances in pharmacology.

[24]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[25]  R. Elliott,et al.  Abnormal neural response to feedback on planning and guessing tasks in patients with unipolar depression , 1998, Psychological Medicine.

[26]  JaneR . Taylor,et al.  Impulsivity resulting from frontostriatal dysfunction in drug abuse: implications for the control of behavior by reward-related stimuli , 1999, Psychopharmacology.

[27]  Carol A. Seger,et al.  Striatal activation during acquisition of a cognitive skill. , 1999, Neuropsychology.

[28]  C. I. Connolly,et al.  Building neural representations of habits. , 1999, Science.

[29]  H. Groenewegen,et al.  Convergence and Segregation of Ventral Striatal Inputs and Outputs , 1999, Annals of the New York Academy of Sciences.

[30]  S. Ikemoto,et al.  The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking , 1999, Brain Research Reviews.

[31]  P. Strick,et al.  Basal Ganglia Output and Cognition: Evidence from Anatomical, Behavioral, and Clinical Studies , 2000, Brain and Cognition.

[32]  P. Strick,et al.  Basal ganglia and cerebellar loops: motor and cognitive circuits , 2000, Brain Research Reviews.

[33]  T. Robbins,et al.  Dissociation in Conditioned Dopamine Release in the Nucleus Accumbens Core and Shell in Response to Cocaine Cues and during Cocaine-Seeking Behavior in Rats , 2000, The Journal of Neuroscience.

[34]  W. Schultz Multiple reward signals in the brain , 2000, Nature Reviews Neuroscience.

[35]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[36]  Samuel M. McClure,et al.  Predictability Modulates Human Brain Response to Reward , 2001, The Journal of Neuroscience.

[37]  W. Schultz,et al.  Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. , 2001, Journal of neurophysiology.

[38]  D. Kahneman,et al.  Functional Imaging of Neural Responses to Expectancy and Experience of Monetary Gains and Losses tasks with monetary payoffs , 2001 .

[39]  M. Gluck,et al.  Interactive memory systems in the human brain , 2001, Nature.

[40]  Osama Mawlawi,et al.  Imaging Human Mesolimbic Dopamine Transmission with Positron Emission Tomography: I. Accuracy and Precision of D2 Receptor Parameter Measurements in Ventral Striatum , 2001, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[41]  E. Rolls,et al.  Representation of pleasant and aversive taste in the human brain. , 2001, Journal of neurophysiology.

[42]  Brian Knutson,et al.  Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens , 2001, The Journal of Neuroscience.

[43]  B. Knowlton,et al.  Learning and memory functions of the Basal Ganglia. , 2002, Annual review of neuroscience.

[44]  Sham M. Kakade,et al.  Opponent interactions between serotonin and dopamine , 2002, Neural Networks.

[45]  J. O'Doherty,et al.  Neural Responses during Anticipation of a Primary Taste Reward , 2002, Neuron.

[46]  N. Volkow,et al.  “Nonhedonic” food motivation in humans involves dopamine in the dorsal striatum and methylphenidate amplifies this effect , 2002, Synapse.

[47]  P. Montague,et al.  Activity in human ventral striatum locked to errors of reward prediction , 2002, Nature Neuroscience.

[48]  P. Montague,et al.  Neural Economics and the Biological Substrates of Valuation , 2002, Neuron.

[49]  T. Robbins,et al.  Dopamine Release in the Dorsal Striatum during Cocaine-Seeking Behavior under the Control of a Drug-Associated Cue , 2002, The Journal of Neuroscience.

[50]  G. Pagnoni,et al.  A Neural Basis for Social Cooperation , 2002, Neuron.

[51]  R. J. McDonald,et al.  Multiple Parallel Memory Systems in the Brain of the Rat , 2002, Neurobiology of Learning and Memory.

[52]  S. Kapur,et al.  Direct Activation of the Ventral Striatum in Anticipation of Aversive Stimuli , 2003, Neuron.

[53]  Brian Knutson,et al.  A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI , 2003, NeuroImage.

[54]  R. Frank What price the moral high ground , 2003 .

[55]  Samuel M. McClure,et al.  Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum , 2003, Neuron.

[56]  Wolfram Schultz,et al.  Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. , 2003, Journal of neurophysiology.

[57]  Karl J. Friston,et al.  Temporal Difference Models and Reward-Related Learning in the Human Brain , 2003, Neuron.

[58]  M. Gluck,et al.  Dissociating Hippocampal versus Basal Ganglia Contributions to Learning and Transfer , 2003, Journal of Cognitive Neuroscience.

[59]  M. Delgado,et al.  Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations , 2003, Cognitive, affective & behavioral neuroscience.

[60]  Peter Kirsch,et al.  Anticipation of reward in a nonaversive differential conditioning paradigm and the brain reward system: an event-related fMRI study , 2003, NeuroImage.

[61]  Joseph E LeDoux,et al.  Extinction Learning in Humans Role of the Amygdala and vmPFC , 2004, Neuron.

[62]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[63]  D. D. de Quervain,et al.  The Neural Basis of Altruistic Punishment , 2004, Science.

[64]  M. Delgado,et al.  Motivation-dependent responses in the human caudate nucleus. , 2004, Cerebral cortex.

[65]  G. Pagnoni,et al.  Human Striatal Responses to Monetary Reward Depend On Saliency , 2004, Neuron.

[66]  M. Gluck,et al.  Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. , 2004, Brain : a journal of neurology.

[67]  Michael J. Frank,et al.  By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism , 2004, Science.

[68]  Rebecca Elliott,et al.  Instrumental responding for rewards is associated with enhanced neuronal response in subcortical reward systems , 2004, NeuroImage.

[69]  W. Schultz,et al.  Responses to reward in monkey dorsal and ventral striatum , 2004, Experimental Brain Research.

[70]  K. Doya,et al.  A Neural Correlate of Reward-Based Behavioral Learning in Caudate Nucleus: A Functional Magnetic Resonance Imaging Study of a Stochastic Decision Task , 2004, The Journal of Neuroscience.

[71]  T. Robbins,et al.  Putting a spin on the dorsal–ventral divide of the striatum , 2004, Trends in Neurosciences.

[72]  R. Dolan,et al.  Brain Responses to the Acquired Moral Status of Faces , 2004, Neuron.

[73]  M. Delgado,et al.  Modulation of Caudate Activity by Action Contingency , 2004, Neuron.

[74]  M. Delgado,et al.  Event-related functional magnetic resonance imaging of reward-related brain circuitry in children and adolescents , 2004, Biological Psychiatry.

[75]  J. O'Doherty,et al.  Reward representations and reward-related learning in the human brain: insights from neuroimaging , 2004, Current Opinion in Neurobiology.

[76]  Peter Dayan,et al.  Temporal difference models describe higher-order learning in humans , 2004, Nature.

[77]  S. Quartz,et al.  Getting to Know You: Reputation and Trust in a Two-Person Economic Exchange , 2005, Science.

[78]  Matthew T. Kaufman,et al.  Distributed Neural Representation of Expected Value , 2005, The Journal of Neuroscience.

[79]  G. Glover,et al.  The Role of Ventral Frontostriatal Circuitry in Reward-Based Learning in Humans , 2005, The Journal of Neuroscience.

[80]  W. T. Maddox,et al.  Cortical and subcortical brain regions involved in rule-based category learning , 2005, Neuroreport.

[81]  K. Doya,et al.  Representation of Action-Specific Reward Values in the Striatum , 2005, Science.

[82]  M. Delgado,et al.  Perceptions of moral character modulate the neural systems of reward during the trust game , 2005, Nature Neuroscience.

[83]  M. Delgado,et al.  Instructed smoking expectancy modulates cue-elicited neural activity: a preliminary study. , 2005, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[84]  Carol A. Seger,et al.  The Roles of the Caudate Nucleus in Human Classification Learning , 2005, The Journal of Neuroscience.

[85]  M. Kringelbach The human orbitofrontal cortex: linking reward to hedonic experience , 2005, Nature Reviews Neuroscience.

[86]  B. Balleine Neural bases of food-seeking: Affect, arousal and reward in corticostriatolimbic circuits , 2005, Physiology & Behavior.

[87]  Dirk J. Heslenfeld,et al.  Activity in human reward-sensitive brain areas is strongly context dependent , 2005, NeuroImage.

[88]  Jeffrey C. Cooper,et al.  Functional magnetic resonance imaging of reward prediction , 2005, Current opinion in neurology.

[89]  S. Inati,et al.  An fMRI study of reward-related probability learning , 2005, NeuroImage.

[90]  Jonathan D. Cohen,et al.  Imaging valuation models in human choice. , 2006, Annual review of neuroscience.

[91]  M. Delgado,et al.  Fear of losing money? Aversive conditioning with secondary reinforcers. , 2006, Social cognitive and affective neuroscience.

[92]  James L. McClelland,et al.  Performance Feedback Drives Caudate Activation in a Phonological Learning Task , 2006, Journal of Cognitive Neuroscience.

[93]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[94]  Peter Redgrave,et al.  Basal Ganglia , 2020, Encyclopedia of Autism Spectrum Disorders.