Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations

The goal of this research was to further our understanding of how the striatum responds to the delivery of affective feedback. Previously, we had found that the striatum showed a pattern of sustained activation after presentation of a monetary reward, in contrast to a decrease in the hemodynamic response after a punishment. In this study, we tested whether the activity of the striatum could be modulated by parametric variations in the amount of financial reward or punishment. We used an event-related fMRI design in which participants received large or small monetary rewards or punishments after performance in a gambling task. A parametric ordering of conditions was observed in the dorsal striatum according to both magnitude and valence. In addition, an early response to the presentation of feedback was observed and replicated in a second experiment with increased temporal resolution. This study further implicates the dorsal striatum as an integral component of a reward circuitry responsible for the control of motivated behavior, serving to code for such feedback properties as valence and magnitude.

[1]  L. Crespi.  Quantitative variation of incentive and performance in the white rat. , 1942 .

[2]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[3]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[4]  H. Lesieur,et al.  The South Oaks Gambling Screen (SaGS): A New Instrument for the Identification of Pathological Gamblers , 2010 .

[5]  O. Hikosaka,et al.  Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. , 1989, Journal of neurophysiology.

[6]  T. Robbins,et al.  Functions of dopamine in the dorsal and ventral striatum , 1992 .

[7]  R. Turner,et al.  Dynamic magnetic resonance imaging of human brain activity during primary sensory stimulation. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[8]  W. Schultz,et al.  Neuronal activity in monkey ventral striatum related to the expectation of reward , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  W. Schultz,et al.  Neuronal activity in monkey striatum related to the expectation of predictable environmental events. , 1992, Journal of neurophysiology.

[10]  G. McCarthy,et al.  Dynamic mapping of the human visual cortex by high-speed magnetic resonance imaging. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[11]  J. Mazziotta,et al.  Rapid Automated Algorithm for Aligning and Reslicing PET Images , 1992, Journal of computer assisted tomography.

[12]  James L. McGaugh,et al.  Amygdala modulates memory for changes in reward magnitude: Reversible post-training inactivation with lidocaine attenuates the response to a reduction in reward , 1993, Behavioural Brain Research.

[13]  J. Mazziotta,et al.  MRI‐PET Registration with Automated Algorithm , 1993, Journal of computer assisted tomography.

[14]  A. Graybiel,et al.  Responses of tonically active neurons in the primate's striatum undergo systematic changes during behavioral sensorimotor conditioning , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[15]  J. Cohen,et al.  Spiral K‐space MR imaging of cortical activation , 1995, Journal of magnetic resonance imaging : JMRI.

[16]  Jonathan D. Cohen,et al.  Improved Assessment of Significant Activation in Functional Magnetic Resonance Imaging (fMRI): Use of a Cluster‐Size Threshold , 1995, Magnetic resonance in medicine.

[17]  E. Lynd-Balta,et al.  The orbital and medial prefrontal circuit through the primate basal ganglia , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  V J Brown,et al.  Discriminative Cues Indicating Reward Magnitude Continue to Determine Reaction Time of Rats Following Lesions of the Nucleus Accumbens , 1995, The European journal of neuroscience.

[19]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[20]  T. Robbins,et al.  Neurobehavioural mechanisms of reward and motivation , 1996, Current Opinion in Neurobiology.

[21]  B Macwhinney,et al.  The PsyScope experiment-building system. , 1997, Spatial vision.

[22]  Leslie G. Ungerleider,et al.  Transient and sustained activity in a distributed neural system for human working memory , 1997, Nature.

[23]  G. Koob,et al.  The neurobiology of drug addiction. , 1997, The Journal of neuropsychiatry and clinical neurosciences.

[24]  Edward E. Smith,et al.  Temporal dynamics of brain activation during a working memory task , 1997, Nature.

[25]  B. Richmond,et al.  Neuronal Signals in the Monkey Ventral Striatum Related to Progress through a Predictable Series of Trials , 1998, The Journal of Neuroscience.

[26]  M. D’Esposito,et al.  The variability of human BOLD hemodynamic responses , 1998, NeuroImage.

[27]  A. Dale,et al.  Functional-Anatomic Correlates of Object Priming in Humans Revealed by Rapid Presentation Event-Related fMRI , 1998, Neuron.

[28]  J. Hollerman,et al.  Influence of reward expectation on behavior-related neuronal activity in primate striatum. , 1998, Journal of neurophysiology.

[29]  N. White,et al.  Contributions of the hippocampus, amygdala, and dorsal striatum to the response elicited by reward reduction. , 1998, Behavioral neuroscience.

[30]  D. Brooks,et al.  Evidence for striatal dopamine release during a video game , 1998, Nature.

[31]  J. Hollerman,et al.  Reward prediction in primate basal ganglia and frontal cortex , 1998, Neuropharmacology.

[32]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[33]  R. Buckner,et al.  Human Brain Mapping 6:373–377(1998) � Event-Related fMRI and the Hemodynamic Response , 2022 .

[34]  R. Elliott,et al.  Abnormal neural response to feedback on planning and guessing tasks in patients with unipolar depression , 1998, Psychological Medicine.

[35]  G. Chiara,et al.  Drug Addiction as a Disorder of Associative Learning: Role of Nucleus Accumbens Shell/Extended Amygdala Dopamine , 1999, Annals of the New York Academy of Sciences.

[36]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[37]  P. Bandettini.  The temporal resolution of Functional MRI , 1999 .

[38]  H. Breiter,et al.  Functional Magnetic Resonance Imaging of Brain Reward Circuitry in the Human , 1999, Annals of the New York Academy of Sciences.

[39]  T. Robbins,et al.  Choosing between Small, Likely Rewards and Large, Unlikely Rewards Activates Inferior and Orbital Prefrontal Cortex , 1999, The Journal of Neuroscience.

[40]  G. Koob.  The Role of the Striatopallidal and Extended Amygdala Systems in Drug Addiction , 1999, Annals of the New York Academy of Sciences.

[41]  H. Groenewegen,et al.  Convergence and Segregation of Ventral Striatal Inputs and Outputs , 1999, Annals of the New York Academy of Sciences.

[42]  Advancing from the Ventral Striatum to the Extended Amygdala: Implications for Neuropsychiatry and Drug Abuse. Conference in honor of Lennart Heimer. Charlottesville, Virginia, USA. October 18-21, 1998. , 1999, Annals of the New York Academy of Sciences.

[43]  M. Posner.  The Brain and Emotion , 1999, Nature Medicine.

[44]  T. Robbins,et al.  Associative Processes in Addiction and Reward The Role of Amygdala‐Ventral Striatal Subsystems , 1999, Annals of the New York Academy of Sciences.

[45]  J. McGinty.  Advancing from the ventral striatum to the extended amygdala. Implications for neuropsychiatry and drug abuse. Introduction. , 1999, Annals of the New York Academy of Sciences.

[46]  P. Strick,et al.  Basal Ganglia Output and Cognition: Evidence from Anatomical, Behavioral, and Clinical Studies , 2000, Brain and Cognition.

[47]  Carlo Contoreggi,et al.  Drug abusers show impaired performance in a laboratory test of decision making , 2000, Neuropsychologia.

[48]  E. Rolls.  The orbitofrontal cortex and reward. , 2000, Cerebral cortex.

[49]  J. Hollerman,et al.  Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior. , 2000, Progress in brain research.

[50]  Joseph E LeDoux.  Emotion circuits in the brain. , 2009, Annual review of neuroscience.

[51]  Brian Knutson,et al.  FMRI Visualization of Brain Activity during a Monetary Incentive Delay Task , 2000, NeuroImage.

[52]  A. Damasio,et al.  Emotion, decision making and the orbitofrontal cortex. , 2000, Cerebral cortex.

[53]  Karl J. Friston,et al.  Dissociable Neural Responses in Human Reward Systems , 2000, The Journal of Neuroscience.

[54]  W. Schultz.  Multiple reward signals in the brain , 2000, Nature Reviews Neuroscience.

[55]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[56]  Samuel M. McClure,et al.  Predictability Modulates Human Brain Response to Reward , 2001, The Journal of Neuroscience.

[57]  W. Schultz,et al.  Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. , 2001, Journal of neurophysiology.

[58]  D. Ariely,et al.  Beautiful Faces Have Variable Reward Value fMRI and Behavioral Evidence , 2001, Neuron.

[59]  D. Kahneman,et al.  Functional Imaging of Neural Responses to Expectancy and Experience of Monetary Gains and Losses tasks with monetary payoffs , 2001 .

[60]  C. Cepko,et al.  The External Granule Layer of the Developing Chick Cerebellum Generates Granule Cells and Cells of the Isthmus and Rostral Hindbrain , 2001, The Journal of Neuroscience.

[61]  E. Rolls,et al.  Abstract reward and punishment representations in the human orbitofrontal cortex , 2001, Nature Neuroscience.

[62]  Brian Knutson,et al.  Dissociation of reward anticipation and outcome with event-related fMRI , 2001, Neuroreport.

[63]  Randy L. Buckner,et al.  Functional Neuroimaging Methods: PET and fMRI , 2001 .

[64]  Brian Knutson,et al.  Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens , 2001, The Journal of Neuroscience.

[65]  O. Hikosaka,et al.  A neural correlate of response bias in monkey caudate nucleus , 2002, Nature.

[66]  O. Hikosaka,et al.  Feature-Based Anticipation of Cues that Predict Reward in Monkey Caudate Nucleus , 2002, Neuron.

[67]  N. Volkow,et al.  “Nonhedonic” food motivation in humans involves dopamine in the dorsal striatum and methylphenidate amplifies this effect , 2002, Synapse.

[68]  P. Montague,et al.  Activity in human ventral striatum locked to errors of reward prediction , 2002, Nature Neuroscience.

[69]  T. Robbins,et al.  Dopamine Release in the Dorsal Striatum during Cocaine-Seeking Behavior under the Control of a Drug-Associated Cue , 2002, The Journal of Neuroscience.

[70]  Mitsuru Kawamura,et al.  Pure Topographical Disorientation —The Anatomical Basis of Landmark Agnosia , 2002, Cortex.

[71]  W. Schultz,et al.  Responses to reward in monkey dorsal and ventral striatum , 2004, Experimental Brain Research.