Differential cingulate and caudate activation following unexpected nonrewarding stimuli

This study examined the effects of varying the predictability of nonrewarding events on behavior and neural activation using a rapid mixed-trial functional magnetic resonance imagery (fMRI) design. Twelve adult subjects were scanned with echo planar imaging during performance of a visual detection task where the probability of events (target and nontarget) varied. This task included expected and unexpected nonrewarding events (expected target, unexpected nontarget, and omission of target) in a design that closely parallels studies of dopamine function and reward processing in the alert monkey. We predicted that activation in dopamine-rich areas of the forebrain would behave like the animal literature shows that dopamine neurons in the midbrain behave. Specifically, we predicted increased activity in these regions when an unexpected event occurred and decreased activity when an expected event was omitted. Two main regions, the anterior cingulate and dorsal striatum, showed this pattern. The response in these regions was distinguished by enhanced anterior cingulate activity following the occurrence of an unexpected event and greater suppression of caudate activity following the omission of an expected event. These results suggest that neural activity within specific dopamine-rich brain regions can be modulated by violations in the expectation of nonrewarding events and that the direction of the modulation depends on the nature of the violations.

[1]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[2]  J. Cohen,et al.  Context, cortex, and dopamine: a connectionist approach to behavior and biology in schizophrenia. , 1992, Psychological review.

[3]  W. Schultz,et al.  Neuronal activity in monkey ventral striatum related to the expectation of reward , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  B. J. Casey,et al.  Evidence for a mechanistic model of cognitive control , 2001, Clinical Neuroscience Research.

[5]  K. Fuxe,et al.  Evidence for the existence of monoamine neurons in the central nervous system , 1965, Zeitschrift für Zellforschung und Mikroskopische Anatomie.

[6]  Karl J. Friston,et al.  Dissociable neural responses associated with reward, punishment and risk-taking , 1999 .

[7]  M. Botvinick,et al.  The Contribution of the Anterior Cingulate Cortex to Executive Processes in Cognition , 1999, Reviews in the neurosciences.

[8]  J. Hollerman,et al.  Reward processing in primate orbitofrontal cortex and basal ganglia. , 2000, Cerebral cortex.

[9]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[10]  J. Saint-Cyr Frontal-striatal circuit functions: Context, sequence, and consequence , 2003, Journal of the International Neuropsychological Society.

[11]  G. Pagnoni,et al.  Human Striatal Responses to Monetary Reward Depend On Saliency , 2004, Neuron.

[12]  Jonathan D. Cohen,et al.  Conflict monitoring versus selection-for-action in anterior cingulate cortex , 1999, Nature.

[13]  Brian Knutson,et al.  Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens , 2001, The Journal of Neuroscience.

[14]  S. Rauch,et al.  Anterior cingulate cortex dysfunction in attention-deficit/hyperactivity disorder revealed by fMRI and the counting stroop , 1999, Biological Psychiatry.

[15]  S. Haber,et al.  Immunocytochemical localization of the dopamine transporter in human brain , 1999, The Journal of comparative neurology.

[16]  B. Berger,et al.  Catecholamine innervation of the human cerebral cortex as revealed by comparative immunohistochemistry of tyrosine hydroxylase and dopamine‐beta‐hydroxylase , 1989, The Journal of comparative neurology.

[17]  Brian Knutson,et al.  Dissociation of reward anticipation and outcome with event-related fMRI , 2001, Neuroreport.

[18]  D. Kahneman,et al.  Functional Imaging of Neural Responses to Expectancy and Experience of Monetary Gains and Losses tasks with monetary payoffs , 2001 .

[19]  Brian Knutson,et al.  FMRI Visualization of Brain Activity during a Monetary Incentive Delay Task , 2000, NeuroImage.

[20]  W. Schultz Activity of dopamine neurons in the behaving primate , 1992 .

[21]  B. J. Casey,et al.  Clinical, imaging, lesion, and genetic approaches toward a model of cognitive control. , 2002, Developmental psychobiology.

[22]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[23]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[24]  R. Elliott,et al.  Differential Response Patterns in the Striatum and Orbitofrontal Cortex to Financial Reward in Humans: A Parametric Functional Magnetic Resonance Imaging Study , 2003, The Journal of Neuroscience.

[25]  E. Rolls,et al.  Abstract reward and punishment representations in the human orbitofrontal cortex , 2001, Nature Neuroscience.

[26]  J. Horvitz Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events , 2000, Neuroscience.

[27]  A. Dickinson,et al.  Neuronal coding of prediction errors. , 2000, Annual review of neuroscience.

[28]  E. Rolls,et al.  Representation of pleasant and aversive taste in the human brain. , 2001, Journal of neurophysiology.

[29]  M. Botvinick,et al.  Anterior cingulate cortex, error detection, and the online monitoring of performance. , 1998, Science.

[30]  Brian Knutson,et al.  A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI , 2003, NeuroImage.

[31]  J. Mazziotta,et al.  MRI‐PET Registration with Automated Algorithm , 1993, Journal of computer assisted tomography.

[32]  P. Montague,et al.  Neural Economics and the Biological Substrates of Valuation , 2002, Neuron.

[33]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[34]  Edward E. Smith,et al.  Temporal dynamics of brain activation during a working memory task , 1997, Nature.

[35]  J D Cohen,et al.  A network model of catecholamine effects: gain, signal-to-noise ratio, and behavior. , 1990, Science.

[36]  W. Schultz,et al.  Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[37]  J. Hollerman,et al.  Reward prediction in primate basal ganglia and frontal cortex , 1998, Neuropharmacology.

[38]  Jonathan D. Cohen,et al.  Improved Assessment of Significant Activation in Functional Magnetic Resonance Imaging (fMRI): Use of a Cluster‐Size Threshold , 1995, Magnetic resonance in medicine.

[39]  Jonathan D. Cohen,et al.  Cognition and control in schizophrenia: a computational model of dopamine and prefrontal function , 1999, Biological Psychiatry.

[40]  Karl J. Friston,et al.  Dissociable Neural Responses in Human Reward Systems , 2000, The Journal of Neuroscience.

[41]  Samuel M. McClure,et al.  Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum , 2003, Neuron.

[42]  W. Schultz,et al.  Reward-related activity in the monkey striatum and substantia nigra. , 1993, Progress in brain research.

[43]  S. Keele,et al.  Toward a Functional Analysis of the Basal Ganglia , 1998, Journal of Cognitive Neuroscience.

[44]  A. Smit,et al.  Synapse Formation between Central Neurons Requires Postsynaptic Expression of the MEN1 Tumor Suppressor Gene , 2001, The Journal of Neuroscience.

[45]  H. Critchley,et al.  Neural Activity in the Human Brain Relating to Uncertainty and Arousal during Anticipation , 2001, Neuron.

[46]  Joseph A Mindell,et al.  The Poststructural Festivities Begin , 2003, Neuron.

[47]  A. Dale,et al.  Selective averaging of rapidly presented individual trials using fMRI , 1997, Human brain mapping.

[48]  K. Berridge,et al.  What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? , 1998, Brain Research Reviews.

[49]  M. Delgado,et al.  Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations , 2003, Cognitive, affective & behavioral neuroscience.

[50]  J. Horvitz,et al.  Burst activity of ventral tegmental dopamine neurons is elicited by sensory stimuli in the awake cat , 1997, Brain Research.

[51]  T. Robbins,et al.  Neurobehavioural mechanisms of reward and motivation , 1996, Current Opinion in Neurobiology.

[52]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[53]  P. Redgrave,et al.  Is the short-latency dopamine response too short to signal reward error? , 1999, Trends in Neurosciences.

[54]  G H Glover,et al.  Selective effects of methylphenidate in attention deficit hyperactivity disorder: a functional magnetic resonance study. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[55]  G. Pagnoni,et al.  Human Striatal Response to Salient Nonrewarding Stimuli , 2003, The Journal of Neuroscience.

[56]  W. Schultz Getting Formal with Dopamine and Reward , 2002, Neuron.

[57]  B. J. Casey,et al.  The Effect of Preceding Context on Inhibition: An Event-Related fMRI Study , 2002, NeuroImage.

[58]  E T Rolls,et al.  Responses to the Sensory Properties of Fat of Neurons in the Primate Orbitofrontal Cortex , 1999, The Journal of Neuroscience.

[59]  P. Montague,et al.  Activity in human ventral striatum locked to errors of reward prediction , 2002, Nature Neuroscience.

[60]  Daniel Y. Kimberg,et al.  Cognitive effects of the dopamine receptor agonist pergolide , 2003, Neuropsychologia.

[61]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[62]  E. Crone,et al.  Dissociation of response conflict, attentional selection, and expectancy with functional magnetic resonance imaging. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[63]  P. Dayan,et al.  Reward, Motivation, and Reinforcement Learning , 2002, Neuron.

[64]  D. Brooks,et al.  Evidence for striatal dopamine release during a video game , 1998, Nature.

[65]  A. Syrota,et al.  In Vivo Detection of Striatal Dopamine Release during Reward: A PET Study with [11C]Raclopride and a Single Dynamic Scan Approach , 2002, NeuroImage.

[66]  M. Corbetta,et al.  Selective and divided attention during visual discriminations of shape, color, and speed: functional anatomy by positron emission tomography , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[67]  Aziz M. Ulug,et al.  Parametric manipulation of conflict and response competition using rapid mixed-trial event-related fMRI , 2003, NeuroImage.

[68]  S. Haber The primate basal ganglia: parallel and integrative networks , 2003, Journal of Chemical Neuroanatomy.

[69]  J. Swanson,et al.  Dopamine in drug abuse and addiction: results from imaging studies and treatment implications , 2004, Molecular Psychiatry.

[70]  R. O’Reilly,et al.  A computational approach to prefrontal cortex, cognitive control and schizophrenia: recent developments and current challenges. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[71]  Samuel M. McClure,et al.  Predictability Modulates Human Brain Response to Reward , 2001, The Journal of Neuroscience.

[72]  B. J. Casey,et al.  Differential patterns of striatal activation in young children with and without ADHD , 2003, Biological Psychiatry.

[73]  T. Robbins,et al.  Interaction of the Dopaminergic System With Mechanisms of Associative Learning and Cognition: Implications for Drug Abuse , 1999 .

[74]  J. O'Doherty,et al.  Neural Responses during Anticipation of a Primary Taste Reward , 2002, Neuron.

[75]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.