Feedback signals in the caudate reflect goal achievement on a declarative memory task

The striatum has been shown to be a key region in the processing of reward-related information. The head of the caudate nucleus has been implicated in processing performance feedback, or in other words, information about the outcomes of one's actions. However, feedback provides multiple types of information, and it is not clear which of these types of information drive a caudate response. We sought to determine whether the signal in the caudate differed when feedback was informative but only arbitrarily related to performance versus when it provided information about goal achievement. To do this, we used functional magnetic resonance imaging (fMRI) to examine caudate activation during a feedback-based paired associate word-learning task. During an initial round of 60 distinct trials, participants chose one of two responses on each trial and received feedback about whether their responses were correct. On the subsequent two rounds, the 60 trials were repeated and participants chose their responses based on their memory of the correct answer. The caudate nuclei were strongly engaged only during the second two rounds, when feedback reflected the accuracy of memory. These results support the idea that feedback-based caudate activation is context dependent: the caudate can be engaged in feedback-based declarative memory tasks, but it is more strongly engaged when feedback is "earned" by performance than when it is informative but not tied to goal achievement.

[1]  W. T. Maddox,et al.  Neural correlates of rule-based and information-integration visual category learning. , 2006, Cerebral cortex.

[2]  A. Kluger,et al.  The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. , 1996 .

[3]  J. Mazziotta,et al.  Rapid Automated Algorithm for Aligning and Reslicing PET Images , 1992, Journal of computer assisted tomography.

[4]  J. Lisman,et al.  The Hippocampal-VTA Loop: Controlling the Entry of Information into Long-Term Memory , 2005, Neuron.

[5]  Max Coltheart,et al.  The MRC Psycholinguistic Database , 1981 .

[6]  M. Gluck,et al.  Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning. , 2004, Journal of neurophysiology.

[7]  Richard S. J. Frackowiak,et al.  Anatomy of motor learning. I. Frontal cortex and attention to action. , 1997, Journal of neurophysiology.

[8]  Carol A. Seger,et al.  Dissociation between Striatal Regions while Learning to Categorize via Feedback and via Observation , 2007, Journal of Cognitive Neuroscience.

[9]  R. J. Dolan,et al.  Differential neural response to positive and negative feedback in planning and guessing tasks , 1997, Neuropsychologia.

[10]  P. Strick,et al.  Basal-ganglia 'projections' to the prefrontal cortex of the primate. , 2002, Cerebral cortex.

[11]  M. Gluck,et al.  Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. , 2004, Brain : a journal of neurology.

[12]  Emery N Brown,et al.  Behavioral / Systems / Cognitive Functional Magnetic Resonance Imaging Activity during the Gradual Acquisition and Expression of Paired-Associate Memory , 2005 .

[13]  K. Doya,et al.  A Neural Correlate of Reward-Based Behavioral Learning in Caudate Nucleus: A Functional Magnetic Resonance Imaging Study of a Stochastic Decision Task , 2004, The Journal of Neuroscience.

[14]  Nikolaus R. McFarland,et al.  Striatonigrostriatal Pathways in Primates Form an Ascending Spiral from the Shell to the Dorsolateral Striatum , 2000, The Journal of Neuroscience.

[15]  M. Petrides,et al.  Neural Bases of Set-Shifting Deficits in Parkinson's Disease , 2004, The Journal of Neuroscience.

[16]  G. Pagnoni,et al.  Human Striatal Response to Salient Nonrewarding Stimuli , 2003, The Journal of Neuroscience.

[17]  B. Knowlton,et al.  Learning and memory functions of the Basal Ganglia. , 2002, Annual review of neuroscience.

[18]  H. Yin,et al.  The role of the basal ganglia in habit formation , 2006, Nature Reviews Neuroscience.

[19]  S. Inati,et al.  An fMRI study of reward-related probability learning , 2005, NeuroImage.

[20]  R. Elliott,et al.  Dissociable functions in the medial and lateral orbitofrontal cortex: evidence from human neuroimaging studies. , 2000, Cerebral cortex.

[21]  F. Craik,et al.  The Oxford handbook of memory , 2006 .

[22]  G. Pagnoni,et al.  Human Striatal Responses to Monetary Reward Depend On Saliency , 2004, Neuron.

[23]  Craig E. L. Stark,et al.  When zero is not zero: The problem of ambiguous baseline conditions in fMRI , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[24]  L. Squire Memory systems of the brain: A brief history and current perspective , 2004, Neurobiology of Learning and Memory.

[25]  T. Robbins,et al.  Dissociation in Conditioned Dopamine Release in the Nucleus Accumbens Core and Shell in Response to Cocaine Cues and during Cocaine-Seeking Behavior in Rats , 2000, The Journal of Neuroscience.

[26]  Michael J. Frank,et al.  By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism , 2004, Science.

[27]  S. Haber,et al.  Reward-Related Cortical Inputs Define a Large Striatal Region in Primates That Interface with Associative Cortical Connections, Providing a Substrate for Incentive-Based Learning , 2006, The Journal of Neuroscience.

[28]  M. Gluck,et al.  Interactive memory systems in the human brain , 2001, Nature.

[29]  L. Squire,et al.  Robust habit learning in the absence of awareness and independent of the medial temporal lobe , 2005, Nature.

[30]  A. Dale,et al.  Building memories: remembering and forgetting of verbal experiences as predicted by brain activity. , 1998, Science.

[31]  E. Miller,et al.  Different time courses of learning-related activity in the prefrontal cortex and striatum , 2005, Nature.

[32]  M. Farah,et al.  Different underlying impairments in decision-making following ventromedial and dorsolateral frontal lobe damage in humans. , 2004, Cerebral cortex.

[33]  M. Delgado,et al.  Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations , 2003, Cognitive, affective & behavioral neuroscience.

[34]  M. Delgado,et al.  Modulation of Caudate Activity by Action Contingency , 2004, Neuron.

[35]  James L. McClelland,et al.  Performance Feedback Drives Caudate Activation in a Phonological Learning Task , 2006, Journal of Cognitive Neuroscience.

[36]  Guillén Fernández,et al.  Interaction between the Human Hippocampus and the Caudate Nucleus during Route Recognition , 2004, Neuron.

[37]  M. Delgado,et al.  Motivation-dependent responses in the human caudate nucleus. , 2004, Cerebral cortex.

[38]  J. Desmond,et al.  Making memories: brain activity that predicts how well visual experience will be remembered. , 1998, Science.

[39]  R. Cools Dopaminergic modulation of cognitive function-implications for l-DOPA treatment in Parkinson's disease , 2006, Neuroscience & Biobehavioral Reviews.

[40]  Peter W. Foltz,et al.  An introduction to latent semantic analysis , 1998 .

[41]  Ziv M. Williams,et al.  Selective enhancement of associative learning by microstimulation of the anterior caudate , 2006, Nature Neuroscience.

[42]  Jonathan D. Cohen,et al.  Improved Assessment of Significant Activation in Functional Magnetic Resonance Imaging (fMRI): Use of a Cluster‐Size Threshold , 1995, Magnetic resonance in medicine.

[43]  Robert M. Siwiec,et al.  Neural Correlates of Successful Encoding Identified Using Functional Magnetic Resonance Imaging , 2002, The Journal of Neuroscience.

[44]  H. Bergman,et al.  Information processing, dimensionality reduction and reinforcement learning in the basal ganglia , 2003, Progress in Neurobiology.

[45]  Brian Knutson,et al.  Reward-Motivated Learning: Mesolimbic Activation Precedes Memory Formation , 2006, Neuron.

[46]  John McDowall,et al.  When artificial grammar acquisition in Parkinson's disease is impaired: The case of learning via trial-by-trial feedback , 2006, Brain Research.

[47]  Richard S. J. Frackowiak,et al.  Recalling Routes around London: Activation of the Right Hippocampus in Taxi Drivers , 1997, The Journal of Neuroscience.

[48]  S. Haber,et al.  The primate substantia nigra and VTA: integrative circuitry and function. , 1997, Critical reviews in neurobiology.

[49]  T. Robbins,et al.  Functions of dopamine in the dorsal and ventral striatum , 1992 .

[50]  Karl J. Friston,et al.  Dissociable Neural Responses in Human Reward Systems , 2000, The Journal of Neuroscience.

[51]  Carol A. Seger,et al.  The Roles of the Caudate Nucleus in Human Classification Learning , 2005, The Journal of Neuroscience.

[52]  H. Heinze,et al.  Reward-Related fMRI Activation of Dopaminergic Midbrain Is Associated with Enhanced Hippocampus- Dependent Long-Term Memory Formation , 2005, Neuron.

[53]  Samuel M. McClure,et al.  Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum , 2003, Neuron.

[54]  Carol A. Seger,et al.  Striatal activation during acquisition of a cognitive skill. , 1999, Neuropsychology.

[55]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[56]  J. D. McGaugh,et al.  Inactivation of Hippocampus or Caudate Nucleus with Lidocaine Differentially Affects Expression of Place and Response Learning , 1996, Neurobiology of Learning and Memory.

[57]  R. Dolan,et al.  Dissociating prefrontal and hippocampal function in episodic memory encoding , 1997, Nature.

[58]  Larry R. Squire,et al.  The medial temporal lobe and the hippocampus. , 2000 .

[59]  Jennifer A. Mangels,et al.  A Neostriatal Habit Learning System in Humans , 1996, Science.

[60]  Dirk J. Heslenfeld,et al.  Activity in human reward-sensitive brain areas is strongly context dependent , 2005, NeuroImage.

[61]  Samuel M. McClure,et al.  Predictability Modulates Human Brain Response to Reward , 2001, The Journal of Neuroscience.

[62]  T. Robbins,et al.  Dopamine Release in the Dorsal Striatum during Cocaine-Seeking Behavior under the Control of a Drug-Associated Cue , 2002, The Journal of Neuroscience.

[63]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[64]  J. Mazziotta,et al.  MRI‐PET Registration with Automated Algorithm , 1993, Journal of computer assisted tomography.

[65]  F. Craik,et al.  Novelty and familiarity activations in PET studies of memory encoding and retrieval. , 1996, Cerebral cortex.

[66]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[67]  E. Rolls,et al.  Abstract reward and punishment representations in the human orbitofrontal cortex , 2001, Nature Neuroscience.

[68]  Brian Knutson,et al.  FMRI Visualization of Brain Activity during a Monetary Incentive Delay Task , 2000, NeuroImage.

[69]  Corey J. Bohil,et al.  Delayed feedback effects on rule-based and information-integration category learning. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[70]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[71]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.