The Cerebellum Is Involved in Reward-based Reversal Learning

The cerebellum has recently been discussed in terms of a possible involvement in reward-based associative learning. To clarify the cerebellar contribution, eight patients with focal vascular lesions of the cerebellum and a group of 24 healthy subjects matched for age and IQ were compared on a range of different probabilistic outcome-based associative learning tasks, assessing acquisition, reversal, cognitive transfer, and generalization as well as the effect of reward magnitude. Cerebellar patients showed intact acquisition of stimulus contingencies, while reward-based reversal learning was significantly impaired. In addition, the patients showed slower acquisition of new stimulus contingencies in a second reward-based learning task, which might reflect reduced carry-over effects. Reward magnitude affected learning only during initial acquisition, with better learning on trials with high rewards in patients and control subjects. Overall, the findings suggest that the cerebellum is implicated in reversal learning as a dissociable component of reward-based learning.

[1]  D. Marr.  A theory of cerebellar cortex , 1969, The Journal of physiology.

[2]  H. Nelson.  A Modified Card Sorting Test Sensitive to Frontal Lobe Defects , 1976, Cortex.

[3]  A. Hirano,et al.  AN ATLAS OF THE HUMAN BRAIN FOR COMPUTERIZED TOMOGRAPHY. , 1978 .

[4]  An Atlas of the Human Brain for Computerized Tomography , 1979 .

[5]  S. Petersen,et al.  Impaired non-motor learning and error detection associated with cerebellar damage. A single case study. , 1992, Brain : a journal of neurology.

[6]  N Birbaumer,et al.  Classical conditioning after cerebellar lesions in humans. , 1993, Behavioral neuroscience.

[7]  Robert Lalonde,et al.  Cerebellar contributions to instrumental learning , 1994, Neuroscience & Biobehavioral Reviews.

[8]  N. Mizuno,et al.  Single neurons in the ventral tegmental area that project to both the cerebral and cerebellar cortical areas by way of axon collaterals , 1994, Neuroscience.

[9]  V L Villemagne,et al.  Activation of memory circuits during cue-elicited cocaine craving. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Camilla Anne Czubaj.  The Wechsler Adult Intelligence Scale - Revised, Revisited , 1996 .

[11]  S. Lisberger,et al.  The Cerebellum: A Neuronal Learning Machine? , 1996, Science.

[12]  I. Daum,et al.  Neuropsychological abnormalities in cerebellar syndromes--fact or fiction? , 1997, International review of neurobiology.

[13]  A. Graziano,et al.  Cerebellar contribution to spatial event processing: characterization of procedural learning , 1999, Experimental Brain Research.

[14]  J Drepper,et al.  Non-motor associative learning in patients with isolated degenerative cerebellar disease. , 1999, Brain : a journal of neurology.

[15]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[16]  A. Dickinson,et al.  Neuronal coding of prediction errors. , 2000, Annual review of neuroscience.

[17]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[18]  Catherine E. Myers,et al.  Cerebellar Substrates for Error Correction in Motor Conditioning , 2001, Neurobiology of Learning and Memory.

[19]  E. Rolls,et al.  Abstract reward and punishment representations in the human orbitofrontal cortex , 2001, Nature Neuroscience.

[20]  P. Strick,et al.  Cerebellar Projections to the Prefrontal Cortex of the Primate , 2001, The Journal of Neuroscience.

[21]  W. Schultz,et al.  Changes in brain activation associated with reward processing in smokers and nonsmokers , 2001, Experimental Brain Research.

[22]  T. Robbins,et al.  Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. , 2001, Cerebral cortex.

[23]  J. Metcalfe,et al.  Neural Systems and Cue-Induced Cocaine Craving , 2002, Neuropsychopharmacology.

[24]  H. Zelaznik,et al.  The Cerebellum and Event Timing , 2002, Annals of the New York Academy of Sciences.

[25]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[26]  Eytan Ruppin,et al.  Actor-critic models of the basal ganglia: new anatomical and computational perspectives , 2002, Neural Networks.

[27]  Leslie G. Ungerleider,et al.  Experience-dependent changes in cerebellar contributions to motor sequence learning , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[28]  T. Robbins,et al.  Defining the Neural Mechanisms of Probabilistic Reversal Learning Using Event-Related Functional Magnetic Resonance Imaging , 2002, The Journal of Neuroscience.

[29]  Yu-Shin Ding,et al.  Expectation Enhances the Regional Brain Metabolic and the Reinforcing Effects of Stimulants in Cocaine Abusers , 2003, The Journal of Neuroscience.

[30]  S. Blakemore,et al.  Action prediction in the cerebellum and in the parietal lobe , 2003, Experimental Brain Research.

[31]  M. Ernst,et al.  Neural substrates of decision making in adults with attention deficit hyperactivity disorder. , 2003, The American journal of psychiatry.

[32]  M. Gluck,et al.  Dissociating Hippocampal versus Basal Ganglia Contributions to Learning and Transfer , 2003, Journal of Cognitive Neuroscience.

[33]  M. Delgado,et al.  Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations , 2003, Cognitive, affective & behavioral neuroscience.

[34]  Saori C. Tanaka,et al.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops , 2004, Nature Neuroscience.

[35]  C. Elger,et al.  Temporal and cerebellar brain regions that support both declarative memory formation and retrieval. , 2004, Cerebral cortex.

[36]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[37]  Michael J. Frank,et al.  By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism , 2004, Science.

[38]  R. Murray,et al.  The cerebellum and decision making under uncertainty. , 2004, Brain research. Cognitive brain research.

[39]  R. E. Passingham,et al.  Prediction error for free monetary reward in the human prefrontal cortex , 2004, NeuroImage.

[40]  A. Lawrence,et al.  Reward processing in health and Parkinson's disease: neural organization and reorganization. , 2004, Cerebral cortex.

[41]  J. Schmahmann.  Disorders of the cerebellum: ataxia, dysmetria of thought, and the cerebellar cognitive affective syndrome. , 2004, The Journal of neuropsychiatry and clinical neurosciences.

[42]  The Emotional Brain : Neural Correlates Of Cat Sexual Behavior And Human Male Ejaculation , 2004 .

[43]  Catherine E. Myers,et al.  Dissociation between medial temporal lobe and basal ganglia memory systems in schizophrenia , 2005, Schizophrenia Research.

[44]  R. Palmiter,et al.  Distinguishing whether dopamine regulates liking, wanting, and/or learning about rewards. , 2005, Behavioral neuroscience.

[45]  Freimut Juengling, Jungling, Jüngling,et al.  Brain activation during craving for alcohol measured by positron emission tomography. , 2006, The Australian and New Zealand journal of psychiatry.

[46]  J. O'Doherty,et al.  Human Neural Learning Depends on Reward Prediction Errors in the Blocking Paradigm , 2005, Journal of neurophysiology.

[47]  Blaise deB Frederick,et al.  Cerebellar Vermis Involvement in Cocaine-Related Behaviors , 2006, Neuropsychopharmacology.

[48]  M. D’Esposito,et al.  Reversal learning in Parkinson's disease depends on medication status and outcome valence , 2006, Neuropsychologia.

[49]  J. Gläscher,et al.  Dissociable Systems for Gain- and Loss-Related Value Predictions and Errors of Prediction in the Human Brain , 2006, The Journal of Neuroscience.

[50]  M. Frank,et al.  Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. , 2006, Psychological review.

[51]  N. Ramnani.  The primate cortico-cerebellar system: anatomy and function , 2006, Nature Reviews Neuroscience.

[52]  Kevin L. Brown,et al.  Discrimination learning and reversal of the conditioned eyeblink reflex in a rodent model of autism , 2007, Behavioural Brain Research.

[53]  M. Delgado,et al.  Reward‐Related Responses in the Human Striatum , 2007, Annals of the New York Academy of Sciences.

[54]  W. Schultz.  Behavioral dopamine signals , 2007, Trends in Neurosciences.

[55]  P. Dayan,et al.  Differential Encoding of Losses and Gains in the Human Striatum , 2007, The Journal of Neuroscience.

[56]  F. Kolb,et al.  The involvement of the human cerebellum in eyeblink conditioning , 2008, The Cerebellum.

[57]  H. Diener,et al.  Use of sequence information in associative learning in control subjects and cerebellar patients , 2008, The Cerebellum.

[58]  Christian Bellebaum,et al.  Focal basal ganglia lesions are associated with impairments in reward-based reversal learning. , 2008, Brain : a journal of neurology.

[59]  Irene Daum,et al.  Cerebellar contributions to cognitive functions: A progress report after two decades of research , 2008, The Cerebellum.

[60]  Christian Bellebaum,et al.  Aging affects acquisition and reversal of reward-based associative learning. , 2008, Learning & memory.

[61]  I. Daum,et al.  Learning‐related changes in reward expectancy are reflected in the feedback‐related negativity , 2008, The European journal of neuroscience.