Classical conditioning drives learned reward prediction signals in climbing fibers across the lateral cerebellum

Classical models of cerebellar learning posit that climbing fibers operate according to a supervised learning rule to instruct changes in motor output by signaling the occurrence of movement errors. However, cerebellar output is also associated with non-motor behaviors, and recently with modulating reward association pathways in the VTA. To test how the cerebellum processes reward related signals in the same type of classical conditioning behavior typically studied to evaluate reward processing in the VTA and striatum, we have used calcium imaging to visualize instructional signals carried by climbing fibers across the lateral cerebellum in mice before and after learning. We find distinct climbing fiber responses in three lateral cerebellar regions that can each signal reward prediction. These instructional signals are well suited to guide cerebellar learning based on reward expectation and enable a cerebellar contribution to reward driven behaviors, suggesting a broad role for the lateral cerebellum in reward-based learning.

[1]  J. Christie,et al.  Inhibition gates supralinear Ca2+ signaling in Purkinje cell dendrites during practiced movements , 2018, eLife.

[2]  Daniela Popa,et al.  Cerebellum involvement in cortical sensorimotor circuits for the control of voluntary movements , 2014, Nature Neuroscience.

[3]  D. Caplan,et al.  Cognition, emotion and the cerebellum. , 2006, Brain : a journal of neurology.

[4]  M. Ito,et al.  Neural design of the cerebellar motor control system. , 1972, Brain research.

[5]  J. Christie,et al.  Chronic imaging of movement-related Purkinje cell calcium activity in awake behaving mice. , 2016, Journal of neurophysiology.

[6]  D. Marr A theory of cerebellar cortex , 1969, The Journal of physiology.

[7]  Luke T. Coddington,et al.  The timing of action determines reward prediction signals in identified midbrain dopamine neurons , 2018, Nature Neuroscience.

[8]  R. Ivry,et al.  The neural representation of time , 2004, Current Opinion in Neurobiology.

[9]  Tatsuya Kimura,et al.  Cerebellar complex spikes encode both destinations and errors in arm movements , 1998, Nature.

[10]  D. Reis,et al.  Predatory Attack, Grooming, and Consummatory Behaviors Evoked by Electrical Stimulation of Cat Cerebellar Nuclei , 1973, Science.

[11]  Mati Joshua,et al.  Coordinated cerebellar climbing fiber activity signals learned sensorimotor predictions , 2018, bioRxiv.

[12]  Ilana B. Witten,et al.  Reward and choice encoding in terminals of midbrain dopamine neurons depends on striatal target , 2016, Nature Neuroscience.

[13]  Thomas D. Mrsic-Flogel,et al.  Cerebellar contribution to preparatory activity in motor neocortex , 2018 .

[14]  M. Häusser,et al.  Predictive and reactive reward signals conveyed by climbing fiber inputs to cerebellar Purkinje cells , 2019, Nature Neuroscience.

[15]  Frank Van Overwalle,et al.  Social cognition and the cerebellum: A meta-analysis of over 350 fMRI studies , 2014, NeuroImage.

[16]  Mario Negrello,et al.  Neurons of the inferior olive respond to broad classes of sensory input while subject to homeostatic control , 2018, bioRxiv.

[17]  Catherine J. Stoodley,et al.  The Theory and Neuroscience of Cerebellar Cognition. , 2019, Annual review of neuroscience.

[18]  Timothy J Ebner,et al.  Climbing fibers predict movement kinematics and performance errors. , 2017, Journal of neurophysiology.

[19]  J. Schmahmann An emerging concept. The cerebellar contribution to higher function. , 1991, Archives of neurology.

[20]  M. Garwicz,et al.  Anatomical and physiological foundations of cerebellar information processing , 2005, Nature Reviews Neuroscience.

[21]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[22]  Ben Deverett,et al.  Normal cognitive and social development require posterior cerebellar activity , 2018, eLife.

[23]  Richard Apps,et al.  Cerebellar cortical organization: a one-map hypothesis , 2009, Nature Reviews Neuroscience.

[24]  Michael A. Gaffield,et al.  Movement Rate Is Encoded and Influenced by Widespread, Coherent Activity of Cerebellar Molecular Layer Interneurons , 2017, The Journal of Neuroscience.

[25]  P. Strick,et al.  Activation of a cerebellar output nucleus during cognitive processing. , 1994, Science.

[26]  L. Luo,et al.  Cerebellar granule cells encode the expectation of reward , 2017, Nature.

[27]  Hermann Ackermann,et al.  Cerebellar contributions to speech production and speech perception: psycholinguistic and neurobiological perspectives , 2008, Trends in Neurosciences.

[28]  D. Heck,et al.  Cerebellar Lobulus Simplex and Crus I Differentially Represent Phase and Phase Difference of Prefrontal Cortical and Hippocampal Oscillations , 2019, Cell reports.

[29]  Mati Joshua,et al.  Cerebellar climbing fibers encode expected reward size , 2019, bioRxiv.

[30]  Aleksandra Badura,et al.  The Cerebellum, Sensitive Periods, and Autism , 2014, Neuron.

[31]  N. Uchida,et al.  Opposite initialization to novel cues in dopamine signaling in ventral and posterior striatum in mice , 2016, eLife.

[32]  George J Augustine,et al.  The cerebellum linearly encodes whisker position during voluntary movement , 2016, eLife.

[33]  P. Strick,et al.  The cerebellum communicates with the basal ganglia , 2005, Nature Neuroscience.

[34]  Shogo Ohmae,et al.  Climbing fibers encode a temporal-difference prediction error during cerebellar learning in mice , 2015, Nature Neuroscience.

[35]  Ben Deverett,et al.  Cerebellar involvement in an evidence-accumulation decision-making task , 2018, eLife.

[36]  R. Llinás,et al.  Dynamic organization of motor control within the olivocerebellar system , 1995, Nature.

[37]  J. Albus A Theory of Cerebellar Function , 1971 .

[38]  Gary Donohoe,et al.  Emotion and Theory of Mind in Schizophrenia—Investigating the Role of the Cerebellum , 2015, The Cerebellum.

[39]  I. Raman,et al.  Sensorimotor Integration and Amplification of Reflexive Whisking by Well-Timed Spiking in the Cerebellar Corticonuclear Circuit , 2018, Neuron.

[40]  D. Heck,et al.  Cerebellar cortical output encodes temporal aspects of rhythmic licking movements and is necessary for normal licking frequency , 2010, The European journal of neuroscience.

[41]  Kamran Khodakhah,et al.  Cerebellar modulation of the reward circuitry and social behavior , 2019, Science.

[42]  R. Bogacz,et al.  Action Initiation Shapes Mesolimbic Dopamine Encoding of Future Rewards , 2015, Nature Neuroscience.

[44]  George J Augustine,et al.  Serial processing of kinematic signals by cerebellar circuitry during voluntary whisking , 2017, Nature Communications.