Encoding of eye movements explains reward-related activity in cerebellar simple spikes.

The cerebellum exhibits both motor and reward-related signals. However, it remains unclear whether reward is processed independently from the motor command or might reflect the motor consequences of the reward drive. To test how reward-related signals interact with sensorimotor processing in the cerebellum, we recorded Purkinje cell simple spike activity in the cerebellar floccular complex while monkeys were engaged in smooth pursuit eye movement tasks. The color of the target signaled the size of the reward the monkeys would receive at the end of the target motion. When the tracking task presented a single target, both pursuit and neural activity were only slightly modulated by the reward size. The reward modulations in single cells were rarely large enough to be detected. These modulations were only significant in the population analysis when we averaged across many neurons. In two-target tasks where the monkey learned to select based on the size of the reward outcome, both behavior and neural activity adapted rapidly. In both the single and two target tasks, the size of the reward-related modulation matched the size of the effect of reward on behavior. Thus, unlike cortical activity in eye movement structures, the reward-related signals could not be dissociated from the motor command. These results suggest that reward information is integrated with the eye movement command upstream to the Purkinje cells in the floccular complex. Thus, reward-related modulations of the simple spikes are akin to modulations found in motor behavior and not to the central processing of the reward value.

[1]  Andreea C. Bostan,et al.  The basal ganglia and the cerebellum: nodes in an integrated network , 2018, Nature Reviews Neuroscience.

[2]  E. Vaadia,et al.  Encoding of probabilistic rewarding and aversive events by pallidal and nigral neurons. , 2009, Journal of neurophysiology.

[3]  Daeyeol Lee,et al.  Ubiquity and Specificity of Reinforcement Signals throughout the Human Brain , 2011, Neuron.

[4]  L. Optican,et al.  Cerebellar-dependent adaptive control of primate saccadic system. , 1980, Journal of neurophysiology.

[5]  S. Lisberger,et al.  Visual responses of Purkinje cells in the cerebellar flocculus during smooth-pursuit eye movements in monkeys. II. Complex spikes. , 1990, Journal of neurophysiology.

[6]  M. Schwarz,et al.  The Cerebellum Is Involved in Reward-based Reversal Learning , 2008, The Cerebellum.

[7]  S G Lisberger,et al.  Visual motion commands for pursuit eye movements in the cerebellum. , 1991, Science.

[8]  A. Fuchs,et al.  Afferents to the flocculus of the cerebellum in the rhesus macaque as revealed by retrograde transport of horseradish peroxidase , 1985, The Journal of comparative neurology.

[9]  O. Hikosaka,et al.  Comparison of Reward Modulation in the Frontal Eye Field and Caudate of the Macaque , 2006, The Journal of Neuroscience.

[10]  Rhea R. Kimpo,et al.  Cerebellar Purkinje cell activity drives motor learning , 2013, Nature Neuroscience.

[11]  Stephen G Lisberger,et al.  Reward Action in the Initiation of Smooth Pursuit Eye Movements , 2012, The Journal of Neuroscience.

[12]  D. A. Suzuki,et al.  The role of the flocculus of the monkey in fixation and smooth pursuit eye movements. , 1979, The Journal of physiology.

[13]  R. Llinás,et al.  Electrophysiological properties of in vitro Purkinje cell somata in mammalian cerebellar slices. , 1980, The Journal of physiology.

[14]  S G Lisberger,et al.  The neural basis for learning of simple motor skills. , 1988, Science.

[15]  Mati Joshua,et al.  Using extracellular low frequency signals to improve the spike sorting of cerebellar complex spikes , 2019, Journal of Neuroscience Methods.

[16]  J. Albus A Theory of Cerebellar Function , 1971 .

[17]  William E. Allen,et al.  Thirst regulates motivated behavior through modulation of brainwide neural population dynamics , 2019, Science.

[18]  Yoshiko Kojima,et al.  Encoding of action by the Purkinje cells of the cerebellum , 2015, Nature.

[19]  Michael N. Economo,et al.  A cortico-cerebellar loop for motor planning , 2018, Nature.

[20]  Kamran Khodakhah,et al.  Cerebellar modulation of the reward circuitry and social behavior , 2019, Science.

[21]  Konrad Paul Kording,et al.  Premotor and Motor Cortices Encode Reward , 2016, PloS one.

[22]  S. Lisberger,et al.  Variation, Signal, and Noise in Cerebellar Sensory–Motor Processing for Smooth-Pursuit Eye Movements , 2007, The Journal of Neuroscience.

[23]  A. Fuchs,et al.  Floccular efferents in the rhesus macaque as revealed by autoradiography and horseradish peroxidase , 1985, The Journal of comparative neurology.

[24]  Stephen G Lisberger,et al.  Diversity of Neural Responses in the Brainstem during Smooth Pursuit Eye Movements Constrains the Circuit Mechanisms of Neural Integration , 2013, The Journal of Neuroscience.

[25]  Seiji Ono,et al.  Smooth Pursuit–Related Information Processing in Frontal Eye Field Neurons that Project to the NRTP , 2008, Cerebral cortex.

[26]  M. Häusser,et al.  Predictive and reactive reward signals conveyed by climbing fiber inputs to cerebellar Purkinje cells , 2019, Nature Neuroscience.

[27]  Links from complex spikes to local plasticity and motor learning in the cerebellum of awake-behaving monkeys. , 2008, Nature neuroscience.

[28]  M. Joshua,et al.  Dissecting patterns of preparatory activity in the frontal eye fields during pursuit target selection. , 2017, Journal of neurophysiology.

[29]  L. Luo,et al.  Cerebellar granule cells encode the expectation of reward , 2017, Nature.

[30]  R. E. Passingham,et al.  Prediction error for free monetary reward in the human prefrontal cortex , 2004, NeuroImage.

[31]  Ben Deverett,et al.  Cerebellar involvement in an evidence-accumulation decision-making task , 2018, eLife.

[32]  William Heffley,et al.  Classical conditioning drives learned reward prediction signals in climbing fibers across the lateral cerebellum , 2019, eLife.

[33]  J. Schmahmann Disorders of the cerebellum: ataxia, dysmetria of thought, and the cerebellar cognitive affective syndrome. , 2004, The Journal of neuropsychiatry and clinical neurosciences.

[34]  A. Mikami,et al.  Discharges of neurons in the dorsal paraflocculus of monkeys during eye movements and visual stimulation. , 1986, Journal of neurophysiology.

[35]  C. Rashbass,et al.  The relationship between saccadic and smooth tracking eye movements , 1961, The Journal of physiology.

[36]  Stephen G Lisberger,et al.  Responses of Purkinje cells in the oculomotor vermis of monkeys during smooth pursuit eye movements and saccades: comparison with floccular complex. , 2017, Journal of neurophysiology.

[37]  Stephen G Lisberger,et al.  Role of Plasticity at Different Sites across the Time Course of Cerebellar Motor Learning , 2014, The Journal of Neuroscience.

[38]  Masao Ito,et al.  Consensus Paper: The Cerebellum's Role in Movement and Cognition , 2013, The Cerebellum.

[39]  F A Miles,et al.  Role of the oculomotor vermis in generating pursuit and saccades: effects of microstimulation. , 1998, Journal of neurophysiology.

[40]  Reza Shadmehr,et al.  Encoding of error and learning to correct that error by the Purkinje cells of the cerebellum , 2018, Nature Neuroscience.

[41]  Ziv M. Williams,et al.  Selective enhancement of associative learning by microstimulation of the anterior caudate , 2006, Nature Neuroscience.

[42]  P. Strick,et al.  Cerebellar Loops with Motor Cortex and Prefrontal Cortex of a Nonhuman Primate , 2003, The Journal of Neuroscience.

[43]  W. T. Thach,et al.  Purkinje cell activity during motor learning , 1977, Brain Research.

[44]  Thomas D. Mrsic-Flogel,et al.  Cerebellar Contribution to Preparatory Activity in Motor Neocortex , 2018, Neuron.

[45]  Greg Wayne,et al.  A temporal basis for predicting the sensory consequences of motor commands in an electric fish , 2014, Nature Neuroscience.

[46]  M. Joshua,et al.  Cerebellar climbing fibers encode expected reward size , 2019, eLife.

[47]  Visuomotor Cerebellum in Human and Nonhuman Primates , 2010, The Cerebellum.

[48]  Stephen G Lisberger,et al.  A framework for using signal, noise, and variation to determine whether the brain controls movement synergies or single muscles. , 2014, Journal of neurophysiology.

[49]  M. Kawato,et al.  Inverse-dynamics model eye movement control by Purkinje cells in the cerebellum , 1993, Nature.

[50]  S. Lisberger,et al.  Interactions between target location and reward size modulate the rate of microsaccades in monkeys. , 2015, Journal of neurophysiology.

[51]  Jun Maruta,et al.  Identifying Purkinje cells using only their spontaneous simple spike activity , 2014, Journal of Neuroscience Methods.

[52]  Peter W Dicke,et al.  Encoding of smooth-pursuit eye movement initiation by a population of vermal Purkinje cells. , 2012, Cerebral cortex.

[53]  Mati Joshua,et al.  Encoding of Reward and Decoding Movement from the Frontal Eye Field during Smooth Pursuit Eye Movements , 2018, The Journal of Neuroscience.

[54]  William R. Softky,et al.  Comparison of discharge variability in vitro and in vivo in cat visual cortex neurons. , 1996, Journal of neurophysiology.

[55]  D. Zee,et al.  Effects of lesions of the oculomotor vermis on eye movements in primate: saccades. , 1998, Journal of neurophysiology.

[56]  O. Hikosaka,et al.  Modulation of saccadic eye movements by predicted reward outcome , 2001, Experimental Brain Research.

[57]  J. Raymond,et al.  Timing Rules for Synaptic Plasticity Matched to Behavioral Function , 2016, Neuron.

[58]  K. Fukushima,et al.  No-go neurons in the cerebellar oculomotor vermis and caudal fastigial nuclei: planning tracking eye movements , 2013, Experimental Brain Research.

[59]  D. Marr A theory of cerebellar cortex , 1969, The Journal of physiology.

[60]  S. Lisberger,et al.  Neural basis for motor learning in the vestibuloocular reflex of primates. II. Changes in the responses of horizontal gaze velocity Purkinje cells in the cerebellar flocculus and ventral paraflocculus. , 1994, Journal of neurophysiology.

[61]  R. F. Thompson,et al.  Neuronal responses of the rabbit cerebellum during acquisition and performance of a classically conditioned nictitating membrane-eyelid response , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[62]  A. Fuchs,et al.  Role of primate flocculus during rapid behavioral modification of vestibuloocular reflex. I. Purkinje cell activity during visually guided horizontal smooth-pursuit eye movements and passive head rotation. , 1978, Journal of neurophysiology.

[63]  Mati Joshua,et al.  Coordinated cerebellar climbing fiber activity signals learned sensorimotor predictions , 2018, bioRxiv.

[64]  Konrad Paul Kording,et al.  Role of expected reward in frontal eye field during natural scene search. , 2016, Journal of neurophysiology.

[65]  P. Thier,et al.  Role of the Vermal Cerebellum in Visually Guided Eye Movements and Visual Motion Perception. , 2019, Annual review of vision science.

[66]  Saori C. Tanaka,et al.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops , 2004, Nature Neuroscience.

[67]  B. Hayden,et al.  Neurons in Anterior Cingulate Cortex Multiplex Information about Reward and Action , 2010, The Journal of Neuroscience.

[68]  Shane A. Heiney,et al.  Probabilistic Identification of Cerebellar Cortical Neurones across Species , 2013, PloS one.

[69]  Masao Ito,et al.  Climbing fibre induced depression of both mossy fibre responsiveness and glutamate sensitivity of cerebellar Purkinje cells , 1982, The Journal of physiology.

[70]  M. Roesch,et al.  Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex. , 2003, Journal of neurophysiology.

[71]  P. Thier,et al.  The oculomotor role of the pontine nuclei and the nucleus reticularis tegmenti pontis. , 2006, Progress in brain research.

[72]  H. Bergman,et al.  Frontiers in Systems Neuroscience Systems Neuroscience Materials and Methods , 2022 .