A cerebellar population coding model for sensorimotor learning

The cerebellum plays a critical role in sensorimotor learning, and in particular using error information to keep the sensorimotor system well-calibrated. Here we present a population-coding model of how the cerebellum compensates for motor errors. The model consists of a two-layer network, one corresponding to the cerebellar cortex and the other to the deep cerebellum nuclei, where the units within each layer are tuned to two features, the direction of the movement and the direction of the error. We evaluated our model through a series of behavioral experiments that test sensorimotor adaptation across a wide range of perturbation schedules. The model successfully accounts for interference from prior learning, the effects of error uncertainties, and learning in response to perturbations that vary across different time scales. Importantly, the model does not require any modulation of the parameters or context-dependent processes during adaptation. Our results provide a novel framework to understand how context and environmental uncertainty modulate cerebellar-dependent learning.

[1]  Sabrina J. Abram,et al.  Perturbation Variability Does Not Influence Implicit Sensorimotor Adaptation , 2023, bioRxiv.

[2]  James B. Heald,et al.  Contextual inference in learning and memory , 2022, Trends in Cognitive Sciences.

[3]  R. Ivry,et al.  Signatures of contextual interference in implicit sensorimotor adaptation , 2022, bioRxiv.

[4]  R. Ivry,et al.  The Effect of Perturbation Variability on Sensorimotor Adaptation Does Not Require an Implicit Memory of Errors , 2022, bioRxiv.

[5]  A. Collins,et al.  Context is key for learning motor skills , 2021, Nature.

[6]  R. Shadmehr,et al.  Synchronous spiking of cerebellar Purkinje cells during control of movements , 2021, bioRxiv.

[7]  Jordan A. Taylor,et al.  Implicit adaptation to mirror-reversal is in the correct coordinate system but the wrong direction , 2021, bioRxiv.

[8]  Hyosub E. Kim,et al.  Reexposure to a sensorimotor perturbation produces opposite effects on explicit and implicit learning processes , 2021, PLoS biology.

[9]  Scott T. Albert,et al.  Competition between parallel sensorimotor learning systems , 2020, bioRxiv.

[10]  Máté Lengyel,et al.  Contextual inference underlies the learning of sensorimotor repertoires , 2020, Nature.

[11]  Reza Shadmehr,et al.  Population coding in the cerebellum: a machine learning perspective. , 2020, Journal of neurophysiology.

[12]  N. Daw,et al.  A model for learning based on the joint estimation of stochasticity and volatility , 2020, Nature Communications.

[13]  Hyosub E. Kim,et al.  The Psychology of Reaching: Action Selection, Movement Implementation, and Sensorimotor Learning. , 2020, Annual review of psychology.

[14]  R. Ivry,et al.  Contextual effects in sensorimotor adaptation adhere to associative learning rules , 2020, bioRxiv.

[15]  David J. Herzfeld,et al.  Principles of operation of a cerebellar learning circuit , 2020, eLife.

[16]  Richard B. Ivry,et al.  Continuous Reports of Sensed Hand Position During Sensorimotor Adaptation , 2020, bioRxiv.

[17]  Richard B. Ivry,et al.  The Effect of Visual Uncertainty on Implicit Motor Adaptation , 2020, bioRxiv.

[18]  Cathrin B. Canto,et al.  Cerebellar plasticity and associative memories are controlled by perineuronal nets , 2019, Proceedings of the National Academy of Sciences.

[19]  Jordan A. Taylor,et al.  Implicit Visuomotor Adaptation Remains Limited after Several Days of Training , 2019, eNeuro.

[20]  Alireza Soltani,et al.  Adaptive learning under expected and unexpected uncertainty , 2019, Nature Reviews Neuroscience.

[21]  Reza Shadmehr,et al.  The origins of anterograde interference in visuomotor adaptation , 2019, bioRxiv.

[22]  Egidio D’Angelo,et al.  Long-Lasting Response Changes in Deep Cerebellar Nuclei in vivo Correlate With Low-Frequency Oscillations , 2019, Front. Cell. Neurosci..

[23]  Guy Avraham,et al.  Environmental Consistency Modulation of Error Sensitivity During Motor Adaptation is Explicitly Controlled , 2019, bioRxiv.

[24]  Sarah A Hutter,et al.  Relative sensitivity of explicit re-aiming and implicit motor adaptation , 2018, bioRxiv.

[25]  Dominik Endres,et al.  Learning from the past: A reverberation of past errors in the cerebellar climbing fiber signal , 2018, PLoS biology.

[26]  R. Shadmehr,et al.  Encoding of error and learning to correct that error by the Purkinje cells of the cerebellum , 2018, Nature Neuroscience.

[27]  Anne G. E. Collins,et al.  The tortoise and the hare: interactions between reinforcement learning and working memory , 2017, bioRxiv.

[28]  Reza Moazzezi,et al.  Invariant errors reveal limitations in motor correction rather than constraints on error sensitivity , 2017, Communications Biology.

[29]  Richard B. Ivry,et al.  Characteristics of Implicit Sensorimotor Adaptation Revealed by Task-irrelevant Clamped Feedback , 2017, Journal of Cognitive Neuroscience.

[30]  G. Hesslow,et al.  Mechanisms for motor timing in the cerebellar cortex , 2016, Current Opinion in Behavioral Sciences.

[31]  Yoshiko Kojima,et al.  Encoding of action by the Purkinje cells of the cerebellum , 2015, Nature.

[32]  Jordan A Taylor,et al.  Explicit and Implicit Processes Constitute the Fast and Slow Processes of Sensorimotor Learning , 2015, The Journal of Neuroscience.

[33]  Katrina Y. Choe,et al.  Circuit Mechanisms Underlying Motor Memory Formation in the Cerebellum , 2015, Neuron.

[34]  Joseph T. McGuire,et al.  Functionally Dissociable Influences on Learning Rate in a Dynamic Environment , 2014, Neuron.

[35]  A. Rugy,et al.  Anodal motor cortex stimulation paired with movement repetition increases anterograde interference but not savings , 2014, The European journal of neuroscience.

[36]  Maurice A. Smith,et al.  Environmental Consistency Determines the Rate of Motor Adaptation , 2014, Current Biology.

[37]  J. Krakauer,et al.  Explicit and Implicit Contributions to Learning in a Sensorimotor Adaptation Task , 2014, The Journal of Neuroscience.

[38]  Reza Shadmehr,et al.  Cerebellum estimates the sensory state of the body , 2014, Trends in Cognitive Sciences.

[39]  C. Mathys,et al.  Hierarchical Prediction Errors in Midbrain and Basal Forebrain during Sensory Learning , 2013, Neuron.

[40]  Hermann Ebbinghaus (1885) Memory: A Contribution to Experimental Psychology , 2013, Annals of Neurosciences.

[41]  Tycho M. Hoogland,et al.  Strength and timing of motor responses mediated by rebound firing in the cerebellar nuclei after Purkinje cell activation , 2013, Front. Neural Circuits.

[42]  D. Wolpert,et al.  Context-Dependent Decay of Motor Memories during Skill Acquisition , 2013, Current Biology.

[43]  Robert C. Wilson,et al.  Rational regulation of learning dynamics by pupil–linked arousal systems , 2012, Nature Neuroscience.

[44]  E. Koechlin,et al.  Reasoning, Learning, and Creativity: Frontal Lobe Function and Human Decision-Making , 2012, PLoS biology.

[45]  R. Ivry,et al.  An Explicit Strategy Prevails When the Cerebellum Fails to Compute Movement Errors , 2010, The Cerebellum.

[46]  Gary C. Sing,et al.  Reduction in Learning Rates Associated with Anterograde Interference Results from Interactions between Different Timescales in Motor Adaptation , 2010, PLoS Comput. Biol..

[47]  C. Gilbert,et al.  Perceptual learning and adult cortical plasticity , 2009, The Journal of physiology.

[48]  W. Regehr,et al.  Inhibitory Regulation of Electrically Coupled Neurons in the Inferior Olive Is Mediated by Asynchronous Release of GABA , 2009, Neuron.

[49]  Konrad Paul Kording,et al.  Relevance of error: what drives motor adaptation? , 2009, Journal of neurophysiology.

[50]  Timothy J. Ebner,et al.  Cerebellum Predicts the Future Motor State , 2008, The Cerebellum.

[51]  Stephen G. Lisberger,et al.  Links from complex spikes to local plasticity and motor learning in the cerebellum of awake-behaving monkeys , 2008, Nature Neuroscience.

[52]  Konrad Paul Kording,et al.  The dynamics of memory as a consequence of optimal adaptation to a changing body , 2007, Nature Neuroscience.

[53]  R. Shadmehr,et al.  Interacting Adaptive Processes with Different Timescales Underlie Short-Term Motor Learning , 2006, PLoS biology.

[54]  J. Krakauer,et al.  An Implicit Plan Overrides an Explicit Strategy during Visuomotor Adaptation , 2006, The Journal of Neuroscience.

[55]  J. Wixted The psychology and neuroscience of forgetting. , 2004, Annual review of psychology.

[56]  Daniel M. Wolpert,et al.  Hierarchical MOSAIC for movement generation , 2003 .

[57]  Masao Ito Mechanisms of motor learning in the cerebellum 1 1 Published on the World Wide Web on 24 November 2000. , 2000, Brain Research.

[58]  Javier F. Medina,et al.  Timing Mechanisms in the Cerebellum: Testing Predictions of a Large-Scale Computer Simulation , 2000, The Journal of Neuroscience.

[59]  P. Thier,et al.  Saccadic Dysmetria and Adaptation after Lesions of the Cerebellar Cortex , 1999, The Journal of Neuroscience.

[60]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[61]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[62]  P. Viviani,et al.  Pointing errors reflect biases in the perception of the initial hand position. , 1998, Journal of neurophysiology.

[63]  M. Mauk,et al.  Pharmacological analysis of cerebellar contributions to the timing and expression of conditioned eyelid responses , 1998, Neuropharmacology.

[64]  E. Bizzi,et al.  Consolidation in human motor memory , 1996, Nature.

[65]  S. Lisberger,et al.  The Cerebellum: A Neuronal Learning Machine? , 1996, Science.

[66]  G. Orban,et al.  Human perceptual learning in identifying the oblique orientation: retinotopy, orientation specificity and monocularity. , 1995, The Journal of physiology.

[67]  C. I. Zeeuw,et al.  Olivary projecting neurons in the nucleus of Darkschewitsch in the cat receive excitatory monosynaptic input from the cerebellar nuclei , 1994, Brain Research.

[68]  S G Lisberger,et al.  Responses during eye movements of brain stem neurons that receive monosynaptic inhibition from the flocculus and ventral paraflocculus in monkeys. , 1994, Journal of neurophysiology.

[69]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[70]  Masao Ito,et al.  Long-lasting depression of parallel fiber-Purkinje cell transmission induced by conjunctive stimulation of parallel fibers and climbing fibers in the cerebellar cortex , 1982, Neuroscience Letters.

[71]  J. Shea,et al.  Contextual interference effects on the acquisition, retention, and transfer of a motor skill. , 1979 .

[72]  J. Albus A Theory of Cerebellar Function , 1971 .

[73]  D. Marr A theory of cerebellar cortex , 1969, The Journal of physiology.

[74]  L. E. Ross,et al.  Rabbit eyelid conditioning: Effects of age, interstimulus interval, and intertrial interval , 1968 .

[75]  M. C. Smith,et al.  CS-US interval and US intensity in classical conditioning of the rabbit's nictitating membrane response. , 1968, Journal of comparative and physiological psychology.

[76]  I. Gormezano,et al.  CONDITIONING OF THE NICTITATING MEMBRANE OF THE RABBIT AS A FUNCTION OF CS-US INTERVAL. , 1964, Journal of comparative and physiological psychology.

[77]  A. T. Mathers,et al.  Conditioned Reflexes. An Investigation of the Physiological Activity of the Cerebral Cortex , 1927 .

[78]  R. Ivry,et al.  Cerebellar and prefrontal cortex contributions to adaptation, strategies, and reinforcement learning. , 2014, Progress in brain research.

[79]  Germund Hesslow,et al.  Cerebellar control of the inferior olive , 2008, The Cerebellum.

[80]  M. Glickstein,et al.  Classical conditioning of the nictitating membrane response of the rabbit , 2004, Experimental Brain Research.

[81]  Mitsuo Kawato,et al.  Feedback-Error-Learning Neural Network for Supervised Motor Learning , 1990 .

[82]  M. Ito Cerebellar control of the vestibulo-ocular reflex--around the flocculus hypothesis. , 1982, Annual review of neuroscience.