50 Years Since the Marr, Ito, and Albus Models of the Cerebellum

Fifty years have passed since David Marr, Masao Ito, and James Albus proposed seminal models of cerebellar functions. These models share the essential concept that parallel-fiber-Purkinje-cell synapses undergo plastic changes, guided by climbing-fiber activities during sensorimotor learning. However, they differ in several important respects, including holistic versus complementary roles of the cerebellum, pattern recognition versus control as computational objectives, potentiation versus depression of synaptic plasticity, teaching signals versus error signals transmitted by climbing-fibers, sparse expansion coding by granule cells, and cerebellar internal models. In this review, we evaluate different features of the three models based on recent computational and experimental studies. While acknowledging that the three models have greatly advanced our understanding of cerebellar control mechanisms in eye movements and classical conditioning, we propose a new direction for computational frameworks of the cerebellum, that is, hierarchical reinforcement learning with multiple internal models.

[1]  Masaki Tanaka,et al.  Entrained neuronal activity to periodic visual stimuli in the primate striatum compared with the cerebellum , 2019, eLife.

[2]  Akiyo Takahashi,et al.  Optogenetic Control of Synaptic AMPA Receptor Endocytosis Reveals Roles of LTD in Motor Learning , 2018, Neuron.

[3]  Wei Zhang,et al.  Long-Term Depression at the Mossy Fiber–Deep Cerebellar Nucleus Synapse , 2006, The Journal of Neuroscience.

[4]  D. Linden The Return of the Spike Postsynaptic Action Potentials and the Induction of LTP and LTD , 1999, Neuron.

[5]  M. Sakurai Synaptic modification of parallel fibre‐Purkinje cell transmission in in vitro guinea‐pig cerebellar slices. , 1987, The Journal of physiology.

[6]  Katrina Y. Choe,et al.  Circuit Mechanisms Underlying Motor Memory Formation in the Cerebellum , 2015, Neuron.

[7]  M. Kawato,et al.  A hierarchical neural-network model for control and learning of voluntary movement , 2004, Biological Cybernetics.

[8]  Michael Häusser,et al.  Multimodal sensory integration in single cerebellar granule cells in vivo , 2015, eLife.

[9]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Y. Dan,et al.  Spike timing-dependent plasticity: a Hebbian learning rule. , 2008, Annual review of neuroscience.

[11]  D. Armstrong,et al.  Activity patterns of cerebellar cortical neurones and climbing fibre afferents in the awake cat. , 1979, The Journal of physiology.

[12]  Thomas D. Mrsic-Flogel,et al.  Cerebellar contribution to preparatory activity in motor neocortex , 2018 .

[13]  Martina Sgritta,et al.  Hebbian Spike-Timing Dependent Plasticity at the Cerebellar Input Stage , 2017, The Journal of Neuroscience.

[14]  Martin T. Wiechert,et al.  Synaptic diversity enables temporal coding of coincident multi-sensory inputs in single neurons , 2015, Nature Neuroscience.

[15]  S. Nagao,et al.  Motor learning in common marmosets: Vestibulo-ocular reflex adaptation and its sensitivity to inhibitors of Purkinje cell long-term depression , 2014, Neuroscience Research.

[16]  T. Hirano,et al.  Occurrence of long-term depression in the cerebellar flocculus during adaptation of optokinetic response , 2018, eLife.

[17]  M. Horne,et al.  Comparison of the basal ganglia in rats, marmosets, macaques, baboons, and humans: Volume and neuronal number for the output, internal relay, and striatal modulating nuclei , 2002, The Journal of comparative neurology.

[18]  Mitsuo Kawato,et al.  Adaptive feedback control models of the vestibulocerebellum and spinocerebellum , 2004, Biological Cybernetics.

[19]  M. Kawato,et al.  Exploration of Signal Transduction Pathways in Cerebellar Long-Term Depression by Kinetic Simulation , 2001, The Journal of Neuroscience.

[20]  M. Ito,et al.  Pharmacological properties of the postsynaptic inhibition by Purkinje cell axons and the action of γ-aminobutyric acid on Deiters neurones , 2004, Experimental Brain Research.

[21]  Germund Hesslow,et al.  Simple and Complex Spike Firing Patterns in Purkinje Cells During Classical Conditioning , 2008, The Cerebellum.

[22]  Nathaniel B. Sawtell,et al.  Neural Mechanisms for Predicting the Sensory Consequences of Behavior: Insights from Electrosensory Systems. , 2017, Annual review of physiology.

[23]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[24]  M. Kawato,et al.  Inverse-dynamics model eye movement control by Purkinje cells in the cerebellum , 1993, Nature.

[25]  T. Holy,et al.  Sensory Experience Remodels Genome Architecture in Neural Circuit to Drive Motor Learning , 2019, Nature.

[26]  Xiaofeng Lu,et al.  Anatomical evidence for the involvement of medial cerebellar output from the interpositus nuclei in cognitive functions , 2012, Proceedings of the National Academy of Sciences.

[27]  Mitsuo Kawato,et al.  Multiple Model-Based Reinforcement Learning , 2002, Neural Computation.

[28]  M. Häusser,et al.  High-fidelity transmission of sensory information by single cerebellar mossy fibre boutons , 2007, Nature.

[29]  Tadashi Yamazaki,et al.  Long-term depression as a model of cerebellar plasticity. , 2014, Progress in brain research.

[30]  George J Augustine,et al.  Precise Control of Movement Kinematics by Optogenetic Inhibition of Purkinje Cell Activity , 2014, The Journal of Neuroscience.

[31]  Mitsuo Kawato,et al.  Nitric Oxide Regulates Input Specificity of Long-Term Depression and Context Dependence of Cerebellar Learning , 2006, PLoS Comput. Biol..

[32]  Thomas D. Mrsic-Flogel,et al.  Cerebellar Contribution to Preparatory Activity in Motor Neocortex , 2018, Neuron.

[33]  M. Kawato,et al.  Internal forward models in the cerebellum: fMRI study on grip force and load force coupling. , 2003, Progress in brain research.

[34]  T. Ebner,et al.  Force field effects on cerebellar Purkinje cell discharge with implications for internal models , 2006, Nature Neuroscience.

[35]  Andrei Khilkevich,et al.  A cerebellar adaptation to uncertain inputs , 2018, Science Advances.

[36]  R. Huganir,et al.  Reevaluating the Role of LTD in Cerebellar Motor Learning , 2011, Neuron.

[37]  Surya Ganguli,et al.  Shared Cortex-Cerebellum Dynamics in the Execution and Learning of a Motor Task , 2019, Cell.

[38]  A. Joyner,et al.  Morphology, molecular codes, and circuitry produce the three-dimensional complexity of the cerebellum. , 2007, Annual review of cell and developmental biology.

[39]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[40]  Mitsuo Kawato,et al.  Adaptive coupling of inferior olive neurons in cerebellar learning , 2013, Neural Networks.

[41]  Shane A. Heiney,et al.  Chromatin remodeling inactivates activity genes and regulates neural coding , 2016, Science.

[42]  D. Marr A theory of cerebellar cortex , 1969, The Journal of physiology.

[43]  Yan Yang,et al.  Duration of complex-spikes grades Purkinje cell plasticity and cerebellar motor learning , 2014, Nature.

[44]  Masaki Tanaka,et al.  Cerebellar Roles in Self-Timing for Sub- and Supra-Second Intervals , 2017, The Journal of Neuroscience.

[45]  Yusuke Murayama,et al.  Unravelling cerebellar pathways with high temporal precision targeting motor and extensive sensory and parietal networks , 2012, Nature Communications.

[46]  Terrence J. Sejnowski,et al.  Unsupervised Learning , 2018, Encyclopedia of GIS.

[47]  Tracy M. Yamawaki,et al.  Evolution of pallium, hippocampus, and cortical cell types revealed by single-cell transcriptomics in reptiles , 2018, Science.

[48]  Jennifer L. Raymond,et al.  Depressed by Learning—Heterogeneity of the Plasticity Rules at Parallel Fiber Synapses onto Purkinje Cells , 2018, The Cerebellum.

[49]  M. Ito,et al.  Cerebellar long-term depression: characterization, signal transduction, and functional roles. , 2001, Physiological reviews.

[50]  Ruben Portugues,et al.  Sensorimotor Representations in Cerebellar Granule Cells in Larval Zebrafish Are Dense, Spatially Organized, and Non-temporally Patterned , 2017, Current Biology.

[51]  Jennifer L Raymond,et al.  Computational Principles of Supervised Learning in the Cerebellum. , 2018, Annual review of neuroscience.

[52]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[53]  D. Wolpert,et al.  The cerebellum is involved in predicting the sensory consequences of action , 1999, Neuroreport.

[54]  Masao Ito The molecular organization of cerebellar long-term depression , 2002, Nature Reviews Neuroscience.

[55]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[56]  Joshua G. Hale,et al.  Using Humanoid Robots to Study Human Behavior , 2000, IEEE Intell. Syst..

[57]  Zhenyu Gao,et al.  Distributed synergistic plasticity and cerebellar learning , 2012, Nature Reviews Neuroscience.

[58]  Jerome Carriot,et al.  Learning to expect the unexpected: rapid updating in primate cerebellum during voluntary self-motion , 2015, Nature Neuroscience.

[59]  Masao Ito Control of mental activities by internal models in the cerebellum , 2008, Nature Reviews Neuroscience.

[60]  H J G Gundersen,et al.  No change in neuron numbers in the dentate nucleus of patients with schizophrenia estimated with a new stereological method – the smooth fractionator , 2004, Journal of anatomy.

[61]  Yoshiko Kojima,et al.  Encoding of action by the Purkinje cells of the cerebellum , 2015, Nature.

[62]  M. Mauk,et al.  A Mechanism for Savings in the Cerebellum , 2001, The Journal of Neuroscience.

[63]  Masao Ito Cerebellar circuitry as a neuronal machine , 2006, Progress in Neurobiology.

[64]  Tadashi Yamazaki,et al.  Revisiting a Theory of Cerebellar Cortex , 2019, Neuroscience Research.

[65]  A. Takemura,et al.  Visual inputs to cerebellar ventral paraflocculus during ocular following responses. , 1996, Progress in brain research.

[66]  Aaron R. Seitz,et al.  Learning what to expect , 2013 .

[67]  Mitsuo Kawato,et al.  The neural and cognitive architecture for learning from a small sample , 2018, Current Opinion in Neurobiology.

[68]  N. Yozbatiran,et al.  Diffusion tensor imaging of the human cerebellar pathways and their interplay with cerebral macrostructure , 2015, Front. Neuroanat..

[69]  Magnus Borga,et al.  Hierarchical Reinforcement Learning , 1993 .

[70]  Sumio Watanabe Algebraic Geometry and Statistical Learning Theory , 2009 .

[71]  Abigail L. Person,et al.  Cerebellar Loops: A Review of the Nucleocortical Pathway , 2013, The Cerebellum.

[72]  Kazuyuki Aihara,et al.  The role of chaotic resonance in cerebellar learning , 2010, Neural Networks.

[73]  M. Kawato,et al.  Shared neural correlates for language and tool use in Broca's area , 2009, Neuroreport.

[74]  T Tyrrell,et al.  Cerebellar cortex: its simulation and the relevance of Marr's theory. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[75]  伊藤 正男 The cerebellum and neural control , 1984 .

[76]  M. Kawato,et al.  Non-commercial Research and Educational Use including without Limitation Use in Instruction at Your Institution, Sending It to Specific Colleagues That You Know, and Providing a Copy to Your Institution's Administrator. All Other Uses, Reproduction and Distribution, including without Limitation Comm , 2022 .

[77]  Eduardo Ros,et al.  Distributed Circuit Plasticity: New Clues for the Cerebellar Mechanisms of Learning , 2016, The Cerebellum.

[78]  Naveen Sendhilnathan,et al.  Neural Correlates of Reinforcement Learning in Mid-lateral Cerebellum , 2020, Neuron.

[79]  Masahiko Watanabe,et al.  Structure–Function Relationships between Aldolase C/Zebrin II Expression and Complex Spike Synchrony in the Cerebellum , 2015, The Journal of Neuroscience.

[80]  S. M. Morton,et al.  Mechanisms of cerebellar gait ataxia , 2008, The Cerebellum.

[81]  Douglas R. Wylie,et al.  More on climbing fiber signals and their consequence(s) , 1996 .

[82]  Junichiro Yoshimoto,et al.  A Kinetic Model of Dopamine- and Calcium-Dependent Striatal Synaptic Plasticity , 2010, PLoS Comput. Biol..

[83]  伊藤 正男 The cerebellum : brain for an implicit self , 2012 .

[84]  M. Kawato,et al.  Encoding of movement dynamics by Purkinje cell simple spike activity during fast arm movements under resistive and assistive force fields. , 2007, Journal of neurophysiology.

[85]  P. Greengard,et al.  Dichotomous Dopaminergic Control of Striatal Synaptic Plasticity , 2008, Science.

[86]  K. Obata,et al.  Monosynaptic inhibition of the intracerebellar nuclei induced from the cerebellar cortex , 1964, Experientia.

[87]  Sarah E. Criscimagna-Hemminger,et al.  Cerebellar Contributions to Reach Adaptation and Learning Sensory Consequences of Action , 2012, The Journal of Neuroscience.

[88]  G. Allen,et al.  Cerebrocerebellar communication systems. , 1974, Physiological reviews.

[89]  N. Ramnani The primate cortico-cerebellar system: anatomy and function , 2006, Nature Reviews Neuroscience.

[90]  Jesse M. Lingeman,et al.  How Do You Learn to Walk? Thousands of Steps and Dozens of Falls per Day , 2012, Psychological science.

[91]  M. Kawato,et al.  New insights into olivo-cerebellar circuits for learning from a small training sample , 2017, Current Opinion in Neurobiology.

[92]  V. Han,et al.  Reversible Associative Depression and Nonassociative Potentiation at a Parallel Fiber Synapse , 2000, Neuron.

[93]  M. Barrot,et al.  Clusters of cerebellar Purkinje cells control their afferent climbing fiber discharge , 2013, Proceedings of the National Academy of Sciences.

[94]  Johannes Schmidt-Hieber,et al.  Nonparametric regression using deep neural networks with ReLU activation function , 2017, The Annals of Statistics.

[95]  Emanuel Todorov,et al.  Iterative Linear Quadratic Regulator Design for Nonlinear Biological Movement Systems , 2004, ICINCO.

[96]  Jan Evangelista Purkinje Purkinje Cells , 2002 .

[97]  Masaki Tanaka,et al.  Different contributions of preparatory activity in the basal ganglia and cerebellum for self-timing , 2018, eLife.

[98]  M. Kawato,et al.  Temporal firing patterns of Purkinje cells in the cerebellar ventral paraflocculus during ocular following responses in monkeys I. Simple spikes. , 1998, Journal of neurophysiology.

[99]  Claude-Nicolas Fiechter,et al.  Efficient reinforcement learning , 1994, COLT '94.

[100]  Andrew K. Wise,et al.  Systematic Regional Variations in Purkinje Cell Spiking Patterns , 2014, PloS one.

[101]  M. Häusser,et al.  Predictive and reactive reward signals conveyed by climbing fiber inputs to cerebellar Purkinje cells , 2019, Nature Neuroscience.

[102]  Kamran Khodakhah,et al.  Cerebellar modulation of the reward circuitry and social behavior , 2019, Science.

[103]  Tracy M. Yamawaki,et al.  The reptilian brain , 2015, Current Biology.

[104]  I. Sugihara,et al.  Convergence of unisensory-evoked signals via multiple pathways to the cerebellum , 2019, bioRxiv.

[105]  Gordon M. Shepherd,et al.  Neocortical Lamination: Insights from Neuron Types and Evolutionary Precursors , 2017, Front. Neuroanat..

[106]  Mitsuo Kawato,et al.  Cerebellar Activity Evoked By Common Tool-Use Execution And Imagery Tasks: An Fmri Study , 2007, Cortex.

[107]  K Kawano,et al.  Inverse‐Dynamics Representation of Eye Movements by Cerebellar Purkinje Cell Activity during Short‐Latency Ocular‐Following Responses , 1996, Annals of the New York Academy of Sciences.

[108]  M. Kawato,et al.  Metacognition facilitates the exploitation of unconscious brain states , 2019, bioRxiv.

[109]  Jessica X. Brooks,et al.  The Primate Cerebellum Selectively Encodes Unexpected Self-Motion , 2013, Current Biology.

[110]  Wulfram Gerstner,et al.  Spike-timing dependent plasticity , 2010, Scholarpedia.

[111]  M. Häusser,et al.  Propagation of action potentials in dendrites depends on dendritic morphology. , 2001, Journal of neurophysiology.

[112]  D. Wolpert,et al.  Central cancellation of self-produced tickle sensation , 1998, Nature Neuroscience.

[113]  J. Raymond,et al.  Timing Rules for Synaptic Plasticity Matched to Behavioral Function , 2016, Neuron.

[114]  H. Jörntell,et al.  Questioning the role of sparse coding in the brain , 2015, Trends in Neurosciences.

[115]  Jeanette Kotaleski,et al.  Transient Calcium and Dopamine Increase PKA Activity and DARPP-32 Phosphorylation , 2006, PLoS Comput. Biol..

[116]  Joseph E LeDoux,et al.  Parallels between cerebellum- and amygdala-dependent conditioning , 2002, Nature Reviews Neuroscience.

[117]  M Ito,et al.  Neurophysiological aspects of the cerebellar motor control system. , 1970, International journal of neurology.

[118]  M. Yuzaki,et al.  Interneuronal NMDA receptors regulate long‐term depression and motor learning in the cerebellum , 2018, The Journal of physiology.

[119]  N. Yamaguchi,et al.  Pathology of the cerebellar dentate and interpositus nuclei in Joseph disease: a morphometric investigation , 1992, Journal of the Neurological Sciences.

[120]  R. Llinás,et al.  Electrophysiological properties of in vitro Purkinje cell dendrites in mammalian cerebellar slices. , 1980, The Journal of physiology.

[121]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[122]  Stefan Schaal,et al.  Forward models in visuomotor control. , 2002, Journal of neurophysiology.

[123]  Nathaniel B Sawtell,et al.  Neural mechanisms for filtering self-generated sensory signals in cerebellum-like circuits , 2011, Current Opinion in Neurobiology.

[124]  M. Fujita,et al.  Adaptive filter model of the cerebellum , 1982, Biological Cybernetics.

[125]  Greg Wayne,et al.  A temporal basis for predicting the sensory consequences of motor commands in an electric fish , 2014, Nature Neuroscience.

[126]  Henrik Jörntell,et al.  Properties of Somatosensory Synaptic Integration in Cerebellar Granule Cells In Vivo , 2006, The Journal of Neuroscience.

[127]  J. Kotaleski,et al.  Subcellular interactions between parallel fibre and climbing fibre signals in purkinje cells predict sensitivity of classical conditioning to interstimulus interval , 2002, Integrative physiological and behavioral science : the official journal of the Pavlovian Society.

[128]  Nicolas Le Novère,et al.  DARPP-32 Is a Robust Integrator of Dopamine and Glutamate Signals , 2006, PLoS Comput. Biol..

[129]  Tadashi Yamazaki,et al.  Modeling memory consolidation during posttraining periods in cerebellovestibular learning , 2015, Proceedings of the National Academy of Sciences.

[130]  Soichi Nagao,et al.  Tandem internal models execute motor learning in the cerebellum , 2018, Proceedings of the National Academy of Sciences.

[131]  O. Oscarsson,et al.  Projections to lateral vestibular nucleus from cerebellar climbing fiber zones , 1978, Experimental Brain Research.

[132]  S. Wang,et al.  Coincidence detection in single dendritic spines mediated by calcium release , 2000, Nature Neuroscience.

[133]  M. Goldberg,et al.  Neural Correlates of Reinforcement Learning in Mid-lateral Cerebellum , 2020, Neuron.

[134]  Christopher H. Yeo,et al.  Cerebellar Function in Consolidation of a Motor Memory , 2002, Neuron.

[135]  Chris I. De Zeeuw,et al.  High Frequency Burst Firing of Granule Cells Ensures Transmission at the Parallel Fiber to Purkinje Cell Synapse at the Cost of Temporal Coding , 2013, Front. Neural Circuits.

[136]  Mitsuo Kawato,et al.  Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning , 2006, Neural Networks.

[137]  Mitsuo Kawato,et al.  Systems Biology Perspectives on Cerebellar Long-Term Depression , 2008, Neurosignals.

[138]  Mitsuo Kawato,et al.  MOSAIC Model for Sensorimotor Learning and Control , 2001, Neural Computation.

[139]  M. Kawato,et al.  Modular organization of internal models of tools in the human cerebellum , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[140]  M. Kawato,et al.  Inositol 1,4,5-Trisphosphate-Dependent Ca2+ Threshold Dynamics Detect Spike Timing in Cerebellar Purkinje Cells , 2005, The Journal of Neuroscience.

[141]  K. Doya,et al.  Unsupervised learning of granule cell sparse codes enhances cerebellar adaptive control , 2001, Neuroscience.

[142]  D. Nicholson,et al.  Addition of inhibition in the olivocerebellar system and the ontogeny of a motor memory , 2003, Nature Neuroscience.

[143]  R Angus Silver,et al.  The Contribution of Single Synapses to Sensory Representation in Vivo , 2008, Science.

[144]  R. Nicoll,et al.  Excitatory synaptic currents in Purkinje cells , 1990, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[145]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[146]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[147]  D. Linden,et al.  Long-term synaptic depression. , 1995, Annual review of neuroscience.

[148]  Yasushi Nakada,et al.  Normal motor learning during pharmacological prevention of Purkinje cell long-term depression. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[149]  P. Strick,et al.  Cerebellum and nonmotor function. , 2009, Annual review of neuroscience.

[150]  A. Bastian Learning to predict the future: the cerebellum adapts feedforward movement control , 2006, Current Opinion in Neurobiology.

[151]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[152]  J. Albus A Theory of Cerebellar Function , 1971 .

[153]  Masao Ito,et al.  Climbing fibre induced depression of both mossy fibre responsiveness and glutamate sensitivity of cerebellar Purkinje cells , 1982, The Journal of physiology.

[154]  Mitsuo Kawato,et al.  Cerebellar supervised learning revisited: biophysical modeling and degrees-of-freedom control , 2011, Current Opinion in Neurobiology.

[155]  Masato Inoue,et al.  Error Signals in Motor Cortices Drive Adaptation in Reaching , 2016, Neuron.

[156]  Masao Ito,et al.  Reassessment of long-term depression in cerebellar Purkinje cells in mice carrying mutated GluA2 C terminus , 2016, Proceedings of the National Academy of Sciences.

[157]  Hiroshi Imamizu,et al.  Human cerebellar activity reflecting an acquired internal model of a new tool , 2000, Nature.

[158]  Zhanmin Lin,et al.  Excitatory Cerebellar Nucleocortical Circuit Provides Internal Amplification during Associative Conditioning , 2016, Neuron.

[159]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[160]  Mitsuo Kawato,et al.  A computational model of four regions of the cerebellum based on feedback-error learning , 2004, Biological Cybernetics.

[161]  M. Yamamoto,et al.  Topographical representation of vestibulo-ocular reflexes in rabbit cerebellar flocculus , 1982, Neuroscience.

[162]  Gordon Cheng,et al.  Learning to select primitives and generate sub-goals from practice , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[163]  Mitsuo Kawato,et al.  MOSAIC for Multiple-Reward Environments , 2008 .

[164]  G S Brindley,et al.  Nerve net models of plausible size that perform many simple learning tasks , 1969, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[165]  C. C. Bell,et al.  Effect of electric organ discharge on ampullary receptors in a mormyrid , 1978, Brain Research.

[166]  A H Guenther,et al.  IEEE (Institute of Electrical and Electronics Engineers) International Pulsed Power Conference on (2nd) Held in Lubbock, Texas on 12-14 June 1979 (Digest of Technical Papers) , 1980 .

[167]  Mati Joshua,et al.  Cerebellar climbing fibers encode expected reward size , 2019, bioRxiv.

[168]  Aleksandra Badura,et al.  Cerebellar Granule Cells: Dense, Rich and Evolving Representations , 2017, Current Biology.

[169]  Dmitry Berenson,et al.  What Happened at the DARPA Robotics Challenge Finals , 2018 .

[170]  Kenji Doya,et al.  Symbolization and Imitation Learning of Motion Sequence Using Competitive Modules , 2006 .

[171]  Yoshikazu Isomura,et al.  Modular organization of cerebellar climbing fiber inputs during goal-directed behavior , 2019, eLife.

[172]  Masao Ito,et al.  Long-lasting depression of parallel fiber-Purkinje cell transmission induced by conjunctive stimulation of parallel fibers and climbing fibers in the cerebellar cortex , 1982, Neuroscience Letters.

[173]  Richard Apps,et al.  Cerebellar cortical organization: a one-map hypothesis , 2009, Nature Reviews Neuroscience.

[174]  Mitsuo Kawato,et al.  Computational study on monkey VOR adaptation and smooth pursuit based on the parallel control-pathway theory. , 2002, Journal of neurophysiology.

[175]  J. Simpson,et al.  Microcircuitry and function of the inferior olive , 1998, Trends in Neurosciences.

[176]  M. Iino,et al.  Cross Talk between Metabotropic and Ionotropic Glutamate Receptor-Mediated Signaling in Parallel Fiber-Induced Inositol 1,4,5-Trisphosphate Production in Cerebellar Purkinje Cells , 2004, The Journal of Neuroscience.

[177]  M. Jeannerod,et al.  Plasticity of the vestibulo-ocular reflex. , 1979, Acta oto-rhino-laryngologica Belgica.

[178]  João Fayad,et al.  A quantitative framework for whole-body coordination reveals specific deficits in freely walking ataxic mice , 2015, eLife.

[179]  M. Kawato,et al.  Computational studies on acquisition and adaptation of ocular following responses based on cerebellar synaptic plasticity. , 2002, Journal of neurophysiology.

[180]  M. Häusser,et al.  Initiation and spread of sodium action potentials in cerebellar purkinje cells , 1994, Neuron.

[181]  George J. Augustine,et al.  Graded Control of Climbing-Fiber-Mediated Plasticity and Learning by Inhibition in the Cerebellum , 2018, Neuron.

[182]  B. Widrow,et al.  Stationary and nonstationary learning characteristics of the LMS adaptive filter , 1976, Proceedings of the IEEE.

[183]  Mitsuo Kawato,et al.  Feedback-error-learning neural network for trajectory control of a robotic manipulator , 1988, Neural Networks.

[184]  K. Doya,et al.  A unifying computational framework for motor control and social interaction. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[185]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[186]  Soichi Nagao,et al.  Effects of reversible pharmacological shutdown of cerebellar flocculus on the memory of long-term horizontal vestibulo-ocular reflex adaptation in monkeys , 2010, Neuroscience Research.

[187]  E. Gardner,et al.  Optimal storage properties of neural network models , 1988 .

[188]  M. Ito,et al.  The cerebellar-evoked monosynaptic inhibition of Deiters' neurones , 1964, Experientia.

[189]  D. Angelaki,et al.  Neural Representation of Orientation Relative to Gravity in the Macaque Cerebellum , 2013, Neuron.

[190]  M. Farrant,et al.  Climbing‐fibre activation of NMDA receptors in Purkinje cells of adult mice , 2007, The Journal of physiology.

[191]  Shogo Ohmae,et al.  Climbing fibers encode a temporal-difference prediction error during cerebellar learning in mice , 2015, Nature Neuroscience.

[192]  Reza Shadmehr,et al.  Computational nature of human adaptive control during learning of reaching movements in force fields , 1999, Biological Cybernetics.

[193]  R. Weale Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[194]  M. Kawato,et al.  Ca2+ Requirements for Cerebellar Long-Term Synaptic Depression: Role for a Postsynaptic Leaky Integrator , 2007, Neuron.

[195]  Mitsuo Kawato,et al.  Recognition of manipulated objects by motor learning with modular architecture networks , 1991, Neural Networks.

[196]  J. Simpson,et al.  Visual climbing fiber input to rabbit vestibulo-cerebellum: a source of direction-specific information. , 1974, Brain research.

[197]  T. Hirano,et al.  Depression and potentiation of the synaptic transmission between a granule cell and a Purkinje cell in rat cerebellar culture , 1990, Neuroscience Letters.

[198]  Shogo Ohmae,et al.  Temporally Specific Sensory Signals for the Detection of Stimulus Omission in the Primate Deep Cerebellar Nuclei , 2013, The Journal of Neuroscience.

[199]  Timothy J. Ebner,et al.  Modulation of sensory prediction error in Purkinje cells during visual feedback manipulations , 2018, Nature Communications.

[200]  R. A. Hensbroek,et al.  Intraburst and Interburst Signaling by Climbing Fibers , 2007, The Journal of Neuroscience.

[201]  L. Luo,et al.  Cerebellar granule cells encode the expectation of reward , 2017, Nature.

[202]  Jun Morimoto,et al.  The eMOSAIC model for humanoid robot control , 2012, Neural Networks.

[203]  S. G. Lisberger,et al.  Motor learning in a recurrent network model based on the vestibulo–ocular reflex , 1992, Nature.

[204]  Terence D. Sanger,et al.  A Cerebellar Computational Mechanism for Delay Conditioning at Precise Time Intervals , 2020, Neural Computation.

[205]  Masato Inoue,et al.  Motor Error in Parietal Area 5 and Target Error in Area 7 Drive Distinctive Adaptation in Reaching , 2018, Current Biology.

[206]  Jennifer L. Raymond,et al.  Timing Rules for Synaptic Plasticity Matched to Behavioral Function , 2018, Neuron.

[207]  Javier F. Medina,et al.  Computer simulation of cerebellar information processing , 2000, Nature Neuroscience.

[208]  Abigail L. Person,et al.  Theoretically Sparse, Empirically Dense: New Views on Cerebellar Granule Cells , 2018, Trends in Neurosciences.

[209]  E. D’Angelo,et al.  Beyond parallel fiber LTD: the diversity of synaptic and non-synaptic plasticity in the cerebellum , 2001, Nature Neuroscience.

[210]  Michael N. Economo,et al.  A cortico-cerebellar loop for motor planning , 2018, Nature.

[211]  J. Krakauer,et al.  Sensory prediction errors drive cerebellum-dependent adaptation of reaching. , 2007, Journal of neurophysiology.

[212]  Allison M Okamura,et al.  Predicting and correcting ataxia using a model of cerebellar function. , 2014, Brain : a journal of neurology.

[213]  KawatoMitsuo,et al.  Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops , 2006 .

[214]  F. A. Miles,et al.  Plasticity in the vestibulo-ocular reflex: a new hypothesis. , 1981, Annual review of neuroscience.

[215]  Ranran L French,et al.  Cerebellar Purkinje cells control eye movements with a rapid rate code that is invariant to spike irregularity , 2019, eLife.

[216]  William Heffley,et al.  Classical conditioning drives learned reward prediction signals in climbing fibers across the lateral cerebellum , 2019, bioRxiv.

[217]  Keiko Tanaka,et al.  Experimental and computational aspects of signaling mechanisms of spike‐timing‐dependent plasticity , 2009, HFSP journal.

[218]  Mitsuo Kawato,et al.  Equilibrium-Point Control Hypothesis Examined by Measured Arm Stiffness During Multijoint Movement , 1996, Science.

[219]  J. Wickens,et al.  Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex In vitro , 1996, Neuroscience.

[220]  S. Itohara,et al.  Memory trace of motor learning shifts transsynaptically from cerebellar cortex to nuclei for consolidation , 2006, Neuroscience.

[221]  Jun Morimoto,et al.  Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning , 2000, Robotics Auton. Syst..

[222]  Miltiadis Boboulos Automation and Robotics , 2010 .

[223]  M. Kawato,et al.  Electrical coupling controls dimensionality and chaotic firing of inferior olive neurons , 2019, bioRxiv.

[224]  Debra Bourne Simple and complex , 2015 .

[225]  Cathrin B. Canto,et al.  Role of Synchronous Activation of Cerebellar Purkinje Cell Ensembles in Multi-joint Movement Control , 2015, Current Biology.

[226]  Ben Deverett,et al.  Cerebellar granule cells acquire a widespread predictive feedback signal during motor learning , 2017, Nature Neuroscience.

[227]  M. Häusser,et al.  Encoding of Oscillations by Axonal Bursts in Inferior Olive Neurons , 2009, Neuron.

[228]  Michael I. Jordan,et al.  Forward Models: Supervised Learning with a Distal Teacher , 1992, Cogn. Sci..

[229]  Richard Apps,et al.  Heterogeneity of Purkinje cell simple spike–complex spike interactions: zebrin‐ and non‐zebrin‐related variations , 2017, The Journal of physiology.

[230]  Daniel M. Wolpert,et al.  Hierarchical MOSAIC for movement generation , 2003 .

[231]  James S. Albus,et al.  New Approach to Manipulator Control: The Cerebellar Model Articulation Controller (CMAC)1 , 1975 .

[232]  Mati Joshua,et al.  Coordinated cerebellar climbing fiber activity signals learned sensorimotor predictions , 2018, bioRxiv.

[233]  Riccardo Zucca,et al.  Number of Spikes in Climbing Fibers Determines the Direction of Cerebellar Learning , 2013, The Journal of Neuroscience.

[234]  Zhanmin Lin,et al.  Cerebellar modules operate at different frequencies , 2014, eLife.

[235]  D. Wolpert,et al.  Is the cerebellum a smith predictor? , 1993, Journal of motor behavior.

[236]  P. Bromberg Structure-Function Relationships , 1999 .

[237]  W. Skaggs,et al.  The Cerebellum , 2016 .

[238]  Mitsuo Kawato,et al.  Expansion coding and computation in the cerebellum: 50 years after the Marr–Albus codon theory , 2019, The Journal of physiology.

[239]  渡邊 澄夫 Algebraic geometry and statistical learning theory , 2009 .

[240]  Kenji Doya,et al.  What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? , 1999, Neural Networks.

[241]  Catherine J. Stoodley,et al.  The Theory and Neuroscience of Cerebellar Cognition. , 2019, Annual review of neuroscience.

[242]  Samy Bengio,et al.  Understanding deep learning requires rethinking generalization , 2016, ICLR.

[243]  Taiji Suzuki,et al.  Adaptivity of deep ReLU network for learning in Besov and mixed smooth Besov spaces: optimal rate and curse of dimensionality , 2018, ICLR.

[244]  M. Garwicz,et al.  Anatomical and physiological foundations of cerebellar information processing , 2005, Nature Reviews Neuroscience.

[245]  A. Takemura,et al.  Neural activity in the dorsal medial superior temporal area of monkeys represents retinal error during adaptive motor learning , 2017, Scientific Reports.

[246]  Alberto Bemporad,et al.  The explicit linear quadratic regulator for constrained systems , 2003, Autom..

[247]  Henrik Jörntell,et al.  Sensory transmission in cerebellar granule cells relies on similarly coded mossy fiber inputs , 2009, Proceedings of the National Academy of Sciences.

[248]  T. Hirano,et al.  Long-term depression and other synaptic plasticity in the cerebellum , 2013, Proceedings of the Japan Academy. Series B, Physical and biological sciences.

[249]  Reza Shadmehr,et al.  Encoding of error and learning to correct that error by the Purkinje cells of the cerebellum , 2018, Nature Neuroscience.

[250]  Tatsuya Kimura,et al.  Cerebellar complex spikes encode both destinations and errors in arm movements , 1998, Nature.

[251]  K. Akert,et al.  The cerebellum as a neuronal machine , 1969 .

[252]  Thomas M. Cover,et al.  Geometrical and Statistical Properties of Systems of Linear Inequalities with Applications in Pattern Recognition , 1965, IEEE Trans. Electron. Comput..

[253]  D. Tank,et al.  Cerebellar disruption impairs working memory during evidence accumulation , 2019, Nature Communications.

[254]  Kenji Kawano,et al.  Ocular tracking: behavior and neurophysiology , 1999, Current Opinion in Neurobiology.

[255]  Yasmine El-Shamayleh,et al.  Selective Optogenetic Control of Purkinje Cells in Monkey Cerebellum , 2017, Neuron.

[256]  R. Ivry,et al.  The Cerebellum: Adaptive Prediction for Movement and Cognition , 2017, Trends in Cognitive Sciences.

[257]  Adam W Hantman,et al.  Convergence of pontine and proprioceptive streams onto multimodal cerebellar granule cells , 2013, eLife.

[258]  Shun-ichi Amari Any Target Function Exists in a Neighborhood of Any Sufficiently Wide Random Network: A Geometrical Perspective , 2020, Neural Computation.

[259]  Sten Grillner,et al.  Striatal cellular properties conserved from lampreys to mammals , 2011, The Journal of physiology.