A model of cerebellar metaplasticity.

The term "learning rule" in neural network theory usually refers to a rule for the plasticity of a given synapse, whereas metaplasticity involves a "metalearning algorithm" describing higher level control mechanisms for apportioning plasticity across a population of synapses. We propose here that the cerebellar cortex may use metaplasticity, and we demonstrate this by introducing the Cerebellar Adaptive Rate Learning (CARL) algorithm that concentrates learning on those Purkinje cell synapses whose adaptation is most relevant to learning an overall pattern. Our results show that this biologically plausible metalearning algorithm not only improves significantly the learning capability of the cerebellum but is very robust. Finally, we identify several putative neurochemicals that could be involved in a cascade of events leading to adaptive learning rates in Purkinje cell synapses.

[1]  D. Marr.  A theory of cerebellar cortex , 1969, The Journal of physiology.

[2]  J. Albus.  A Theory of Cerebellar Function , 1971 .

[3]  Y. Lamarre,et al.  The Inferior olivary nucleus : anatomy and physiology , 1980 .

[4]  O. Oscasson.  Functional organization of olivary projection to the cerebellar anterior lobe , 1980 .

[5]  Masao Ito,et al.  Climbing fibre induced depression of both mossy fibre responsiveness and glutamate sensitivity of cerebellar Purkinje cells , 1982, The Journal of physiology.

[6]  E. Mugnaini.  The length of cerebellar parallel fibers in chicken and rhesus monkey , 1983, The Journal of comparative neurology.

[7]  Joseph D. Novak,et al.  Learning How to Learn , 1984 .

[8]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[9]  N. Littlestone.  Learning Quickly When Irrelevant Attributes Abound: A New Linear-Threshold Algorithm , 1987, 28th Annual Symposium on Foundations of Computer Science (sfcs 1987).

[10]  F. Crépel,et al.  Activation of protein kinase C induces a long-term depression of glutamate sensitivity of cerebellar Purkinje cells. An in vitro study , 1988, Brain Research.

[11]  Robert A. Jacobs,et al.  Increased rates of convergence through learning rate adaptation , 1987, Neural Networks.

[12]  John J. Shynk,et al.  Analysis of the momentum LMS algorithm , 1990, IEEE Trans. Acoust. Speech Signal Process..

[13]  A. Konnerth,et al.  Intradendritic release of calcium induced by glutamate in cerebellar purkinje cells , 1991, Neuron.

[14]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[15]  M. Dickinson,et al.  A long-term depression of AMPA currents in cultured cerebellar purkinje neurons , 1991, Neuron.

[16]  W T Thach,et al.  The cerebellum and the adaptive coordination of movement. , 1992, Annual review of neuroscience.

[17]  Richard S. Sutton,et al.  Adapting Bias by Gradient Descent: An Incremental Version of Delta-Bar-Delta , 1992, AAAI.

[18]  M. Baudry,et al.  Calpain‐mediated regulation of AMPA receptors in adult rat brain , 1994, Neuroreport.

[19]  L. Soldati,et al.  A genetic deficiency in calpastatin and isovalerylcarnitine treatment is associated with enhanced hippocampal long‐term potentiation , 1995, Synapse.

[20]  W. T. Thach,et al.  Cerebellar ataxia: abnormal control of interaction torques across multiple joints. , 1996, Journal of neurophysiology.

[21]  F. Crépel,et al.  Cellular mechanisms of long-term depression in the cerebellum , 1996 .

[22]  F. Grynspan,et al.  Regional differences in gene expression for calcium activated neutral proteases (calpains) and their endogenous inhibitor calpastatin in mouse brain and spinal cord. , 1996, Journal of neurobiology.

[23]  M. Bear,et al.  Metaplasticity: the plasticity of synaptic plasticity , 1996, Trends in Neurosciences.

[24]  M. Baudry,et al.  Regional distribution and time-course of calpain activation following kainate-induced seizure activity in adult rat brain , 1996, Brain Research.

[25]  Manfred K. Warmuth,et al.  Exponentiated Gradient Versus Gradient Descent for Linear Predictors , 1997, Inf. Comput..

[26]  M. Arbib,et al.  Role of the cerebellum in reaching movements in humans. I. Distributed inverse dynamics control , 1998, The European journal of neuroscience.

[27]  M. Arbib,et al.  Role of the cerebellum in reaching movements in humans. II. A neural model of the intermediate cerebellum , 1998, The European journal of neuroscience.