Recurrent cerebellar architecture solves the motor-error problem

Current views of cerebellar function have been heavily influenced by the models of Marr and Albus, who suggested that the climbing fibre input to the cerebellum acts as a teaching signal for motor learning. It is commonly assumed that this teaching signal must be motor error (the difference between actual and correct motor command), but this approach requires complex neural structures to estimate unobservable motor error from its observed sensory consequences. We have proposed elsewhere a recurrent decorrelation control architecture in which Marr–Albus models learn without requiring motor error. Here, we prove convergence for this architecture and demonstrate important advantages for the modular control of systems with multiple degrees of freedom. These results are illustrated by modelling adaptive plant compensation for the three–dimensional vestibular ocular reflex. This provides a functional role for recurrent cerebellar connectivity, which may be a generic anatomical feature of projections between regions of cerebral and cerebellar cortex.

[1]  D. Marr A theory of cerebellar cortex , 1969, The Journal of physiology.

[2]  J. Eccles The Dynamic Loop Hypothesis of Movement Control , 1969 .

[3]  J. Albus A Theory of Cerebellar Function , 1971 .

[4]  P. Gilbert A theory of memory that explains the function and structure of the cerebellum. , 1974, Brain research.

[5]  T. Sejnowski,et al.  Storing covariance with nonlinearly interacting neurons , 1977, Journal of mathematical biology.

[6]  A. Fuchs,et al.  Role of primate flocculus during rapid behavioral modification of vestibuloocular reflex. II. Mossy fiber firing patterns during horizontal head rotation and eye movement. , 1978, Journal of neurophysiology.

[7]  D. A. Suzuki,et al.  Processing of eye movement signals in the flocculus of the monkey. , 1979, The Journal of physiology.

[8]  F. A. Miles,et al.  Long-term adaptive changes in primate vestibuloocular reflex. III. Electrophysiological observations in flocculus of normal monkeys. , 1980, Journal of neurophysiology.

[9]  F. A. Miles,et al.  Long-term adaptive changes in primate vestibuloocular reflex. IV. Electrophysiological observations in flocculus of adapted monkeys. , 1980, Journal of neurophysiology.

[10]  S. Nakao,et al.  Eye movement related neurons in the cat pontine reticular formation: projection to the flocculus , 1980, Brain Research.

[11]  D. Zee,et al.  Effects of ablation of flocculus and paraflocculus of eye movements in primate. , 1981, Journal of neurophysiology.

[12]  R. Weale Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[13]  Masao Ito The Cerebellum And Neural Control , 1984 .

[14]  H. Noda,et al.  Response properties and visual receptive fields of climbing and mossy fibers terminating in the flocculus of the monkey , 1987, Experimental Neurology.

[15]  J. Simpson,et al.  Spatial organization of visual messages of the rabbit's cerebellar flocculus. II. Complex and simple spike responses of Purkinje cells. , 1988, Journal of neurophysiology.

[16]  S. Sastry,et al.  Adaptive Control: Stability, Convergence and Robustness , 1989 .

[17]  Mitsuo Kawato,et al.  Feedback-Error-Learning Neural Network for Supervised Motor Learning , 1990 .

[18]  S. Lisberger,et al.  Visual responses of Purkinje cells in the cerebellar flocculus during smooth-pursuit eye movements in monkeys. I. Simple spikes. , 1990, Journal of neurophysiology.

[19]  Eye velocity is not the major factor that determines mossy fiber responses of rabbit floccular Purkinje cells to head and screen oscillation , 1990 .

[20]  G Cheron,et al.  Discharge properties of brain stem neurons projecting to the flocculus in the alert cat. I. Medical vestibular nucleus. , 1996, Journal of neurophysiology.

[21]  N. Gerrits,et al.  Organization of the Vestibulocerebellum , 1996, Annals of the New York Academy of Sciences.

[22]  G Cheron,et al.  Discharge properties of brain stem neurons projecting to the flocculus in the alert cat. II. Prepositus hypoglossal nucleus. , 1996, Journal of neurophysiology.

[23]  Douglas R. Wylie,et al.  More on climbing fiber signals and their consequence(s) , 1996 .

[24]  J. Büttner-Ennever,et al.  Pretectal projections to the oculomotor complex of the monkey and their role in eye movements , 1996, The Journal of comparative neurology.

[25]  A G Barto,et al.  Prediction of complex two-dimensional trajectories by a cerebellar model of smooth pursuit eye movement. , 1997, Journal of neurophysiology.

[26]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[27]  J. Simpson,et al.  Microcircuitry and function of the inferior olive , 1998, Trends in Neurosciences.

[28]  Mitsuo Kawato,et al.  Cerebellum and motor control , 1998 .

[29]  L. Optican,et al.  Model of the control of saccades by superior colliculus and cerebellum. , 1999, Journal of neurophysiology.

[30]  James C. Houk,et al.  A Cerebellar Model of Timing and Prediction in the Control of Reaching , 1999, Neural Computation.

[31]  Kaoru Yoshida,et al.  Evidence for brainstem structures participating in oculomotor integration. , 2000, Science.

[32]  P. Strick,et al.  Basal ganglia and cerebellar loops: motor and cognitive circuits , 2000, Brain Research Reviews.

[33]  J. Houk,et al.  Functional connectivity between cerebellum and primary motor cortex in the awake monkey. , 2000, Journal of neurophysiology.

[34]  R. McCrea,et al.  Role of the cerebellar flocculus region in cancellation of the VOR during passive whole body rotation. , 2000, Journal of neurophysiology.

[35]  Michael A. Arbib,et al.  Cerebellar learning of accurate predictive control for fast-reaching movements , 2000, Biological Cybernetics.

[36]  Christopher Assad,et al.  An Hypothesis for a Novel Learning Mechanism in the Cerebellar Cortex , 2001, Auton. Robots.

[37]  Y. Hirata,et al.  Acute adaptation of the vestibuloocular reflex: signal processing by floccular and ventral parafloccular Purkinje cells. , 2001, Journal of neurophysiology.

[38]  Chris Miall,et al.  Expanding cerebellar horizons , 2001, Trends in Cognitive Sciences.

[39]  M. Kawato,et al.  Computational studies on acquisition and adaptation of ocular following responses based on cerebellar synaptic plasticity. , 2002, Journal of neurophysiology.

[40]  James V. Stone,et al.  Decorrelation control by the cerebellum achieves oculomotor plant compensation in simulated vestibulo-ocular reflex , 2002, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[41]  Bertrand Tondu,et al.  A model of the cerebellar pathways applied to the control of a single-joint robot arm actuated by McKibben artificial muscles , 2002, Biological Cybernetics.

[42]  Milton Pong,et al.  Inhibitory Control of Olivary Discharge , 2002, Annals of the New York Academy of Sciences.

[43]  P. Strick,et al.  An unfolded map of the cerebellar dentate nucleus and its projections to the cerebral cortex. , 2003, Journal of neurophysiology.

[44]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces to restore motor function and probe neural circuits , 2003, Nature Reviews Neuroscience.

[45]  Mitsuo Kawato,et al.  Adaptive feedback control models of the vestibulocerebellum and spinocerebellum , 2004, Biological Cybernetics.

[46]  M. Garwicz,et al.  Evidence for a GABA-mediated cerebellar inhibition of the inferior olive in the cat , 2004, Experimental Brain Research.

[47]  F. A. Miles,et al.  Floccular lesions abolish adaptive control of post-saccadic ocular drift in primates , 2004, Experimental Brain Research.

[48]  A. Straube,et al.  Neuronal activity in the flocculus of the alert monkey during sinusoidal optokinetic stimulation , 1988, Experimental Brain Research.

[49]  M. Fujita,et al.  Adaptive filter model of the cerebellum , 1982, Biological Cybernetics.