Cerebellar learning of accurate predictive control for fast-reaching movements

Abstract. Long conduction delays in the nervous system prevent the accurate control of movements by feedback control alone. We present a new, biologically plausible cerebellar model to study how fast arm movements can be executed in spite of these delays. To provide a realistic test-bed of the cerebellar neural model, we embed the cerebellar network in a simulated biological motor system comprising a spinal cord model and a six-muscle two-dimensional arm model. We argue that if the trajectory errors are detected at the spinal cord level, memory traces in the cerebellum can solve the temporal mismatch problem between efferent motor commands and delayed error signals. Moreover, learning is made stable by the inclusion of the cerebello-nucleo-olivary loop in the model. It is shown that the cerebellar network implements a nonlinear predictive regulator by learning part of the inverse dynamics of the plant and spinal circuit. After learning, fast accurate reaching movements can be generated.

[1]  James S. Albus,et al.  New Approach to Manipulator Control: The Cerebellar Model Articulation Controller (CMAC)1 , 1975 .

[2]  N. Hogan,et al.  Does the nervous system use equilibrium-point control to guide single and multiple joint movements? , 1992, The Behavioral and brain sciences.

[3]  W T Thach,et al.  Cerebellar relation to muscle spindles in hand tracking. , 1986, Progress in brain research.

[4]  James C. Houk,et al.  Cerebellar learning for control of a two-link arm in muscle space , 1997, Proceedings of International Conference on Robotics and Automation.

[5]  R. F. Thompson,et al.  Inhibitory cerebello-olivary projections and blocking effect in classical conditioning. , 1998, Science.

[6]  Masao Ito The Cerebellum And Neural Control , 1984 .

[7]  G E Alexander,et al.  Neural representations of the target (goal) of visually guided arm movements in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[8]  Satinder Singh,et al.  Distributed Representation of Limb Motor Programs in Arrays of Adjustable Pattern Generators , 1993, Journal of Cognitive Neuroscience.

[9]  D. Marr A theory of cerebellar cortex , 1969, The Journal of physiology.

[10]  James S. Albus,et al.  Data Storage in the Cerebellar Model Articulation Controller (CMAC) , 1975 .

[11]  J. Kalaska,et al.  A comparison of movement direction-related versus load direction- related activity in primate motor cortex, using a two-dimensional reaching task , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  James C. Houk,et al.  An Adaptive Sensorimotor Network Inspired by the Anatomy and Physiology , 1989 .

[13]  G. E. Alexander,et al.  Control of goal-directed limb movements in primates: neurobiological evidence for parallel, distributed motor processing , 1992 .

[14]  J. Voogd,et al.  Cerebellar Influence on Olivary Excitability in the Cat , 1995, The European journal of neuroscience.

[15]  N. Özkaya,et al.  Fundamentals of Biomechanics: Equilibrium, Motion, and Deformation , 1991 .

[16]  E. Bizzi,et al.  Posture control and trajectory formation during arm movement , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  A. G. Feldman Once more on the equilibrium-point hypothesis (lambda model) for motor control. , 1986, Journal of motor behavior.

[18]  Stephen Grossberg,et al.  A neural model of timed response learning in the cerebellum , 1994, Neural Networks.

[19]  J. Kien,et al.  Neurobiology of Motor Programme Selection: New Approaches to the Study of Behavioural Choice , 1992 .

[20]  Mitsuo Kawato,et al.  Neural network control for a closed-loop System using Feedback-error-learning , 1993, Neural Networks.

[21]  W. T. Miller,et al.  CMAC: an associative neural network alternative to backpropagation , 1990, Proc. IEEE.

[22]  Marc H. Schieber,et al.  Cerebellar Output: Body Maps and Muscle Spindles , 1982 .

[23]  M. H. Schieber,et al.  Cerebellar Learning in Limb Movements , 1982 .

[24]  Mitsuo Kawato,et al.  Feedback-error-learning neural network for trajectory control of a robotic manipulator , 1988, Neural Networks.

[25]  Richard S. Sutton,et al.  An Adaptive Sensorimotor Network Inspired by the Anatomy and Physiology of the Cerebellum , 1995 .

[26]  T. Ebner,et al.  Neuronal specification of direction and distance during reaching movements in the superior precentral premotor area and primary motor cortex of monkeys. , 1993, Journal of neurophysiology.

[27]  Blake Hannaford,et al.  Study of human forearm posture maintenance with a physiologically based robotic arm and spinal level neural controller , 1997, Biological Cybernetics.

[28]  A. Riehle,et al.  Monkey primary motor and premotor cortex: single-cell activity related to prior information about direction and extent of an intended movement. , 1989, Journal of neurophysiology.

[29]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[30]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[31]  N. Donegan,et al.  A model of Pavlovian eyelid conditioning based on the synaptic organization of the cerebellum. , 1997, Learning & memory.

[32]  J. Albus A Theory of Cerebellar Function , 1971 .

[33]  M. Arbib,et al.  Role of the cerebellum in reaching movements in humans. II. A neural model of the intermediate cerebellum , 1998, The European journal of neuroscience.

[34]  M. Arbib,et al.  Role of the cerebellum in reaching movements in humans. I. Distributed inverse dynamics control , 1998, The European journal of neuroscience.

[35]  W. T. Thach,et al.  Cerebellar ataxia: abnormal control of interaction torques across multiple joints. , 1996, Journal of neurophysiology.

[36]  J. Murphy,et al.  Responses of cerebellar cortical neurons to dynamic proprioceptive inputs from forelimb muscles. , 1973, Journal of neurophysiology.

[37]  S. Grossberg,et al.  A neural model of cerebellar learning for arm movement control: cortico-spino-cerebellar dynamics. , 1997, Learning & memory.

[38]  James C. Houk,et al.  A Cerebellar Model of Timing and Prediction in the Control of Reaching , 1999, Neural Computation.

[39]  J. Kalaska,et al.  Comparison of cerebellar and motor cortex activity during reaching: directional tuning and response variability. , 1993, Journal of neurophysiology.

[40]  John S. Edwards,et al.  The Hedonistic Neuron: A Theory of Memory, Learning and Intelligence , 1983 .

[41]  Blake Hannaford,et al.  rement and ding of McKibben Pneumatic Artificial Muscles , 1996 .

[42]  J. McIntyre,et al.  Servo Hypotheses for the Biological Control of Movement. , 1993, Journal of motor behavior.

[43]  Masazumi Katayama,et al.  A parallel‐hierarchical neural network model for motor control of a musculo‐skeletal system , 1991 .

[44]  Blake Hannaford,et al.  Measurement and modeling of McKibben pneumatic artificial muscles , 1996, IEEE Trans. Robotics Autom..