Feed-forward associative learning for volitional movement control

One of the most difficult problems in motor learning is determining the source of a learning signal, sometimes called an error signal. This problem is hidden in the adaptations of simple reflexive movements by attributing its source to sensory organs. The feed-forward associative motor learning theory proposed here attributes the source to the movement system itself. When a subject performs a corrective movement after his primary movement, the proposed neural learning device learns to associate the primary motor command with the corrective motor command by using a place-coding system. In the subsequent trials, the primary movement will involve a correction due to the participation of this mechanism, thus resulting in better performance. The theory assumes three conditions, namely, that a motor center and the learning device share the same place-encoded motor information; the motor center issues a command and a learning signal simultaneously from the same unit; and a learning signal issued with a corrective command has a heterosynaptic interaction with the previous primary command. The cerebellum is a reasonable candidate for the device satisfying these conditions. The reaction time of a corrective movement, usually 100-300 ms, almost satisfies the coincidence condition for long-term depression of the granule-to-Purkinje synapses. As an application, this theory is demonstrated to account for behavioral results regarding saccadic adaptation.

[1]  Gavin P. Lawrence,et al.  Online versus offline processing of visual feedback in the control of movement amplitude. , 2003, Acta psychologica.

[2]  L M Optican,et al.  Adaptive properties of the saccadic system. , 1985, Reviews of oculomotor research.

[3]  S. Grossberg,et al.  A neural model of saccadic eye movement control explains task-specific adaptation , 1999, Vision Research.

[4]  Peter Ford Dominey,et al.  A model of the cerebellum in adaptive control of saccadic gain , 1996, Biological cybernetics.

[5]  Kaoru Yoshida,et al.  Changes in cerebellar fastigial burst activity related to saccadic gain adaptation in the monkey , 2003, Neuroscience Research.

[6]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[7]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[8]  Hiroshi Imamizu,et al.  Human cerebellar activity reflecting an acquired internal model of a new tool , 2000, Nature.

[9]  H. Noda,et al.  Involvement of Purkinje cells in evoking saccadic eye movements by microstimulation of the posterior cerebellar vermis of monkeys. , 1987, Journal of neurophysiology.

[10]  D. Robinson,et al.  Eye movements evoked by cerebellar stimulation in the alert monkey. , 1973, Journal of neurophysiology.

[11]  M. Yamamoto,et al.  Specific patterns of neuronal connexions involved in the control of the rabbit's vestibulo‐ocular reflexes by the cerebellar flocculus. , 1977, The Journal of physiology.

[12]  D. Sparks,et al.  Cerebellotectal pathways in the macaque: Implications for collicular generation of saccades , 1990, Neuroscience.

[13]  J. Mayhew,et al.  Learning and Maintaining Saccadic Accuracy: A Model of BrainstemCerebellar Interactions , 1994, Journal of Cognitive Neuroscience.

[14]  P. Dean,et al.  Modelling the role of the cerebellar fastigial nuclei in producing accurate saccades: the importance of burst timing , 1995, Neuroscience.

[15]  Masao Ito,et al.  Climbing fibre induced depression of both mossy fibre responsiveness and glutamate sensitivity of cerebellar Purkinje cells , 1982, The Journal of physiology.

[16]  A. Fuchs,et al.  Transfer of gain changes from targeting to other types of saccade in the monkey: constraints on possible sites of saccadic gain adaptation. , 1996, Journal of neurophysiology.

[17]  Michael A. Khan,et al.  Online Versus Offline Processing of Visual Feedback in the Production of Component Submovements , 2003, Journal of motor behavior.

[18]  A. Fuchs,et al.  Characteristics of saccadic gain adaptation in rhesus macaques. , 1997, Journal of neurophysiology.

[19]  Topographical organization of the tecto-olivo-cerebellar projection in the cat , 1991, Neuroscience.

[20]  H. Noda,et al.  Afferent and efferent connections of the oculomotor cerebellar vermis in the macaque monkey , 1987, The Journal of comparative neurology.

[21]  D. Robinson Eye movements evoked by collicular stimulation in the alert monkey. , 1972, Vision research.

[22]  C. Scudder,et al.  Adaptive modification of saccade size produces correlated changes in the discharges of fastigial nucleus neurons. , 2003, Journal of neurophysiology.

[23]  D. Sparks,et al.  Population coding of saccadic eye movements by neurons in the superior colliculus , 1988, Nature.

[24]  M. Kawato,et al.  A hierarchical neural-network model for control and learning of voluntary movement , 2004, Biological Cybernetics.

[25]  S. Wray Adaptive mechanisms in gaze control. , 1986, Reviews of oculomotor research.

[26]  M. Fujita,et al.  Simulation of adaptive modification of the vestibulo-ocular reflex with an adaptive filter model of the cerebellum , 1982, Biological Cybernetics.

[27]  J. Massion,et al.  Cerebro-cerebellar interactions , 1979 .

[28]  S. Lisberger,et al.  Neural Learning Rules for the Vestibulo-Ocular Reflex , 1998, The Journal of Neuroscience.

[29]  J. Szentágothai,et al.  Quantitative histological analysis of the cerebellar cortex in the cat. IV. Mossy fiber-Purkinje cell numerical transfer. , 1972, Brain research.

[30]  A. Fuchs,et al.  Saccadic gain modification: visual error drives motor adaptation. , 1998, Journal of neurophysiology.

[31]  William F. Hughes,et al.  Functional Basis of Ocular Motility Disorders , 1984 .

[32]  R. Miall,et al.  Intermittency in human manual tracking tasks. , 1993, Journal of motor behavior.

[33]  S G Lisberger,et al.  Multiple subclasses of Purkinje cells in the primate floccular complex provide similar signals to guide learning in the vestibulo-ocular reflex. , 1997, Learning & memory.

[34]  C. Darlot,et al.  Cerebellar learning of bio-mechanical functions of extra-ocular muscles: modeling by artificial neural networks , 2003, Neuroscience.

[35]  V. Henn,et al.  Vertical eye movement related unit activity in the rostral mesencephalic reticular formation of the alert monkey , 1977, Brain Research.

[36]  M. Fujita,et al.  Adaptive filter model of the cerebellum , 1982, Biological Cybernetics.

[37]  Tatsuya Kimura,et al.  Cerebellar complex spikes encode both destinations and errors in arm movements , 1998, Nature.

[38]  W. B. Templeton,et al.  Saccadic plasticity: parametric adaptive control by retinal feedback. , 1981, Journal of experimental psychology. Human perception and performance.

[39]  K. HEPP,et al.  On the Generation of Rapid Eye Movements in Three Dimensions , 1988, Annals of the New York Academy of Sciences.

[40]  Masahiko Fujita,et al.  Selective and delay adaptation of human saccades. , 2002, Brain research. Cognitive brain research.

[41]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[42]  Mitsuo Kawato,et al.  MOSAIC Model for Sensorimotor Learning and Control , 2001, Neural Computation.

[43]  Neuroscience Research , 2006, Neuroscience Research.

[44]  A. Fuchs,et al.  Cerebellar Influences on Saccade Plasticity , 2002, Annals of the New York Academy of Sciences.

[45]  L. Optican,et al.  Cerebellar-dependent adaptive control of primate saccadic system. , 1980, Journal of neurophysiology.

[46]  M Ito,et al.  Neurophysiological aspects of the cerebellar motor control system. , 1970, International journal of neurology.

[47]  T. Aso,et al.  Saccadic eye movements evoked by microstimulation of the fastigial nucleus of macaque monkeys. , 1988, Journal of neurophysiology.

[48]  Roger Y Tsien,et al.  A new form of cerebellar long-term potentiation is postsynaptic and depends on nitric oxide but not cAMP , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[49]  M. O'connor,et al.  Motor areas of the cerebral cortex , 1987 .

[50]  B. Cohen,et al.  Eye movements induced by stimulation of the pontine reticular formation: evidence for integration in oculomotor pathways. , 1972, Experimental neurology.

[51]  H Deubel,et al.  Adaptive gain control of saccadic eye movements. , 1986, Human neurobiology.

[52]  D. Zee,et al.  Effects of lesions of the oculomotor vermis on eye movements in primate: saccades. , 1998, Journal of neurophysiology.

[53]  J. Szentágothai,et al.  Quantitative histological analysis of the cerebellar cortex in the cat. I. Number and arrangement in space of the Purkinje cells. , 1971, Brain research.

[54]  Optican Lm Adaptive properties of the saccadic system. , 1985 .

[55]  M. Ito Cerebellar control of the vestibulo-ocular reflex--around the flocculus hypothesis. , 1982, Annual review of neuroscience.

[56]  M. Ito,et al.  Neural design of the cerebellar motor control system. , 1972, Brain research.

[57]  Kaoru Yoshida,et al.  Memory of Learning Facilitates Saccadic Adaptation in the Monkey , 2004, The Journal of Neuroscience.

[58]  W. T. Thach What is the role of the cerebellum in motor learning and cognition? , 1998, Trends in Cognitive Sciences.

[59]  Hitoshi Sato,et al.  Divergent axon collaterals from fastigial oculomotor region to mesodiencephalic junction and paramedian pontine reticular formation in macaques , 1991, Neuroscience Research.

[60]  C. J. Erkelens,et al.  Selective adaptation of internally triggered saccades made to visual targets , 2004, Experimental Brain Research.

[61]  K. Ohtsuka,et al.  Discharge properties of Purkinje cells in the oculomotor vermis during visually guided saccades in the macaque monkey. , 1995, Journal of neurophysiology.

[62]  尚 不二門,et al.  Saccadic eye movements evoked by microstimulation of lobule VII of the cerebellar vermis of macaque monkeys , 1988 .

[63]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[64]  A. Berthoz,et al.  Adaptive mechanisms in gaze control : facts and theories , 1985 .

[65]  Masao Ito The Cerebellum And Neural Control , 1984 .

[66]  G. Allen,et al.  Cerebrocerebellar communication systems. , 1974, Physiological reviews.

[67]  R. F. Thompson,et al.  Temporal specificity of long-term depression in parallel fiber--Purkinje synapses in rat cerebellar slice. , 1995, Learning & memory.

[68]  A. Opstal,et al.  Transfer of short-term adaptation in human saccadic eye movements , 2004, Experimental Brain Research.

[69]  H. Deubel Separate adaptive mechanisms for the control of reactive and volitional saccadic eye movements , 1995, Vision Research.

[70]  Topographical organization of the tecto-olivo-cerebellar projection in the cat , 1990 .

[71]  D. Marr A theory of cerebellar cortex , 1969, The Journal of physiology.

[72]  H. Harlow,et al.  The History and Philosophy of Knowledge of the Brain and its Functions , 1960, Neurology.

[73]  R. Eckmiller Advanced neural computers , 1990 .

[74]  K Matsuyama,et al.  Stimulation of a restricted region in the midline cerebellar white matter evokes coordinated quadrupedal locomotion in the decerebrate cat. , 1999, Journal of neurophysiology.

[75]  L. Carlton Processing visual feedback information for movement control. , 1981, Journal of experimental psychology. Human perception and performance.

[76]  P. Thier,et al.  Encoding of movement time by populations of cerebellar Purkinje cells , 2000, Nature.

[77]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[78]  W T Thach,et al.  The cerebellum and the adaptive coordination of movement. , 1992, Annual review of neuroscience.

[79]  S. C. Mclaughlin Parametric adjustment in saccadic eye movements , 1967 .

[80]  H. Deubel ADAPTIVITY OF GAIN AND DIRECTION IN OBLIQUE SACCADES1 , 1987 .

[81]  W. T. Thach,et al.  Throwing while looking through prisms , 2005 .

[82]  R. F. Thompson,et al.  Cerebellum: essential involvement in the classically conditioned eyelid response. , 1984, Science.

[83]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[84]  A F Fuchs,et al.  Temporal characteristics of error signals driving saccadic gain adaptation in the macaque monkey. , 2000, Journal of neurophysiology.

[85]  M. Kawato,et al.  Computational studies on acquisition and adaptation of ocular following responses based on cerebellar synaptic plasticity. , 2002, Journal of neurophysiology.

[86]  S. Kitazawa,et al.  Effects of delayed visual information on the rate and amount of prism adaptation in the human , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[87]  Mitsuo Kawato,et al.  Feedback-Error-Learning Neural Network for Supervised Motor Learning , 1990 .

[88]  L. Optican,et al.  Model of the control of saccades by superior colliculus and cerebellum. , 1999, Journal of neurophysiology.

[89]  W. T. Thach,et al.  Throwing while looking through prisms. I. Focal olivocerebellar lesions impair adaptation. , 1996, Brain : a journal of neurology.

[90]  J. Albus A Theory of Cerebellar Function , 1971 .