Models of generalization in motor control

Motor learning for humans is based on the capacity of the central nervous system (CNS) to perform computation and build an internal model for a task. This thesis investigates the CNS’s ability to generalize a learned motor skill throughout neighboring spatial locations, its ability to divide the spatial generalization with variation of context, and proposes models of how these generalizations might be implemented. The investigation involved human psychophysics and simulations. The experimental paradigm was to study human neuromuscular adaptation to viscous force perturbation. When external perturbations were applied to the hand during a reaching task, the movement became distorted. This distortion motivated the CNS to produce counterbalancing forces, which resulted in the modification of the internal model for the task. Experimental results indicated that the introduction of interfering perturbations near the trained location disturbed the learned skill. In addition, if the same movement was perturbed in two opposite directions in sequence, neither of the forces are learned. Conversely, the adaptation to two opposite forces was possible within the same space when the forces were applied to two contextually distinguished movements. This was possible only when these movements were interleaved fairly regularly. During the adaptation to a difficult task, such as contextual distinction in the same spatial location, humans often used other strategies to avoid learning the actual paradigm. These strategies allowed subjects to perform the task without changing their internal models appropriately, and thus this was also investigated as a part of the learning process. Finally, a multiple function model was constructed which allowed multiple contextually dependent functions to co-exist within one state space. The sensory feedback affected all functions, however, only one function was active to output a motor command. This model supported the experimental data presented. The results of the psychophysical experiments as well as an explanation of the simulations and models that were developed will be presented in this thesis. Thesis Supervisor: Emilio Bizzi Title: Professor, Department of Brain and Cognitive Sciences Thesis Supervisor: Rodney Brooks Title: Professor, Department of Electrical Engineering and Computer Science

[1]  Francesca Gandolfo The role of motor primitives in the control of movement and learning , 1996 .

[2]  Neville Hogan,et al.  Integrable Solutions of Kinematic Redundancy via Impedance Control , 1991, Int. J. Robotics Res..

[3]  Emilio Bizzi,et al.  The equilibrium-point framework: A point of departure , 1992 .

[4]  Ferdinando A. Mussa-Ivaldi,et al.  Computational Elements of the Adaptive Controller of the Human Arm , 1993, NIPS.

[5]  Apostolos P. Georgopoulos,et al.  New concepts in generation of movement , 1994, Neuron.

[6]  D. Amaral,et al.  Memory and the Hippocampus , 1989 .

[7]  Tamar Flash,et al.  Arm Stiffness And Movement Adaptation To External Loads , 1991, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society Volume 13: 1991.

[8]  S. Grossberg,et al.  A neural model of cerebellar learning for arm movement control: cortico-spino-cerebellar dynamics. , 1997, Learning & memory.

[9]  R. Shadmehr,et al.  Control of Equilibrium Position and Stiffness Through Postural Modules. , 1993, Journal of motor behavior.

[10]  C. Hofsten,et al.  Structuring of early reaching movements: a longitudinal study. , 1991 .

[11]  Patricia S. Goldman-Rakic,et al.  The prefrontal cortex and internally generated motor acts , 1992, Current Opinion in Neurobiology.

[12]  R L Sainburg,et al.  Control of limb dynamics in normal subjects and patients without proprioception. , 1995, Journal of neurophysiology.

[13]  Kumpati S. Narendra,et al.  Adaptive control using multiple models , 1997, IEEE Trans. Autom. Control..

[14]  D. P. Lloyd Integrative pattern of excitation and inhibition in two-neuron reflex arcs. , 1946, Journal of neurophysiology.

[15]  S. Hochstein,et al.  Task difficulty and the specificity of perceptual learning , 1997, Nature.

[16]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  A. Georgopoulos,et al.  The motor cortex and the coding of force. , 1992, Science.

[18]  Ferdinando A. Mussa-Ivaldi,et al.  Interference in Learning Internal Models of Inverse Dynamics in Humans , 1994, NIPS.

[19]  R Caminiti,et al.  Making arm movements within different parts of space: the premotor and motor cortical representation of a coordinate system for reaching to visual targets , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.

[21]  T. Sanger,et al.  Probability density estimation for the interpretation of neural population codes. , 1996, Journal of neurophysiology.

[22]  W. Penfield,et al.  The Cerebral Cortex of Man: A Clinical Study of Localization of Function , 1968 .

[23]  S. Scott,et al.  Changes in motor cortex activity during reaching movements with similar hand paths but different arm postures. , 1995, Journal of neurophysiology.

[24]  E. Bizzi,et al.  Human arm trajectory formation. , 1982, Brain : a journal of neurology.

[25]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[26]  E. Bizzi,et al.  Postural force fields of the human arm and their role in generating multijoint movements , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  John F. Kalaska,et al.  Spatial coding of movement: A hypothesis concerning the coding of movement direction by motor cortical populations , 1983 .

[28]  Robert Sessions Woodworth,et al.  THE ACCURACY OF VOLUNTARY MOVEMENT , 1899 .

[29]  B Abernethy,et al.  Training the Visual-Perceptual Skills of Athletes: Insights from the Study of Motor Expertise , 1996, The American journal of sports medicine.

[30]  M J Buekers,et al.  Resolving a conflict between sensory feedback and knowledge of results, while learning a motor skill. , 1994, Journal of motor behavior.

[31]  Terence D. Sanger A Practice Strategy for Robot Learning Control , 1992, NIPS.

[32]  M. Horak The utility of connectionism for motor learning: a reinterpretation of contextual interference in movement schemas. , 1992, Journal of motor behavior.

[33]  J R Flanagan,et al.  Trajectory adaptation to a nonlinear visuomotor transformation: evidence of motion planning in visually perceived space. , 1995, Journal of neurophysiology.

[34]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[35]  Paul B. Johnson,et al.  Making arm movements within different parts of space: dynamic aspects in the primate motor cortex , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[36]  J. Rothwell Principles of Neural Science , 1982 .

[37]  Mitsuo Kawato,et al.  Equilibrium-Point Control Hypothesis Examined by Measured Arm Stiffness During Multijoint Movement , 1996, Science.

[38]  Terence D. Sanger,et al.  Theoretical Considerations for the Analysis of Population Coding in Motor Cortex , 1994, Neural Computation.

[39]  A. Georgopoulos,et al.  Cognitive neurophysiology of the motor cortex. , 1993, Science.

[40]  Reza Shadmehr,et al.  Catastrophic Interference in Human Motor Learning , 1994, NIPS.

[41]  E. Bizzi,et al.  Neural, mechanical, and geometric factors subserving arm posture in humans , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[42]  J. Donoghue,et al.  Different forms of synaptic plasticity in somatosensory and motor areas of the neocortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[43]  Ferdinando A. Mussa-Ivaldi,et al.  Geometric Structure of the Adaptive Controller of the Human Arm , 1993 .

[44]  A. Graybiel Building action repertoires: memory and learning functions of the basal ganglia , 1995, Current Opinion in Neurobiology.

[45]  F. Mussa-Ivaldi,et al.  Do neurons in the motor cortex encode movement direction? An alternative hypothesis , 1988, Neuroscience Letters.

[46]  Michael I. Jordan,et al.  A more biologically plausible learning rule for neural networks. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[47]  Snehasis Mukhopadhyay,et al.  Intelligent Control Using Neural Networks , 1991, 1991 American Control Conference.

[48]  F A Mussa-Ivaldi,et al.  Computations underlying the execution of movement: a biological perspective. , 1991, Science.

[49]  John W. Scott,et al.  Selected Writings of John Hughlings Jackson , 1959 .

[50]  T Poggio,et al.  Regularization Algorithms for Learning That Are Equivalent to Multilayer Networks , 1990, Science.

[51]  Gene F. Franklin,et al.  Feedback Control of Dynamic Systems , 1986 .

[52]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[53]  N. Hogan An organizing principle for a class of voluntary movements , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[54]  T Poggio,et al.  Fast perceptual learning in visual hyperacuity. , 1991, Science.

[55]  E Bizzi,et al.  Augmented Feedback Presented in a Virtual Environment Accelerates Learning of a Difficult Motor Task. , 1997, Journal of motor behavior.

[56]  A. Fiorentini,et al.  Perceptual learning specific for orientation and spatial frequency , 1980, Nature.

[57]  E. Bizzi,et al.  Consolidation in human motor memory , 1996, Nature.

[58]  R. Magill,et al.  A note on schema and exemplar approaches to motor skill representation in memory. , 1992, Journal of motor behavior.

[59]  E Bizzi,et al.  Motor learning by field approximation. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[60]  D. Brooks,et al.  Motor sequence learning: a study with positron emission tomography , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[61]  Rodney A. Brooks,et al.  Building brains for bodies , 1995, Auton. Robots.

[62]  M. Kawato,et al.  The cerebellum and VOR/OKR learning models , 1992, Trends in Neurosciences.

[63]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[64]  E. Bizzi,et al.  Posture control and trajectory formation during arm movement , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[65]  Barbara Moore,et al.  Theory of networks for learning , 1990, Defense, Security, and Sensing.

[66]  Michael I. Jordan,et al.  Internal World Models and Supervised Learning , 1991, ML.

[67]  A. Karni,et al.  The time course of learning a visual skill , 1993, Nature.

[68]  J. Lackner,et al.  Rapid adaptation to Coriolis force perturbations of arm trajectory. , 1994, Journal of neurophysiology.

[69]  R. Schmidt,et al.  Augmented Kinematic Feedback for Motor Learning. , 1992, Journal of motor behavior.

[70]  Richard Durbin,et al.  The computing neuron , 1989 .

[71]  C. Von Hofsten Structuring of early reaching movements: a longitudinal study. , 1991, Journal of motor behavior.

[72]  R. Schmidt A schema theory of discrete motor skill learning. , 1975 .

[73]  M. Jeannerod,et al.  Selective perturbation of visual input during prehension movements , 2004, Experimental Brain Research.

[74]  Apostolos P. Georgopoulos,et al.  A Neural Network for Coding of Trajectories by Time Series of Neuronal Population Vectors , 1994, Neural Computation.

[75]  M. Peters,et al.  When can attention not be divided? , 1994, Journal of motor behavior.

[76]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[77]  Y Burnod,et al.  Learning a new visuomotor transformation: error correction and generalization. , 1995, Brain research. Cognitive brain research.

[78]  Michael I. Jordan,et al.  Forward Models: Supervised Learning with a Distal Teacher , 1992, Cogn. Sci..

[79]  M. A. Arbib,et al.  Models of Trajectory Formation and Temporal Interaction of Reach and Grasp. , 1993, Journal of motor behavior.

[80]  A. Georgopoulos Current issues in directional motor control , 1995, Trends in Neurosciences.

[81]  A P Georgopoulos,et al.  Spatiotemporal Motor Processing a , 1993, Annals of the New York Academy of Sciences.

[82]  N. Hogan,et al.  Does the nervous system use equilibrium-point control to guide single and multiple joint movements? , 1992, The Behavioral and brain sciences.