The Binding of Learning to Action in Motor Adaptation

In motor tasks, errors between planned and actual movements generally result in adaptive changes which reduce the occurrence of similar errors in the future. It has commonly been assumed that the motor adaptation arising from an error occurring on a particular movement is specifically associated with the motion that was planned. Here we show that this is not the case. Instead, we demonstrate the binding of the adaptation arising from an error on a particular trial to the motion experienced on that same trial. The formation of this association means that future movements planned to resemble the motion experienced on a given trial benefit maximally from the adaptation arising from it. This reflects the idea that actual rather than planned motions are assigned ‘credit’ for motor errors because, in a computational sense, the maximal adaptive response would be associated with the condition credited with the error. We studied this process by examining the patterns of generalization associated with motor adaptation to novel dynamic environments during reaching arm movements in humans. We found that these patterns consistently matched those predicted by adaptation associated with the actual rather than the planned motion, with maximal generalization observed where actual motions were clustered. We followed up these findings by showing that a novel training procedure designed to leverage this newfound understanding of the binding of learning to action, can improve adaptation rates by greater than 50%. Our results provide a mechanistic framework for understanding the effects of partial assistance and error augmentation during neurologic rehabilitation, and they suggest ways to optimize their use.

[1]  Gary C. Sing,et al.  Linear hypergeneralization of learned dynamics across movement speeds reveals anisotropic, gain-encoding primitives for motor adaptation. , 2011, Journal of neurophysiology.

[2]  Richard B. Ivry,et al.  Flexible Cognitive Strategies during Motor Learning , 2011, PLoS Comput. Biol..

[3]  Kurt A. Thoroughman,et al.  Rapid Reshaping of Human Motor Generalization , 2005, The Journal of Neuroscience.

[4]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  Robert M. Sanner,et al.  A mathematical model of the adaptive control of human arm motions , 1999, Biological Cybernetics.

[6]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[7]  Konrad Paul Kording,et al.  Estimating the sources of motor errors for adaptation and generalization , 2008, Nature Neuroscience.

[8]  J. Krakauer,et al.  A computational neuroanatomy for motor control , 2008, Experimental Brain Research.

[9]  R. Scheidt,et al.  Reach adaptation and final position control amid environmental uncertainty after stroke. , 2007, Journal of neurophysiology.

[10]  D.J. Reinkensmeyer,et al.  Robot-enhanced motor learning: accelerating internal model formation during locomotion by transient dynamic amplification , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  J. Krakauer,et al.  Sensory prediction errors drive cerebellum-dependent adaptation of reaching. , 2007, Journal of neurophysiology.

[12]  Mark J Wagner,et al.  Shared Internal Models for Feedforward and Feedback Control , 2008, The Journal of Neuroscience.

[13]  T. Ebner,et al.  Hereditary cerebellar ataxia progressively impairs force adaptation during goal-directed arm movements. , 2004, Journal of neurophysiology.

[14]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[15]  S. Lisberger,et al.  The Cerebellum: A Neuronal Learning Machine? , 1996, Science.

[16]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[17]  J. Krakauer,et al.  Explaining savings for visuomotor adaptation: linear time-invariant state-space models are not sufficient. , 2008, Journal of neurophysiology.

[18]  Mitsuo Kawato,et al.  Equilibrium-Point Control Hypothesis Examined by Measured Arm Stiffness During Multijoint Movement , 1996, Science.

[19]  Otmar Bock,et al.  Effects of variable practice and declarative knowledge on sensorimotor adaptation to rotated visual feedback , 2007, Experimental Brain Research.

[20]  Kaoru Yoshida,et al.  Memory of Learning Facilitates Saccadic Adaptation in the Monkey , 2004, The Journal of Neuroscience.

[21]  Kurt A. Thoroughman,et al.  Trial-by-trial transformation of error into sensorimotor adaptation changes with environmental dynamics. , 2007, Journal of neurophysiology.

[22]  Kurt A. Thoroughman,et al.  Motor adaptation to single force pulses: sensitive to direction but insensitive to within-movement pulse placement and magnitude. , 2006, Journal of neurophysiology.

[23]  M. Spong,et al.  Robot Modeling and Control , 2005 .

[24]  M. Häusser,et al.  High-fidelity transmission of sensory information by single cerebellar mossy fibre boutons , 2007, Nature.

[25]  R. Shadmehr,et al.  Intact ability to learn internal models of arm dynamics in Huntington's disease but not cerebellar degeneration. , 2005, Journal of neurophysiology.

[26]  M. Kawato,et al.  A hierarchical neural-network model for control and learning of voluntary movement , 2004, Biological Cybernetics.

[27]  F A Mussa-Ivaldi,et al.  Central representation of time during motor learning. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[28]  James L. Patton,et al.  Therapist-mediated post-stroke rehabilitation using haptic/graphic error augmentation , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[29]  A. Bastian Learning to predict the future: the cerebellum adapts feedforward movement control , 2006, Current Opinion in Neurobiology.

[30]  Masao Ito Cerebellar circuitry as a neuronal machine , 2006, Progress in Neurobiology.

[31]  Timothy J. Ebner,et al.  Cerebellum Predicts the Future Motor State , 2008, The Cerebellum.

[32]  O. Donchin,et al.  Change of desired trajectory caused by training in a novel motor task , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[33]  N. Hogan,et al.  A comparison of functional and impairment-based robotic training in severe to moderate chronic stroke: a pilot study. , 2008, NeuroRehabilitation.

[34]  Robert M. Sanner,et al.  Gaussian Networks for Direct Adaptive Control , 1991, 1991 American Control Conference.

[35]  Hiroshi Imamizu,et al.  Human cerebellar activity reflecting an acquired internal model of a new tool , 2000, Nature.

[36]  Mitsuo Kawato,et al.  A computational model of four regions of the cerebellum based on feedback-error learning , 2004, Biological Cybernetics.

[37]  S. Shankar Sastry,et al.  Adaptive Control of Mechanical Manipulators , 1987, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[38]  Jörn Diedrichsen,et al.  Dissociating Timing and Coordination as Functions of the Cerebellum , 2007, The Journal of Neuroscience.

[39]  R. Shadmehr,et al.  Interacting Adaptive Processes with Different Timescales Underlie Short-Term Motor Learning , 2006, PLoS biology.

[40]  N. H. Sabah,et al.  Afferent volleys in limb nerves influencing impulse discharges in cerebellar cortex I. In mossy fibers and granule cells , 1971, Experimental Brain Research.

[41]  Reza Shadmehr,et al.  Quantifying Generalization from Trial-by-Trial Behavior of Adaptive Systems that Learn with Basis Functions: Theory and Experiments in Human Motor Control , 2003, The Journal of Neuroscience.

[42]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[43]  C Ghez,et al.  Learning of Visuomotor Transformations for Vectorial Planning of Reaching Trajectories , 2000, The Journal of Neuroscience.

[44]  Olivier White,et al.  Use-Dependent and Error-Based Learning of Motor Behaviors , 2010, The Journal of Neuroscience.

[45]  J. Patton,et al.  Visual error augmentation for enhancing motor learning and rehabilitative relearning , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[46]  Jörn Diedrichsen,et al.  Reach adaptation: what determines whether we learn an internal model of the tool or adapt the model of our arm? , 2008, Journal of neurophysiology.

[47]  Reza Shadmehr,et al.  Computational nature of human adaptive control during learning of reaching movements in force fields , 1999, Biological Cybernetics.

[48]  Wilsaan M. Joiner,et al.  Long-term retention explained by a model of short-term learning in the adaptive control of reaching. , 2008, Journal of neurophysiology.

[49]  Reza Shadmehr,et al.  Changes in Control of Saccades during Gain Adaptation , 2008, The Journal of Neuroscience.

[50]  J. Patton,et al.  Evaluation of robotic training forces that either enhance or reduce error in chronic hemiparetic stroke survivors , 2005, Experimental Brain Research.

[51]  F. Mussa-Ivaldi,et al.  The motor system does not learn the dynamics of the arm by rote memorization of past experience. , 1997, Journal of neurophysiology.

[52]  Konrad Paul Kording,et al.  The dynamics of memory as a consequence of optimal adaptation to a changing body , 2007, Nature Neuroscience.

[53]  David J Ostry,et al.  Modifiability of generalization in dynamics learning. , 2007, Journal of neurophysiology.

[54]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[55]  R A Scheidt,et al.  Persistence of motor adaptation during constrained, multi-joint, arm movements. , 2000, Journal of neurophysiology.

[56]  Robert M. Sanner,et al.  Stable Adaptive Control of Robot Manipulators Using Neural Networks , 1995, Neural Computation.

[57]  J. Lackner,et al.  Rapid adaptation to Coriolis force perturbations of arm trajectory. , 1994, Journal of neurophysiology.

[58]  Konrad Paul Kording,et al.  Relevance of error: what drives motor adaptation? , 2009, Journal of neurophysiology.

[59]  Scott E. Bevans,et al.  Effect of visual error size on saccade adaptation in monkey. , 2003, Journal of neurophysiology.

[60]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[61]  Terence D. Sanger,et al.  Failure of Motor Learning for Large Initial Errors , 2004, Neural Computation.

[62]  Neville Hogan,et al.  Robotic upper-limb neurorehabilitation in chronic stroke patients. , 2005, Journal of rehabilitation research and development.

[63]  Gary C. Sing,et al.  Primitives for Motor Adaptation Reflect Correlated Neural Tuning to Position and Velocity , 2009, Neuron.

[64]  D. Nowak,et al.  Dexterity in cerebellar agenesis , 2007, Neuropsychologia.

[65]  Maurice A Smith,et al.  Bayesian and "anti-Bayesian" biases in sensory integration for action and perception in the size-weight illusion. , 2010, Journal of neurophysiology.

[66]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[67]  J. Krakauer,et al.  An Implicit Plan Overrides an Explicit Strategy during Visuomotor Adaptation , 2006, The Journal of Neuroscience.