Error correction, sensory prediction, and adaptation in motor control.

Motor control is the study of how organisms make accurate goal-directed movements. Here we consider two problems that the motor system must solve in order to achieve such control. The first problem is that sensory feedback is noisy and delayed, which can make movements inaccurate and unstable. The second problem is that the relationship between a motor command and the movement it produces is variable, as the body and the environment can both change. A solution is to build adaptive internal models of the body and the world. The predictions of these internal models, called forward models because they transform motor commands into sensory consequences, can be used to both produce a lifetime of calibrated movements, and to improve the ability of the sensory system to estimate the state of the body and the world around it. Forward models are only useful if they produce unbiased predictions. Evidence shows that forward models remain calibrated through motor adaptation: learning driven by sensory prediction errors.

[1]  Richard Held,et al.  Technique for Studying Adaptation to Disarranged Hand-Eye Coordination , 1958 .

[2]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[3]  R. Held,et al.  PLASTICITY IN HUMAN SENSORIMOTOR CONTROL. , 1963, Science.

[4]  S. C. Mclaughlin Parametric adjustment in saccadic eye movements , 1967 .

[5]  D. Robinson,et al.  Absence of a stretch reflex in extraocular muscles of the monkey. , 1971, Journal of neurophysiology.

[6]  B. Cohen,et al.  Quantitative analysis of the velocity characteristics of optokinetic nystagmus and optokinetic after‐nystagmus , 1977, The Journal of physiology.

[7]  F A Miles,et al.  THE “ERROR” SIGNALS SUBSERVING ADAPTIVE GAIN CONTROL IN THE PRIMATE VESTIBULO‐OCULAR REFLEX , 1981, Annals of the New York Academy of Sciences.

[8]  D. Sparks,et al.  Corollary discharge provides accurate eye position information to the oculomotor system. , 1983, Science.

[9]  A. Fuchs,et al.  Fatigue resistance of human extraocular muscles. , 1983, Journal of neurophysiology.

[10]  J. F. Soechting,et al.  Behavior of the stretch reflex in a multi-jointed limb , 1984, Brain Research.

[11]  J. V. Gisbergen,et al.  A parametric analysis of human saccades in different experimental paradigms , 1987, Vision Research.

[12]  D S Zee,et al.  Effects of occipital lobectomy upon eye movements in primate. , 1987, Journal of neurophysiology.

[13]  J. F. Soechting,et al.  Quantitative evaluation of the electromyographic responses to multidirectional load perturbations of the human arm. , 1988, Journal of neurophysiology.

[14]  宇野 洋二,et al.  Formation and control of optimal trajectory in human multijoint arm movement : minimum torque-change model , 1988 .

[15]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[16]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  J. Lackner,et al.  Rapid adaptation to Coriolis force perturbations of arm trajectory. , 1994, Journal of neurophysiology.

[18]  Amy Wenzel,et al.  One hundred years of forgetting: A quantitative description of retention , 1996 .

[19]  E Bizzi,et al.  Motor learning by field approximation. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[20]  D. Rubin,et al.  One Hundred Years of Forgetting : A Quantitative Description of Retention , 1996 .

[21]  Paul DiZio,et al.  Motor function in microgravity: movement in weightlessness , 1996, Current Opinion in Neurobiology.

[22]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[23]  Peter Thier,et al.  False perception of motion in a patient who cannot compensate for eye movements , 1997, Nature.

[24]  P. van Donkelaar,et al.  Eye-hand interactions during goal-directed pointing movements. , 1997, Neuroreport.

[25]  Paul van Donkelaar,et al.  Eye–hand interactions during goal‐directed pointing movements , 1997 .

[26]  A. Fuchs,et al.  Characteristics of saccadic gain adaptation in rhesus macaques. , 1997, Journal of neurophysiology.

[27]  A. Fuchs,et al.  Saccadic gain modification: visual error drives motor adaptation. , 1998, Journal of neurophysiology.

[28]  R J Leigh,et al.  Properties of horizontal saccades accompanied by blinks. , 1998, Journal of neurophysiology.

[29]  R Shadmehr,et al.  Electromyographic Correlates of Learning an Internal Model of Reaching Movements , 1999, The Journal of Neuroscience.

[30]  Reza Shadmehr,et al.  Computational nature of human adaptive control during learning of reaching movements in force fields , 1999, Biological Cybernetics.

[31]  John W. Krakauer,et al.  Independent learning of internal models for kinematic and dynamic control of reaching , 1999, Nature Neuroscience.

[32]  C Ghez,et al.  Learning of Visuomotor Transformations for Vectorial Planning of Reaching Trajectories , 2000, The Journal of Neuroscience.

[33]  R A Scheidt,et al.  Persistence of motor adaptation during constrained, multi-joint, arm movements. , 2000, Journal of neurophysiology.

[34]  O. Hikosaka,et al.  Modulation of saccadic eye movements by predicted reward outcome , 2001, Experimental Brain Research.

[35]  F R Robinson,et al.  Visual error is the stimulus for saccade gain adaptation. , 2001, Brain research. Cognitive brain research.

[36]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[37]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[38]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[39]  Anthony R. Dickinson,et al.  Eye-hand coordination: saccades are faster when accompanied by a coordinated arm movement. , 2002, Journal of neurophysiology.

[40]  R. Shadmehr,et al.  A Real-Time State Predictor in Motor Control: Study of Saccadic Eye Movements during Unseen Reaching Movements , 2002, The Journal of Neuroscience.

[41]  Stefan Schaal,et al.  Forward models in visuomotor control. , 2002, Journal of neurophysiology.

[42]  R. Wurtz,et al.  A Pathway in Primate Brain for Internal Monitoring of Movements , 2002, Science.

[43]  J. Saunders,et al.  Humans use continuous visual feedback from the hand to control fast reaching movements , 2003, Experimental Brain Research.

[44]  R. Johansson,et al.  Prediction Precedes Control in Motor Learning , 2003, Current Biology.

[45]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[46]  J. Krakauer,et al.  Differential cortical and subcortical activations in learning rotations and gains for reaching: a PET study. , 2004, Journal of neurophysiology.

[47]  R. Rescorla Spontaneous recovery. , 2004, Learning & memory.

[48]  David C Knill,et al.  Visual Feedback Control of Hand Movements , 2004, The Journal of Neuroscience.

[49]  Kaoru Yoshida,et al.  Memory of Learning Facilitates Saccadic Adaptation in the Monkey , 2004, The Journal of Neuroscience.

[50]  J. Wixted On Common Ground: Jost's (1897) law of forgetting and Ribot's (1881) law of retrograde amnesia. , 2004, Psychological review.

[51]  Daniel M Wolpert,et al.  Bayesian integration in force estimation. , 2004, Journal of neurophysiology.

[52]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[53]  D. Ostry,et al.  Stimulation of the Posterior Parietal Cortex Interferes with Arm Trajectory Adjustments during the Learning of New Dynamics , 2004, The Journal of Neuroscience.

[54]  J. Krakauer,et al.  Adaptation to Visuomotor Transformations: Consolidation, Interference, and Forgetting , 2005, The Journal of Neuroscience.

[55]  Randolf Menzel,et al.  Spontaneous Recovery from Extinction Depends on the Reconsolidation of the Acquisition Memory in an Appetitive Learning Paradigm in the Honeybee (Apis mellifera) , 2005, The Journal of Neuroscience.

[56]  R. Shadmehr,et al.  Adaptation and generalization in acceleration-dependent force fields , 2006, Experimental Brain Research.

[57]  R. Shadmehr,et al.  Why Does the Brain Predict Sensory Consequences of Oculomotor Commands? Optimal Integration of the Predicted and the Actual Sensory Feedback , 2006, The Journal of Neuroscience.

[58]  T. Ebner,et al.  Force field effects on cerebellar Purkinje cell discharge with implications for internal models , 2006, Nature Neuroscience.

[59]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[60]  J. Krakauer,et al.  An Implicit Plan Overrides an Explicit Strategy during Visuomotor Adaptation , 2006, The Journal of Neuroscience.

[61]  J. Krakauer,et al.  Generalization of Motor Learning Depends on the History of Prior Action , 2006, PLoS biology.

[62]  Robert H. Wurtz,et al.  Influence of the thalamus on spatial visual processing in frontal cortex , 2006, Nature.

[63]  Emilio Bizzi,et al.  Disruption of Primary Motor Cortex before Learning Impairs Memory of Movement Dynamics , 2006, The Journal of Neuroscience.

[64]  R. Shadmehr,et al.  Interacting Adaptive Processes with Different Timescales Underlie Short-Term Motor Learning , 2006, PLoS biology.

[65]  J. Krakauer,et al.  Sensory prediction errors drive cerebellum-dependent adaptation of reaching. , 2007, Journal of neurophysiology.

[66]  Konrad Paul Kording,et al.  The dynamics of memory as a consequence of optimal adaptation to a changing body , 2007, Nature Neuroscience.

[67]  L. Christensen,et al.  University of Birmingham Disruption of state estimation in the human lateral cerebellum , 2007 .

[68]  Kazuyuki Aihara,et al.  Bayesian Inference Explains Perception of Unity and Ventriloquism Aftereffect: Identification of Common Sources of Audiovisual Stimuli , 2007, Neural Computation.

[69]  Scott T. Grafton,et al.  BOLD coherence reveals segregated functional neural interactions when adapting to distinct torque perturbations. , 2007, Journal of neurophysiology.

[70]  Reza Shadmehr,et al.  Impairment of Retention But Not Acquisition of a Visuomotor Skill Through Time-Dependent Disruption of Primary Motor Cortex , 2007, The Journal of Neuroscience.

[71]  Raul Benitez,et al.  Motor adaptation as a greedy optimization of error and effort. , 2007, Journal of neurophysiology.

[72]  Sarah E. Criscimagna-Hemminger,et al.  Consolidation Patterns of Human Motor Memory , 2008, The Journal of Neuroscience.

[73]  Reza Shadmehr,et al.  On-Line Processing of Uncertain Information in Visuomotor Control , 2008, The Journal of Neuroscience.

[74]  Wilsaan M. Joiner,et al.  Adaptive Control of Saccades via Internal Feedback , 2008, The Journal of Neuroscience.

[75]  J. Krakauer,et al.  A computational neuroanatomy for motor control , 2008, Experimental Brain Research.

[76]  Wilsaan M. Joiner,et al.  Long-term retention explained by a model of short-term learning in the adaptive control of reaching. , 2008, Journal of neurophysiology.

[77]  R. Shadmehr,et al.  Spontaneous recovery of motor memory during saccade adaptation. , 2008, Journal of neurophysiology.

[78]  Reza Shadmehr,et al.  Motor Adaptation as a Process of Reoptimization , 2008, The Journal of Neuroscience.

[79]  Mark J Wagner,et al.  Shared Internal Models for Feedforward and Feedback Control , 2008, The Journal of Neuroscience.

[80]  P. Thier,et al.  Reduced saccadic resilience and impaired saccadic adaptation due to cerebellar disease , 2007, The European journal of neuroscience.

[81]  J. Krakauer,et al.  Explaining savings for visuomotor adaptation: linear time-invariant state-space models are not sufficient. , 2008, Journal of neurophysiology.

[82]  J. A. Pruszynski,et al.  Long-Latency Reflexes of the Human Arm Reflect an Internal Model of Limb Dynamics , 2008, Current Biology.

[83]  R. Shadmehr,et al.  The intrinsic value of visual information affects saccade velocities , 2009, Experimental Brain Research.

[84]  Ethan R. Buch,et al.  Noninvasive cortical stimulation enhances motor skill acquisition over multiple days through an effect on consolidation , 2009, Proceedings of the National Academy of Sciences.

[85]  Jeremy D Wong,et al.  Visual cues signaling object grasp reduce interference in motor learning. , 2009, Journal of neurophysiology.

[86]  John W Krakauer,et al.  Motor learning and consolidation: the case of visuomotor rotation. , 2009, Advances in experimental medicine and biology.

[87]  Daniel A. Braun,et al.  Motor Task Variation Induces Structural Learning , 2009, Current Biology.

[88]  R. Shadmehr,et al.  Cerebellar Contributions to Adaptive Control of Saccades in Humans , 2009, The Journal of Neuroscience.

[89]  J. Kalaska,et al.  Neural mechanisms for interacting with a world full of action choices. , 2010, Annual review of neuroscience.

[90]  S. Jacobson,et al.  The genomic, biochemical, and cellular responses of the retina in inherited photoreceptor degenerations and prospects for the treatment of these disorders. , 2010, Annual review of neuroscience.

[91]  M. Goldberg,et al.  Attention, intention, and priority in the parietal lobe. , 2010, Annual review of neuroscience.

[92]  S. Dib-Hajj,et al.  Sodium channels in normal and pathological pain. , 2010, Annual review of neuroscience.

[93]  C. Shilyansky,et al.  Molecular and cellular mechanisms of learning disabilities: a focus on NF1. , 2010, Annual review of neuroscience.