Principles of sensorimotor learning

The exploits of Martina Navratilova and Roger Federer represent the pinnacle of motor learning. However, when considering the range and complexity of the processes that are involved in motor learning, even the mere mortals among us exhibit abilities that are impressive. We exercise these abilities when taking up new activities — whether it is snowboarding or ballroom dancing — but also engage in substantial motor learning on a daily basis as we adapt to changes in our environment, manipulate new objects and refine existing skills. Here we review recent research in human motor learning with an emphasis on the computational mechanisms that are involved.

[1]  L. Pinneo On noise in the nervous system. , 1966, Psychological review.

[2]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[3]  Michael I. Jordan,et al.  Forward Models: Supervised Learning with a Distal Teacher , 1992, Cogn. Sci..

[4]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  H. Ross,et al.  Learning "what" and "how" in a human motor task. , 1995, Learning & memory.

[6]  W. T. Thach,et al.  Throwing while looking through prisms. II. Specificity and storage of multiple gaze-throw calibrations. , 1996, Brain : a journal of neurology.

[7]  W. T. Thach,et al.  Throwing while looking through prisms. I. Focal olivocerebellar lesions impair adaptation. , 1996, Brain : a journal of neurology.

[8]  E. Bizzi,et al.  Consolidation in human motor memory , 1996, Nature.

[9]  Benoni B. Edin,et al.  Coordination of fingertip forces during human manipulation can emerge from independent neural networks controlling each engaged digit , 1997, Experimental Brain Research.

[10]  J R Flanagan,et al.  The Role of Internal Models in Motion Planning and Control: Evidence from Grip Force Adjustments during Movements of Hand-Held Loads , 1997, The Journal of Neuroscience.

[11]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[12]  M. Hallett,et al.  Rapid plasticity of human cortical movement representation induced by practice. , 1998, Journal of neurophysiology.

[13]  Michael F. Land,et al.  From eye movements to actions: how batsmen hit the ball , 2000, Nature Neuroscience.

[14]  S. Wise,et al.  Mechanisms of use-dependent plasticity in the human motor cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[15]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[16]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[17]  C Ghez,et al.  Learning of Visuomotor Transformations for Vectorial Planning of Reaching Trajectories , 2000, The Journal of Neuroscience.

[18]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[19]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[20]  D. Wolpert,et al.  Motor prediction , 2001, Current Biology.

[21]  G. Rizzolatti,et al.  The Cortical Motor System , 2001, Neuron.

[22]  T. Flash,et al.  Planning Movements in a Simple Redundant Task , 2002, Current Biology.

[23]  C. Heyes,et al.  Motor learning by observation: Evidence from a serial reaction time task , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[24]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[25]  K. Doya,et al.  A unifying computational framework for motor control and social interaction. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[26]  Reza Shadmehr,et al.  Quantifying Generalization from Trial-by-Trial Behavior of Adaptive Systems that Learn with Basis Functions: Theory and Experiments in Human Motor Control , 2003, The Journal of Neuroscience.

[27]  D. Ballard,et al.  What you see is what you need. , 2003, Journal of vision.

[28]  R. Johansson,et al.  Action plans used in action observation , 2003, Nature.

[29]  E. Fetz,et al.  Sensory input to primate spinal cord is presynaptically inhibited during voluntary movement , 2003, Nature Neuroscience.

[30]  J. Kalaska,et al.  Context-dependent anticipation of different task dynamics: rapid recall of appropriate motor skills using visual cues. , 2003, Journal of neurophysiology.

[31]  R. Johansson,et al.  Prediction Precedes Control in Motor Learning , 2003, Current Biology.

[32]  C. S. Green,et al.  Action video game modifies visual selective attention , 2003, Nature.

[33]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[34]  H. Bülthoff,et al.  Merging the senses into a robust percept , 2004, Trends in Cognitive Sciences.

[35]  D. Wolpert,et al.  Consolidation of Dynamic Motor Learning Is Not Disrupted by rTMS of Primary Motor Cortex , 2004, Current Biology.

[36]  Kaoru Yoshida,et al.  Memory of Learning Facilitates Saccadic Adaptation in the Monkey , 2004, The Journal of Neuroscience.

[37]  D. Ostry,et al.  Stimulation of the Posterior Parietal Cortex Interferes with Arm Trajectory Adjustments during the Learning of New Dynamics , 2004, The Journal of Neuroscience.

[38]  D. Wolpert,et al.  Failure to Consolidate the Consolidation Theory of Learning for Sensorimotor Adaptation Tasks , 2004, The Journal of Neuroscience.

[39]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[40]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[41]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[42]  D. Wolpert,et al.  Mental state inference using visual control parameters. , 2005, Brain research. Cognitive brain research.

[43]  Ferdinando A Mussa-Ivaldi,et al.  Remapping hand movements in a novel geometrical environment. , 2005, Journal of neurophysiology.

[44]  R. Ivry,et al.  Cerebellar involvement in anticipating the consequences of self-produced actions during bimanual movements. , 2005, Journal of neurophysiology.

[45]  R. Shadmehr,et al.  Intact ability to learn internal models of arm dynamics in Huntington's disease but not cerebellar degeneration. , 2005, Journal of neurophysiology.

[46]  Yasmin L. Hashambhoy,et al.  Neural Correlates of Reach Errors , 2005, The Journal of Neuroscience.

[47]  Andrew A G Mattar,et al.  Motor Learning by Observing , 2005, Neuron.

[48]  R. Johansson,et al.  Eye–Hand Coordination during Learning of a Novel Visuomotor Task , 2005, The Journal of Neuroscience.

[49]  Steven B. Most,et al.  What you see is what you set: sustained inattentional blindness and the capture of awareness. , 2005, Psychological review.

[50]  J. Lackner,et al.  Motor control and learning in altered dynamic environments , 2005, Current Opinion in Neurobiology.

[51]  Konrad Paul Kording,et al.  Review TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Bayesian decision theory in sensorimotor control , 2022 .

[52]  Stephen H Scott,et al.  Limited transfer of learning between unimanual and bimanual skills within the same limb , 2006, Nature Neuroscience.

[53]  R. Shadmehr,et al.  Why Does the Brain Predict Sensory Consequences of Oculomotor Commands? Optimal Integration of the Predicted and the Actual Sensory Feedback , 2006, The Journal of Neuroscience.

[54]  P. Gribble,et al.  Are there distinct neural representations of object and limb dynamics? , 2006, Experimental Brain Research.

[55]  S. M. Morton,et al.  Cerebellar Contributions to Locomotor Adaptations during Splitbelt Treadmill Walking , 2006, The Journal of Neuroscience.

[56]  R. Johansson,et al.  How a Lateralized Brain Supports Symmetrical Bimanual Tasks , 2006, PLoS biology.

[57]  Roland S Johansson,et al.  Eye movements when observing predictable and unpredictable actions. , 2006, Journal of neurophysiology.

[58]  K. Shenoy,et al.  A Central Source of Movement Variability , 2006, Neuron.

[59]  Hod Lipson,et al.  Resilient Machines Through Continuous Self-Modeling , 2006, Science.

[60]  Pat A. Walsh,et al.  Visualising the onset of meandering structures in a small length scale fluidic junction using dye injections , 2006, J. Vis..

[61]  Francesco Lacquaniti,et al.  Control of Fast-Reaching Movements by Muscle Synergy Combinations , 2006, The Journal of Neuroscience.

[62]  J. Flanagan,et al.  Neural Correlates of Internal-Model Loading , 2006, Current Biology.

[63]  Miles C. Bowman,et al.  Control strategies in object manipulation tasks , 2006, Current Opinion in Neurobiology.

[64]  Peter M. Vishton,et al.  Haptically Linked Dyads , 2006, Psychological science.

[65]  R. Shadmehr,et al.  Interacting Adaptive Processes with Different Timescales Underlie Short-Term Motor Learning , 2006, PLoS biology.

[66]  Daniel M Wolpert,et al.  Computational principles of sensorimotor control that minimize uncertainty and variability , 2007, The Journal of physiology.

[67]  M. Brass,et al.  Investigating Action Understanding: Inferential Processes versus Action Simulation , 2007, Current Biology.

[68]  J. Diedrichsen Optimal Task-Dependent Changes of Bimanual Feedback Control and Adaptation , 2007, Current Biology.

[69]  Rieko Osu,et al.  Endpoint Stiffness of the Arm Is Directionally Tuned to Instability in the Environment , 2007, The Journal of Neuroscience.

[70]  J. Ashe,et al.  Lack of adaptation to random conflicting force fields of variable magnitude. , 2007, Journal of neurophysiology.

[71]  J. Krakauer,et al.  Sensory prediction errors drive cerebellum-dependent adaptation of reaching. , 2007, Journal of neurophysiology.

[72]  Konrad Paul Kording,et al.  The dynamics of memory as a consequence of optimal adaptation to a changing body , 2007, Nature Neuroscience.

[73]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[74]  Edwin M Robertson,et al.  Inducing motor skill improvements with a declarative task , 2007, Nature Neuroscience.

[75]  Reza Shadmehr,et al.  Impairment of Retention But Not Acquisition of a Visuomotor Skill Through Time-Dependent Disruption of Primary Motor Cortex , 2007, The Journal of Neuroscience.

[76]  Konrad Paul Kording,et al.  Estimating the sources of motor errors for adaptation and generalization , 2008, Nature Neuroscience.

[77]  C. Urgesi,et al.  Action anticipation and motor resonance in elite basketball players , 2008, Nature Neuroscience.

[78]  Clayton E Curtis,et al.  Obligatory adaptation of saccade gains. , 2008, Journal of neurophysiology.

[79]  Ian S Howard,et al.  Composition and Decomposition in Bimanual Dynamic Learning , 2008, The Journal of Neuroscience.

[80]  Vincent S. Huang,et al.  Active learning: learning a motor skill without a coach. , 2008, Journal of neurophysiology.

[81]  Sethu Vijayakumar,et al.  Unifying the Sensory and Motor Components of Sensorimotor Adaptation , 2008, NIPS.

[82]  J. A. Pruszynski,et al.  Rapid motor responses are appropriately tuned to the metrics of a visuospatial task. , 2008, Journal of neurophysiology.

[83]  M. Landy,et al.  Decision making, movement planning and statistical decision theory , 2008, Trends in Cognitive Sciences.

[84]  Rieko Osu,et al.  CNS Learns Stable, Accurate, and Efficient Movements Using a Simple Algorithm , 2008, The Journal of Neuroscience.

[85]  J. Randall Flanagan,et al.  Flexible Representations of Dynamics Are Used in Object Manipulation , 2008, Current Biology.

[86]  Mark J Wagner,et al.  Shared Internal Models for Feedforward and Feedback Control , 2008, The Journal of Neuroscience.

[87]  P. Thier,et al.  Reduced saccadic resilience and impaired saccadic adaptation due to cerebellar disease , 2007, The European journal of neuroscience.

[88]  Jörn Diedrichsen,et al.  Reach adaptation: what determines whether we learn an internal model of the tool or adapt the model of our arm? , 2008, Journal of neurophysiology.

[89]  N. Schweighofer,et al.  Dual Adaptation Supports a Parallel Architecture of Motor Memory , 2009, The Journal of Neuroscience.

[90]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[91]  Gary C. Sing,et al.  Primitives for Motor Adaptation Reflect Correlated Neural Tuning to Position and Velocity , 2009, Neuron.

[92]  D. Wolpert,et al.  Changing your mind: a computational mechanism of vacillation , 2009, Nature.

[93]  R. J. Beers,et al.  Motor Learning Is Optimally Tuned to the Properties of Motor Noise , 2009, Neuron.

[94]  A. Luft,et al.  Dopaminergic signals in primary motor cortex , 2009, International Journal of Developmental Neuroscience.

[95]  D. Henriques,et al.  Sensory recalibration of hand position following visuomotor adaptation. , 2009, Journal of neurophysiology.

[96]  Gereon R. Fink,et al.  End or Means—The “What” and “How” of Observed Intentional Actions , 2009, Journal of Cognitive Neuroscience.

[97]  S. Scott,et al.  Multi-compartment model can explain partial transfer of learning within the same limb between unimanual and bimanual reaching , 2009, Experimental Brain Research.

[98]  Jörn Diedrichsen,et al.  Integration of vision and haptics during tool use. , 2009, Journal of vision.

[99]  Ethan R. Buch,et al.  Noninvasive cortical stimulation enhances motor skill acquisition over multiple days through an effect on consolidation , 2009, Proceedings of the National Academy of Sciences.

[100]  Daniel A. Braun,et al.  Nash Equilibria in Multi-Agent Motor Interactions , 2009, PLoS Comput. Biol..

[101]  Jeremy D Wong,et al.  Visual cues signaling object grasp reduce interference in motor learning. , 2009, Journal of neurophysiology.

[102]  B. Tatler,et al.  Looking and Acting: Vision and eye movements in natural behaviour , 2009 .

[103]  Emanuel Todorov,et al.  Structured variability of muscle activations supports the minimal intervention principle of motor control. , 2009, Journal of neurophysiology.

[104]  Daniel A. Braun,et al.  Learning Optimal Adaptation Strategies in Unpredictable Motor Tasks , 2009, The Journal of Neuroscience.

[105]  Carl E. Rasmussen,et al.  Gaussian process dynamic programming , 2009, Neurocomputing.

[106]  Daniel A. Braun,et al.  Motor Task Variation Induces Structural Learning , 2009, Current Biology.

[107]  John W Krakauer,et al.  Adaptation to visuomotor rotation through interaction between posterior parietal and motor cortical areas. , 2009, Journal of neurophysiology.

[108]  J. A. Pruszynski,et al.  Temporal evolution of "automatic gain-scaling". , 2009, Journal of neurophysiology.

[109]  David J. Ostry,et al.  Auditory plasticity and speech motor learning , 2009, Proceedings of the National Academy of Sciences.

[110]  Vincent S. Huang,et al.  Persistence of motor memories reflects statistics of the learning event. , 2009, Journal of neurophysiology.

[111]  S. Vijayakumar,et al.  A Computational Model of Limb Impedance Control Based on Principles of Internal Model Uncertainty , 2010, PloS one.

[112]  J. Kalaska,et al.  Neural mechanisms for interacting with a world full of action choices. , 2010, Annual review of neuroscience.

[113]  Olivier White,et al.  Use-Dependent and Error-Based Learning of Motor Behaviors , 2010, The Journal of Neuroscience.

[114]  Rachael D. Seidler,et al.  Contributions of Spatial Working Memory to Visuomotor Learning , 2010, Journal of Cognitive Neuroscience.

[115]  Jody C. Culham,et al.  fMRI Activation during Observation of Others' Reach Errors , 2010, Journal of Cognitive Neuroscience.

[116]  Jeremy D Wong,et al.  Somatosensory Plasticity and Motor Learning , 2010, The Journal of Neuroscience.

[117]  D. Wolpert,et al.  Multiple Grasp-Specific Representations of Tool Dynamics Mediate Skillful Manipulation , 2010, Current Biology.

[118]  R. Shadmehr,et al.  A Shared Resource between Declarative Memory and Motor Memory , 2010, The Journal of Neuroscience.

[119]  Daniel A. Braun,et al.  Risk-Sensitive Optimal Feedback Control Accounts for Sensorimotor Behavior under Uncertainty , 2010, PLoS Comput. Biol..

[120]  D. Wolpert,et al.  Structure Learning in a Sensorimotor Association Task , 2010, PloS one.

[121]  D. Wolpert,et al.  Context-dependent partitioning of motor learning in bimanual movements. , 2010, Journal of neurophysiology.

[122]  W. Schultz,et al.  Neural mechanisms of observational learning , 2010, Proceedings of the National Academy of Sciences.

[123]  Daniel A. Braun,et al.  Structure learning in action , 2010, Behavioural Brain Research.

[124]  J. Diedrichsen,et al.  Responsibility Assignment in Redundant Systems , 2010, Current Biology.

[125]  D. Pélisson,et al.  Sensorimotor adaptation of saccadic eye movements , 2010, Neuroscience & Biobehavioral Reviews.

[126]  Maura Casadio,et al.  Reorganization of finger coordination patterns during adaptation to rotation and scaling of a newly learned sensorimotor transformation. , 2011, Journal of neurophysiology.

[127]  Heidi M. Schambra,et al.  Reward Improves Long-Term Retention of a Motor Memory through Induction of Offline Memory Gains , 2011, Current Biology.

[128]  Philip N. Sabes,et al.  How Each Movement Changes the Next: An Experimental and Theoretical Study of Fast Adaptive Priors in Reaching , 2011, The Journal of Neuroscience.

[129]  Daniel A. Braun,et al.  Risk-Sensitivity in Sensorimotor Control , 2011, Front. Hum. Neurosci..

[130]  Daniel A. Braun,et al.  Risk-sensitivity and the mean-variance trade-off: decision making in sensorimotor control , 2011, Proceedings of the Royal Society B: Biological Sciences.

[131]  P. Celnik,et al.  Dissociating the roles of the cerebellum and motor cortex during adaptive learning: the motor cortex retains what the cerebellum learns. , 2011, Cerebral cortex.

[132]  Daniel A. Braun,et al.  Motor coordination: when two have to act as one , 2011, Experimental Brain Research.

[133]  Vincent S. Huang,et al.  Rethinking Motor Learning and Savings in Adaptation Paradigms: Model-Free Memory for Successful Actions Combines with Internal Models , 2011, Neuron.

[134]  Laurent Madelain,et al.  Modification of saccadic gain by reinforcement. , 2011, Journal of neurophysiology.

[135]  Ana Pekanovic,et al.  Dopaminergic Projections from Midbrain to Primary Motor Cortex Mediate Motor Skill Learning , 2011, The Journal of Neuroscience.

[136]  Reza Shadmehr,et al.  Learning from Sensory and Reward Prediction Errors during Motor Adaptation , 2011, PLoS Comput. Biol..

[137]  J. Flanagan,et al.  Relation between reaction time and reach errors during visuomotor adaptation , 2011, Behavioural Brain Research.