How is a motor skill learned? Change and invariance at the levels of task success and trajectory control.

The public pays large sums of money to watch skilled motor performance. Notably, however, in recent decades motor skill learning (performance improvement beyond baseline levels) has received less experimental attention than motor adaptation (return to baseline performance in the setting of an external perturbation). Motor skill can be assessed at the levels of task success and movement quality, but the link between these levels remains poorly understood. We devised a motor skill task that required visually guided curved movements of the wrist without a perturbation, and we defined skill learning at the task level as a change in the speed-accuracy trade-off function (SAF). Practice in restricted speed ranges led to a global shift of the SAF. We asked how the SAF shift maps onto changes in trajectory kinematics, to establish a link between task-level performance and fine motor control. Although there were small changes in mean trajectory, improved performance largely consisted of reduction in trial-to-trial variability and increase in movement smoothness. We found evidence for improved feedback control, which could explain the reduction in variability but does not preclude other explanations such as an increased signal-to-noise ratio in cortical representations. Interestingly, submovement structure remained learning invariant. The global generalization of the SAF across a wide range of difficulty suggests that skill for this task is represented in a temporally scalable network. We propose that motor skill acquisition can be characterized as a slow reduction in movement variability, which is distinct from faster model-based learning that reduces systematic error in adaptation paradigms.

[1]  Professor Bartlett on skill. , 1948 .

[2]  Professor Bartlett on skill. , 1948, Occupational psychology.

[3]  J. Deese The psychology of learning , 1952 .

[4]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[5]  C. Reinsch Smoothing by spline functions , 1967 .

[6]  A. T. Welford,et al.  The fundamentals of skill , 1968 .

[7]  Wayne A. Wickelgren,et al.  Speed-accuracy tradeoff and information processing dynamics , 1977 .

[8]  R. Welch Perceptual modification : adapting to altered sensory environments / Robert B. Welch , 1978 .

[9]  M C Davison,et al.  The relation between the generalized matching law and signal-detection theory. , 1978, Journal of the experimental analysis of behavior.

[10]  J. T. Massey,et al.  Spatial trajectories and reaction times of aimed movements: effects of practice, uncertainty, and change in target location. , 1981, Journal of neurophysiology.

[11]  P. Viviani,et al.  Trajectory determines movement dynamics , 1982, Neuroscience.

[12]  Timothy D. Lee,et al.  Motor Control and Learning: A Behavioral Emphasis , 1982 .

[13]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  J. Adams Historical review and appraisal of research on the learning, retention, and transfer of human motor skills. , 1987 .

[15]  G. Logan Toward an instance theory of automatization. , 1988 .

[16]  R A Abrams,et al.  Optimality in human motor performance: ideal control of rapid aimed movements. , 1988, Psychological review.

[17]  H. Cunningham Aiming error under transformed spatial mappings suggests a structure for visual-motor maps. , 1989, Journal of experimental psychology. Human perception and performance.

[18]  Felice L. Bedford,et al.  Constraints on learning new mappings between perceptual dimensions , 1989 .

[19]  A Agresti,et al.  Tutorial on modeling ordered categorical response data. , 1989, Psychological bulletin.

[20]  M. Hallett,et al.  Motor learning in patients with cerebellar dysfunction. , 1990, Brain : a journal of neurology.

[21]  K. M. Newell,et al.  Searching for solutions to the coordination function : learning as exploratory behavior , 1992 .

[22]  G. Recanzone,et al.  Changes in the distributed temporal response properties of SI cortical neurons reflect improvements in performance on a temporally based tactile discrimination task. , 1992, Journal of neurophysiology.

[23]  T. Milner,et al.  A model for the generation of movements requiring endpoint precision , 1992, Neuroscience.

[24]  Otmar Bock,et al.  Adaptation of aimed arm movements to sensorimotor discordance: evidence for direction-independent gain control , 1992, Behavioural Brain Research.

[25]  S. Jaric,et al.  Principles for learning single-joint movements. I. Enhanced performance by practice. , 1993, Experimental brain research.

[26]  J. Wessberg,et al.  Organization of motor output in slow finger movements in man. , 1993, The Journal of physiology.

[27]  T. D. Lee,et al.  Contextual interference in movements of the same class: differential effects on program and parameter learning. , 1993, Journal of motor behavior.

[28]  R A Abrams,et al.  Rapid aimed limb movements: differential effects of practice on component submovements. , 1993, Journal of motor behavior.

[29]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[30]  Leslie G. Ungerleider,et al.  Functional MRI evidence for adult motor cortex plasticity during motor skill learning , 1995, Nature.

[31]  R. Proctor,et al.  Skill acquisition and human performance , 1995 .

[32]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[33]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[34]  S. Kitazawa,et al.  Prism Adaptation of Reaching Movements: Specificity for the Velocity of Reaching , 1997, The Journal of Neuroscience.

[35]  R Plamondon,et al.  Speed/accuracy trade-offs in target-directed movements , 1997, Behavioral and Brain Sciences.

[36]  Daniel B. Willingham,et al.  A Neuropsychological Theory of Motor Skill Learning , 2004 .

[37]  D. Wolpert,et al.  Temporal and amplitude generalization in motor learning. , 1998, Journal of neurophysiology.

[38]  Joseph A. Doeringer,et al.  Intermittency in preplanned elbow movements persists in the absence of visual feedback. , 1998, Journal of neurophysiology.

[39]  Gregor Schöner,et al.  The uncontrolled manifold concept: identifying control variables for a functional task , 1999, Experimental Brain Research.

[40]  John W. Krakauer,et al.  Independent learning of internal models for kinematic and dynamic control of reaching , 1999, Nature Neuroscience.

[41]  A B Schwartz,et al.  Motor cortical representation of speed and direction during reaching. , 1999, Journal of neurophysiology.

[42]  Hiroshi Imamizu,et al.  Human cerebellar activity reflecting an acquired internal model of a new tool , 2000, Nature.

[43]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[44]  C Ghez,et al.  Learning of Visuomotor Transformations for Vectorial Planning of Reaching Trajectories , 2000, The Journal of Neuroscience.

[45]  M. Ghilardi,et al.  Patterns of regional brain activation associated with different forms of motor learning , 2000, Brain Research.

[46]  M Hallett,et al.  Changes in motor cortex excitability during ipsilateral hand muscle activation in humans , 2000, Clinical Neurophysiology.

[47]  K. Newell,et al.  Time scales in motor learning and development. , 2001, Psychological review.

[48]  R. Sainburg,et al.  Interlimb transfer of visuomotor rotations: independence of direction and final position information , 2002, Experimental Brain Research.

[49]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[50]  K. E. Novak,et al.  The use of overlapping submovements in the control of rapid hand movements , 2002, Experimental Brain Research.

[51]  R. Stickgold,et al.  Practice with Sleep Makes Perfect Sleep-Dependent Motor Skill Learning , 2002, Neuron.

[52]  R. Miall,et al.  Adaptation to rotated visual feedback: a re-examination of motor interference , 2003, Experimental Brain Research.

[53]  Neville Hogan,et al.  Avoiding spurious submovement decompositions: a globally optimal algorithm , 2003, Biological Cybernetics.

[54]  M. Hallett,et al.  How self-initiated memorized movements become automatic: a functional MRI study. , 2004, Journal of neurophysiology.

[55]  P. Morasso,et al.  Trajectory formation and handwriting: A computational model , 1982, Biological Cybernetics.

[56]  D. Sternad,et al.  Decomposition of variability in the execution of goal-oriented tasks: three components of skill improvement. , 2004, Journal of experimental psychology. Human perception and performance.

[57]  S. Jaric,et al.  Principles for learning single-joint movements , 1993, Experimental Brain Research.

[58]  R. J. van Beers,et al.  The role of execution noise in movement variability. , 2004, Journal of neurophysiology.

[59]  J. Kleim,et al.  Cortical Synaptogenesis and Motor Map Reorganization Occur during Late, But Not Early, Phase of Motor Skill Learning , 2004, The Journal of Neuroscience.

[60]  M. Guadagnoli,et al.  Challenge Point: A Framework for Conceptualizing the Effects of Various Practice Conditions in Motor Learning , 2004, Journal of motor behavior.

[61]  William J Kargo,et al.  Improvements in the Signal-to-Noise Ratio of Motor Cortex Cells Distinguish Early versus Late Phases of Motor Skill Learning , 2004, The Journal of Neuroscience.

[62]  R. Shadmehr Generalization as a behavioral window to the neural mechanisms of learning internal models. , 2004, Human movement science.

[63]  K. Worsley,et al.  Unified univariate and multivariate random field theory , 2004, NeuroImage.

[64]  Michael I. Jordan,et al.  Are arm trajectories planned in kinematic or dynamic coordinates? An adaptation study , 1995, Experimental Brain Research.

[65]  Karl M Newell,et al.  Changes in the structure of children's isometric force variability with practice. , 2004, Journal of experimental child psychology.

[66]  D. Wolpert,et al.  Failure to Consolidate the Consolidation Theory of Learning for Sensorimotor Adaptation Tasks , 2004, The Journal of Neuroscience.

[67]  Edward A. Stern,et al.  Birdbrains could teach basal ganglia research a new song , 2005, Trends in Neurosciences.

[68]  J. Barden,et al.  Repetitive pointing to remembered proprioceptive targets improves 3D hand positioning accuracy. , 2005, Human movement science.

[69]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[70]  W. Bialek,et al.  A sensory source for motor variation , 2005, Nature.

[71]  Aaron S. Andalman,et al.  Vocal Experimentation in the Juvenile Songbird Requires a Basal Ganglia Circuit , 2005, PLoS biology.

[72]  T. Sanger Arm Trajectories in Dyskinetic Cerebral Palsy Have Increased Random Variability , 2006, Journal of child neurology.

[73]  K. Newell,et al.  Qualitative and quantitative change in the dynamics of motor learning. , 2006, Journal of experimental psychology. Human perception and performance.

[74]  Sygal Amitay,et al.  Discrimination learning induced by training with identical stimuli , 2006, Nature Neuroscience.

[75]  J. Krakauer,et al.  An Implicit Plan Overrides an Explicit Strategy during Visuomotor Adaptation , 2006, The Journal of Neuroscience.

[76]  A. Bastian Learning to predict the future: the cerebellum adapts feedforward movement control , 2006, Current Opinion in Neurobiology.

[77]  K. Shenoy,et al.  A Central Source of Movement Variability , 2006, Neuron.

[78]  R. Shadmehr,et al.  Interacting Adaptive Processes with Different Timescales Underlie Short-Term Motor Learning , 2006, PLoS biology.

[79]  J C Houk,et al.  Action selection and refinement in subcortical loops through basal ganglia and cerebellum , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[80]  Philip N. Sabes,et al.  Visual-shift adaptation is composed of separable sensory and task-dependent effects. , 2007, Journal of neurophysiology.

[81]  J. Krakauer,et al.  Sensory prediction errors drive cerebellum-dependent adaptation of reaching. , 2007, Journal of neurophysiology.

[82]  John C Rothwell,et al.  Differential Modulation of Motor Cortical Plasticity and Excitability in Early and Late Phases of Human Motor Learning , 2007, The Journal of Neuroscience.

[83]  R. J. van Beers,et al.  The Sources of Variability in Saccadic Eye Movements , 2007, The Journal of Neuroscience.

[84]  R. J. Beers The Sources of Variability in Saccadic Eye Movements , 2007 .

[85]  T. R. Kaminski,et al.  Learning a multi-joint throwing task: a morphometric analysis of skill development , 2008, Experimental Brain Research.

[86]  D. Sternad,et al.  Variability in motor learning: relocating, channeling and reducing noise , 2009, Experimental Brain Research.

[87]  Claude Bonnet,et al.  Reaction times as a measure of uncertainty. , 2008, Psicothema.

[88]  P. Thier,et al.  The Cerebellum Updates Predictions about the Visual Consequences of One's Behavior , 2008, Current Biology.

[89]  Mark J Wagner,et al.  Shared Internal Models for Feedforward and Feedback Control , 2008, The Journal of Neuroscience.

[90]  Stefan Schaal,et al.  Learning and generalization of motor skills by learning from demonstration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[91]  W. Gan,et al.  Stably maintained dendritic spines are associated with lifelong memories , 2009, Nature.

[92]  Willie F. Tobin,et al.  Rapid formation and selective stabilization of synapses for enduring motor memories , 2009, Nature.

[93]  J. Krakauer,et al.  Inside the brain of an elite athlete: the neural processes that support high achievement in sports , 2009, Nature Reviews Neuroscience.

[94]  Yoram Ben-Shaul,et al.  A Compact Representation of Drawing Movements with Sequences of Parabolic Primitives , 2009, PLoS Comput. Biol..

[95]  Ethan R. Buch,et al.  Noninvasive cortical stimulation enhances motor skill acquisition over multiple days through an effect on consolidation , 2009, Proceedings of the National Academy of Sciences.

[96]  John W Krakauer,et al.  Learning of a sequential motor skill comprises explicit and implicit components that consolidate differently. , 2009, Journal of neurophysiology.

[97]  Dagmar Sternad,et al.  Motor learning: changes in the structure of variability in a redundant task. , 2009, Advances in experimental medicine and biology.

[98]  Jean-René Duhamel,et al.  Optimal Sensorimotor Control in Eye Movement Sequences , 2009, The Journal of Neuroscience.

[99]  P Madeleine,et al.  Changes in the amount and structure of motor variability during a deboning process are associated with work experience and neck-shoulder discomfort. , 2009, Applied ergonomics.

[100]  D Timmann,et al.  Adaptation to visuomotor rotation and force field perturbation is correlated to different brain areas in patients with cerebellar degeneration. , 2009, Journal of neurophysiology.

[101]  Daniel A. Braun,et al.  Optimal Control Predicts Human Performance on Objects with Internal Degrees of Freedom , 2009, PLoS Comput. Biol..

[102]  John W Krakauer,et al.  Adaptation to visuomotor rotation through interaction between posterior parietal and motor cortical areas. , 2009, Journal of neurophysiology.

[103]  Gregory A Apker,et al.  Interacting noise sources shape patterns of arm movement variability in three-dimensional space. , 2010, Journal of neurophysiology.

[104]  Jennifer L. Raymond,et al.  Motor Learning Reduces Eye Movement Variability through Reweighting of Sensory Inputs , 2010, The Journal of Neuroscience.

[105]  Rajiv Ranganathan,et al.  Influence of motor learning on utilizing path redundancy , 2010, Neuroscience Letters.

[106]  Sarah E. Criscimagna-Hemminger,et al.  Size of error affects cerebellar contributions to motor learning. , 2010, Journal of neurophysiology.

[107]  Neville Hogan,et al.  The curvature and variability of wrist and arm movements , 2010, Experimental Brain Research.

[108]  R. Ivry,et al.  The coordination of movement: optimal feedback control and beyond , 2010, Trends in Cognitive Sciences.

[109]  Dagmar Sternad,et al.  Coordinate Dependence of Variability Analysis , 2010, PLoS Comput. Biol..

[110]  J. Krakauer,et al.  Error correction, sensory prediction, and adaptation in motor control. , 2010, Annual review of neuroscience.

[111]  Gary C. Sing,et al.  Linear hypergeneralization of learned dynamics across movement speeds reveals anisotropic, gain-encoding primitives for motor adaptation. , 2011, Journal of neurophysiology.

[112]  D. Sagi Perceptual learning in Vision Research , 2011, Vision Research.

[113]  J. Krakauer,et al.  Are We Ready for a Natural History of Motor Learning? , 2011, Neuron.

[114]  Vincent S. Huang,et al.  Rethinking Motor Learning and Savings in Adaptation Paradigms: Model-Free Memory for Successful Actions Combines with Internal Models , 2011, Neuron.

[115]  J. Krakauer,et al.  Human sensorimotor learning: adaptation, skill, and beyond , 2011, Current Opinion in Neurobiology.

[116]  Ana Pekanovic,et al.  Dopaminergic Projections from Midbrain to Primary Motor Cortex Mediate Motor Skill Learning , 2011, The Journal of Neuroscience.

[117]  Reza Shadmehr,et al.  Learning from Sensory and Reward Prediction Errors during Motor Adaptation , 2011, PLoS Comput. Biol..

[118]  Jeremy D Wong,et al.  Spatially selective enhancement of proprioceptive acuity following motor learning. , 2011, Journal of neurophysiology.

[119]  D. Wolpert,et al.  Principles of sensorimotor learning , 2011, Nature Reviews Neuroscience.

[120]  Dagmar Sternad,et al.  State space analysis of timing: exploiting task redundancy to reduce sensitivity to timing. , 2012, Journal of neurophysiology.