Multiple motor memories are learned to control different points on a tool

Skilful object manipulation requires learning the dynamics of objects, linking applied force to motion1,2. This involves the formation of a motor memory3,4, which has been assumed to be associated with the object, independent of the point on the object that one chooses to control. Importantly, in manipulation tasks, different control points on an object, such as the rim of a cup when drinking or its base when setting it down, can be associated with distinct dynamics. Here, we show that opposing dynamic perturbations, which interfere when controlling a single location on an object, can be learned when each is associated with a separate control point. This demonstrates that motor memory formation is linked to control points on the object, rather than the object per se. We also show that the motor system only generates separate memories for different control points if they are linked to different dynamics, allowing efficient use of motor memory. To account for these results, we develop a normative switching state-space model of motor learning, in which the association between cues (control points) and contexts (dynamics) is learned rather than fixed. Our findings uncover an important mechanism through which the motor system generates flexible and dexterous behaviour.Different parts of tools are often handled in different ways. This study presents a computational model explaining how humans build separate motor memories for different parts of the same objects.

[1]  Daniel A. Braun,et al.  Optimal Control Predicts Human Performance on Objects with Internal Degrees of Freedom , 2009, PLoS Comput. Biol..

[2]  J. Krakauer,et al.  Error correction, sensory prediction, and adaptation in motor control. , 2010, Annual review of neuroscience.

[3]  Jörn Diedrichsen,et al.  Reach adaptation: what determines whether we learn an internal model of the tool or adapt the model of our arm? , 2008, Journal of neurophysiology.

[4]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  Karl-Theodor Kalveram,et al.  Motor adaptation to different dynamic environments is facilitated by indicative context stimuli , 2004, Psychological research.

[6]  Daniel M Wolpert,et al.  Fast But Fleeting: Adaptive Motor Learning Processes Associated with Aging and Cognitive Decline , 2014, The Journal of Neuroscience.

[7]  Warren B. Powell,et al.  Adaptive stepsizes for recursive estimation with applications in approximate dynamic programming , 2006, Machine Learning.

[8]  Marco Santello,et al.  Context-Dependent Learning Interferes with Visuomotor Transformations for Manipulation Planning , 2012, The Journal of Neuroscience.

[9]  J. Krakauer,et al.  Explaining savings for visuomotor adaptation: linear time-invariant state-space models are not sufficient. , 2008, Journal of neurophysiology.

[10]  H. Robbins A Stochastic Approximation Method , 1951 .

[11]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[12]  J. Flanagan,et al.  Sensorimotor memory of weight asymmetry in object manipulation , 2007, Experimental Brain Research.

[13]  R. Shumway,et al.  Dynamic linear models with switching , 1991 .

[14]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[15]  O. Cappé,et al.  On‐line expectation–maximization algorithm for latent data models , 2009 .

[16]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[17]  N. Schweighofer,et al.  Dual Adaptation Supports a Parallel Architecture of Motor Memory , 2009, The Journal of Neuroscience.

[18]  R A Scheidt,et al.  Persistence of motor adaptation during constrained, multi-joint, arm movements. , 2000, Journal of neurophysiology.

[19]  R. Johansson,et al.  Coordinated isometric muscle commands adequately and erroneously programmed for the weight during lifting task with precision grip , 2004, Experimental Brain Research.

[20]  R. S. Johansson,et al.  Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects , 2004, Experimental Brain Research.

[21]  G. A. Ackerson,et al.  On state estimation in switching environments , 1968 .

[22]  D. Wolpert,et al.  The Value of the Follow-Through Derives from Motor Learning Depending on Future Actions , 2015, Current Biology.

[23]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[24]  A. Benton,et al.  Right-left discrimination and finger localization : development and pathology , 1960 .

[25]  E Bizzi,et al.  Motor learning by field approximation. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Stephen H Scott,et al.  Limited transfer of learning between unimanual and bimanual skills within the same limb , 2006, Nature Neuroscience.

[27]  Atsushi Iriki,et al.  Shaping multisensory action–space with tools: evidence from patients with cross-modal extinction , 2005, Neuropsychologia.

[28]  D. Wolpert,et al.  Multiple Grasp-Specific Representations of Tool Dynamics Mediate Skillful Manipulation , 2010, Current Biology.

[29]  K. Lynch,et al.  The Separate Neural Control of Hand Movements and Contact Forces , 2009, The Journal of Neuroscience.

[30]  Nicolas Schweighofer,et al.  Between-Trial Forgetting Due to Interference and Time in Motor Adaptation , 2015, PloS one.

[31]  D. Nozaki,et al.  Distinct Motor Plans Form and Retrieve Distinct Motor Memories for Physically Identical Movements , 2012, Current Biology.

[32]  M. Tanaka,et al.  Coding of modified body schema during tool use by macaque postcentral neurones. , 1996, Neuroreport.

[33]  A. Benton,et al.  Right-left discrimination and finger localization in defective children. , 1955, A.M.A. archives of neurology and psychiatry.

[34]  J. Flanagan,et al.  Independence of perceptual and sensorimotor predictions in the size–weight illusion , 2000, Nature Neuroscience.

[35]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[36]  Michael I. Jordan,et al.  Nonparametric Bayesian Learning of Switching Linear Dynamical Systems , 2008, NIPS.

[37]  Olivier Capp'e Online EM Algorithm for Hidden Markov Models , 2009, 0908.2359.

[38]  Daniel M Wolpert,et al.  Q&A: Robotics as a tool to understand the brain , 2010, BMC Biology.

[39]  R. Johansson,et al.  Eye–Hand Coordination in Object Manipulation , 2001, The Journal of Neuroscience.

[40]  D. Wolpert,et al.  Context-Dependent Decay of Motor Memories during Skill Acquisition , 2013, Current Biology.

[41]  D. Pierre Forward Smoothing Using Sequential Monte Carlo , 2009 .

[42]  J. Randall Flanagan,et al.  Motor learning of novel dynamics is not represented in a single global coordinate system: evaluation of mixed coordinate representations and local learning , 2013, Journal of neurophysiology.

[43]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[44]  Ferdinando A. Mussa-Ivaldi,et al.  Learning to push and learning to move: the adaptive control of contact forces , 2015, Front. Comput. Neurosci..

[45]  S. Scott,et al.  Multi-compartment model can explain partial transfer of learning within the same limb between unimanual and bimanual reaching , 2009, Experimental Brain Research.

[46]  D. Wolpert,et al.  Principles of sensorimotor learning , 2011, Nature Reviews Neuroscience.

[47]  D. Wolpert,et al.  Naturalistic approaches to sensorimotor control. , 2011, Progress in brain research.

[48]  Arnaud Doucet,et al.  Particle filters for state estimation of jump Markov linear systems , 2001, IEEE Trans. Signal Process..

[49]  I Salimi,et al.  Specificity of internal representations underlying grasping. , 2000, Journal of neurophysiology.

[50]  Lee A Baugh,et al.  Material evidence: interaction of well-learned priors and sensorimotor memory when lifting objects. , 2012, Journal of neurophysiology.

[51]  F. Mussa-Ivaldi,et al.  Experimentally confirmed mathematical model for human control of a non-rigid object. , 2004, Journal of neurophysiology.

[52]  David W Franklin,et al.  Impedance control and internal model use during the initial stage of adaptation to novel dynamics in humans , 2005, The Journal of physiology.

[53]  Masaya Hirashima,et al.  Gain Field Encoding of the Kinematics of Both Arms in the Internal Model Enables Flexible Bimanual Action , 2011, The Journal of Neuroscience.

[54]  K. J. Cole,et al.  Memory representations underlying motor commands used during manipulation of common and novel objects. , 1993, Journal of neurophysiology.

[55]  Vincent S. Huang,et al.  Persistence of motor memories reflects statistics of the learning event. , 2009, Journal of neurophysiology.

[56]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[57]  J R Flanagan,et al.  The Role of Internal Models in Motion Planning and Control: Evidence from Grip Force Adjustments during Movements of Hand-Held Loads , 1997, The Journal of Neuroscience.

[58]  L. M. M.-T. Theory of Probability , 1929, Nature.

[59]  D. Wolpert,et al.  Gone in 0.6 Seconds: The Encoding of Motor Memories Depends on Recent Sensorimotor States , 2012, The Journal of Neuroscience.

[60]  R. Johansson,et al.  Factors influencing the force control during precision grip , 2004, Experimental Brain Research.

[61]  S. Kitazawa,et al.  Sensation at the tips of invisible tools , 2001, Nature Neuroscience.

[62]  Miles C. Bowman,et al.  Control strategies in object manipulation tasks , 2006, Current Opinion in Neurobiology.

[63]  Reza Shadmehr,et al.  Dissociable effects of the implicit and explicit memory systems on learning control of reaching , 2006, Experimental Brain Research.

[64]  J. Randall Flanagan,et al.  Flexible Representations of Dynamics Are Used in Object Manipulation , 2008, Current Biology.

[65]  D. Wolpert,et al.  Motor Planning, Not Execution, Separates Motor Memories , 2016, Neuron.

[66]  Christopher D Mah,et al.  Manipulating objects with internal degrees of freedom: evidence for model-based control. , 2002, Journal of neurophysiology.

[67]  Daniel M. Wolpert,et al.  A modular planar robotic manipulandum with end-point torque control , 2009, Journal of Neuroscience Methods.

[68]  W. Epstein,et al.  Tool use affects perceived distance, but only when you intend to use it. , 2005, Journal of experimental psychology. Human perception and performance.

[69]  M F Land,et al.  The knowledge base of the oculomotor system. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[70]  J Randall Flanagan,et al.  The role of haptic feedback when manipulating nonrigid objects. , 2012, Journal of neurophysiology.

[71]  J. Randall Flanagan,et al.  An error-tuned model for sensorimotor learning , 2017, PLoS Comput. Biol..

[72]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[73]  D. Wolpert,et al.  The effect of contextual cues on the encoding of motor memories , 2013, Journal of neurophysiology.

[74]  R C Miall,et al.  System Identification Applied to a Visuomotor Task: Near-Optimal Human Performance in a Noisy Changing Task , 2003, The Journal of Neuroscience.

[75]  M. Ernst,et al.  The statistical determinants of adaptation rate in human reaching. , 2008, Journal of vision.

[76]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[77]  J. Randall Flanagan,et al.  A Single-Rate Context-Dependent Learning Process Underlies Rapid Adaptation to Familiar Object Dynamics , 2011, PLoS Comput. Biol..

[78]  David W. Franklin,et al.  Coordinate Representations for Interference Reduction in Motor Learning , 2015, PloS one.

[79]  Terrence J. Sejnowski,et al.  Variational Learning for Switching State-Space Models , 2001 .

[80]  Marco Santello,et al.  Retention and interference of learned dexterous manipulation: interaction between multiple sensorimotor processes. , 2015, Journal of neurophysiology.

[81]  R. Shadmehr,et al.  Interacting Adaptive Processes with Different Timescales Underlie Short-Term Motor Learning , 2006, PLoS biology.

[82]  M. Athans,et al.  State Estimation for Discrete Systems with Switching Parameters , 1978, IEEE Transactions on Aerospace and Electronic Systems.

[83]  Dagmar Sternad,et al.  Rhythmic Manipulation of Objects with Complex Dynamics: Predictability over Chaos , 2014, PLoS Comput. Biol..

[84]  Fredrik Lindsten,et al.  Recursive Maximum Likelihood Identification of Jump Markov Nonlinear Systems , 2013, IEEE Transactions on Signal Processing.

[85]  P. Gribble,et al.  Are there distinct neural representations of object and limb dynamics? , 2006, Experimental Brain Research.