Formation of model-free motor memories during motor adaptation depends on perturbation schedule.

Motor adaptation to an external perturbation relies on several mechanisms such as model-based, model-free, strategic, or repetition-dependent learning. Depending on the experimental conditions, each of these mechanisms has more or less weight in the final adaptation state. Here we focused on the conditions that lead to the formation of a model-free motor memory (Huang VS, Haith AM, Mazzoni P, Krakauer JW. Neuron 70: 787-801, 2011), i.e., a memory that does not depend on an internal model or on the size or direction of the errors experienced during the learning. The formation of such model-free motor memory was hypothesized to depend on the schedule of the perturbation (Orban de Xivry JJ, Ahmadi-Pajouh MA, Harran MD, Salimpour Y, Shadmehr R. J Neurophysiol 109: 124-136, 2013). Here we built on this observation by directly testing the nature of the motor memory after abrupt or gradual introduction of a visuomotor rotation, in an experimental paradigm where the presence of model-free motor memory can be identified (Huang VS, Haith AM, Mazzoni P, Krakauer JW. Neuron 70: 787-801, 2011). We found that relearning was faster after abrupt than gradual perturbation, which suggests that model-free learning is reduced during gradual adaptation to a visuomotor rotation. In addition, the presence of savings after abrupt introduction of the perturbation but gradual extinction of the motor memory suggests that unexpected errors are necessary to induce a model-free motor memory. Overall, these data support the hypothesis that different perturbation schedules do not lead to a more or less stabilized motor memory but to distinct motor memories with different attributes and neural representations.

[1]  Maurice A. Smith,et al.  Environmental Consistency Determines the Rate of Motor Adaptation , 2014, Current Biology.

[2]  Konrad Paul Kording,et al.  Estimating the sources of motor errors for adaptation and generalization , 2008, Nature Neuroscience.

[3]  Allison M Okamura,et al.  Cerebellar motor learning: are environment dynamics more important than error size? , 2013, Journal of neurophysiology.

[4]  Ju Lu,et al.  REPETITIVE MOTOR LEARNING INDUCES COORDINATED FORMATION OF CLUSTERED DENDRITIC SPINES IN VIVO , 2012, Nature.

[5]  Kurt A. Thoroughman,et al.  Trial-by-trial transformation of error into sensorimotor adaptation changes with environmental dynamics. , 2007, Journal of neurophysiology.

[6]  G. Torres-Oviedo,et al.  Natural error patterns enable transfer of motor learning to novel contexts. , 2012, Journal of neurophysiology.

[7]  Philip N. Sabes,et al.  How Each Movement Changes the Next: An Experimental and Theoretical Study of Fast Adaptive Priors in Reaching , 2011, The Journal of Neuroscience.

[8]  Vincent S. Huang,et al.  Rethinking Motor Learning and Savings in Adaptation Paradigms: Model-Free Memory for Successful Actions Combines with Internal Models , 2011, Neuron.

[9]  A. Haith,et al.  Model-based and model-free mechanisms of human motor learning. , 2013, Advances in experimental medicine and biology.

[10]  Emery N. Brown,et al.  Faculty Opinions recommendation of Interacting adaptive processes with different timescales underlie short-term motor learning. , 2006 .

[11]  Stephen H Scott,et al.  Limited transfer of learning between unimanual and bimanual skills within the same limb , 2006, Nature Neuroscience.

[12]  Raymond J. Delnicki,et al.  Overcoming Motor “Forgetting” Through Reinforcement Of Learned Actions , 2012, The Journal of Neuroscience.

[13]  R. Nudo,et al.  Effects of Repetitive Motor Training on Movement Representations in Adult Squirrel Monkeys: Role of Use versus Learning , 2000, Neurobiology of Learning and Memory.

[14]  S. Kollias,et al.  Electrophysiological evidence for cortical plasticity with movement repetition , 2005, The European journal of neuroscience.

[15]  J. Krakauer,et al.  An Implicit Plan Overrides an Explicit Strategy during Visuomotor Adaptation , 2006, The Journal of Neuroscience.

[16]  Reza Shadmehr,et al.  Learning from Sensory and Reward Prediction Errors during Motor Adaptation , 2011, PLoS Comput. Biol..

[17]  A. de Rugy,et al.  Different mechanisms contributing to savings and anterograde interference are impaired in Parkinson's disease , 2013, Front. Hum. Neurosci..

[18]  M. Hallett,et al.  Rapid plasticity of human cortical movement representation induced by practice. , 1998, Journal of neurophysiology.

[19]  G. Stelmach,et al.  Adaptation to gradual as compared with sudden visuo-motor distortions , 1997, Experimental Brain Research.

[20]  R. Ivry,et al.  An Explicit Strategy Prevails When the Cerebellum Fails to Compute Movement Errors , 2010, The Cerebellum.

[21]  Jeremy D Wong,et al.  Visual cues signaling object grasp reduce interference in motor learning. , 2009, Journal of neurophysiology.

[22]  G. Hammond,et al.  Impaired savings despite intact initial learning of motor adaptation in Parkinson’s disease , 2012, Experimental Brain Research.

[23]  Jörn Diedrichsen,et al.  Reach adaptation: what determines whether we learn an internal model of the tool or adapt the model of our arm? , 2008, Journal of neurophysiology.

[24]  J. Ushiba,et al.  Different strategy of hand choice after learning of constant and incremental dynamical perturbation in arm reaching , 2014, Front. Hum. Neurosci..

[25]  V. Della-Maggiore,et al.  Sensorimotor Adaptation , 2015, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[26]  Sarah E. Criscimagna-Hemminger,et al.  Contributions of the motor cortex to adaptive control of reaching depend on the perturbation schedule. , 2011, Cerebral cortex.

[27]  Leslie G. Ungerleider,et al.  Formation of a Motor Memory by Action Observation , 2005, The Journal of Neuroscience.

[28]  Sarah E. Criscimagna-Hemminger,et al.  Size of error affects cerebellar contributions to motor learning. , 2010, Journal of neurophysiology.

[29]  Sarah E. Criscimagna-Hemminger,et al.  Cerebellar Contributions to Reach Adaptation and Learning Sensory Consequences of Action , 2012, The Journal of Neuroscience.

[30]  Olivier White,et al.  Use-Dependent and Error-Based Learning of Motor Behaviors , 2010, The Journal of Neuroscience.

[31]  John E. Schlerf,et al.  Dynamic Modulation of Cerebellar Excitability for Abrupt, But Not Gradual, Visuomotor Adaptation , 2012, The Journal of Neuroscience.

[32]  J. Krakauer,et al.  Are We Ready for a Natural History of Motor Learning? , 2011, Neuron.

[33]  Daniel A. Braun,et al.  Motor Task Variation Induces Structural Learning , 2009, Current Biology.

[34]  R. Shadmehr,et al.  Changes in corticospinal excitability during reach adaptation in force fields. , 2013, Journal of neurophysiology.

[35]  S. Wise,et al.  Mechanisms of use-dependent plasticity in the human motor cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[36]  T. Kasai,et al.  Rapid Plastic Changes of Human Primary Motor Cortex with Repetitive Motor Practice and Transcranial Magnetic Stimulation , 2005, Perceptual and motor skills.

[37]  R. Shadmehr,et al.  Intact ability to learn internal models of arm dynamics in Huntington's disease but not cerebellar degeneration. , 2005, Journal of neurophysiology.

[38]  Sarah E. Pekny,et al.  Protection and Expression of Human Motor Memories , 2011, The Journal of Neuroscience.

[39]  D. Timmann,et al.  Neural correlates of adaptation to gradual and to sudden visuomotor distortions in humans , 2014, Experimental Brain Research.

[40]  Vincent S. Huang,et al.  Persistence of motor memories reflects statistics of the learning event. , 2009, Journal of neurophysiology.

[41]  Carolyn E. Jones,et al.  Gradual extinction prevents the return of fear: implications for the discovery of state , 2013, Front. Behav. Neurosci..

[42]  David Hansel,et al.  Interference and Shaping in Sensorimotor Adaptations with Rewards , 2014, PLoS Comput. Biol..

[43]  M. Ghilardi,et al.  Learning and consolidation of visuo-motor adaptation in Parkinson's disease. , 2009, Parkinsonism & related disorders.

[44]  Daniel A. Braun,et al.  Facilitation of learning induced by both random and gradual visuomotor task variation , 2011, Journal of neurophysiology.

[45]  Yves Rossetti,et al.  Enhancing Visuomotor Adaptation by Reducing Error Signals: Single-step (Aware) versus Multiple-step (Unaware) Exposure to Wedge Prisms , 2007, Journal of Cognitive Neuroscience.

[46]  Masaya Hirashima,et al.  Asymmetric Transfer of Visuomotor Learning between Discrete and Rhythmic Movements , 2010, The Journal of Neuroscience.

[47]  Laurent Madelain,et al.  Modification of saccadic gain by reinforcement. , 2011, Journal of neurophysiology.

[48]  J. Flanagan,et al.  Learning and recall of incremental kinematic and dynamic sensorimotor transformations , 2005, Experimental Brain Research.

[49]  R. Shadmehr,et al.  Interacting Adaptive Processes with Different Timescales Underlie Short-Term Motor Learning , 2006, PLoS biology.

[50]  Ethan R. Buch,et al.  Visuomotor adaptation in normal aging. , 2003, Learning & memory.

[51]  D. Nozaki,et al.  Distinct Motor Plans Form and Retrieve Distinct Motor Memories for Physically Identical Movements , 2012, Current Biology.

[52]  S. C. Cramer,et al.  Reward Improves Long-Term Retention of a Motor Memory through Induction of Offline Memory Gains , 2013 .

[53]  O. Bock,et al.  Sensorimotor adaptation to rotated visual input: different mechanisms for small versus large rotations , 2001, Experimental Brain Research.

[54]  J. Sanes,et al.  Basal ganglia-dependent processes in recalling learned visual-motor adaptations , 2011, Experimental Brain Research.

[55]  Hiroaki Gomi,et al.  Multiple Motor Learning Strategies in Visuomotor Rotation , 2010, PloS one.

[56]  R. Ivry,et al.  Annals of the New York Academy of Sciences the Role of Strategies in Motor Learning , 2022 .

[57]  A. Rugy,et al.  Anodal motor cortex stimulation paired with movement repetition increases anterograde interference but not savings , 2014, The European journal of neuroscience.

[58]  Emilio Bizzi,et al.  Disruption of Primary Motor Cortex before Learning Impairs Memory of Movement Dynamics , 2006, The Journal of Neuroscience.

[59]  J. Krakauer,et al.  Explicit and Implicit Contributions to Learning in a Sensorimotor Adaptation Task , 2014, The Journal of Neuroscience.

[60]  Reza Shadmehr,et al.  A memory of errors in sensorimotor learning , 2014, Science.

[61]  Aaron L. Wong,et al.  Saccade adaptation improves in response to a gradually introduced stimulus perturbation , 2011, Neuroscience Letters.

[62]  Richard B. Ivry,et al.  Flexible Cognitive Strategies during Motor Learning , 2011, PLoS Comput. Biol..