Visuomotor feedback gains upregulate during the learning of novel dynamics

At an early stage of learning novel dynamics, changes in muscle activity are mainly due to corrective feedback responses. These feedback contributions to the overall motor command are gradually reduced as feedforward control is learned. The temporary increased use of feedback could arise simply from the large errors in early learning with either unaltered gains or even slightly downregulated gains, or from an upregulation of the feedback gains when feedforward prediction is insufficient. We therefore investigated whether the sensorimotor control system alters feedback gains during adaptation to a novel force field generated by a robotic manipulandum. To probe the feedback gains throughout learning, we measured the magnitude of involuntary rapid visuomotor responses to rapid shifts in the visual location of the hand during reaching movements. We found large increases in the magnitude of the rapid visuomotor response whenever the dynamics changed: both when the force field was first presented, and when it was removed. We confirmed that these changes in feedback gain are not simply a byproduct of the change in background load, by demonstrating that this rapid visuomotor response is not load sensitive. Our results suggest that when the sensorimotor control system experiences errors, it increases the gain of the visuomotor feedback pathways to deal with the unexpected disturbances until the feedforward controller learns the appropriate dynamics. We suggest that these feedback gains are upregulated with increased uncertainty in the knowledge of the dynamics to counteract any errors or disturbances and ensure accurate and skillful movements.

[1]  J. Saunders,et al.  Humans use continuous visual feedback from the hand to control fast reaching movements , 2003, Experimental Brain Research.

[2]  Hiroaki Gomi,et al.  Temporal development of anticipatory reflex modulation to dynamical interactions during arm movement. , 2009, Journal of neurophysiology.

[3]  J. A. Pruszynski,et al.  Long-Latency Reflexes of the Human Arm Reflect an Internal Model of Limb Dynamics , 2008, Current Biology.

[4]  J. A. Pruszynski,et al.  Rapid motor responses are appropriately tuned to the metrics of a visuospatial task. , 2008, Journal of neurophysiology.

[5]  J. Andrew Pruszynski,et al.  Primary motor cortex underlies multi-joint integration for fast feedback control , 2011, Nature.

[6]  R. J. Beers,et al.  Motor Learning Is Optimally Tuned to the Properties of Motor Noise , 2009, Neuron.

[7]  E. Brenner,et al.  Fast corrections of movements with a computer mouse. , 2003, Spatial vision.

[8]  David W Franklin,et al.  Impedance control and internal model use during the initial stage of adaptation to novel dynamics in humans , 2005, The Journal of physiology.

[9]  Daniel M. Wolpert,et al.  A modular planar robotic manipulandum with end-point torque control , 2009, Journal of Neuroscience Methods.

[10]  K. Shenoy,et al.  A Central Source of Movement Variability , 2006, Neuron.

[11]  G. Lewis,et al.  Interactions with compliant loads alter stretch reflex gains but not intermuscular coordination. , 2008, Journal of neurophysiology.

[12]  L. Selen,et al.  Impedance Control Reduces Instability That Arises from Motor Noise , 2009, The Journal of Neuroscience.

[13]  C. Prablanc,et al.  Automatic control during hand reaching at undetected two-dimensional target displacements. , 1992, Journal of neurophysiology.

[14]  J. Tanji,et al.  Reflex and intended responses in motor cortex pyramidal tract neurons of monkey. , 1976, Journal of neurophysiology.

[15]  M. Kawato,et al.  Visual Feedback Is Not Necessary for the Learning of Novel Dynamics , 2007, PloS one.

[16]  Manu Chhabra,et al.  Flexible, Task-Dependent Use of Sensory Feedback to Control Hand Movements , 2011, The Journal of Neuroscience.

[17]  Reza Shadmehr,et al.  Motor Adaptation as a Process of Reoptimization , 2008, The Journal of Neuroscience.

[18]  F. Horak,et al.  Postural feedback responses scale with biomechanical constraints in human standing , 2004, Experimental Brain Research.

[19]  Daniel M Wolpert,et al.  Kinematics and Dynamics Are Not Represented Independently in Motor Working Memory: Evidence from an Interference Study , 2002, The Journal of Neuroscience.

[20]  F Crevecoeur,et al.  Movement stability under uncertain internal models of dynamics. , 2010, Journal of neurophysiology.

[21]  David C. Knill,et al.  Humans use continuous visual feedback from the hand to control both the direction and distance of pointing movements , 2005, Experimental Brain Research.

[22]  D. Wolpert,et al.  Task-dependent coordination of rapid bimanual motor responses , 2011, Journal of neurophysiology.

[23]  J. Vercher,et al.  Target and hand position information in the online control of goal-directed arm movements , 2003, Experimental Brain Research.

[24]  Stephen H Scott,et al.  Long-latency responses during reaching account for the mechanical interaction between the shoulder and elbow joints. , 2009, Journal of neurophysiology.

[25]  Raul Benitez,et al.  Motor adaptation as a greedy optimization of error and effort. , 2007, Journal of neurophysiology.

[26]  Rieko Osu,et al.  Endpoint Stiffness of the Arm Is Directionally Tuned to Instability in the Environment , 2007, The Journal of Neuroscience.

[27]  J. A. Pruszynski,et al.  Temporal evolution of "automatic gain-scaling". , 2009, Journal of neurophysiology.

[28]  Kelvin E. Jones,et al.  The scaling of motor noise with muscle strength and motor unit number in humans , 2004, Experimental Brain Research.

[29]  M. Kawato,et al.  Functional significance of stiffness in adaptation of multijoint arm movements to stable and unstable dynamics , 2003, Experimental Brain Research.

[30]  J. Lackner,et al.  Congenitally blind individuals rapidly adapt to coriolis force perturbations of their reaching movements. , 2000, Journal of Neurophysiology.

[31]  M. Kawato,et al.  Adaptation to Stable and Unstable Dynamics Achieved By Combined Impedance Control and Inverse Dynamics Model , 2003 .

[32]  Shin'ya Nishida,et al.  Spatiotemporal Tuning of Rapid Interactions between Visual-Motion Analysis and Reaching Movement , 2006, The Journal of Neuroscience.

[33]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[34]  Robert L. Sainburg,et al.  Differential influence of vision and proprioception on control of movement distance , 2006, Experimental Brain Research.

[35]  Iven M. Y. Mareels,et al.  Stability and motor adaptation in human arm movements , 2005, Biological Cybernetics.

[36]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[37]  David W. Franklin,et al.  Feedback Modulation: A Window into Cortical Function , 2011, Current Biology.

[38]  P. Haggard,et al.  Transcranial Magnetic Stimulation over Sensorimotor Cortex Disrupts Anticipatory Reflex Gain Modulation for Skilled Action , 2006, The Journal of Neuroscience.

[39]  R Shadmehr,et al.  Electromyographic Correlates of Learning an Internal Model of Reaching Movements , 1999, The Journal of Neuroscience.

[40]  J. Vercher,et al.  Online control of the direction of rapid reaching movements , 2004, Experimental Brain Research.

[41]  Rieko Osu,et al.  Short- and long-term changes in joint co-contraction associated with motor learning as revealed from surface EMG. , 2002, Journal of neurophysiology.

[42]  Paul L Gribble,et al.  Role of cocontraction in arm movement accuracy. , 2003, Journal of neurophysiology.

[43]  Reza Shadmehr,et al.  On-Line Processing of Uncertain Information in Visuomotor Control , 2008, The Journal of Neuroscience.

[44]  Rieko Osu,et al.  CNS Learns Stable, Accurate, and Efficient Movements Using a Simple Algorithm , 2008, The Journal of Neuroscience.

[45]  Peter J. Beek,et al.  Can co-activation reduce kinematic variability? A simulation study , 2005, Biological Cybernetics.

[46]  Yasmin L. Hashambhoy,et al.  Neural Correlates of Reach Errors , 2005, The Journal of Neuroscience.

[47]  R. Ivry,et al.  Independent on‐line control of the two hands during bimanual reaching , 2004, The European journal of neuroscience.

[48]  Helen J. Huang,et al.  Reduction of Metabolic Cost during Motor Learning of Arm Reaching Dynamics , 2012, The Journal of Neuroscience.

[49]  D. Wolpert,et al.  Specificity of Reflex Adaptation for Task-Relevant Variability , 2008, The Journal of Neuroscience.

[50]  David W. Franklin,et al.  Computational Mechanisms of Sensorimotor Control , 2011, Neuron.

[51]  Joaquin A. Anguera,et al.  Changes in Performance Monitoring during Sensorimotor Adaptation Yfi(\ Aq: a ~·~i.ku"w , 2022 .

[52]  Kelvin E. Jones,et al.  Sources of signal-dependent noise during isometric force production. , 2002, Journal of neurophysiology.

[53]  N. Hogan Adaptive control of mechanical impedance by coactivation of antagonist muscles , 1984 .

[54]  Ferdinando A Mussa-Ivaldi,et al.  Interaction of visual and proprioceptive feedback during adaptation of human reaching movements. , 2005, Journal of neurophysiology.

[55]  Mark M. Churchland,et al.  Supplemental Data A Central Source of Movement Variability , 2006 .

[56]  J. Lackner,et al.  Rapid adaptation to Coriolis force perturbations of arm trajectory. , 1994, Journal of neurophysiology.

[57]  P. Matthews Observations on the automatic compensation of reflex gain on varying the pre‐existing level of motor discharge in man. , 1986, The Journal of physiology.

[58]  David C Knill,et al.  Visual Feedback Control of Hand Movements , 2004, The Journal of Neuroscience.

[59]  Je Hi An,et al.  The Differential Role of Motor Cortex in Stretch Reflex Modulation Induced by Changes in Environmental Mechanics and Verbal Instruction , 2009, Journal of Neuroscience.

[60]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[61]  Daniel R Lametti,et al.  Control of movement variability and the regulation of limb impedance. , 2007, Journal of neurophysiology.

[62]  Neville Hogan,et al.  The mechanics of multi-joint posture and movement control , 1985, Biological Cybernetics.

[63]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[64]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[65]  Gergő Orbán,et al.  Representations of uncertainty in sensorimotor control , 2011, Current Opinion in Neurobiology.

[66]  B. Day,et al.  Voluntary modification of automatic arm movements evoked by motion of a visual target , 1999, Experimental Brain Research.

[67]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[68]  S. Scott Optimal feedback control and the neural basis of volitional motor control , 2004, Nature Reviews Neuroscience.

[69]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[70]  R. Trumbower,et al.  Interactions between limb and environmental mechanics influence stretch reflex sensitivity in the human arm. , 2010, Journal of neurophysiology.

[71]  Mark J Wagner,et al.  Shared Internal Models for Feedforward and Feedback Control , 2008, The Journal of Neuroscience.