Feedforward and Feedback Control Share an Internal Model of the Arm's Dynamics

Humans have a remarkable capacity to learn novel movement patterns in a wide variety of contexts. Recent work has shown that, when countering external forces, the nervous system adjusts not only voluntary (ie. feedforward) control but also reflex (ie. feedback) responses. Here we show that directly altering the physical properties of the arm (i.e. intersegmental dynamics) causes the nervous system to adjust feedforward control and that this learning also transfers to feedback responses even though they were never directly trained. In our first experiment, we altered intersegmental dynamics by asking participants to generate pure elbow movements with the shoulder joint either free to rotate or locked. Locking the shoulder joint cancels the interaction forces that arise at the shoulder during forearm rotation and thus removes the need to activate shoulder muscles to prevent shoulder joint rotation. We first asked whether the nervous system learns this altered mapping of intersegmental dynamics. In the baseline phase, we found robust activation of shoulder flexor muscles for pure elbow flexion trials prior to movement onset – as required to counter the intersegmental dynamics. After locking the shoulder joint in the adaptation phase, we found a substantial reduction in shoulder muscle activity over many trials. After unlocking the shoulder joint in the post-adaptation phase, we observed after-effects, as participants made systematic hand path errors. In our second experiment, we investigated whether such learning transfers to feedback control. Mechanical perturbations applied to the limb in the baseline phase revealed that feedback responses, like feedforward control, also appropriately countered intersegmental dynamics. In the adaptation phase, we found a substantial reduction in shoulder feedback responses – as appropriate for the altered intersegmental dynamics. We also found that this decay in shoulder feedback responses correlated across subjects with the amount of decay during feedforward control. Our work adds to the growing evidence that feedforward and feedback control share an internal model of the arm’s dynamics.

[1]  Stephen H Scott,et al.  Rapid Feedback Responses Correlate with Reach Adaptation and Properties of Novel Upper Limb Loads , 2013, The Journal of Neuroscience.

[2]  Mark J Wagner,et al.  Shared Internal Models for Feedforward and Feedback Control , 2008, The Journal of Neuroscience.

[3]  Stephen H Scott,et al.  Fast feedback control involves two independent processes utilizing knowledge of limb dynamics. , 2014, Journal of neurophysiology.

[4]  E. Evarts,et al.  Transcortical reflexes and servo control of movement. , 1981, Canadian journal of physiology and pharmacology.

[5]  Stephen H Scott,et al.  Long-latency responses during reaching account for the mechanical interaction between the shoulder and elbow joints. , 2009, Journal of neurophysiology.

[6]  Stephen H Scott,et al.  Cerebellar damage diminishes long-latency responses to multijoint perturbations. , 2013, Journal of neurophysiology.

[7]  Frédéric Crevecoeur,et al.  A perspective on multisensory integration and rapid perturbation responses , 2015, Vision Research.

[8]  R. Shadmehr,et al.  Preparing to Reach: Selecting an Adaptive Long-Latency Feedback Controller , 2012, The Journal of Neuroscience.

[9]  Frédéric Crevecoeur,et al.  Priors Engaged in Long-Latency Responses to Mechanical Perturbations Suggest a Rapid Update in State Estimation , 2013, PLoS Comput. Biol..

[10]  J R Wolpaw,et al.  Amplitude of responses to perturbation in primate sensorimotor cortex as a function of task. , 1980, Journal of neurophysiology.

[11]  T. Vilis,et al.  Loss of set in muscle responses to limb perturbations during cerebellar dysfunction. , 1984, Journal of neurophysiology.

[12]  Raul Benitez,et al.  Motor adaptation as a greedy optimization of error and effort. , 2007, Journal of neurophysiology.

[13]  W. T. Thach,et al.  Preserved Simple and Impaired Compound Movement After Infarction in the Territory of the Superior Cerebellar Artery , 1993, Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques.

[14]  W. T. Thach,et al.  Cerebellar ataxia: abnormal control of interaction torques across multiple joints. , 1996, Journal of neurophysiology.

[15]  David J Reinkensmeyer,et al.  Effect of muscle fatigue on internal model formation and retention during reaching with the arm. , 2006, Journal of applied physiology.

[16]  P. Gribble,et al.  Persistence of inter-joint coupling during single-joint elbow flexions after shoulder fixation , 2005, Experimental Brain Research.

[17]  J. A. Pruszynski,et al.  Optimal feedback control and the long-latency stretch response , 2012, Experimental Brain Research.

[18]  Helen J. Huang,et al.  Reductions in muscle coactivation and metabolic cost during visuomotor adaptation. , 2014, Journal of neurophysiology.

[19]  Rodrigo S. Maeda,et al.  Compensating for intersegmental dynamics across the shoulder, elbow and wrist joints during feedforward and feedback control , 2017, bioRxiv.

[20]  Aymar de Rugy,et al.  Muscle Coordination Is Habitual Rather than Optimal , 2012, The Journal of Neuroscience.

[21]  D. Wolpert,et al.  Principles of sensorimotor learning , 2011, Nature Reviews Neuroscience.

[22]  J. Tanji,et al.  Reflex and intended responses in motor cortex pyramidal tract neurons of monkey. , 1976, Journal of neurophysiology.

[23]  J. A. Pruszynski,et al.  Temporal evolution of "automatic gain-scaling". , 2009, Journal of neurophysiology.

[24]  R. Shadmehr,et al.  Decay of Motor Memories in the Absence of Error , 2013, The Journal of Neuroscience.

[25]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[26]  Jörn Diedrichsen,et al.  Structural learning in feedforward and feedback control. , 2012, Journal of neurophysiology.

[27]  Stephen H Scott,et al.  Correction: Beyond Muscles Stiffness: Importance of State-Estimation to Account for Very Fast Motor Corrections , 2014, PLoS Comput. Biol..

[28]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  A. M. Smith,et al.  Primary motor cortical responses to perturbations of prehension in the monkey. , 1992, Journal of neurophysiology.

[30]  H. Cunningham Aiming error under transformed spatial mappings suggests a structure for visual-motor maps. , 1989, Journal of experimental psychology. Human perception and performance.

[31]  P. Haggard,et al.  Transcranial Magnetic Stimulation over Sensorimotor Cortex Disrupts Anticipatory Reflex Gain Modulation for Skilled Action , 2006, The Journal of Neuroscience.

[32]  J. A. Pruszynski,et al.  Long-Latency Reflexes of the Human Arm Reflect an Internal Model of Limb Dynamics , 2008, Current Biology.

[33]  J. Andrew Pruszynski,et al.  Primary motor cortex underlies multi-joint integration for fast feedback control , 2011, Nature.

[34]  Stephen H. Scott,et al.  Apparatus for measuring and perturbing shoulder and elbow joint positions and torques during reaching , 1999, Journal of Neuroscience Methods.

[35]  D J Ostry,et al.  Compensation for interaction torques during single- and multijoint limb movement. , 1999, Journal of neurophysiology.

[36]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[37]  L. Nashner,et al.  Properties of postural adjustments associated with rapid arm movements. , 1982, Journal of neurophysiology.

[38]  Stephen H Scott,et al.  Perturbation-evoked responses in primary motor cortex are modulated by behavioral context. , 2014, Journal of neurophysiology.

[39]  I. Kurtzer,et al.  Integrative Neuroscience Review Article Long-latency Reflexes Account for Limb Biomechanics through Several Supraspinal Pathways , 2022 .

[40]  P. Strick The influence of motor preparation on the response of cerebellar neurons to limb displacements , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[41]  Paul Cisek,et al.  Descending Corticospinal Control of Intersegmental Dynamics , 2011, The Journal of Neuroscience.

[42]  W. T. Thach,et al.  Cerebellar ataxia: torque deficiency or torque mismatch between joints? , 2000, Journal of neurophysiology.

[43]  E. Evarts Motor Cortex Reflexes Associated with Learned Movement , 1973, Science.

[44]  S. Scott,et al.  Feedback control during voluntary motor actions , 2015, Current Opinion in Neurobiology.

[45]  Stephen H. Scott,et al.  A Functional Taxonomy of Bottom-Up Sensory Feedback Processing for Motor Actions , 2016, Trends in Neurosciences.

[46]  Z. Hasan,et al.  Activity of wrist muscles elicited during imposed or voluntary movements about the elbow joint. , 1991, Journal of motor behavior.

[47]  John J. Foxe,et al.  Primary motor cortex and fast feedback responses to mechanical perturbations: a primer on what we know now and some suggestions on what we should find out next , 2014, Front. Integr. Neurosci..

[48]  Reza Shadmehr,et al.  Learning the dynamics of reaching movements results in the modification of arm impedance and long-latency perturbation responses , 2001, Biological Cybernetics.

[49]  J. F. Soechting,et al.  EMG responses to load perturbations of the upper limb: effect of dynamic coupling between shoulder and elbow motion , 2004, Experimental Brain Research.

[50]  Olivier White,et al.  Use-Dependent and Error-Based Learning of Motor Behaviors , 2010, The Journal of Neuroscience.

[51]  Daniel M. Wolpert,et al.  Signal-dependent noise determines motor planning , 1998, Nature.

[52]  S. Scott,et al.  Comparison of neural responses in primary motor cortex to transient and continuous loads during posture. , 2009, Journal of neurophysiology.

[53]  M. Kawato,et al.  Impedance control balances stability with metabolically costly muscle activation. , 2004, Journal of neurophysiology.

[54]  J. A. Pruszynski,et al.  Rapid motor responses are appropriately tuned to the metrics of a visuospatial task. , 2008, Journal of neurophysiology.

[55]  G. Holmes THE CEREBELLUM OF MAN , 1939 .

[56]  R L Sainburg,et al.  Intersegmental dynamics are controlled by sequential anticipatory, error correction, and postural mechanisms. , 1999, Journal of neurophysiology.