Predicting Perturbed Human Arm Movements in a Neuro-Musculoskeletal Model to Investigate the Muscular Force Response

Human movement is generated by a dynamic interplay between the nervous system, the biomechanical structures, and the environment. To investigate this interaction, we propose a neuro-musculoskeletal model of human goal-directed arm movements. Using this model, we simulated static perturbations of the inertia and damping properties of the arm, as well as dynamic torque perturbations for one-degree-of freedom movements around the elbow joint. The controller consists of a feed-forward motor command and feedback based on muscle fiber length and contraction velocity representing short-latency (25 ms) or long-latency (50 ms) stretch reflexes as the first neuronal responses elicited by an external perturbation. To determine the open-loop control signal, we parameterized the control signal resulting in a piecewise constant stimulation over time for each muscle. Interestingly, such an intermittent open-loop signal results in a smooth movement that is close to experimental observations. So, our model can generate the unperturbed point-to-point movement solely by the feed-forward command. The feedback only contributed to the stimulation in perturbed movements. We found that the relative contribution of this feedback is small compared to the feed-forward control and that the characteristics of the musculoskeletal system create an immediate and beneficial reaction to the investigated perturbations. The novelty of these findings is (1) the reproduction of static as well as dynamic perturbation experiments in one neuro-musculoskeletal model with only one set of basic parameters. This allows to investigate the model's neuro-muscular response to the perturbations that—at least to some degree—represent stereotypical interactions with the environment; (2) the demonstration that in feed-forward driven movements the muscle characteristics generate a mechanical response with zero-time delay which helps to compensate for the perturbations; (3) that this model provides enough biomechanical detail to allow for the prediction of internal forces, including joint loads and muscle-bone contact forces which are relevant in ergonomics and for the development of assistive devices but cannot be observed in experiments.

[1]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[2]  Christian Rode,et al.  Computational modeling of muscle biomechanics , 2014 .

[3]  Taegyo Kim,et al.  From the motor cortex to the movement and back again , 2017, PloS one.

[4]  Maarten F. Bobbert,et al.  The contribution of muscle properties in the control of explosive movements , 1993, Biological Cybernetics.

[5]  J. A. Pruszynski,et al.  Optimal feedback control and the long-latency stretch response , 2012, Experimental Brain Research.

[6]  Matthew Millard,et al.  Flexing computational muscle: modeling and simulation of musculotendon dynamics. , 2013, Journal of biomechanical engineering.

[7]  Sudesh Sivarasu,et al.  Effect of humeral tray placement on impingement‐free range of motion and muscle moment arms in reverse shoulder arthroplasty , 2019, Clinical biomechanics.

[8]  Gerald E. Loeb,et al.  Optimal isn’t good enough , 2012, Biological Cybernetics.

[9]  Jeremy D Wong,et al.  The central nervous system does not minimize energy cost in arm movements. , 2010, Journal of neurophysiology.

[10]  David W. Franklin,et al.  Computational Mechanisms of Sensorimotor Control , 2011, Neuron.

[11]  Scott T. Grafton,et al.  Forward modeling allows feedback control for fast reaching movements , 2000, Trends in Cognitive Sciences.

[12]  Gerald E. Loeb,et al.  Proprioceptors and Models of Transduction , 2015, Scholarpedia.

[13]  E Pennestrì,et al.  Virtual musculo-skeletal model for the biomechanical analysis of the upper limb. , 2007, Journal of biomechanics.

[14]  N. Hogan,et al.  Does the nervous system use equilibrium-point control to guide single and multiple joint movements? , 1992, The Behavioral and brain sciences.

[15]  Francesco Nori,et al.  Evidence for Composite Cost Functions in Arm Movement Planning: An Inverse Optimal Control Approach , 2011, PLoS Comput. Biol..

[16]  Scott L. Delp,et al.  A Model of the Upper Extremity for Simulating Musculoskeletal Surgery and Analyzing Neuromuscular Control , 2005, Annals of Biomedical Engineering.

[17]  Christian Rode,et al.  The active force–length relationship is invisible during extensive eccentric contractions in skinned skeletal muscle fibres , 2017, Proceedings of the Royal Society B: Biological Sciences.

[18]  S Schmitt,et al.  Quantifying control effort of biological and technical movements: an information-entropy-based approach. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  Jeremy D Wong,et al.  The cost of moving optimally: kinematic path selection. , 2014, Journal of neurophysiology.

[20]  Syn Schmitt,et al.  Muscles Reduce Neuronal Information Load: Quantification of Control Effort in Biological vs. Robotic Pointing and Walking , 2020, Frontiers in Robotics and AI.

[21]  Mark L. Latash,et al.  Motor Control: In Search of Physics of the Living Systems , 2010 .

[22]  Xin He,et al.  Fusimotor control of spindle sensitivity regulates central and peripheral coding of joint angles , 2012, Front. Comput. Neurosci..

[23]  Jeffrey Weiler,et al.  Rapid feedback responses are flexibly coordinated across arm muscles to support goal-directed reaching , 2017, bioRxiv.

[24]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[25]  Dinant A. Kistemaker,et al.  A model of open-loop control of equilibrium position and stiffness of the human elbow joint , 2007, Biological Cybernetics.

[26]  Karl-Theodor Kalveram,et al.  Threading neural feedforward into a mechanical spring: How biology exploits physics in limb control , 2005, Biological Cybernetics.

[27]  Ian E. Brown,et al.  Mechanics of feline soleus: II design and validation of a mathematical model , 1996, Journal of Muscle Research & Cell Motility.

[28]  S Schmitt,et al.  Hill-type muscle model with serial damping and eccentric force-velocity relation. , 2014, Journal of biomechanics.

[29]  Jeroen B. J. Smeets,et al.  Conclusions on motor control depend on the type of model used to represent the periphery , 2012, Biological Cybernetics.

[30]  A. G. Feldman Once More on the Equilibrium-Point Hypothesis (λ Model) for Motor Control , 1986 .

[31]  Anthony Jarc,et al.  Simplified and effective motor control based on muscle synergies to exploit musculoskeletal dynamics , 2009, Proceedings of the National Academy of Sciences.

[32]  J. A. Pruszynski,et al.  The long-latency reflex is composed of at least two functionally independent processes. , 2011, Journal of neurophysiology.

[33]  J. A. Pruszynski,et al.  Long-Latency Reflexes of the Human Arm Reflect an Internal Model of Limb Dynamics , 2008, Current Biology.

[34]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[35]  D J Ostry,et al.  Are complex control signals required for human arm movement? , 1998, Journal of neurophysiology.

[36]  M Günther,et al.  Tailoring anatomical muscle paths: a sheath-like solution for muscle routing in musculoskeletal computer models. , 2019, Mathematical biosciences.

[37]  Stephen H. Scott,et al.  A Functional Taxonomy of Bottom-Up Sensory Feedback Processing for Motor Actions , 2016, Trends in Neurosciences.

[38]  Nando de Freitas,et al.  A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning , 2010, ArXiv.

[39]  Syn Schmitt,et al.  Comparative Sensitivity Analysis of Muscle Activation Dynamics , 2015, Comput. Math. Methods Medicine.

[40]  Vladimir Nosenko,et al.  Wakes in inhomogeneous plasmas. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[41]  Maarten F Bobbert,et al.  Is equilibrium point control feasible for fast goal-directed single-joint movements? , 2006, Journal of neurophysiology.

[42]  Peter Giesl,et al.  Musculoskeletal Stabilization of the Elbow - Complex or Real , 2007 .

[43]  André Seyfarth,et al.  Inverse biomimetics: How robots can help to verify concepts concerning sensorimotor control of human arm and leg movements , 2009, Journal of Physiology-Paris.

[44]  João M. Ferreira Calado,et al.  Approaches to human arm movement control - A review , 2009, Annu. Rev. Control..

[45]  Makoto Sato,et al.  Learning and generation of goal-directed arm reaching from scratch , 2009, Neural Networks.

[46]  J. Houk,et al.  Improvement in linearity and regulation of stiffness that results from actions of stretch reflex. , 1976, Journal of neurophysiology.

[47]  Michael Günther,et al.  The dynamics of the skeletal muscle: A systems biophysics perspective on muscle modeling with the focus on Hill‐type muscle models , 2019, GAMM-Mitteilungen.

[48]  Jeffrey Weiler,et al.  Spinal stretch reflexes support efficient hand control , 2019, Nature Neuroscience.

[49]  Reinhard Blickhan,et al.  Muscle force depends on the amount of transversal muscle loading. , 2014, Journal of biomechanics.

[50]  Maarten F Bobbert,et al.  Length-dependent [Ca2+] sensitivity adds stiffness to muscle. , 2005, Journal of biomechanics.

[51]  O Röhrle,et al.  A two-muscle, continuum-mechanical forward simulation of the upper limb , 2017, Biomechanics and modeling in mechanobiology.

[52]  Eric J. Perreault,et al.  Stretch sensitive reflexes as an adaptive mechanism for maintaining limb stability , 2010, Clinical Neurophysiology.

[53]  Allison M Okamura,et al.  Predicting and correcting ataxia using a model of cerebellar function. , 2014, Brain : a journal of neurology.

[54]  Jeremy D Wong,et al.  Control of position and movement is simplified by combined muscle spindle and Golgi tendon organ feedback. , 2013, Journal of neurophysiology.

[55]  Reza Shadmehr,et al.  Actuator and kinematic redundancy in biological motor control , 1991 .

[56]  Zoubin Ghahramani,et al.  Computational principles of movement neuroscience , 2000, Nature Neuroscience.

[57]  Mark L. Latash,et al.  The role of kinematic redundancy in adaptation of reaching , 2006, Experimental Brain Research.

[58]  David J. Ostry,et al.  Compensation for loads during arm movements using equilibrium-point control , 2000, Experimental Brain Research.

[59]  K. Wachholder,et al.  Beiträge zur Physiologie der willkürlichen Bewegung , 1926, Pflüger's Archiv für die gesamte Physiologie des Menschen und der Tiere.

[60]  Jeffrey Weiler,et al.  Coordinating long-latency stretch responses across the shoulder, elbow, and wrist during goal-directed reaching. , 2016, Journal of neurophysiology.

[61]  Lena H Ting,et al.  Contribution of muscle short-range stiffness to initial changes in joint kinetics and kinematics during perturbations to standing balance: A simulation study. , 2017, Journal of biomechanics.

[62]  Iven M. Y. Mareels,et al.  Stability and motor adaptation in human arm movements , 2005, Biological Cybernetics.

[63]  Antonie J. van den Bogert,et al.  A Real-Time, 3-D Musculoskeletal Model for Dynamic Simulation of Arm Movements , 2009, IEEE Transactions on Biomedical Engineering.

[64]  K. Y. Zhu,et al.  Biomechanical Stability Analysis of the lambda-Model Controlling One Joint , 2007, Int. J. Neural Syst..

[65]  J. Andrew Pruszynski,et al.  Rapid feedback responses are flexibly coordinated across arm muscles to support goal-directed reaching , 2017, bioRxiv.

[66]  D. F. B. Haeufle,et al.  The influence of biophysical muscle properties on simulating fast human arm movements , 2017, Computer methods in biomechanics and biomedical engineering.

[67]  H. Hatze,et al.  A myocybernetic control model of skeletal muscle , 1977, Biological Cybernetics.

[68]  A. W. Wiegner,et al.  Role of agonist and antagonist muscles in fast arm movements in man , 2004, Experimental Brain Research.

[69]  I. Kurtzer,et al.  Integrative Neuroscience Review Article Long-latency Reflexes Account for Limb Biomechanics through Several Supraspinal Pathways , 2022 .

[70]  Michael Günther,et al.  Electro-mechanical delay in Hill-type muscle models , 2012 .

[71]  S. Scott Optimal feedback control and the neural basis of volitional motor control , 2004, Nature Reviews Neuroscience.

[72]  Syn Schmitt,et al.  A movement generation algorithm for FE Human Body Models , 2017 .

[73]  Marc Toussaint,et al.  Learning to Control Redundant Musculoskeletal Systems with Neural Networks and SQP: Exploiting Muscle Properties , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[74]  Keyan Zahedi,et al.  Evaluating Morphological Computation in Muscle and DC-Motor Driven Models of Hopping Movements , 2016, Front. Robot. AI.

[75]  Stephen H Scott,et al.  Fast feedback control involves two independent processes utilizing knowledge of limb dynamics. , 2014, Journal of neurophysiology.

[76]  J. Krakauer,et al.  Error correction, sensory prediction, and adaptation in motor control. , 2010, Annual review of neuroscience.