A synergy-based motor control framework for the fast feedback control of musculoskeletal systems.

This paper presents a computational framework for the fast feedback control of musculoskeletal systems using muscle synergies. The proposed motor control framework has a hierarchical structure. A feedback controller at the higher level of hierarchy handles the trajectory planning and error compensation in the task space. This task space controller only deals with the task-related kinematic variables, thus is computationally efficient. The output of the task space controller is a force vector in the task space, which is fed to the low-level controller to be translated into muscle activity commands. Muscle synergies are employed to make this force-to-activation (F2A) mapping computationally efficient. The explicit relationship between the muscle synergies and task space forces allows for the fast estimation of muscle activations that result in the reference force. The synergy-enabled F2A mapping replaces a computationally-heavy non-linear optimization process by a vector decomposition problem that is solvable in real-time. The estimation performance of the F2A mapping is evaluated by comparing the F2A-estimated muscle activities against measured EMG data. The results show that the F2A algorithm can estimate the muscle activations using only the task-related kinematics/dynamics information with ~70% accuracy. An example predictive simulation is also presented; the results show that this feedback motor control framework can control arbitrary movements of a 3D musculoskeletal arm model quickly and near-optimally. It is two orders-of-magnitude faster than the optimal controller, with only 12% increase in muscle activities compared to the optimal.

[1]  Lena H Ting,et al.  Ratio of shear to load ground-reaction force may underlie the directional tuning of the automatic postural response to rotation and translation. , 2004, Journal of neurophysiology.

[2]  Dominique M. Durand,et al.  Motion control of musculoskeletal systems with redundancy , 2008, Biological Cybernetics.

[3]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. I. Relations between single cell discharge and direction of movement , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[5]  Naser Mehrabi,et al.  Predictive Simulation of Reaching Moving Targets Using Nonlinear Model Predictive Control , 2017, Front. Comput. Neurosci..

[6]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[7]  Robert F. Kirsch,et al.  Combined feedforward and feedback control of a redundant, nonlinear, dynamic musculoskeletal system , 2009, Medical & Biological Engineering & Computing.

[8]  S. Giszter,et al.  Modular Premotor Drives and Unit Bursts as Primitives for Frog Motor Behaviors , 2004, The Journal of Neuroscience.

[9]  Gerald E. Loeb,et al.  Optimal isn’t good enough , 2012, Biological Cybernetics.

[10]  G. J. Thomas The Co-ordination and Regulation of Movements , 1967 .

[11]  Matthew C. Tresch,et al.  The number and choice of muscles impact the results of muscle synergy analyses , 2013, Front. Comput. Neurosci..

[12]  A. P. Georgopoulos,et al.  Movement parameters and neural activity in motor cortex and area 5. , 1994, Cerebral cortex.

[13]  Mohammad Sharif Shourijeh,et al.  An approach for improving repeatability and reliability of non-negative matrix factorization for muscle synergy analysis. , 2016, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[14]  Mark L. Latash,et al.  The use of flexible arm muscle synergies to perform an isometric stabilization task , 2007, Clinical Neurophysiology.

[15]  William Z Rymer,et al.  Robustness of muscle synergies underlying three-dimensional force generation at the hand in healthy humans. , 2012, Journal of neurophysiology.

[16]  Brigitte M. Potvin,et al.  A forward-muscular inverse-skeletal dynamics framework for human musculoskeletal simulations. , 2016, Journal of biomechanics.

[17]  D. B. Lockhart,et al.  Optimal sensorimotor transformations for balance , 2007, Nature Neuroscience.

[18]  Francesco Lacquaniti,et al.  Control of Fast-Reaching Movements by Muscle Synergy Combinations , 2006, The Journal of Neuroscience.

[19]  M. Tresch,et al.  The case for and against muscle synergies , 2022 .

[20]  Jyl Boline,et al.  On the relations between single cell activity in the motor cortex and the direction and magnitude of three-dimensional dynamic isometric force , 1996, Experimental Brain Research.

[21]  Aymar de Rugy,et al.  Muscle Coordination Is Habitual Rather than Optimal , 2012, The Journal of Neuroscience.

[22]  Anthony Jarc,et al.  Simplified and effective motor control based on muscle synergies to exploit musculoskeletal dynamics , 2009, Proceedings of the National Academy of Sciences.

[23]  A B Schwartz,et al.  Motor cortical representation of speed and direction during reaching. , 1999, Journal of neurophysiology.

[24]  Reza Sharif Razavian A Human Motor Control Framework based on Muscle Synergies , 2017 .

[25]  T. Lillicrap,et al.  Preference Distributions of Primary Motor Cortex Neurons Reflect Control Solutions Optimized for Limb Biomechanics , 2013, Neuron.

[26]  Gregor Schöner,et al.  The uncontrolled manifold concept: identifying control variables for a functional task , 1999, Experimental Brain Research.

[27]  John McPhee,et al.  Feedback Control of Functional Electrical Stimulation for 2-D Arm Reaching Movements , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  Lena H. Ting,et al.  Suboptimal Muscle Synergy Activation Patterns Generalize their Motor Function across Postures , 2016, Front. Comput. Neurosci..

[29]  Chad E. Gooyers,et al.  Exploring interactions between force, repetition and posture on intervertebral disc height loss and bulging in isolated porcine cervical functional spinal units from sub-acute-failure magnitudes of cyclic compressive loading. , 2015, Journal of biomechanics.

[30]  Arun Ramakrishnan,et al.  A simple experimentally based model using proprioceptive regulation of motor primitives captures adjusted trajectory formation in spinal frogs. , 2010, Journal of neurophysiology.

[31]  Dario Farina,et al.  Extracting Signals Robust to Electrode Number and Shift for Online Simultaneous and Proportional Myoelectric Control by Factorization Algorithms , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Naser Mehrabi,et al.  A Neuronal Model of Central Pattern Generator to Account for Natural Motion Variation , 2016 .

[33]  Kathleen M Jagodnik,et al.  An optimized proportional-derivative controller for the human upper extremity with gravity. , 2015, Journal of biomechanics.

[34]  A. d’Avella,et al.  Locomotor Primitives in Newborn Babies and Their Development , 2011, Science.

[35]  Michael I. Jordan,et al.  A Minimal Intervention Principle for Coordinated Movement , 2002, NIPS.

[36]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[37]  Andrea d'Avella,et al.  Differences in Adaptation Rates after Virtual Surgeries Provide Direct Evidence for Modularity , 2013, The Journal of Neuroscience.

[38]  Naser Mehrabi,et al.  A model-based approach to predict muscle synergies using optimization: application to feedback control , 2015, Front. Comput. Neurosci..

[39]  Lena H Ting,et al.  Muscle synergy organization is robust across a variety of postural perturbations. , 2006, Journal of neurophysiology.

[40]  P. Morasso Spatial control of arm movements , 2004, Experimental Brain Research.

[41]  John McPhee,et al.  Steering disturbance rejection using a physics-based neuromusculoskeletal driver model , 2015 .

[42]  Lena H Ting,et al.  Neuromechanics of muscle synergies for posture and movement , 2007, Current Opinion in Neurobiology.

[43]  E. Bizzi,et al.  Central and Sensory Contributions to the Activation and Organization of Muscle Synergies during Natural Motor Behaviors , 2005, The Journal of Neuroscience.

[44]  Kathleen M Jagodnik,et al.  Optimization and evaluation of a proportional derivative controller for planar arm movement. , 2010, Journal of biomechanics.

[45]  John McPhee,et al.  Feedback control of functional electrical stimulation for arbitrary upper extremity movements , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[46]  John McPhee,et al.  On the Relationship Between Muscle Synergies and Redundant Degrees of Freedom in Musculoskeletal Systems , 2019, Front. Comput. Neurosci..

[47]  Dinesh K. Pai,et al.  Robustness of muscle synergies during visuomotor adaptation , 2013, Front. Comput. Neurosci..

[48]  M. Schwartz,et al.  Muscle synergies and complexity of neuromuscular control during gait in cerebral palsy , 2015, Developmental medicine and child neurology.

[49]  Jonathan P. Walter,et al.  Muscle synergies may improve optimization prediction of knee contact forces during walking. , 2014, Journal of biomechanical engineering.

[50]  Aymar de Rugy,et al.  Are muscle synergies useful for neural control? , 2013, Front. Comput. Neurosci..

[51]  F. Lacquaniti,et al.  Five basic muscle activation patterns account for muscle activity during human locomotion , 2004, The Journal of physiology.

[52]  Panayiota Poirazi,et al.  Computational modeling of the effects of amyloid-beta on release probability at hippocampal synapses , 2013, Front. Comput. Neurosci..

[53]  M. Pandy,et al.  Dynamic optimization of human walking. , 2001, Journal of biomechanical engineering.

[54]  Walter Herzog,et al.  Model-based estimation of muscle forces exerted during movements. , 2007, Clinical biomechanics.

[55]  I. Cathers,et al.  Standard maximum isometric voluntary contraction tests for normalizing shoulder muscle EMG , 2008, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[56]  Dario Farina,et al.  A musculoskeletal model of human locomotion driven by a low dimensional set of impulsive excitation primitives , 2013, Front. Comput. Neurosci..

[57]  Anil V. Rao,et al.  Muscle Synergies Facilitate Computational Prediction of Subject-Specific Walking Motions , 2016, Front. Bioeng. Biotechnol..

[58]  Reza Sharif Razavian,et al.  A motor control framework for the fast control of a 3 D musculoskeletal arm motion using muscle synergy , 2016 .

[59]  Dario Farina,et al.  Intuitive, Online, Simultaneous, and Proportional Myoelectric Control Over Two Degrees-of-Freedom in Upper Limb Amputees , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[60]  Andrea d'Avella,et al.  A computational analysis of motor synergies by dynamic response decomposition , 2014, Front. Comput. Neurosci..

[61]  Andrea d'Avella,et al.  Effective force control by muscle synergies , 2014, Front. Comput. Neurosci..

[62]  Hiroshi Ishiguro,et al.  Extracting motor synergies from random movements for low-dimensional task-space control of musculoskeletal robots , 2015, Bioinspiration & biomimetics.

[63]  Dinesh K Pai,et al.  Changes in hand muscle synergies in subjects with spinal cord injury: Characterization and functional implications , 2012, The journal of spinal cord medicine.

[64]  E. Bizzi,et al.  Muscle synergies encoded within the spinal cord: evidence from focal intraspinal NMDA iontophoresis in the frog. , 2001, Journal of neurophysiology.

[65]  David Cai,et al.  Effects of Firing Variability on Network Structures with Spike-Timing-Dependent Plasticity , 2018, Front. Comput. Neurosci..

[66]  Andrea d'Avella,et al.  Matrix factorization algorithms for the identification of muscle synergies: evaluation on simulated and experimental data sets. , 2006, Journal of neurophysiology.

[67]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. III. Positional gradients and population coding of movement direction from various movement origins , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[68]  Philip S. Thomas,et al.  Training an Actor-Critic Reinforcement Learning Controller for Arm Movement Using Human-Generated Rewards , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[69]  W. Rymer,et al.  Endpoint force fluctuations reveal flexible rather than synergistic patterns of muscle cooperation. , 2008, Journal of neurophysiology.

[70]  Bastien Berret,et al.  Space-by-Time Modular Decomposition Effectively Describes Whole-Body Muscle Activity During Upright Reaching in Various Directions , 2017, bioRxiv.

[71]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. II. Coding of the direction of movement by a neuronal population , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[72]  Richard R Neptune,et al.  Merging of healthy motor modules predicts reduced locomotor performance and muscle coordination complexity post-stroke. , 2010, Journal of neurophysiology.

[73]  E. Bizzi,et al.  The construction of movement by the spinal cord , 1999, Nature Neuroscience.

[74]  D. Thelen Adjustment of muscle mechanics model parameters to simulate dynamic contractions in older adults. , 2003, Journal of biomechanical engineering.

[75]  Mohammad Sharif Shourijeh,et al.  Use of muscle synergies and wavelet transforms to identify fatigue during squatting. , 2016, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[76]  Simon A. Overduin,et al.  Modulation of Muscle Synergy Recruitment in Primate Grasping , 2008, The Journal of Neuroscience.

[77]  E. Bizzi,et al.  Article history: , 2005 .

[78]  Richard R Neptune,et al.  Modular control of human walking: a simulation study. , 2009, Journal of biomechanics.