Optimization of Muscle Activity for Task-Level Goals Predicts Complex Changes in Limb Forces across Biomechanical Contexts

Optimality principles have been proposed as a general framework for understanding motor control in animals and humans largely based on their ability to predict general features movement in idealized motor tasks. However, generalizing these concepts past proof-of-principle to understand the neuromechanical transformation from task-level control to detailed execution-level muscle activity and forces during behaviorally-relevant motor tasks has proved difficult. In an unrestrained balance task in cats, we demonstrate that achieving task-level constraints center of mass forces and moments while minimizing control effort predicts detailed patterns of muscle activity and ground reaction forces in an anatomically-realistic musculoskeletal model. Whereas optimization is typically used to resolve redundancy at a single level of the motor hierarchy, we simultaneously resolved redundancy across both muscles and limbs and directly compared predictions to experimental measures across multiple perturbation directions that elicit different intra- and interlimb coordination patterns. Further, although some candidate task-level variables and cost functions generated indistinguishable predictions in a single biomechanical context, we identified a common optimization framework that could predict up to 48 experimental conditions per animal (n = 3) across both perturbation directions and different biomechanical contexts created by altering animals' postural configuration. Predictions were further improved by imposing experimentally-derived muscle synergy constraints, suggesting additional task variables or costs that may be relevant to the neural control of balance. These results suggested that reduced-dimension neural control mechanisms such as muscle synergies can achieve similar kinetics to the optimal solution, but with increased control effort (≈2×) compared to individual muscle control. Our results are consistent with the idea that hierarchical, task-level neural control mechanisms previously associated with voluntary tasks may also be used in automatic brainstem-mediated pathways for balance.

[1]  T. Drew,et al.  Neurons in the pontomedullary reticular formation signal posture and movement both as an integrated behavior and independently. , 2008, Journal of neurophysiology.

[2]  F. Zajac,et al.  Muscle coordination of maximum-speed pedaling. , 1997, Journal of biomechanics.

[3]  Emanuel Todorov,et al.  Cosine Tuning Minimizes Motor Errors , 2002, Neural Computation.

[4]  F. Zajac,et al.  Determining Muscle's Force and Action in Multi‐Articular Movement , 1989, Exercise and sport sciences reviews.

[5]  Sukyung Park,et al.  Postural feedback scaling deficits in Parkinson's disease. , 2009, Journal of neurophysiology.

[6]  Dan Liu,et al.  Hierarchical optimal control of a 7-DOF arm model , 2009, 2009 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning.

[7]  Y. Shinoda,et al.  Multiple axon collaterals of single corticospinal axons in the cat spinal cord. , 1986, Journal of neurophysiology.

[8]  Kazuhito Yokoi,et al.  Biped walking pattern generation by using preview control of zero-moment point , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[9]  L. Ting,et al.  Biomechanical capabilities influence postural control strategies in the cat hindlimb. , 2007, Journal of biomechanics.

[10]  Robert J. Peterka,et al.  Postural control model interpretation of stabilogram diffusion analysis , 2000, Biological Cybernetics.

[11]  R. Peterka Sensorimotor integration in human postural control. , 2002, Journal of neurophysiology.

[12]  T. Drew,et al.  The pontomedullary reticular formation contributes to the compensatory postural responses observed following removal of the support surface in the standing cat. , 2009, Journal of neurophysiology.

[13]  Anthony Jarc,et al.  Simplified and effective motor control based on muscle synergies to exploit musculoskeletal dynamics , 2009, Proceedings of the National Academy of Sciences.

[14]  Etienne Burdet,et al.  Dissociating Variability and Effort as Determinants of Coordination , 2009, PLoS Comput. Biol..

[15]  F. Zajac Muscle and tendon: properties, models, scaling, and application to biomechanics and motor control. , 1989, Critical reviews in biomedical engineering.

[16]  Torrence D. J. Welch,et al.  A feedback model explains the differential scaling of human postural responses to perturbation acceleration and velocity. , 2009, Journal of neurophysiology.

[17]  Emanuel Todorov,et al.  Structured variability of muscle activations supports the minimal intervention principle of motor control. , 2009, Journal of neurophysiology.

[18]  J M Macpherson,et al.  Changes in a postural strategy with inter-paw distance. , 1994, Journal of neurophysiology.

[19]  B. Prilutsky,et al.  Forces of individual cat ankle extensor muscles during locomotion predicted using static optimization. , 1997, Journal of biomechanics.

[20]  G. Loeb,et al.  Spinal-Like Regulator Facilitates Control of a Two-Degree-of-Freedom Wrist , 2010, The Journal of Neuroscience.

[21]  E. Todorov,et al.  Infinite Horizon Optimal Control Framework for Goal Directed Movements , 2010 .

[22]  Arun Ramakrishnan,et al.  A simple experimentally based model using proprioceptive regulation of motor primitives captures adjusted trajectory formation in spinal frogs. , 2010, Journal of neurophysiology.

[23]  S. Giszter,et al.  A Neural Basis for Motor Primitives in the Spinal Cord , 2010, The Journal of Neuroscience.

[24]  J. A. Pruszynski,et al.  Primate upper limb muscles exhibit activity patterns that differ from their anatomical action during a postural task. , 2006, Journal of neurophysiology.

[25]  Neville Hogan,et al.  Integrable Solutions of Kinematic Redundancy via Impedance Control , 1991, Int. J. Robotics Res..

[26]  C. K. Liu,et al.  Optimal feedback control for character animation using an abstract model , 2010, ACM Trans. Graph..

[27]  Daniel M Wolpert,et al.  Optimal control of redundant muscles in step-tracking wrist movements. , 2005, Journal of neurophysiology.

[28]  R. Poppele,et al.  Independent representations of limb axis length and orientation in spinocerebellar response components. , 2002, Journal of neurophysiology.

[29]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. I. Relations between single cell discharge and direction of movement , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[30]  Nathan E. Bunderson,et al.  Reduction of neuromuscular redundancy for postural force generation using an intrinsic stability criterion. , 2008, Journal of biomechanics.

[31]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[32]  M. Pandy,et al.  Dynamic optimization of human walking. , 2001, Journal of biomechanical engineering.

[33]  Jason J Kutch,et al.  Muscle redundancy does not imply robustness to muscle dysfunction. , 2011, Journal of biomechanics.

[34]  A. Kuo An optimal state estimation model of sensory integration in human postural balance , 2005, Journal of neural engineering.

[35]  A.D. Kuo,et al.  An optimal control model for analyzing human postural balance , 1995, IEEE Transactions on Biomedical Engineering.

[36]  Richard R Neptune,et al.  Merging of healthy motor modules predicts reduced locomotor performance and muscle coordination complexity post-stroke. , 2010, Journal of neurophysiology.

[37]  E. Bizzi,et al.  The construction of movement by the spinal cord , 1999, Nature Neuroscience.

[38]  E. Bizzi,et al.  Modules in the brain stem and spinal cord underlying motor behaviors. , 2011, Journal of neurophysiology.

[39]  E. Fetz,et al.  Postspike facilitation of forelimb muscle activity by primate corticomotoneuronal cells. , 1980, Journal of neurophysiology.

[40]  Francesco Nori,et al.  Evidence for Composite Cost Functions in Arm Movement Planning: An Inverse Optimal Control Approach , 2011, PLoS Comput. Biol..

[41]  T Richard Nichols,et al.  Three‐dimensional model of the feline hindlimb , 2004, Journal of morphology.

[42]  Atsuo Takanishi,et al.  Development of a bipedal humanoid robot-control method of whole body cooperative dynamic biped walking , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[43]  J. Krakauer,et al.  A computational neuroanatomy for motor control , 2008, Experimental Brain Research.

[44]  Lena H Ting,et al.  Task-level feedback can explain temporal recruitment of spatially fixed muscle synergies throughout postural perturbations. , 2012, Journal of neurophysiology.

[45]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[46]  Alexander A. Frolov,et al.  Biomechanical analysis of movement strategies in human forward trunk bending. I. Modeling , 2001, Biological Cybernetics.

[47]  Daniel M. Corcos,et al.  Relations between joint torque, motion, and electromyographic patterns at the human elbow , 2004, Experimental Brain Research.

[48]  Emanuel Todorov,et al.  From task parameters to motor synergies: A hierarchical framework for approximately optimal control of redundant manipulators , 2005, J. Field Robotics.

[49]  Hugh M. Herr,et al.  Angular momentum primitives for human turning: Control implications for biped robots , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[50]  Ashvin Shah,et al.  A computational model of muscle recruitment for wrist movements. , 2002, Journal of neurophysiology.

[51]  J M Macpherson,et al.  Strategies that simplify the control of quadrupedal stance. II. Electromyographic activity. , 1988, Journal of neurophysiology.

[52]  H P Clamann,et al.  Motor unit recruitment and the gradation of muscle force. , 1993, Physical therapy.

[53]  E. Oja Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[54]  K. Gruben,et al.  Foot force direction in an isometric pushing task: prediction by kinematic and musculoskeletal models , 2003, Experimental Brain Research.

[55]  Andrea d'Avella,et al.  Modularity for Sensorimotor Control: Evidence and a New Prediction , 2010, Journal of motor behavior.

[56]  F. Horak,et al.  Postural feedback responses scale with biomechanical constraints in human standing , 2004, Experimental Brain Research.

[57]  Richard R Neptune,et al.  Modular control of human walking: Adaptations to altered mechanical demands. , 2010, Journal of biomechanics.

[58]  Bruno A Olshausen,et al.  Sparse coding of sensory inputs , 2004, Current Opinion in Neurobiology.

[59]  T. Nichols,et al.  The decerebrate cat generates the essential features of the force constraint strategy. , 2010, Journal of neurophysiology.

[60]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[61]  J. He,et al.  Feedback gains for correcting small perturbations to standing posture , 1989, Proceedings of the 28th IEEE Conference on Decision and Control,.

[62]  R. M. Glaser,et al.  Improving the efficacy of electrical stimulation-induced leg cycle ergometry: an analysis based on a dynamic musculoskeletal model , 1993 .

[63]  D. F. Hoyt,et al.  Gait and the energetics of locomotion in horses , 1981, Nature.

[64]  Mako Popovic,et al.  Angular momentum primitives for human walking: biomechanics and control , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[65]  A. Kuo,et al.  A biomechanical analysis of muscle strength as a limiting factor in standing posture. , 1992, Journal of biomechanics.

[66]  A. Ruina,et al.  Multiple walking speed-frequency relations are predicted by constrained optimization. , 2001, Journal of theoretical biology.

[67]  Stacie A. Chvatal,et al.  Common muscle synergies for control of center of mass and force in nonstepping and stepping postural behaviors. , 2011, Journal of neurophysiology.

[68]  Marko Ackermann,et al.  Optimality principles for model-based prediction of human gait. , 2010, Journal of biomechanics.

[69]  Lena H Ting,et al.  Muscle synergy organization is robust across a variety of postural perturbations. , 2006, Journal of neurophysiology.

[70]  L. Ting,et al.  Functional muscle synergies constrain force production during postural tasks. , 2008, Journal of biomechanics.

[71]  R. Neptune,et al.  Muscle contributions to whole-body sagittal plane angular momentum during walking. , 2011, Journal of biomechanics.

[72]  E Burdet,et al.  Motor memory and local minimization of error and effort, not global optimization, determine motor behavior. , 2010, Journal of neurophysiology.

[73]  R. Zaremba,et al.  ATP utilization for calcium uptake and force production in different types of human skeletal muscle fibres , 2001, The Journal of physiology.

[74]  Lena H Ting,et al.  Ratio of shear to load ground-reaction force may underlie the directional tuning of the automatic postural response to rotation and translation. , 2004, Journal of neurophysiology.

[75]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[76]  Ila R Fiete,et al.  Temporal sparseness of the premotor drive is important for rapid learning in a neural network model of birdsong. , 2004, Journal of neurophysiology.

[77]  Lena H Ting,et al.  A limited set of muscle synergies for force control during a postural task. , 2005, Journal of neurophysiology.

[78]  A. English,et al.  Differential activation of neuromuscular compartments in the rabbit masseter muscle during different oral behaviors , 2003, Experimental Brain Research.

[79]  E. Bizzi,et al.  Article history: , 2005 .

[80]  Richard R Neptune,et al.  Modular control of human walking: a simulation study. , 2009, Journal of biomechanics.

[81]  Daniel M. Wolpert,et al.  The Main Sequence of Saccades Optimizes Speed-accuracy Trade-off , 2006, Biological Cybernetics.

[82]  J. E. Jackson,et al.  Statistical Factor Analysis and Related Methods: Theory and Applications , 1995 .

[83]  P. Strick,et al.  Subdivisions of primary motor cortex based on cortico-motoneuronal cells , 2009, Proceedings of the National Academy of Sciences.

[84]  Marko B. Popovic,et al.  Angular momentum in human walking , 2008, Journal of Experimental Biology.

[85]  Torrence D. J. Welch,et al.  A feedback model reproduces muscle activity during human postural responses to support-surface translations. , 2008, Journal of neurophysiology.

[86]  Alexander Basilevsky,et al.  Statistical Factor Analysis and Related Methods , 1994 .

[87]  Lena H Ting,et al.  Neuromechanics of muscle synergies for posture and movement , 2007, Current Opinion in Neurobiology.

[88]  F. Zajac,et al.  Locomotor strategy for pedaling: muscle groups and biomechanical functions. , 1999, Journal of neurophysiology.

[89]  D. B. Lockhart,et al.  Optimal sensorimotor transformations for balance , 2007, Nature Neuroscience.

[90]  Lena H Ting,et al.  Subject-specific muscle synergies in human balance control are consistent across different biomechanical contexts. , 2010, Journal of neurophysiology.

[91]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[92]  L. Nashner Fixed patterns of rapid postural responses among leg muscles during stance , 1977, Experimental Brain Research.

[93]  Robert J. Peterka,et al.  Comparison of human and humanoid robot control of upright stance , 2009, Journal of Physiology-Paris.

[94]  M. Tresch,et al.  The case for and against muscle synergies , 2022 .

[95]  Sung-Hee Lee,et al.  The Reaction Mass Pendulum (RMP) Model for Humanoid Robot Gait and Balance Control , 2009 .

[96]  J. Macpherson Strategies that simplify the control of quadrupedal stance. I. Forces at the ground. , 1988, Journal of neurophysiology.

[97]  M L Hull,et al.  A theoretical basis for interpreting the force applied to the pedal in cycling. , 1993, Journal of biomechanics.

[98]  Mark L Latash,et al.  An analytical approach to the problem of inverse optimization with additive objective functions: an application to human prehension , 2010, Journal of mathematical biology.

[99]  L Stark,et al.  Estimated mechanical properties of synergistic muscles involved in movements of a variety of human joints. , 1988, Journal of biomechanics.

[100]  R. Shadmehr,et al.  Temporal Discounting of Reward and the Cost of Time in Motor Control , 2010, The Journal of Neuroscience.

[101]  T. Drew,et al.  Sequential activation of motor cortical neurons contributes to intralimb coordination during reaching in the cat by modulating muscle synergies. , 2011, Journal of neurophysiology.

[102]  Alexander A. Frolov,et al.  Biomechanical analysis of movement strategies in human forward trunk bending. II. Experimental study , 2001, Biological Cybernetics.

[103]  David A. Winter,et al.  Human balance and posture control during standing and walking , 1995 .

[104]  Claire F. Honeycutt,et al.  Electromyographic responses from the hindlimb muscles of the decerebrate cat to horizontal support surface perturbations. , 2009, Journal of neurophysiology.

[105]  D J Weber,et al.  Limb-state feedback from ensembles of simultaneously recorded dorsal root ganglion neurons , 2007, Journal of neural engineering.

[106]  J. Macpherson,et al.  Two functional muscle groupings during postural equilibrium tasks in standing cats. , 1996, Journal of neurophysiology.

[107]  R. Roy,et al.  Architecture of the hind limb muscles of cats: Functional significance , 1982, Journal of morphology.

[108]  Keith W van Antwerp,et al.  Inter-joint coupling effects on muscle contributions to endpoint force and acceleration in a musculoskeletal model of the cat hindlimb. , 2007, Journal of biomechanics.

[109]  J J Collins,et al.  The redundant nature of locomotor optimization laws. , 1995, Journal of biomechanics.

[110]  C. K. Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, SIGGRAPH 2005.

[111]  Johnathan Lucas McKay Neuromechanical constraints and optimality for balance , 2010 .

[112]  R. Crowninshield,et al.  A physiologically based criterion of muscle force prediction in locomotion. , 1981, Journal of biomechanics.

[113]  Nathan E. Bunderson,et al.  Directional constraint of endpoint force emerges from hindlimb anatomy , 2010, Journal of Experimental Biology.

[114]  Chris H. Mullens,et al.  Estimation of musculoskeletal models from in situ measurements of muscle action in the rat hindlimb , 2011, Journal of Experimental Biology.

[115]  L. Miller,et al.  Primary motor cortical neurons encode functional muscle synergies , 2002, Experimental Brain Research.

[116]  Mark G. Carpenter,et al.  Directional sensitivity of stretch reflexes and balance corrections for normal subjects in the roll and pitch planes , 1999, Experimental Brain Research.

[117]  W S Levine,et al.  An optimal control model for maximum-height human jumping. , 1990, Journal of biomechanics.

[118]  C. Karen Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, ACM Trans. Graph..

[119]  Manoj Srinivasan,et al.  Computer optimization of a minimal biped model discovers walking and running , 2006, Nature.

[120]  Robert A. Jacobs,et al.  Properties of Synergies Arising from a Theory of Optimal Motor Behavior , 2006, Neural Computation.

[121]  V. Dietz,et al.  Compensation of translational and rotational perturbations in human posture: Stabilization of the centre of gravity , 1989, Neuroscience Letters.