Muscle synergies in neuroscience and robotics: from input-space to task-space perspectives

In this paper we review the works related to muscle synergies that have been carried-out in neuroscience and control engineering. In particular, we refer to the hypothesis that the central nervous system (CNS) generates desired muscle contractions by combining a small number of predefined modules, called muscle synergies. We provide an overview of the methods that have been employed to test the validity of this scheme, and we show how the concept of muscle synergy has been generalized for the control of artificial agents. The comparison between these two lines of research, in particular their different goals and approaches, is instrumental to explain the computational implications of the hypothesized modular organization. Moreover, it clarifies the importance of assessing the functional role of muscle synergies: although these basic modules are defined at the level of muscle activations (input-space), they should result in the effective accomplishment of the desired task. This requirement is not always explicitly considered in experimental neuroscience, as muscle synergies are often estimated solely by analyzing recorded muscle activities. We suggest that synergy extraction methods should explicitly take into account task execution variables, thus moving from a perspective purely based on input-space to one grounded on task-space as well.

[1]  Lena H Ting,et al.  Subject-specific muscle synergies in human balance control are consistent across different biomechanical contexts. , 2010, Journal of neurophysiology.

[2]  J. Kalaska,et al.  Muscle synergies during locomotion in the cat: a model for motor cortex control , 2008, The Journal of physiology.

[3]  E. Bizzi,et al.  Central and Sensory Contributions to the Activation and Organization of Muscle Synergies during Natural Motor Behaviors , 2005, The Journal of Neuroscience.

[4]  Evangelos Theodorou,et al.  Reduced dimensionality control for the ACT hand , 2012, 2012 IEEE International Conference on Robotics and Automation.

[5]  I. Pitas,et al.  A new sparse image representation algorithm applied to facial expression recognition , 2004, Proceedings of the 2004 14th IEEE Signal Processing Society Workshop Machine Learning for Signal Processing, 2004..

[6]  F. Lacquaniti,et al.  Motor patterns in human walking and running. , 2006, Journal of neurophysiology.

[7]  Mark L Latash,et al.  Motor synergies and the equilibrium-point hypothesis. , 2010, Motor control.

[8]  Lena H Ting,et al.  Task-level feedback can explain temporal recruitment of spatially fixed muscle synergies throughout postural perturbations. , 2012, Journal of neurophysiology.

[9]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[10]  Aee-Ni Park,et al.  Synthesis of Character Behaviour by Dynamic Interaction of Synergies Learned from Motion Capture Data , 2008 .

[11]  W. Kargo,et al.  Early Skill Learning Is Expressed through Selection and Tuning of Cortically Represented Muscle Synergies , 2003, The Journal of Neuroscience.

[12]  H. Harry Asada,et al.  Inter-finger coordination and postural synergies in robot hands via mechanical implementation of principal components analysis , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Francisco J. Valero Cuevas,et al.  Challenges and New Approaches to Proving the Existence of Muscle Synergies of Neural Origin , 2012, PLoS Comput. Biol..

[14]  T. Drew,et al.  Sequential activation of motor cortical neurons contributes to intralimb coordination during reaching in the cat by modulating muscle synergies. , 2011, Journal of neurophysiology.

[15]  Giulio Sandini,et al.  Exploiting Motor Modules in Modular Contexts in Humanoid Robotics , 2008 .

[16]  Antonio Bicchi,et al.  Modelling natural and artificial hands with synergies , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[17]  Paul S. G. Stein,et al.  Motor pattern deletions and modular organization of turtle spinal cord , 2008, Brain Research Reviews.

[18]  Maja J. Mataric,et al.  Movement control methods for complex, dynamically simulated agents: Adonis dances the Macarena , 1998, AGENTS '98.

[19]  Aee-Ni Park,et al.  Self organized character animation based on learned synergies from full-body motion capture data , 2008 .

[20]  Aude Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[21]  Richard R Neptune,et al.  Merging of healthy motor modules predicts reduced locomotor performance and muscle coordination complexity post-stroke. , 2010, Journal of neurophysiology.

[22]  E. Bizzi,et al.  The construction of movement by the spinal cord , 1999, Nature Neuroscience.

[23]  William J. Kargo,et al.  Conserved temporal dynamics and vector superposition of primitives in frog wiping reflexes during spontaneous extensor deletions , 2000, Neurocomputing.

[24]  Emilio Bizzi,et al.  Combinations of muscle synergies in the construction of a natural motor behavior , 2003, Nature Neuroscience.

[25]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[26]  E. Bizzi,et al.  Modules in the brain stem and spinal cord underlying motor behaviors. , 2011, Journal of neurophysiology.

[27]  N. Hogan,et al.  Does the nervous system use equilibrium-point control to guide single and multiple joint movements? , 1992, The Behavioral and brain sciences.

[28]  E. Bizzi,et al.  Stability of muscle synergies for voluntary actions after cortical stroke in humans , 2009, Proceedings of the National Academy of Sciences.

[29]  E. Bizzi,et al.  Article history: , 2005 .

[30]  Francesco Lacquaniti,et al.  Development of human locomotion , 2012, Current Opinion in Neurobiology.

[31]  Yoky Matsuoka,et al.  Task-specific demonstration and practiced synergies for writing with the ACT hand , 2011, 2011 IEEE International Conference on Robotics and Automation.

[32]  Max Berniker Linearity, motor primitives and low-dimensionality in the spinal organization of motor control , 2005 .

[33]  A. d’Avella,et al.  Locomotor Primitives in Newborn Babies and Their Development , 2011, Science.

[34]  Vladimir M. Zatsiorsky,et al.  Muscle synergies during shifts of the center of pressure by standing persons , 2003, Experimental Brain Research.

[35]  Emanuel Todorov,et al.  From task parameters to motor synergies: A hierarchical framework for approximately optimal control of redundant manipulators , 2005, J. Field Robotics.

[36]  宁北芳,et al.  疟原虫var基因转换速率变化导致抗原变异[英]/Paul H, Robert P, Christodoulou Z, et al//Proc Natl Acad Sci U S A , 2005 .

[37]  Anthony Jarc,et al.  Simplified and effective motor control based on muscle synergies to exploit musculoskeletal dynamics , 2009, Proceedings of the National Academy of Sciences.

[38]  R. Darlington,et al.  Multiple regression in psychological research and practice. , 1968, Psychological bulletin.

[39]  Frédo Durand,et al.  Linear Bellman combination for control of character animation , 2009, ACM Trans. Graph..

[40]  Y. Matsuoka,et al.  Mechanisms of the Anatomically Correct Testbed Hand , 2013, IEEE/ASME Transactions on Mechatronics.

[41]  Martin A. Giese,et al.  Trajectory synthesis by hierarchical spatio-temporal correspondence: comparison of different methods , 2005, APGV '05.

[42]  Richard R Neptune,et al.  Modular control of human walking: a simulation study. , 2009, Journal of biomechanics.

[43]  Francesco Nori,et al.  Symbolic Control with Biologically Inspired Motion Primitives , 2005 .

[44]  W. Rymer,et al.  Endpoint force fluctuations reveal flexible rather than synergistic patterns of muscle cooperation. , 2008, Journal of neurophysiology.

[45]  Torrence D. J. Welch,et al.  A feedback model reproduces muscle activity during human postural responses to support-surface translations. , 2008, Journal of neurophysiology.

[46]  Arun Ramakrishnan,et al.  A simple experimentally based model using proprioceptive regulation of motor primitives captures adjusted trajectory formation in spinal frogs. , 2010, Journal of neurophysiology.

[47]  S. Giszter,et al.  A Neural Basis for Motor Primitives in the Spinal Cord , 2010, The Journal of Neuroscience.

[48]  P. Latham,et al.  Synergy, Redundancy, and Independence in Population Codes, Revisited , 2005, The Journal of Neuroscience.

[49]  Helmut Hauser,et al.  Biologically inspired kinematic synergies enable linear balance control of a humanoid robot , 2011, Biological Cybernetics.

[50]  A. Jackson,et al.  Flexible Cortical Control of Task-Specific Muscle Synergies , 2012, The Journal of Neuroscience.

[51]  Francesco Lacquaniti,et al.  Motor Control Programs and Walking , 2006, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[52]  William J Kargo,et al.  Individual Premotor Drive Pulses, Not Time-Varying Synergies, Are the Units of Adjustment for Limb Trajectories Constructed in Spinal Cord , 2008, The Journal of Neuroscience.

[53]  L. Miller,et al.  Primary motor cortical neurons encode functional muscle synergies , 2002, Experimental Brain Research.

[54]  Andrea d'Avella,et al.  Synthesis and Adaptation of Effective Motor Synergies for the Solution of Reaching Tasks , 2012, SAB.

[55]  Richard R Neptune,et al.  Modular control of human walking: Adaptations to altered mechanical demands. , 2010, Journal of biomechanics.

[56]  M. Latash,et al.  Motor control theories and their applications. , 2010, Medicina.

[57]  Ferdinando A. Mussa-Ivaldi,et al.  Vector field approximation: a computational paradigm for motor control and learning , 1992, Biological Cybernetics.

[58]  Stacie A. Chvatal,et al.  Common muscle synergies for control of center of mass and force in nonstepping and stepping postural behaviors. , 2011, Journal of neurophysiology.

[59]  Albert Mukovskiy,et al.  Real-Time Synthesis of Body Movements Based on Learned Primitives , 2009, Statistical and Geometrical Approaches to Visual Motion Analysis.

[60]  Ruggero Frezza,et al.  A control theory approach to the analysis and synthesis of the experimentally observed motion primitives , 2005, Biological Cybernetics.

[61]  T Brochier,et al.  Patterns of muscle activity underlying object-specific grasp by the macaque monkey. , 2004, Journal of neurophysiology.

[62]  E. Bizzi,et al.  Muscle synergies encoded within the spinal cord: evidence from focal intraspinal NMDA iontophoresis in the frog. , 2001, Journal of neurophysiology.

[63]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[64]  M. Carpenter The Co-ordination and Regulation of Movements , 1968 .

[65]  Lena H Ting,et al.  A limited set of muscle synergies for force control during a postural task. , 2005, Journal of neurophysiology.

[66]  F Lacquaniti,et al.  Spinal cord maps of spatiotemporal alpha-motoneuron activation in humans walking at different speeds. , 2006, Journal of neurophysiology.

[67]  W. Rymer,et al.  Alterations in upper limb muscle synergy structure in chronic stroke survivors. , 2013, Journal of neurophysiology.

[68]  Andrea d'Avella,et al.  Matrix factorization algorithms for the identification of muscle synergies: evaluation on simulated and experimental data sets. , 2006, Journal of neurophysiology.

[69]  A. Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[70]  Francesco Lacquaniti,et al.  Patterned control of human locomotion , 2012, The Journal of physiology.

[71]  M. Tresch,et al.  The case for and against muscle synergies , 2022 .

[72]  Emilio Bizzi,et al.  Shared and specific muscle synergies in natural motor behaviors. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[73]  Stefano Panzeri,et al.  Quantitative evaluation of muscle synergy models: a single-trial task decoding approach , 2013, Front. Comput. Neurosci..

[74]  Simon A. Overduin,et al.  Modulation of Muscle Synergy Recruitment in Primate Grasping , 2008, The Journal of Neuroscience.

[75]  J. Kalaska,et al.  Sequential activation of muscle synergies during locomotion in the intact cat as revealed by cluster analysis and direct decomposition. , 2006, Journal of neurophysiology.

[76]  F. Lacquaniti,et al.  Spatiotemporal organization of α‐motoneuron activity in the human spinal cord during different gaits and gait transitions , 2008, The European journal of neuroscience.

[77]  L. Ting,et al.  Muscle synergies characterizing human postural responses. , 2007, Journal of neurophysiology.

[78]  Richard R Neptune,et al.  Three-dimensional modular control of human walking. , 2012, Journal of biomechanics.

[79]  Albert Mukovskiy,et al.  Analysis and Design of the Dynamical Stability of Collective Behavior in Crowds , 2011, J. WSCG.

[80]  Aymar de Rugy,et al.  Muscle Coordination Is Habitual Rather than Optimal , 2012, The Journal of Neuroscience.

[81]  Zoubin Ghahramani,et al.  Unsupervised learning of sensory-motor primitives , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[82]  Emanuel Todorov,et al.  Structured variability of muscle activations supports the minimal intervention principle of motor control. , 2009, Journal of neurophysiology.

[83]  Simon A. Overduin,et al.  Microstimulation Activates a Handful of Muscle Synergies , 2012, Neuron.

[84]  N. L. Johnson,et al.  Multivariate Analysis , 1958, Nature.

[85]  Tamar Flash,et al.  Motor primitives in vertebrates and invertebrates , 2005, Current Opinion in Neurobiology.

[86]  Yoky Matsuoka,et al.  Musical piano performance by the ACT Hand , 2011, 2011 IEEE International Conference on Robotics and Automation.

[87]  Ioannis Delis,et al.  On the Origins of Modularity in Motor Control , 2010, The Journal of Neuroscience.

[88]  S. Giszter,et al.  Modular Premotor Drives and Unit Bursts as Primitives for Frog Motor Behaviors , 2004, The Journal of Neuroscience.

[89]  Grégory Faye Dynamical Systems and Chaos , 2012 .

[90]  E. Bizzi,et al.  Muscle synergy patterns as physiological markers of motor cortical damage , 2012, Proceedings of the National Academy of Sciences.

[91]  M. Flanders,et al.  Timing of muscle activation in a hand movement sequence. , 2006, Cerebral cortex.

[92]  F. Lacquaniti,et al.  Migration of motor pool activity in the spinal cord reflects body mechanics in human locomotion. , 2010, Journal of neurophysiology.

[93]  Stefano Panzeri,et al.  Investigating reduction of dimensionality during single-joint elbow movements: a case study on muscle synergies , 2013, Front. Comput. Neurosci..

[94]  Dario Farina,et al.  Impulses of activation but not motor modules are preserved in the locomotion of subacute stroke patients. , 2011, Journal of neurophysiology.

[95]  Andrea d'Avella,et al.  Modularity in the motor system: decomposition of muscle patterns as combinations of time-varying synergies , 2001, NIPS.

[96]  M. Latash,et al.  Hierarchies of Synergies in Human Movements. , 2008, Kinesiology.

[97]  Maja J. Matarić,et al.  Behavior-based primitives for articulated control , 1998 .

[98]  Emilio Bizzi,et al.  Adjustments of motor pattern for load compensation via modulated activations of muscle synergies during natural behaviors. , 2009, Journal of neurophysiology.

[99]  S. Micera,et al.  Age-related modifications of muscle synergies and spinal cord activity during locomotion. , 2010, Journal of neurophysiology.

[100]  E Bizzi,et al.  Motor learning through the combination of primitives. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[101]  Qi Tian,et al.  Integrating Discriminant and Descriptive Information for Dimension Reduction and Classification , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[102]  F. Lacquaniti,et al.  Five basic muscle activation patterns account for muscle activity during human locomotion , 2004, The Journal of physiology.

[103]  Stacie A. Chvatal,et al.  Decomposing Muscle Activity in Motor TasksMethods and Interpretation , 2010 .

[104]  Emanuel Todorov,et al.  Compositionality of optimal control laws , 2009, NIPS.

[105]  A. A. Handzel,et al.  Three-dimensional arm movements at constant equi-affine speed , 2009, Cortex.

[106]  M. Latash,et al.  Muscle synergies during shifts of the center of pressure by standing persons , 2003, Experimental Brain Research.

[107]  Andrew G. Barto,et al.  Motor primitive discovery , 2012, 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL).

[108]  C. Alessandro,et al.  Identification of synergies by optimization of trajectory tracking tasks , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[109]  William Z Rymer,et al.  Robustness of muscle synergies underlying three-dimensional force generation at the hand in healthy humans. , 2012, Journal of neurophysiology.

[110]  Visar Berisha,et al.  Energy-constrained discriminant analysis , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[111]  Francesco Lacquaniti,et al.  Modulation of phasic and tonic muscle synergies with reaching direction and speed. , 2008, Journal of neurophysiology.

[112]  Antonio Bicchi,et al.  On the role of hand synergies in the optimal choice of grasping forces , 2010, Auton. Robots.

[113]  M. Young,et al.  Correlations, feature‐binding and population coding in primary visual cortex , 2003, Neuroreport.

[114]  Robert A. Jacobs,et al.  Learning to Combine Motor Primitives Via Greedy Additive Regression , 2008, J. Mach. Learn. Res..

[115]  F. Lacquaniti,et al.  Coordination of Locomotion with Voluntary Movements in Humans , 2005, The Journal of Neuroscience.

[116]  Ferdinando A. Mussa-Ivaldi,et al.  Nonlinear force fields: a distributed system of control primitives for representing and learning movements , 1997, Proceedings 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation CIRA'97. 'Towards New Computational Principles for Robotics and Automation'.

[117]  Dario Farina,et al.  Identifying representative synergy matrices for describing muscular activation patterns during multidirectional reaching in the horizontal plane. , 2010, Journal of neurophysiology.

[118]  E. Bizzi,et al.  Linear combinations of primitives in vertebrate motor control. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[119]  Emilio Bizzi,et al.  Coordination and localization in spinal motor systems , 2002, Brain Research Reviews.

[120]  Lilian Fautrelle,et al.  Muscular synergies during motor corrections: Investigation of the latencies of muscle activities , 2010, Behavioural Brain Research.

[121]  W J Kargo,et al.  Rapid Correction of Aimed Movements by Summation of Force-Field Primitives , 2000, The Journal of Neuroscience.

[122]  S. Giszter,et al.  Output Units of Motor Behavior: An Experimental and Modeling Study , 2000, Journal of Cognitive Neuroscience.

[123]  Naveen Kuppuswamy,et al.  Unsupervised Learning of a Reduced Dimensional Controller for a Tendon Driven Robot Platform , 2012, SAB.

[124]  Matei T. Ciocarlie,et al.  Hand Posture Subspaces for Dexterous Robotic Grasping , 2009, Int. J. Robotics Res..

[125]  S. Giszter,et al.  Afferent roles in hindlimb wipe-reflex trajectories: free-limb kinematics and motor patterns. , 2000, Journal of neurophysiology.

[126]  Lena H Ting,et al.  Muscle synergy organization is robust across a variety of postural perturbations. , 2006, Journal of neurophysiology.

[127]  Lena H. Ting,et al.  Optimization of Muscle Activity for Task-Level Goals Predicts Complex Changes in Limb Forces across Biomechanical Contexts , 2012, PLoS Comput. Biol..

[128]  Alejandro Hernández Arieta,et al.  Body Schema in Robotics: A Review , 2010, IEEE Transactions on Autonomous Mental Development.

[129]  F. Lacquaniti,et al.  Temporal components of the motor patterns expressed by the human spinal cord reflect foot kinematics. , 2003, Journal of neurophysiology.

[130]  Raibert Hodgins Making Complex Articulated Agents Dance , 1999 .

[131]  Francesco Lacquaniti,et al.  Superposition and modulation of muscle synergies for reaching in response to a change in target location. , 2011, Journal of neurophysiology.

[132]  Sylvain Dorel,et al.  Consistency of muscle synergies during pedaling across different mechanical constraints. , 2011, Journal of neurophysiology.

[133]  Martha Flanders,et al.  Muscular and postural synergies of the human hand. , 2004, Journal of neurophysiology.

[134]  L. Ting,et al.  Functional muscle synergies constrain force production during postural tasks. , 2008, Journal of biomechanics.

[135]  Michael J. Berry,et al.  Synergy, Redundancy, and Independence in Population Codes , 2003, The Journal of Neuroscience.

[136]  Rajiv Ranganathan,et al.  Extracting synergies in gait: using EMG variability to evaluate control strategies. , 2012, Journal of neurophysiology.

[137]  G. Lewis,et al.  Interactions with compliant loads alter stretch reflex gains but not intermuscular coordination. , 2008, Journal of neurophysiology.

[138]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[139]  R. Quiroga,et al.  Extracting information from neuronal populations : information theory and decoding approaches , 2022 .

[140]  F. A. Mussa-lvaldi,et al.  Convergent force fields organized in the frog's spinal cord , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.