On the Time-Invariance Properties of Upper Limb Synergies

In this paper, we present a novel approach to dynamically describe human upper limb trajectories, addressing the question on whether and to which extent synergistic multi-joint behavior is observed and preserved over time evolution and across subjects. To this goal, we performed experiments to collect human upper limb joint angle trajectories and organized them in a dataset of daily living tasks. We then characterized the upper limb poses at each time frame through a technique that we named repeated-principal component analysis (R-PCA). We found that, although there is no strong evidence on the predominance of one principal component (PC) over the others, the subspace identified by the first three PCs takes into account most of the motion variability. We evaluated the stability of these results over time, showing that during the reaching phase, there is a strong consistency of these findings across participants. In other words, our results suggest that there is a time-invariant low-dimensional approximation of upper limb kinematics, which can be used to define a suitable reduced dimensionality control space for upper limb robotic devices in motion phases.

[1]  Giuseppe Averta,et al.  A functional analysis-based approach to quantify upper limb impairment level in chronic stroke patients: a pilot study , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[2]  Patrick van der Smagt,et al.  Evidence of muscle synergies during human grasping , 2013, Biological Cybernetics.

[3]  Martin A. Giese,et al.  Modularity in motor control: from muscle synergies to cognitive action representation , 2016 .

[4]  Carolyn R. Mason,et al.  Hand synergies during reach-to-grasp. , 2001, Journal of neurophysiology.

[5]  E. Bizzi,et al.  The construction of movement by the spinal cord , 1999, Nature Neuroscience.

[6]  Francesco Lacquaniti,et al.  Dimensionality of joint torques and muscle patterns for reaching , 2014, Front. Comput. Neurosci..

[7]  Brian R. Duffy,et al.  Anthropomorphism and the social robot , 2003, Robotics Auton. Syst..

[8]  Scott L. Delp,et al.  A Model of the Upper Extremity for Simulating Musculoskeletal Surgery and Analyzing Neuromuscular Control , 2005, Annals of Biomedical Engineering.

[9]  Radhika Nagpal,et al.  Design and control of a bio-inspired soft wearable robotic device for ankle–foot rehabilitation , 2014, Bioinspiration & biomimetics.

[10]  Philip Chan,et al.  Toward accurate dynamic time warping in linear time and space , 2007, Intell. Data Anal..

[11]  Cecilia Laschi,et al.  Soft robotics: a bioinspired evolution in robotics. , 2013, Trends in biotechnology.

[12]  Giuseppe Averta,et al.  Incrementality and Hierarchies in the Enrollment of Multiple Synergies for Grasp Planning , 2018, IEEE Robotics and Automation Letters.

[13]  M. Hepp-Reymond,et al.  EMG activation patterns during force production in precision grip , 2004, Experimental Brain Research.

[14]  K. Newell,et al.  Dimensional change in motor learning. , 2001, Human movement science.

[15]  E. Bizzi,et al.  Muscle synergies encoded within the spinal cord: evidence from focal intraspinal NMDA iontophoresis in the frog. , 2001, Journal of neurophysiology.

[16]  Lena H Ting,et al.  A limited set of muscle synergies for force control during a postural task. , 2005, Journal of neurophysiology.

[17]  Andrea d'Avella,et al.  Matrix factorization algorithms for the identification of muscle synergies: evaluation on simulated and experimental data sets. , 2006, Journal of neurophysiology.

[18]  P. Morasso,et al.  Anthropomorphic robotics , 1980, Biological Cybernetics.

[19]  Giuseppe Averta,et al.  Efficient Walking Gait Generation via Principal Component Representation of Optimal Trajectories: Application to a Planar Biped Robot With Elastic Joints , 2018, IEEE Robotics and Automation Letters.

[20]  Amy L Ladd,et al.  Three-dimensional kinematics of the upper limb during a Reach and Grasp Cycle for children. , 2009, Gait & posture.

[21]  Alba Perez-Gracia,et al.  Quantification of Upper-Body Synergies: A Case Comparison for Stroke and Non-Stroke Victims , 2016 .

[22]  Merico E. Argentati,et al.  Principal Angles between Subspaces in an A-Based Scalar Product: Algorithms and Perturbation Estimates , 2001, SIAM J. Sci. Comput..

[23]  Manuel G. Catalano,et al.  Adaptive synergies for the design and control of the Pisa/IIT SoftHand , 2014, Int. J. Robotics Res..

[24]  Giuseppe Averta,et al.  Postural Hand Synergies during Environmental Constraint Exploitation , 2017, Front. Neurorobot..

[25]  Emilio Bizzi,et al.  Combinations of muscle synergies in the construction of a natural motor behavior , 2003, Nature Neuroscience.

[26]  E. Todorov,et al.  Analysis of the synergies underlying complex hand manipulation , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  M. Santello,et al.  Are Movement Disorders and Sensorimotor Injuries Pathologic Synergies? When Normal Multi-Joint Movement Synergies Become Pathologic , 2015, Front. Hum. Neurosci..

[28]  John P Scholz,et al.  Aspects of joint coordination are preserved during pointing in persons with post-stroke hemiparesis. , 2003, Brain : a journal of neurology.

[29]  Kazuto Kora,et al.  Human-inspired robotic exoskeleton (HuREx) for lower limb rehabilitation , 2013, 2013 IEEE International Conference on Mechatronics and Automation.

[30]  F. Lacquaniti,et al.  Five basic muscle activation patterns account for muscle activity during human locomotion , 2004, The Journal of physiology.

[31]  Jingzhou Yang,et al.  Towards understanding the workspace of human limbs , 2004, Ergonomics.

[32]  Gerald E. Loeb,et al.  Optimal isn’t good enough , 2012, Biological Cybernetics.

[33]  Gregor Schöner,et al.  The uncontrolled manifold concept: identifying control variables for a functional task , 1999, Experimental Brain Research.

[34]  F. Valero-Cuevas Predictive modulation of muscle coordination pattern magnitude scales fingertip force magnitude over the voluntary range. , 2000, Journal of neurophysiology.

[35]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[36]  Simona Casini,et al.  Design of an under-actuated wrist based on adaptive synergies , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[37]  L Dipietro,et al.  Changing motor synergies in chronic stroke. , 2007, Journal of neurophysiology.

[38]  Giuseppe Averta,et al.  Unvealing the Principal Modes of Human Upper Limb Movements through Functional Analysis , 2017, Front. Robot. AI.

[39]  Amy J Bastian,et al.  Multidigit Movement Synergies of the Human Hand in an Unconstrained Haptic Exploration Task , 2008, The Journal of Neuroscience.

[40]  J.C. Perry,et al.  Upper-Limb Powered Exoskeleton Design , 2007, IEEE/ASME Transactions on Mechatronics.

[41]  Danica Kragic,et al.  The GRASP Taxonomy of Human Grasp Types , 2016, IEEE Transactions on Human-Machine Systems.

[42]  Marco Santello,et al.  Patterns of Hand Motion during Grasping and the Influence of Sensory Guidance , 2002, The Journal of Neuroscience.

[43]  Matteo Bianchi,et al.  Hand synergies: Integration of robotics and neuroscience for understanding the control of biological and artificial hands. , 2016, Physics of life reviews.

[44]  Andrea d'Avella,et al.  Modularity in the motor system: decomposition of muscle patterns as combinations of time-varying synergies , 2001, NIPS.

[45]  W. Rymer,et al.  Alterations in upper limb muscle synergy structure in chronic stroke survivors. , 2013, Journal of neurophysiology.

[46]  Vladimir M. Zatsiorsky,et al.  Muscle synergies during shifts of the center of pressure by standing persons , 2003, Experimental Brain Research.

[47]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[48]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[49]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[50]  J. Lenarcic,et al.  Simple Model of Human Arm Reachable Workspace , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[51]  R. Cubelli,et al.  Cognition in Action: Testing a Model of Limb Apraxia , 2000, Brain and Cognition.

[52]  Marco Santello,et al.  Force-independent distribution of correlated neural inputs to hand muscles during three-digit grasping. , 2010, Journal of neurophysiology.

[53]  Giuseppe Averta,et al.  Predicting Object-Mediated Gestures From Brain Activity: An EEG Study on Gender Differences , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[54]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[55]  Martha Flanders,et al.  Muscular and postural synergies of the human hand. , 2004, Journal of neurophysiology.

[56]  Minoru Asada,et al.  Human-Inspired Robots , 2006, IEEE Intelligent Systems.

[57]  A. Ciancio,et al.  Differences between kinematic synergies and muscle synergies during two-digit grasping , 2015, Front. Hum. Neurosci..

[58]  Zhi-Hong Mao,et al.  Temporal Postural Synergies of the Hand in Rapid Grasping Tasks , 2010, IEEE Transactions on Information Technology in Biomedicine.

[59]  Francesco Lacquaniti,et al.  Control of Fast-Reaching Movements by Muscle Synergy Combinations , 2006, The Journal of Neuroscience.

[60]  Gregor Schöner,et al.  Toward a new theory of motor synergies. , 2007, Motor control.