Unvealing the Principal Modes of Human Upper Limb Movements through Functional Analysis

The rich variety of human upper limb movements requires an extraordinary coordination of different joints according to specific spatio-temporal patterns. However, unvealing these motor schemes is a challenging task. Principal components have been often used for analogous purposes, but such an approach relies on hypothesis of temporal uncorrelation of upper limb poses in time. To overcome these limitations, in this work we leverage on functional Principal Component Analysis (fPCA). We carried out experiments with 7 s​bjects performing a set of most significant human actions, selected considering state-of-the-art grasp taxonomies and human kinematic workspace. fPCA results show that human upper limb trajectories can be reconstructed by a linear combination of few principal time dependent functions, with a first component alone explaining around 60/70% of the observed behaviours. This allows to infer that in daily living activities humans reduce the complexity of movement by modulating their motions through a reduced set of few principal patterns. Finally, we discuss how this approach could be profitably applied in robotics and bioengineering, opening fascinating perspectives to advance the state of the art of artificial systems, as it was the case of hand synergies.

[1]  Amy L Ladd,et al.  Three-dimensional kinematics of the upper limb during a Reach and Grasp Cycle for children. , 2009, Gait & posture.

[2]  Alba Perez-Gracia,et al.  Quantification of Upper-Body Synergies: A Case Comparison for Stroke and Non-Stroke Victims , 2016 .

[3]  Philip Chan,et al.  Toward accurate dynamic time warping in linear time and space , 2007, Intell. Data Anal..

[4]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[5]  Gabriel Baud-Bovy,et al.  Neural bases of hand synergies , 2013, Front. Comput. Neurosci..

[6]  E V Biryukova,et al.  Kinematics of human arm reconstructed from spatial tracking system recordings. , 2000, Journal of biomechanics.

[7]  P. James McLellan,et al.  A functional-PCA approach for analyzing and reducing complex chemical mechanisms , 2006, Comput. Chem. Eng..

[8]  Yutaka Nakamura,et al.  Analysis of Motor Synergies Utilization for Optimal Movement Generation for a Human-like Robotic Arm , 2013, Int. J. Autom. Comput..

[9]  Alessandra Pedrocchi,et al.  Robustness and Reliability of Synergy-Based Myocontrol of a Multiple Degree of Freedom Robotic Arm , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Wei Dai,et al.  Functional analysis of grasping motion , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  S. Levinson,et al.  Considerations in dynamic time warping algorithms for discrete word recognition , 1978 .

[12]  Roger W. Brockett,et al.  Robotic manipulators and the product of exponentials formula , 1984 .

[13]  Ana M. Aguilera,et al.  Forecasting time series by functional PCA. Discussion of several weighted approaches , 1999, Comput. Stat..

[14]  S. Gaglio,et al.  Anthropomorphic robotics , 1980, Biological Cybernetics.

[15]  T. Auton Applied Functional Data Analysis: Methods and Case Studies , 2004 .

[16]  J. Lenarcic,et al.  Simple Model of Human Arm Reachable Workspace , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[17]  Andrew Harrison,et al.  Functional data analysis of knee joint kinematics in the vertical jump , 2006, Sports biomechanics.

[18]  J.C. Perry,et al.  Upper-Limb Powered Exoskeleton Design , 2007, IEEE/ASME Transactions on Mechatronics.

[19]  Daniel Thalmann,et al.  Human shoulder modeling including scapulo-thoracic constraint and joint sinus cones , 2000, Comput. Graph..

[20]  Simona Casini,et al.  Design of an under-actuated wrist based on adaptive synergies , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Jingzhou Yang,et al.  Towards understanding the workspace of human limbs , 2004, Ergonomics.

[22]  Daniel J. Duffy The Boost C++ Libraries: Part II , 2011 .

[23]  Matteo Bianchi,et al.  Hand synergies: Integration of robotics and neuroscience for understanding the control of biological and artificial hands. , 2016, Physics of life reviews.

[24]  P. Morasso,et al.  Anthropomorphic robotics , 1980, Biological Cybernetics.

[25]  Spencer Graves,et al.  Functional Data Analysis with R and MATLAB , 2009 .

[26]  Zhi-Hong Mao,et al.  Temporal Postural Synergies of the Hand in Rapid Grasping Tasks , 2010, IEEE Transactions on Information Technology in Biomedicine.

[27]  Matteo Bianchi,et al.  A data-driven kinematic model of the human hand with soft-tissue artifact compensation mechanism for grasp synergy analysis , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Francesco Lacquaniti,et al.  Control of Fast-Reaching Movements by Muscle Synergy Combinations , 2006, The Journal of Neuroscience.

[29]  P. Pietrini,et al.  A topographical organization for action representation in the human brain , 2015, Human brain mapping.

[30]  Amy J Bastian,et al.  Multidigit Movement Synergies of the Human Hand in an Unconstrained Haptic Exploration Task , 2008, The Journal of Neuroscience.

[31]  Siddhartha S. Srinivasa,et al.  Integrating human observer inferences into robot motion planning , 2014, Auton. Robots.

[32]  Danica Kragic,et al.  The GRASP Taxonomy of Human Grasp Types , 2016, IEEE Transactions on Human-Machine Systems.

[33]  Marco Santello,et al.  Synergistic Control of Hand Muscles Through Common Neural Input , 2014, The Human Hand as an Inspiration for Robot Hand Development.

[34]  E. Todorov,et al.  Analysis of the synergies underlying complex hand manipulation , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[35]  Peter Robinson,et al.  How anthropomorphism affects empathy toward robots , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[36]  R. Cubelli,et al.  Cognition in Action: Testing a Model of Limb Apraxia , 2000, Brain and Cognition.

[37]  Matteo Bianchi,et al.  Controlling Soft Robots: Balancing Feedback and Feedforward Elements , 2017, IEEE Robotics & Automation Magazine.

[38]  Carolyn R. Mason,et al.  Hand synergies during reach-to-grasp. , 2001, Journal of neurophysiology.

[39]  Brian R. Duffy,et al.  Anthropomorphism and the social robot , 2003, Robotics Auton. Syst..

[40]  Scott L. Delp,et al.  A Model of the Upper Extremity for Simulating Musculoskeletal Surgery and Analyzing Neuromuscular Control , 2005, Annals of Biomedical Engineering.

[41]  Francesco Lacquaniti,et al.  Control of reaching movements by muscle synergy combinations , 2013, Front. Comput. Neurosci..

[42]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[43]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[44]  N. Coffey,et al.  Common functional principal components analysis: a new approach to analyzing human movement data. , 2011, Human movement science.

[45]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[46]  Dana Kulic,et al.  Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots , 2009, Int. J. Soc. Robotics.

[47]  B. Silverman,et al.  Functional Data Analysis , 1997 .

[48]  Andrea d'Avella,et al.  Modularity in the motor system: decomposition of muscle patterns as combinations of time-varying synergies , 2001, NIPS.