Linear and Nonlinear Kinematic Synergies in the Grasping Hand

Kinematic synergies in human hand movements have shown promising applications in dexterous control of robotic and prosthetic hands. We and others have previously derived kinematic synergies from human hand grasping movements using a widely used linear dimensionality reduction method, Principal Component Analysis (PCA). As the human biomechanical system is inherently nonlinear, using nonlinear dimensionality reduction methods to derive kinematic synergies might be expected to improve the representation of human hand movements in reduced dimensions. In this paper, we derived linear and nonlinear kinematic synergies from linear (PCA), globally nonlinear (Isomap, Stochastic Proximity Embedding (SPE), Sammon Mapping (SaM), and Stochastic Neighbor Embedding (SNE)) and locally nonlinear (Local Linear Embedding (LLE), LaplacianEigenmaps (LaE), and Local Tangent Space Alignment (LTSA)) dimensionality reduction methods. Synergies derived from linear PCA and nonlinear SaMwere able to capture multiple functional postures and physiological patterns. Results from natural hand grasping movements indicated that PCA performed better than all nonlinear dimensionality reduction methods used in the paper. Results from ASL postural movements indicated that PCA, SaM, and SPE better generalized over ASL postural movements when compared to other methods. Overall, our results show that PCA derived synergies offer qualitative and quantitative advantages over nonlinear methods as a limited number of kinematic synergies begin to be implemented in human prosthetics.

[1]  Amy J Bastian,et al.  Multidigit Movement Synergies of the Human Hand in an Unconstrained Haptic Exploration Task , 2008, The Journal of Neuroscience.

[2]  Francisco J. Valero Cuevas,et al.  Estimating Effective Degrees of Freedom in Motor Systems , 2008, IEEE Transactions on Biomedical Engineering.

[3]  Konrad Paul Kording,et al.  The statistics of natural hand movements , 2008, Experimental Brain Research.

[4]  Dimitris K. Agrafiotis,et al.  Stochastic proximity embedding , 2003, J. Comput. Chem..

[5]  Manuel G. Catalano,et al.  Adaptive synergies for the design and control of the Pisa/IIT SoftHand , 2014, Int. J. Robotics Res..

[6]  N. Hatsopoulos,et al.  Encoding of Coordinated Reach and Grasp Trajectories in Primary Motor Cortex , 2012, The Journal of Neuroscience.

[7]  Antonio Bicchi,et al.  Modelling natural and artificial hands with synergies , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[8]  Zhi-Hong Mao,et al.  Candidates for Synergies: Linear Discriminants versus Principal Components , 2014, Comput. Intell. Neurosci..

[9]  Zhi-Hong Mao,et al.  Dimensionality Reduction in Control and Coordination of the Human Hand , 2008, IEEE Transactions on Biomedical Engineering.

[10]  Christine L. MacKenzie,et al.  The Grasping Hand , 2011, The Grasping Hand.

[11]  Francesco Lacquaniti,et al.  Control of Fast-Reaching Movements by Muscle Synergy Combinations , 2006, The Journal of Neuroscience.

[12]  David S. Touretzky,et al.  Advances in neural information processing systems 2 , 1989 .

[13]  Antonio Bicchi,et al.  On Motion and Force Controllability of Precision Grasps with Hands Actuated by Soft Synergies , 2013, IEEE Transactions on Robotics.

[14]  Jun Nakanishi,et al.  Learning Attractor Landscapes for Learning Motor Primitives , 2002, NIPS.

[15]  W. G. Darling,et al.  Kinematic variability of grasp movements as a function of practice and movement speed , 2004, Experimental Brain Research.

[16]  Gabriel Baud-Bovy,et al.  Neural bases of hand synergies , 2013, Front. Comput. Neurosci..

[17]  Mingui Sun,et al.  Time-Varying Synergies in Velocity Profiles of Finger Joints of the Hand during Reach and Grasp , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  Aymar de Rugy,et al.  Are muscle synergies useful for neural control? , 2013, Front. Comput. Neurosci..

[19]  Subramanian Ramamoorthy,et al.  Constrained geodesic trajectory generation on learnt skill manifolds , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  D. Popovic,et al.  Cloning biological synergies improves control of elbow neuroprostheses , 2001, IEEE Engineering in Medicine and Biology Magazine.

[21]  I. Jolliffe Principal Component Analysis , 2002 .

[22]  Emilio Bizzi,et al.  Combinations of muscle synergies in the construction of a natural motor behavior , 2003, Nature Neuroscience.

[23]  Andrea d'Avella,et al.  Matrix factorization algorithms for the identification of muscle synergies: evaluation on simulated and experimental data sets. , 2006, Journal of neurophysiology.

[24]  Michael Girard,et al.  Computer animation of knowledge-based human grasping , 1991, SIGGRAPH.

[25]  Christian Cipriani,et al.  Principal components analysis based control of a multi-dof underactuated prosthetic hand , 2010, Journal of NeuroEngineering and Rehabilitation.

[26]  Carolyn R. Mason,et al.  Hand synergies during reach-to-grasp. , 2001, Journal of neurophysiology.

[27]  E. Bizzi,et al.  The construction of movement by the spinal cord , 1999, Nature Neuroscience.

[28]  S.D. Iftime,et al.  Automatic determination of synergies by radial basis function artificial neural networks for the control of a neural prosthesis , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[29]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[30]  Eric O. Postma,et al.  Dimensionality Reduction: A Comparative Review , 2008 .

[31]  Marco Santello,et al.  Patterns of Hand Motion during Grasping and the Influence of Sensory Guidance , 2002, The Journal of Neuroscience.

[32]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[33]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[34]  Antonio Bicchi,et al.  On the role of hand synergies in the optimal choice of grasping forces , 2010, Auton. Robots.

[35]  Michel Verleysen,et al.  Nonlinear Dimensionality Reduction , 2021, Computer Vision.

[36]  Monica Malvezzi,et al.  An Object-Based Approach to Map Human Hand Synergies onto Robotic Hands with Dissimilar Kinematics , 2012, Robotics: Science and Systems.