Extracting Postural Synergies for Robotic Grasping

We address the problem of representing and encoding human hand motion data using nonlinear dimensionality reduction methods. We build our work on the notion of postural synergies being typically based on a linear embedding of the data. In addition to addressing the encoding of postural synergies using nonlinear methods, we relate our work to control strategies of combined reaching and grasping movements. We show the drawbacks of the (commonly made) causality assumption and propose methods that model the data as being generated from an inferred latent manifold to cope with the problem. Another important contribution is a thorough analysis of the parameters used in the employed dimensionality reduction techniques. Finally, we provide an experimental evaluation that shows how the proposed methods outperform the standard techniques, both in terms of recognition and generation of motion patterns.

[1]  Joaquin Quiñonero Candela,et al.  Local distance preservation in the GP-LVM through back constraints , 2006, ICML.

[2]  Carolyn R. Mason,et al.  Hand synergies during reach-to-grasp. , 2001, Journal of neurophysiology.

[3]  Lena H Ting,et al.  Dimensional reduction in sensorimotor systems: a framework for understanding muscle coordination of posture. , 2007, Progress in brain research.

[4]  Neil D. Lawrence,et al.  Probabilistic Non-linear Principal Component Analysis with Gaussian Process Latent Variable Models , 2005, J. Mach. Learn. Res..

[5]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[6]  Andrea d'Avella,et al.  Matrix factorization algorithms for the identification of muscle synergies: evaluation on simulated and experimental data sets. , 2006, Journal of neurophysiology.

[7]  Andrew H. Fagg,et al.  Grasping Affordances: Learning to Connet vission to Hand Action , 2009 .

[8]  Matei T. Ciocarlie,et al.  Data-driven optimization for underactuated robotic hands , 2010, 2010 IEEE International Conference on Robotics and Automation.

[9]  Kilian Q. Weinberger,et al.  Spectral Methods for Dimensionality Reduction , 2006, Semi-Supervised Learning.

[10]  Carolyn R. Mason,et al.  Monkey hand postural synergies during reach-to-grasp in the absence of vision of the hand and object. , 2004, Journal of neurophysiology.

[11]  F. Zajac,et al.  Large index-fingertip forces are produced by subject-independent patterns of muscle excitation. , 1998, Journal of biomechanics.

[12]  Thomas Feix,et al.  A comprehensive grasp taxonomy , 2009 .

[13]  Antonio Bicchi,et al.  On the role of hand synergies in the optimal choice of grasping forces , 2010, Auton. Robots.

[14]  Sethu Vijayakumar,et al.  Latent spaces for dynamic movement primitives , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[15]  Yoky Matsuoka,et al.  The relationship between actuator reduction and controllability for a Robotic Hand , 2010, 2010 3rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[16]  G. Dunteman Principal Components Analysis , 1989 .

[17]  Danica Kragic,et al.  Spatio-temporal modeling of grasping actions , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Helge J. Ritter,et al.  A Manifold Representation as Common Basis for Action Production and Recognition , 2009, KI.

[19]  Sylvain Calinon,et al.  Robot Programming by Demonstration - a Probabilistic Approach , 2009 .

[20]  J. A. López del Val,et al.  Principal Components Analysis , 2018, Applied Univariate, Bivariate, and Multivariate Statistics Using Python.

[21]  Aude Billard,et al.  Coupled dynamical system based arm-hand grasping model for learning fast adaptation strategies , 2012, Robotics Auton. Syst..

[22]  Gillian M. Hayes,et al.  Imitation as a dual-route process featuring prediction and learning components: A biologically plaus , 2002 .

[23]  I. V. Grinyagin,et al.  Kinematic and dynamic synergies of human precision-grip movements. , 2005, Journal of neurophysiology.

[24]  Stefan Schaal,et al.  2008 Special Issue: Reinforcement learning of motor skills with policy gradients , 2008 .

[25]  Antonio Bicchi,et al.  On motion and force controllability of grasping hands with postural synergies , 2010, Robotics: Science and Systems.

[26]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[27]  Takeo Kanade,et al.  Automated Construction of Robotic Manipulation Programs , 2010 .

[28]  Sylvain Calino,et al.  Robot programming by demonstration : a probabilistic approach , 2009 .

[29]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[30]  Kilian Q. Weinberger,et al.  Unsupervised Learning of Image Manifolds by Semidefinite Programming , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[31]  Aude Billard,et al.  Recognition and reproduction of gestures using a probabilistic framework combining PCA, ICA and HMM , 2005, ICML.

[32]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[33]  Katsushi Ikeuchi,et al.  Toward automatic robot instruction from perception-mapping human grasps to manipulator grasps , 1997, IEEE Trans. Robotics Autom..

[34]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[35]  Ran,et al.  The correspondence problem , 1998 .

[36]  Matei T. Ciocarlie,et al.  Hand Posture Subspaces for Dexterous Robotic Grasping , 2009, Int. J. Robotics Res..

[37]  Véronique Perdereau,et al.  Arm-hand movement: Imitation of human natural gestures with tenodesis effect , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[38]  Odest Chadwicke Jenkins,et al.  Neighborhood denoising for learning high-dimensional grasping manifolds , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.