Grasp mapping using locality preserving projections and kNN regression

In this paper, we propose a novel mapping approach to map a human grasp to a robotic grasp based on human grasp motion trajectories rather than grasp poses, since the grasp trajectories of a human grasp provide more information to disambiguate between different grasp types than grasp poses. Human grasp motions usually contain complex and nonlinear patterns in a high-dimensional space. In this paper, we reduced the high-dimensionality of motion trajectories by using locality preserving projections (LPP). Then, a Hausdorff distance was performed to find the k-nearest neighbor trajectories in the reduced low-dimensional subspace, and k-nearest neighbor (kNN) regression was used to map a demonstrated grasp motion by a human hand to a robotic hand. Several experiments were designed and carried out to compare the robotic grasping trajectory generated with and without the trajectory-based mapping approach. The regression errors of the mapping results show that our approach generates more robust grasps than using only grasp poses. In addition, our approach has the ability to successfully map a grasp motion of a new grasp demonstration that has not been trained before to a robotic hand.

[1]  Joshua B. Tenenbaum,et al.  Mapping a Manifold of Perceptual Observations , 1997, NIPS.

[2]  Henk Nijmeijer,et al.  Robot Programming by Demonstration , 2010, SIMPAR.

[3]  H. Hotelling Analysis of a complex of statistical variables into principal components. , 1933 .

[4]  Stefan Schaal,et al.  Robot Programming by Demonstration , 2009, Springer Handbook of Robotics.

[5]  Heni Ben Amor,et al.  Grasp Recognition for Uncalibrated Data Gloves: A Machine Learning Approach , 2008, PRESENCE: Teleoperators and Virtual Environments.

[6]  Stefano Caselli,et al.  Grasp recognition in virtual reality for robot pregrasp planning by demonstration , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[7]  Martin Buss,et al.  Multi-fingered telemanipulation - mapping of a human hand to a three finger gripper , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[8]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[9]  Gerd Hirzinger,et al.  Learning techniques in a dataglove based telemanipulation system for the DLR hand , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[10]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[11]  Danica Kragic,et al.  Grasp Recognition for Programming by Demonstration , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[12]  Heni Ben Amor,et al.  Grasp Recognition with Uncalibrated Data Gloves - A Comparison of Classification Methods , 2007, 2007 IEEE Virtual Reality Conference.

[13]  Bastian Goldlücke,et al.  Variational Analysis , 2014, Computer Vision, A Reference Guide.

[15]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[16]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[17]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.