Transferring human grasping synergies to a robot

Abstract In this paper, a system for transferring human grasping skills to a robot is presented. In order to reduce the dimensionality of the grasp postures, we extracted three synergies from data on human grasping experiments and trained a neural network with the features of the objects and the coefficients of the synergies. Then, the trained neural network was employed to control robot grasping via an individually optimized mapping between the human hand and the robot hand. As force control was unavailable on our robot hand, we designed a simple strategy for the robot to grasp and hold the objects by exploiting tactile feedback at the fingers. Experimental results demonstrated that the system can generalize the transferred skills to grasp new objects.

[1]  H. Harry Asada,et al.  Transferring Manipulative Skills to Robots-Representation and Acquisition of Tool Manipulative Skill , 1992 .

[2]  A. Biewener,et al.  Running over rough terrain: guinea fowl maintain dynamic stability despite a large unexpected change in substrate height , 2006, Journal of Experimental Biology.

[3]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[4]  Christopher Yeates Brown.  Inter-finger coordination in robot hands via mechanical implementation of principal components analysis , 2007 .

[5]  Estela Bicho,et al.  Goal-directed imitation for robots: A bio-inspired approach to action understanding and skill learning , 2006, Robotics Auton. Syst..

[6]  Medhat A. Moussa,et al.  Toward a Natural Language Interface for Transferring Grasping Skills to Robots , 2008, IEEE Transactions on Robotics.

[7]  Yang-Wai Chow,et al.  Low-cost multiple degrees-of-freedom optical tracking for 3D interaction in head-mounted display virtual reality , 2009 .

[8]  Jong-Seung Park.  AR-Room: a rapid prototyping framework for augmented reality applications , 2010, Multimedia Tools and Applications.

[9]  Peter C. Y. Chen,et al.  Performance improvement of robot continuous-path operation through iterative learning using neural networks , 2004, Machine Learning.

[10]  Maja J. Mataric,et al.  Automated Derivation of Primitives for Movement Classification , 2000, Auton. Robots.

[11]  Lucy Pao,et al.  Transformation of human hand positions for robotic hand control , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[12]  Angelo M. Sabatini,et al.  Identification of neuromuscular synergies in natural upper-arm movements , 2002, Biological Cybernetics.

[13]  Thomas H. Speeter.  Transforming Human Hand Motion for Telemanipulation , 1992, Presence: Teleoperators & Virtual Environments.

[14]  Michael T. Rosenstein,et al.  Learning at the level of synergies for a robot weightlifter , 2006, Robotics Auton. Syst..

[15]  Stephen H. Lane,et al.  Synergy-based learning of hybrid position/force control for redundant manipulators , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[16]  Emilio Bizzi,et al.  Shared and specific muscle synergies in natural motor behaviors. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Robert Rohling,et al.  Optimized Fingertip Mapping:A General Algorithm for Robotic Hand Teleoperation , 1993, Presence: Teleoperators & Virtual Environments.

[18]  Martin Buss,et al.  Multi-fingered telemanipulation - mapping of a human hand to a three finger gripper , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[19]  Gordon Cheng,et al.  Dexterous Skills Transfer by Extending Human Body Schema to a Robotic Hand , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[20]  Ralf Koeppe,et al.  Sensor fusion for human-robot skill transfer systems , 2000, Adv. Robotics.

[21]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[22]  Jiawei Hong,et al.  Calibrating a VPL DataGlove for teleoperating the Utah/MIT hand , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[23]  Tamim Asfour,et al.  Imitation Learning of Dual-Arm Manipulation Tasks in Humanoid Robots , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[24]  Yangsheng Xu,et al.  Hidden Markov model approach to skill learning and its application to telerobotics , 1993, IEEE Trans. Robotics Autom..

[25]  Jun Wang,et al.  A dual neural network for kinematic control of redundant robot manipulators , 2001, IEEE Trans. Syst. Man Cybern. Part B.