Synergy-based affordance learning for robotic grasping

In this paper, we present an affordance learning system for robotic grasping. The system involves three important aspects: the affordance memory, synergy-based exploration, and a grasping control strategy using local sensor feedback. The affordance memory is modeled with a modified growing neural gas network that allows affordances to be learned quickly from a small dataset of human grasping and object features. After being trained offline, the affordance memory is used in the system to generate online motor commands for reaching and grasping control of the robot. When grasping new objects, the system can explore various grasp postures efficiently in the low dimensional synergy space because the synergies automatically avoid abnormal postures that are more likely to lead to failed grasps. Experimental results demonstrated that the affordance memory can generalize to grasp new objects and predict the effect of the grasp (i.e., the tactile patterns).

[1]  Baris Akgün,et al.  Unsupervised learning of affordance relations on a humanoid robot , 2009, 2009 24th International Symposium on Computer and Information Sciences.

[2]  Manuel Lopes,et al.  Learning grasping affordances from local visual descriptors , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[3]  B Fritzke,et al.  A growing neural gas network learns topologies. G. Tesauro, DS Touretzky, and TK Leen, editors , 1995, NIPS 1995.

[4]  Stephen Hart,et al.  An intrinsic reward for affordance exploration , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[5]  Martin Buss,et al.  Multi-fingered telemanipulation - mapping of a human hand to a three finger gripper , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[6]  Emilio Bizzi,et al.  Shared and specific muscle synergies in natural motor behaviors. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Robert Rohling,et al.  Optimized Fingertip Mapping:A General Algorithm for Robotic Hand Teleoperation , 1993, Presence: Teleoperators & Virtual Environments.

[8]  Pierre-Yves Oudeyer,et al.  Intrinsic Motivation Systems for Autonomous Mental Development , 2007, IEEE Transactions on Evolutionary Computation.

[9]  Yang-Wai Chow,et al.  Low-cost multiple degrees-of-freedom optical tracking for 3D interaction in head-mounted display virtual reality , 2009 .

[10]  Lucy Pao,et al.  Transformation of human hand positions for robotic hand control , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[11]  Manuel Lopes,et al.  Learning Object Affordances: From Sensory--Motor Coordination to Imitation , 2008, IEEE Transactions on Robotics.

[12]  Müjdat Çetin,et al.  A criteria-based approach to grasp synthesis , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[13]  Raúl Suárez Feijóo,et al.  Grasp quality measures , 2006 .

[14]  Giulio Sandini,et al.  Developmental robotics: a survey , 2003, Connect. Sci..

[15]  Lola Cañamero,et al.  Using a SOFM to learn Object Affordances , 2004 .

[16]  Tao Geng,et al.  Transferring human grasping synergies to a robot , 2011 .

[17]  Alexander Stoytchev,et al.  Behavior-Grounded Representation of Tool Affordances , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[18]  James M. Rehg,et al.  Learning Visual Object Categories for Robot Affordance Prediction , 2010, Int. J. Robotics Res..

[19]  A. Biewener,et al.  Running over rough terrain: guinea fowl maintain dynamic stability despite a large unexpected change in substrate height , 2006, Journal of Experimental Biology.

[20]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[21]  Kazuhiko Kawamura,et al.  Towards a cognitive robot that uses internal rehearsal to learn affordance relations , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Juyang Weng,et al.  Inherent Value Systems for Autonomous Mental Development , 2007, Int. J. Humanoid Robotics.

[23]  N. Kruger,et al.  Learning object-specific grasp affordance densities , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[24]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[25]  Marek Teichmann,et al.  Reactive Robotics I: Reactive Grasping with a Modified Gripper and Multifingered Hands , 2000, Int. J. Robotics Res..

[26]  Michael A. Arbib,et al.  Schema design and implementation of the grasp-related mirror neuron system , 2002, Biological Cybernetics.

[27]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[28]  Jiawei Hong,et al.  Calibrating a VPL DataGlove for teleoperating the Utah/MIT hand , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[29]  Gillian Hayes,et al.  Towards an Imitation System for Learning Robots , 2004, SETN.

[30]  Lucas Paletta,et al.  Perception and Developmental Learning of Affordances in Autonomous Robots , 2007, KI.

[31]  Thomas H. Speeter.  Transforming Human Hand Motion for Telemanipulation , 1992, Presence: Teleoperators & Virtual Environments.