Haptic object recognition for multi-fingered robot hands

In this paper, we present an approach for haptic object recognition and its evaluation on multi-fingered robot hands. The recognition approach is based on extracting key features of tactile and kinesthetic data from multiple palpations using a clustering algorithm. A multi-sensory object representation is built by fusion of tactile and kinesthetic features. We evaluated our approach on three robot hands and compared the recognition performance using object sets consisting of daily household objects. Experimental results using the five-fingered hand of the humanoid robot ARMAR, the three-fingered Schunk Dexterous Hand 2 and a parallel Gripper are performed. The results show that the proposed approach generalizes to different robot hands.

[1]  Tamim Asfour,et al.  A new anthropomorphic robotic hand , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[2]  C. Balkenius,et al.  Experiments with Proprioception in a Self-Organizing System for Haptic Perception , 2007 .

[3]  Kenneth S. Roberts,et al.  Haptic object recognition using a multi-fingered dextrous hand , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[4]  Tamim Asfour,et al.  ARMAR-III: An Integrated Humanoid Platform for Sensory-Motor Control , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[5]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[6]  Francesco Zanichelli,et al.  Haptic object recognition with a dextrous hand based on volumetric shape representations , 1994, Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems.

[7]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[8]  H. Worn,et al.  The working principle of resistive tactile sensor cells , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[9]  Heinz Wörn,et al.  Haptic object recognition using passive joints and haptic key features , 2010, 2010 IEEE International Conference on Robotics and Automation.

[10]  Dan Roth,et al.  Learning to detect objects in images via a sparse, part-based representation , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  H. Worn,et al.  A highly versatile and robust tactile sensing system , 2007, 2007 IEEE Sensors.

[12]  Heinz Wörn,et al.  Tactile sensing for an anthropomorphic robotic hand: Hardware and signal processing , 2009, 2009 IEEE International Conference on Robotics and Automation.

[13]  Koh Hosoda,et al.  Repetitive grasping with anthropomorphic skin-covered hand enables robust haptic recognition , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[15]  Wolfram Burgard,et al.  Object identification with tactile sensors using bag-of-features , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.