Proprioceptive shape signatures for object manipulation and recognition purposes in a robotic hand

Tactile information has been largely exploited for object recognition with robotic hands but very few approaches have used propri-oception alone. In those that do, raw values of joint angles or torques are exploited to train learning algorithms. However, these approaches under-exploit the potential of proprioception, such as its usefulness to estimate the object pose and size. Furthermore, they focus on recognizing individual objects, which increases the amount of data needed to train the algorithms. In this paper, we present an approach based only on joint angles of a robotic hand to generate a shape proprioceptive signature that is invariant to the size and position of the object. Instead of recognizing a specific object from a list, object characteristics useful for its manipulation are extracted. This signature is exploited not only for shape recognition but also for pose estimation. To illustrate the scope of this method, tests are performed on primitive shapes. Results show that the signatures are invariant within large ranges of sizes and poses. Experiments on real hand were carried, and results depicted that the method works similarly in both simulated environment and real applications. A comparison between this two results is made and discussed.

[1]  C. Schenck,et al.  Interactive Object Recognition Using Proprioceptive Feedback , 2009 .

[2]  J. Fischer,et al.  The Prehensile Movements of the Human Hand , 2014 .

[3]  H.G. Cai,et al.  Grasping unknown objects based on 3d model reconstruction , 2005, Proceedings, 2005 IEEE/ASME International Conference on Advanced Intelligent Mechatronics..

[4]  Wolfram Burgard,et al.  Object identification with tactile sensors using bag-of-features , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Tamim Asfour,et al.  Haptic exploration for 3D shape reconstruction using five-finger hands , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[6]  Gregory D. Hager,et al.  Tactile-Object Recognition From Appearance Information , 2011, IEEE Transactions on Robotics.

[7]  Giorgio Metta,et al.  Active object recognition on a humanoid robot , 2012, 2012 IEEE International Conference on Robotics and Automation.

[8]  R. Klatzky,et al.  Haptic perception: A tutorial , 2009, Attention, perception & psychophysics.

[9]  B. Siciliano,et al.  Visual Grasp Planning for Unknown Objects Using a Multifingered Robotic Hand , 2013, IEEE/ASME Transactions on Mechatronics.

[10]  H. Bülthoff,et al.  Viewpoint Dependence in Visual and Haptic Object Recognition , 2001, Psychological science.

[11]  J. Cole,et al.  Body image and body schema in a deafferented subject , 1995 .

[12]  Stefan Begej,et al.  Planar and finger-shaped optical tactile sensors for robotic applications , 1988, IEEE J. Robotics Autom..

[13]  Ping Zhang,et al.  A full tactile sensing suite for dextrous robot hands and use in contact force control , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[14]  Haruhisa Kawasaki,et al.  Dexterous anthropomorphic robot hand with distributed tactile sensor: Gifu hand II , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[15]  Helge J. Ritter,et al.  Correcting pose estimates during tactile exploration of object shape: a neuro-robotic study , 2014, 4th International Conference on Development and Learning and on Epigenetic Robotics.

[16]  Connor Schenck,et al.  Interactive object recognition using proprioceptive and auditory feedback , 2011, Int. J. Robotics Res..

[17]  Robert E. Kalaba,et al.  On adaptive control processes , 1959 .

[18]  Jorge Dias,et al.  Identifying objects from hand configurations during in-hand exploration , 2012, 2012 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[19]  Kaspar Althoefer,et al.  A computationally fast algorithm for local contact shape and pose classification using a tactile array sensor , 2012, 2012 IEEE International Conference on Robotics and Automation.

[20]  C. Balkenius,et al.  Experiments with Proprioception in a Self-Organizing System for Haptic Perception , 2007 .

[21]  Yuanfei Zhang,et al.  Object shape recognition approach for sparse point clouds from tactile exploration , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[22]  R L Klatzky,et al.  Identifying objects by touch: An “expert system” , 1985, Perception & psychophysics.

[23]  T. Martin McGinnity,et al.  Object recognition based on tactile form perception , 2011, 2011 IEEE Workshop on Robotic Intelligence In Informationally Structured Space.

[24]  Allison M. Okamura,et al.  Feature Detection for Haptic Exploration with Robotic Fingers , 2001, Int. J. Robotics Res..

[25]  Hadi Moradi,et al.  A visibility-based accessibility analysis of the grasp points for real-time manipulation , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Fumio Kanehiro,et al.  Development of Multi-fingered Hand for Life-size Humanoid Robots , 2008 .

[27]  Heinz Wörn,et al.  Haptic object recognition using passive joints and haptic key features , 2010, 2010 IEEE International Conference on Robotics and Automation.

[28]  Kaspar Althoefer,et al.  Finger contact sensing and the application in dexterous hand manipulation , 2015, Autonomous Robots.

[29]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[30]  Y. Lamarre,et al.  Haptic discrimination of object shape in humans: contribution of cutaneous and proprioceptive inputs , 2002, Experimental Brain Research.