A novel Bayesian filtering approach to tactile object recognition

This paper addresses tactile object recognition, i.e. the identification of an object among a set of known objects, given tactile measurements. The solution of this problem can improve perception capabilities of autonomous robots and complement vision. Such a system is fundamental for the operation of autonomous robots that are often required to recognize objects while interacting with the environment. The proposed approach is innovative for three reasons. First, tactile recognition is cast into a tactile localization problem wherein multiple models are fit to the available measurements and objects are recognized by selecting the model that minimizes the localization error. Second, the measurements consist only of 3D contact point coordinates, which provide poor information for the recognition task. Lastly, we make use of a novel and effective filtering algorithm, named Memory Unscented Particle Filter (MUPF), which solves the 6 degree-of-freedom localization (and recognition) problem recursively by using only contact point measurements. The performance of the proposed approach has been assessed both in simulation and on a real robotic system equipped with tactile sensors (i.e., the iCub humanoid robot). The experiments show that our approach provides good recognition performance and is able to discriminate objects that are similar even in presence of noisy measurements.

[1]  Dan Simon,et al.  Optimal State Estimation: Kalman, H∞, and Nonlinear Approaches , 2006 .

[2]  Dominiek Reynaerts,et al.  Featureless classification of tactile contacts in a gripper using neural networks , 1996 .

[3]  Veronica J. Santos,et al.  Biomimetic Tactile Sensor Array , 2008, Adv. Robotics.

[4]  Shahram Payandeh,et al.  Shape description of general, curved surfaces using tactile sensing and surface normal information , 1997, Proceedings of International Conference on Robotics and Automation.

[5]  Alberto Mazzoni,et al.  Biomimetic tactile sensing , 2015 .

[6]  Giorgio Battistelli,et al.  Memory Unscented Particle Filter for 6-DOF Tactile Localization , 2017, IEEE Transactions on Robotics.

[7]  Kaspar Althoefer,et al.  Surface material recognition through haptic exploration using an intelligent contact sensing finger , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Ronald S. Fearing,et al.  Using a cylindrical tactile sensor for determining curvature , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[9]  Giorgio Metta,et al.  Methods and Technologies for the Implementation of Large-Scale Robot Tactile Sensors , 2011, IEEE Transactions on Robotics.

[10]  Hans Driessen,et al.  Particle based MAP state estimation: A comparison , 2009, 2009 12th International Conference on Information Fusion.

[11]  Peter K. Allen,et al.  Acquisition and interpretation of 3-D sensor data from touch , 1990, IEEE Trans. Robotics Autom..

[12]  Nando de Freitas,et al.  The Unscented Particle Filter , 2000, NIPS.

[13]  Maurizio Valle,et al.  Tactile-Data Classification of Contact Materials Using Computational Intelligence , 2011, IEEE Transactions on Robotics.

[14]  Shahram Payandeh,et al.  Shape Description of Curved Surfaces from Contact Sensing Using Surface Normals , 1999, Int. J. Robotics Res..

[15]  Kenneth S. Roberts,et al.  Haptic object recognition using a multi-fingered dextrous hand , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[16]  Nando de Freitas,et al.  An Introduction to Sequential Monte Carlo Methods , 2001, Sequential Monte Carlo Methods in Practice.

[17]  Giorgio Metta,et al.  A new design of a fingertip for the iCub hand , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Giulio Sandini,et al.  The iCub humanoid robot: an open platform for research in embodied cognition , 2008, PerMIS.

[19]  F. Valero-Cuevas,et al.  Visual and Tactile Guidance of Dexterous Manipulation Tasks: An fMRI Study , 2005, Perceptual and motor skills.

[20]  Oussama Khatib,et al.  Global Localization of Objects via Touch , 2011, IEEE Transactions on Robotics.

[21]  Kaspar Althoefer,et al.  A computationally fast algorithm for local contact shape and pose classification using a tactile array sensor , 2012, 2012 IEEE International Conference on Robotics and Automation.

[22]  P Jenmalm,et al.  Visual and tactile information about object-curvature control fingertip forces and grasp kinematics in human dexterous manipulation. , 2000, Journal of neurophysiology.

[23]  Simon Parkinson,et al.  Sensing surface shape by touch , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.