Surface material recognition through haptic exploration using an intelligent contact sensing finger

Object surface properties are among the most important information which a robot requires in order to effectively interact with an unknown environment. This paper presents a novel haptic exploration strategy for recognizing the physical properties of unknown object surfaces using an intelligent finger. This developed intelligent finger is capable of identifying the contact location, normal and tangential force, and the vibrations generated from the contact in real time. In the proposed strategy, this finger gently slides along the surface with a short stroke while increasing and decreasing the sliding velocity. By applying a dynamic friction model to describe this contact, rich and accurate surface physical properties can be identified within this stroke. This allows different surface materials to be easily distinguished even if when they have very similar texture. Several supervised learning algorithms have been applied and compared for surface recognition based on the obtained surface properties. It has been found that the naïve Bayes classifier is superior to radial basis function network and k-NN method, achieving an overall classification accuracy of 88.5% for distinguishing twelve different surface materials.

[1]  Gregory D. Hager,et al.  Object mapping, recognition, and localization from tactile geometry , 2011, 2011 IEEE International Conference on Robotics and Automation.

[2]  Dikai Liu,et al.  Surface Type Classification With a Laser Range Finder , 2009, IEEE Sensors Journal.

[3]  Wei-Min Shen,et al.  An Inertia-Based Surface Identification System , 2010, 2010 IEEE International Conference on Robotics and Automation.

[4]  Christian Balkenius,et al.  Sense of Touch in Robots With Self-Organizing Maps , 2011, IEEE Transactions on Robotics.

[5]  Heinz Wörn,et al.  Haptic object recognition using passive joints and haptic key features , 2010, 2010 IEEE International Conference on Robotics and Automation.

[6]  Martin Rumpf,et al.  Robust feature detection and local classification for surfaces based on moment analysis , 2004, IEEE Transactions on Visualization and Computer Graphics.

[7]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[8]  Allison M. Okamura,et al.  Feature Detection for Haptic Exploration with Robotic Fingers , 2001, Int. J. Robotics Res..

[9]  Carlos Canudas de Wit,et al.  A new model for control of systems with friction , 1995, IEEE Trans. Autom. Control..

[10]  Minoru Asada,et al.  Anthropomorphic robotic soft fingertip with randomly distributed receptors , 2006, Robotics Auton. Syst..

[11]  John Kenneth Salisbury,et al.  Contact Sensing from Force Measurements , 1990, Int. J. Robotics Res..

[12]  Kaj Madsen,et al.  Methods for Non-Linear Least Squares Problems , 1999 .

[13]  Allison M. Okamura,et al.  Haptic exploration of objects with rolling and sliding , 1997, Proceedings of International Conference on Robotics and Automation.

[14]  R. Klatzky,et al.  Haptic classification of common objects: Knowledge-driven exploration , 1990, Cognitive Psychology.

[15]  Nawid Jamali,et al.  Majority Voting: Material Classification by Tactile Sensing Using Surface Texture , 2011, IEEE Transactions on Robotics.

[16]  R L Klatzky,et al.  Identifying objects by touch: An “expert system” , 1985, Perception & psychophysics.

[17]  Kaspar Althoefer,et al.  A computationally fast algorithm for local contact shape and pose classification using a tactile array sensor , 2012, 2012 IEEE International Conference on Robotics and Automation.

[18]  Katsuko Kikuchi,et al.  The “Haptic Finger”– a new device for monitoring skin condition , 2003, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[19]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[20]  Carlos Canudas de Wit,et al.  Friction Models and Friction Compensation , 1998, Eur. J. Control.

[21]  Judy Czylok Sense of touch: Complementary therapies have become enormously popular with the public - and nurses. One midwife is using them to good effect with her clients and their partners. Judy Czylok reports , 2001 .