Methods for robotic tool-mediated haptic surface recognition

Robots need to be able understand the haptic sensations that occur during physical interaction in order to recognize and manipulate objects. This paper centers on the problem of robotic toolmediated haptic surface recognition. We collected data as a PR2 robot interacted with fifteen different surfaces through a novel tool that captures high-definition recordings of tactile vibrations, contact forces, and tool position. We then developed algorithms for using the recorded data to recognize the identity of the surface under varying contact conditions. We show that successful recognition of surfaces touched through a tool critically depends on accounting for the physical contact information (tool speed and normal force). Additionally, we present several enhancements to improve surface recognition including the combination of multiple vibration axes into a single axis, using frictional force during contact, and logarithmically spaced frequency scaling for vibration analysis. We implement a flexible classifier composed of multiple One-Class Support VectorMachines trained on a data set containing all fifteen surfaces, and we then use this classifier to identify these same surfaces in a new data set recorded under substantially different contact conditions, achieving an overall texture recognition rate of 80%.

[1]  M. Hollins,et al.  Pacinian representations of fine surface texture , 2005, Perception & psychophysics.

[2]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[3]  Christian Balkenius,et al.  Experiments with Self-Organizing Systems for Texture and Hardness Perception , 2009 .

[4]  Fredrik Rehnmark,et al.  Robonaut: NASA's Space Humanoid , 2000, IEEE Intell. Syst..

[5]  Marco Barbieri,et al.  A contact mechanics interpretation of the duplex theory of tactile texture perception , 2016 .

[6]  J Dargahi,et al.  Human tactile perception as a standard for artificial tactile sensing—a review , 2004, The international journal of medical robotics + computer assisted surgery : MRCAS.

[7]  H. Schifferstein,et al.  THE TACTUAL EXPERIENCE OF OBJECTS , 2008 .

[8]  Susan J. Lederman,et al.  Relative performance using haptic and/or touch-produced auditory cues in a remote absolute texture identification task , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[9]  Asma Rabaoui,et al.  Using One-Class SVMs and Wavelets for Audio Surveillance , 2008, IEEE Transactions on Information Forensics and Security.

[10]  Andreas Zell,et al.  Vibration-based Terrain Classification Using Support Vector Machines , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Christian Cipriani,et al.  Roughness Encoding for Discrimination of Surfaces in Artificial Active-Touch , 2011, IEEE Transactions on Robotics.

[12]  Joseph M. Romano,et al.  Dimensional Reduction of High-Frequency Accelerations for Haptic Rendering , 2010, EuroHaptics.

[13]  Nawid Jamali,et al.  Majority Voting: Material Classification by Tactile Sensing Using Surface Texture , 2011, IEEE Transactions on Robotics.

[14]  Sachin Chitta,et al.  Human-Inspired Robotic Grasp Control With Tactile Sensing , 2011, IEEE Transactions on Robotics.

[15]  Takashi Yoshioka,et al.  Factors Involved in Tactile Texture Perception Through Probes , 2009, Adv. Robotics.

[16]  C J Vierck,et al.  A critical band filter in touch , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  Heather Culbertson,et al.  Generating haptic texture models from unconstrained tool-surface interactions , 2013, 2013 World Haptics Conference (WHC).

[18]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[19]  Richard Crowder,et al.  Toward Robots That Can Sense Texture by Touch , 2006, Science.

[20]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[21]  Boleslaw K. Szymanski,et al.  Some Properties of the Gaussian Kernel for One Class Learning , 2007, ICANN.

[22]  Gregory Dudek,et al.  A Simple Tactile Probe for Surface Identification by Mobile Robots , 2011, IEEE Transactions on Robotics.

[23]  J. Gibson.  Observations on active touch. , 1962, Psychological review.

[24]  Susan J. Lederman,et al.  Force variability during surface contact with bare finger or rigid probe , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[25]  Christoph H. Lampert,et al.  Learning Dynamic Tactile Sensing With Robust Vision-Based Training , 2011, IEEE Transactions on Robotics.

[26]  Jivko Sinapov,et al.  Vibrotactile Recognition and Categorization of Surfaces by a Humanoid Robot , 2011, IEEE Transactions on Robotics.

[27]  Karl Iagnemma,et al.  Vibration-based terrain classification for planetary exploration rovers , 2005, IEEE Transactions on Robotics.

[28]  Gerald E. Loeb,et al.  Bayesian Exploration for Intelligent Identification of Textures , 2012, Front. Neurorobot..

[29]  J Edwards,et al.  Extracting textural features from tactile sensors , 2008, Bioinspiration & biomimetics.

[30]  Anthony G. Pipe,et al.  Contact type dependency of texture classification in a whiskered mobile robot , 2009, Auton. Robots.

[31]  E P Gardner,et al.  Simulation of motion on the skin. I. Receptive fields and temporal frequency coding by cutaneous mechanoreceptors of OPTACON pulses delivered to the hand. , 1989, Journal of neurophysiology.