Estimating object hardness with a GelSight touch sensor

Hardness sensing is a valuable capability for a robot touch sensor. We describe a novel method of hardness sensing that does not require accurate control of contact conditions. A GelSight sensor is a tactile sensor that provides high resolution tactile images, which enables a robot to infer object properties such as geometry and fine texture, as well as contact force and slip conditions. The sensor is pressed on silicone samples by a human or a robot and we measure the sample hardness only with data from the sensor, without a separate force sensor and without precise knowledge of the contact trajectory. We describe the features that show object hardness. For hemispherical objects, we develop a model to measure the sample hardness, and the estimation error is about 4% in the range of 8 Shore 00 to 45 Shore A. With this technology, a robot is able to more easily infer the hardness of the touched objects, thereby improving its object recognition as well as manipulation strategy.

[1]  T. Shimizu,et al.  A new type of tactile sensor detecting contact force and hardness of an object , 2002, Technical Digest. MEMS 2002 IEEE International Conference. Fifteenth IEEE International Conference on Micro Electro Mechanical Systems (Cat. No.02CH37266).

[2]  W. B. Tiest.  Tactual perception of material properties , 2010, Vision Research.

[3]  Trevor Darrell,et al.  Using robotic exploratory procedures to learn the meaning of haptic adjectives , 2013, 2013 IEEE International Conference on Robotics and Automation.

[4]  Jonathan Rossiter,et al.  Development of a tactile sensor based on biologically inspired edge encoding , 2009, 2009 International Conference on Advanced Robotics.

[5]  E. Adelson,et al.  Localization and Manipulation of Small Parts Using , 2014 .

[6]  Susan J. Lederman,et al.  Extracting object properties through haptic exploration. , 1993, Acta psychologica.

[7]  Edward H. Adelson,et al.  Lump detection with a gelsight sensor , 2013, 2013 World Haptics Conference (WHC).

[8]  Gert Kootstra,et al.  Design of a flexible tactile sensor for classification of rigid and deformable objects , 2014, Robotics Auton. Syst..

[9]  Astrid M. L. Kappers,et al.  Cues for Haptic Perception of Compliance , 2009, IEEE Transactions on Haptics.

[10]  M. Srinivasan,et al.  Tactual discrimination of softness. , 1995, Journal of neurophysiology.

[11]  Naoki Kawakami,et al.  Vision-based sensor for real-time measuring of surface traction fields , 2005, IEEE Computer Graphics and Applications.

[12]  Edward H. Adelson,et al.  Shape estimation in natural illumination , 2011, CVPR 2011.

[13]  E. Adelson,et al.  Retrographic sensing for the measurement of surface texture and shape , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Takashi Maeno,et al.  Real-time Estimation of Touch Feeling Factors Using Human Finger Mimetic Tactile Sensors , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  S. Omata,et al.  A tactile sensor for detection of physical properties of human skin in vivo. , 1998, Journal of medical engineering & technology.

[16]  Tomonori Yamamoto,et al.  Use of tactile feedback to control exploratory movements to characterize object compliance , 2012, Front. Neurorobot..

[17]  Edward H. Adelson,et al.  Measurement of shear and slip with a GelSight tactile sensor , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Roger W. Brockett,et al.  Reconstructing the Shape of a Deformable Membrane from Image Data , 2000, Int. J. Robotics Res..

[19]  M. Takei,et al.  A New Tactile Skin Sensor for Measuring Skin Hardness in Patients with Systemic Sclerosis and Autoimmune Raynaud's Phenomenon , 2004, The Journal of international medical research.

[20]  Robert D. Howe,et al.  Tactile sensing and control of robotic manipulation , 1993, Adv. Robotics.

[21]  Sadao Omata,et al.  New tactile sensor like the human hand and its applications , 1992 .