Improved GelSight tactile sensor for measuring geometry and slip

A GelSight sensor uses an elastomeric slab covered with a reflective membrane to measure tactile signals. It measures the 3D geometry and contact force information with high spacial resolution, and successfully helped many challenging robot tasks. A previous sensor [1], based on a semi-specular membrane, produces high resolution but with limited geometry accuracy. In this paper, we describe a new design of GelSight for robot gripper, using a Lambertian membrane and new illumination system, which gives greatly improved geometric accuracy while retaining the compact size. We demonstrate its use in measuring surface normals and reconstructing height maps using photometric stereo. We also use it for the task of slip detection, using a combination of information about relative motions on the membrane surface and the shear distortions. Using a robotic arm and a set of 37 everyday objects with varied properties, we find that the sensor can detect translational and rotational slip in general cases, and can be used to improve the stability of the grasp.

[1]  Mark R. Cutkosky,et al.  Sensing skin acceleration for slip and texture perception , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[2]  H. Maekawa,et al.  A finger-shaped tactile sensor using an optical waveguide , 1993, Proceedings of IEEE Systems Man and Cybernetics Conference - SMC.

[3]  Yunde Jiar,et al.  A high resolution and high compliance tactile sensing system for robotic manipulations , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[4]  Lorenzo Marconi,et al.  Slip detection by tactile sensors: algorithms and experimental results , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[5]  Masahiro Ohka,et al.  Data conversion capability of optical tactile sensor featuring an array of pyramidal projections , 1996, 1996 IEEE/SICE/RSJ International Conference on Multisensor Fusion and Integration for Intelligent Systems (Cat. No.96TH8242).

[6]  K. Nagata,et al.  Feature detection with an image based compliant tactile sensor , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[7]  Claudio Melchiorri,et al.  Slip detection and control using tactile and force sensors , 2000 .

[8]  Roger W. Brockett,et al.  Reconstructing the Shape of a Deformable Membrane from Image Data , 2000, Int. J. Robotics Res..

[9]  Naoki Kawakami,et al.  Vision-based sensor for real-time measuring of surface traction fields , 2005, IEEE Computer Graphics and Applications.

[10]  Naoki Kawakami,et al.  Measurement of force vector field of robotic finger using vision-based haptic sensor , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Jonathan Rossiter,et al.  Development of a tactile sensor based on biologically inspired edge encoding , 2009, 2009 International Conference on Advanced Robotics.

[12]  E. Adelson,et al.  Retrographic sensing for the measurement of surface texture and shape , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[14]  Kaspar Althoefer,et al.  Tactile sensing for dexterous in-hand manipulation in robotics-A review , 2011 .

[15]  Edward H. Adelson,et al.  Microgeometry capture using an elastomeric sensor , 2011, ACM Trans. Graph..

[16]  Edward H. Adelson,et al.  Lump detection with a gelsight sensor , 2013, 2013 World Haptics Conference (WHC).

[17]  E. Guglielmelli,et al.  Artificial Sense of Slip—A Review , 2013, IEEE Sensors Journal.

[18]  Edward H. Adelson,et al.  Sensing and Recognizing Surface Textures Using a GelSight Sensor , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Edward H. Adelson,et al.  Localization and manipulation of small parts using GelSight tactile sensing , 2014, IROS.

[20]  Edward H. Adelson,et al.  Measurement of shear and slip with a GelSight tactile sensor , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Gaurav S. Sukhatme,et al.  Force estimation and slip detection/classification for grip control using a biomimetic tactile sensor , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[22]  Véronique Perdereau,et al.  Tactile sensing in dexterous robot hands - Review , 2015, Robotics Auton. Syst..

[23]  Nikolaos G. Tsagarakis,et al.  Reflex control of the Pisa/IIT SoftHand during object slippage , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Edward H. Adelson,et al.  Estimating object hardness with a GelSight touch sensor , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Andrew Owens,et al.  Shape-independent hardness estimation using deep learning and a GelSight tactile sensor , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).