GelSlim 3.0: High-Resolution Measurement of Shape, Force and Slip in a Compact Tactile-Sensing Finger

This work presents a new version of the tactile-sensing finger GelSlim 3.0, which integrates the ability to sense high-resolution shape, force, and slip in a compact form factor for use with small parallel jaw grippers in cluttered bin-picking scenarios. The novel design incorporates the capability to use real-time analytic methods to measure shape, estimate the contact 3D force distribution, and detect incipient slip. To achieve a compact integration, we optimize the optical path from illumination source to camera and other geometric variables in a optical simulation environment. In particular, we optimize the illumination sources and a light shaping lens around the constraints imposed by the photometric stereo algorithm used for depth reconstruction. The optimized optical configuration is integrated into a finger design composed of robust and easily replaceable snap-to-fit fingetip module that allow for ease of manufacture, assembly, use, and repair. To stimulate future research in tactile-sensing and provide the robotics community access to reliable and easily-reproducible tactile finger with a diversity of sensing modalities, we open-source the design and software at this https URL.

[1]  Edward H. Adelson,et al.  Localization and manipulation of small parts using GelSight tactile sensing , 2014, IROS.

[2]  Alberto Rodriguez,et al.  Tactile Dexterity: Manipulation Primitives with Tactile Feedback , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Elliott Donlon,et al.  Maintaining Grasps within Slipping Bounds by Monitoring Incipient Slip , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[4]  Edward H. Adelson,et al.  Sensing and Recognizing Surface Textures Using a GelSight Sensor , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Ian Taylor,et al.  Robotic pick-and-place of novel objects in clutter with multi-affordance grasping and cross-domain image matching , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Sergey Levine,et al.  Manipulation by Feel: Touch-Based Control with Deep Predictive Models , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[7]  Mike Lambeta,et al.  DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor With Application to In-Hand Manipulation , 2020, IEEE Robotics and Automation Letters.

[8]  Maria Bauza,et al.  Tactile Mapping and Localization from High-Resolution Tactile Imprints , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[9]  Yu She,et al.  Exoskeleton-covered soft finger with vision-based proprioception and tactile sensing , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[10]  E. Adelson,et al.  Cable manipulation with a tactile-reactive gripper , 2019, Robotics: Science and Systems.

[11]  Jianhua Li,et al.  GelSlim: A High-Resolution, Compact, Robust, and Calibrated Tactile-sensing Finger , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Sergey Levine,et al.  OmniTact: A Multi-Directional High-Resolution Touch Sensor , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Edward H. Adelson,et al.  Microgeometry capture using an elastomeric sensor , 2011, ACM Trans. Graph..

[14]  E. Adelson,et al.  Retrographic sensing for the measurement of surface texture and shape , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Elliott Donlon,et al.  Dense Tactile Force Estimation using GelSlim and inverse FEM , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[16]  Edward Adelson,et al.  Design of a Fully Actuated Robotic Hand With Multiple Gelsight Tactile Sensors , 2020, ArXiv.

[17]  Edward H. Adelson,et al.  Improved GelSight tactile sensor for measuring geometry and slip , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Jonathan Rossiter,et al.  Development of a tactile sensor based on biologically inspired edge encoding , 2009, 2009 International Conference on Advanced Robotics.