Design of a Fully Actuated Robotic Hand With Multiple Gelsight Tactile Sensors

This work details the design of a novel two finger robot gripper with multiple Gelsight based optical-tactile sensors covering the inner surface of the hand. The multiple Gelsight sensors can gather the surface topology of the object from multiple views simultaneously as well as can track the shear and tensile stress. In addition, other sensing modalities enable the hand to gather the thermal, acoustic and vibration information from the object being grasped. The force controlled gripper is fully actuated so that it can be used for various grasp configurations and can also be used for in-hand manipulation tasks. Here we present the design of such a gripper.

[1]  Michael Yu Wang,et al.  Effective Estimation of Contact Force and Torque for Vision-Based Tactile Sensors With Helmholtz–Hodge Decomposition , 2019, IEEE Robotics and Automation Letters.

[2]  Charles C. Kemp,et al.  Multimodal Tactile Perception of Objects in a Real Home , 2018, IEEE Robotics and Automation Letters.

[3]  Edward H. Adelson,et al.  Microgeometry capture using an elastomeric sensor , 2011, ACM Trans. Graph..

[4]  Seungmoon Choi,et al.  Tactile effect design and evaluation for virtual buttons on a mobile device touchscreen , 2011, Mobile HCI.

[5]  E. Adelson,et al.  Retrographic sensing for the measurement of surface texture and shape , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Charles C. Kemp,et al.  ContactDB: Analyzing and Predicting Grasp Contact via Thermal Imaging , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Mark R. Cutkosky,et al.  Sensing skin acceleration for slip and texture perception , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[8]  Arda Inceoglu,et al.  Failure Detection Using Proprioceptive, Auditory and Visual Modalities , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Aaron M. Dollar,et al.  Design Principles and Optimization of a Planar Underactuated Hand for Caging Grasps , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[10]  J. A. Fishel,et al.  Sensing tactile microvibrations with the BioTac — Comparison with human sensitivity , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[11]  Edward Adelson,et al.  Tracking objects with point clouds from vision and touch , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Francisco J Valero-Cuevas,et al.  Manipulating the edge of instability. , 2007, Journal of biomechanics.

[13]  Jianhua Li,et al.  GelSlim: A High-Resolution, Compact, Robust, and Calibrated Tactile-sensing Finger , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Topi Kaaresoja,et al.  Feel-good touch: finding the most pleasant tactile feedback for a mobile touch screen button , 2008, ICMI '08.

[15]  E. Adelson,et al.  Localization and Manipulation of Small Parts Using , 2014 .

[16]  Edward H. Adelson,et al.  Improved GelSight tactile sensor for measuring geometry and slip , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).