A Sense of Touch for the Shadow Modular Grasper

In this letter, we have designed and built a set of tactile fingertips for integration with a commercial three-fingered robot hand, the Shadow Modular Grasper. The fingertips are an evolution of an established optical biomimetic tactile sensor, the TacTip. In developing the tactile fingertips, we have progressed the technology in areas such as miniaturization, development of custom-shaped finger-pads, and integration of multiple sensors. From these fingertips, we extract a set of high-level features with intuitive relationships to tactile quantities such as contact location and pressure. We present a simple linear-regression method for predicting roll and pitch of the finger-pad relative to a surface normal and show that the method generalizes to unknown depths and shapes. Finally, we apply this prediction to a grasp-control method with the Modular Grasper and show that it can adjust the grasp on three real-world objects from the YCB object set in order to attain a greater area of contact at each fingertip.

[1]  Jonathan Rossiter,et al.  Development of a tactile sensor based on biologically inspired edge encoding , 2009, 2009 International Conference on Advanced Robotics.

[2]  Jonathan Rossiter,et al.  The TacTip Family: Soft Optical Tactile Sensors with 3D-Printed Biomimetic Morphologies , 2018, Soft robotics.

[3]  Edward H. Adelson,et al.  Sensing and Recognizing Surface Textures Using a GelSight Sensor , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Haruhisa Kawasaki,et al.  Dexterous anthropomorphic robot hand with distributed tactile sensor: Gifu hand II , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[5]  Danica Kragic,et al.  Learning the tactile signatures of prototypical object parts for robust part-based grasping of novel objects , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Danica Kragic,et al.  Dexterous grasping under shape uncertainty , 2016, Robotics Auton. Syst..

[7]  Nathan F. Lepora,et al.  Voronoi Features for Tactile Sensing: Direct Inference of Pressure, Shear, and Contact Locations , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Nathan F. Lepora,et al.  Model-Free Precise in-Hand Manipulation with a 3D-Printed Tactile Gripper , 2017, IEEE Robotics and Automation Letters.

[9]  Gaurav S. Sukhatme,et al.  Self-supervised regrasping using spatio-temporal tactile features and reinforcement learning , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Jakub W. Pachocki,et al.  Learning dexterous in-hand manipulation , 2018, Int. J. Robotics Res..

[11]  Abhinav Gupta,et al.  Supersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[12]  R. S. Johansson,et al.  Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects , 2004, Experimental Brain Research.

[13]  Yiannis Demiris,et al.  Incrementally Learning Objects by Touch: Online Discriminative and Generative Models for Tactile-Based Recognition , 2014, IEEE Transactions on Haptics.

[14]  Nathan F. Lepora,et al.  Tactile Manipulation With a TacThumb Integrated on the Open-Hand M2 Gripper , 2016, IEEE Robotics and Automation Letters.

[15]  Jitendra Malik,et al.  More Than a Feeling: Learning to Grasp and Regrasp Using Vision and Touch , 2018, IEEE Robotics and Automation Letters.

[16]  Nathan F. Lepora,et al.  Superresolution with an optical tactile sensor , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  Véronique Perdereau,et al.  Tactile sensing in dexterous robot hands - Review , 2015, Robotics Auton. Syst..

[18]  Gordon Cheng,et al.  In-hand object recognition via texture properties with robotic hands, artificial skin, and novel tactile descriptors , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[19]  Sachin Chitta,et al.  Human-Inspired Robotic Grasp Control With Tactile Sensing , 2011, IEEE Transactions on Robotics.

[20]  Emanuel Todorov,et al.  Design of a highly biomimetic anthropomorphic robotic hand towards artificial limb regeneration , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Martin V. Butz,et al.  Self-supervised regrasping using spatio-temporal tactile features and reinforcement learning , 2016, IROS 2016.

[22]  Aaron M. Dollar,et al.  Single-Grasp Object Classification and Feature Extraction with Simple Robot Hands and Tactile Sensors , 2016, IEEE Transactions on Haptics.

[23]  Vincent Duchaine,et al.  Grasp stability assessment through the fusion of proprioception and tactile signals using convolutional neural networks , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).