Slip Anticipation for Grasping Deformable Objects Using a Soft Force Sensor

Robots using classical control have revolutionised assembly lines where the environment and manipulated objects are restricted and predictable. However, they have proven less effective when the manipulated objects are deformable due to their complex and unpredictable behaviour. The use of tactile sensors and continuous monitoring of tactile feedback is there-fore particularly important for pick-and-place tasks using these materials. This is in part due to the need to use multiple points of contact for the manipulation of deformable objects which can result in slippage with inadequate coordination between manipulators. In this paper, continuous monitoring of tactile feedback, using a liquid metal soft force sensor, for grasping deformable objects is presented. The trained data-driven model distinguishes between successful grasps, slippage and failure during a manipulation task for multiple deformable objects. Slippage could be anticipated before failure occurred using data acquired over a 30 ms period with a greater than 95% accuracy using a random forest classifier. The results were achieved using a single sensor that can be mounted on the fingertips of existing grippers and contributes to the development of an automated pick-and-place process for deformable objects.

[1]  Jonathan Kelly,et al.  Under Pressure: Learning to Detect Slip with Barometric Tactile Sensors , 2021, ArXiv.

[2]  Hyouk Ryeol Choi,et al.  A Non-Array Type Cut to Shape Soft Slip Detection Sensor Applicable to Arbitrary Surface , 2020, Sensors.

[3]  Nathan F. Lepora,et al.  Slip detection for grasp stabilisation with a multi-fingered tactile robot hand , 2020, ArXiv.

[4]  Huseyin Atakan Varol,et al.  Deep Vibro-Tactile Perception for Simultaneous Texture Identification, Slip Detection, and Speed Estimation , 2020, Sensors.

[5]  Stephen J. Redmond,et al.  A novel optical 3D force and displacement sensor – Towards instrumenting the PapillArray tactile sensor , 2019, Sensors and Actuators A: Physical.

[6]  Wei Chen,et al.  Tactile Sensors for Friction Estimation and Incipient Slip Detection—Toward Dexterous Robotic Manipulation: A Review , 2018, IEEE Sensors Journal.

[7]  Nathan F. Lepora,et al.  Slip Detection With a Biomimetic Tactile Sensor , 2018, IEEE Robotics and Automation Letters.

[8]  Jan Peters,et al.  Grip Stabilization of Novel Objects Using Slip Prediction , 2018, IEEE Transactions on Haptics.

[9]  Daniela Rus,et al.  Learning Object Grasping for Soft Robot Hands , 2018, IEEE Robotics and Automation Letters.

[10]  Fariborz Baghaei Naeini,et al.  A Novel Event-Based Incipient Slip Detection Using Dynamic Active-Pixel Vision Sensor (DAVIS) , 2018, Sensors.

[11]  Edward H. Adelson,et al.  Improved GelSight tactile sensor for measuring geometry and slip , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Helge J. Ritter,et al.  Tactile Convolutional Networks for Online Slip and Rotation Detection , 2016, ICANN.

[13]  Pavel Dzitac,et al.  Friction-based slip detection in robotic grasping , 2015, IECON 2015 - 41st Annual Conference of the IEEE Industrial Electronics Society.

[14]  Boby George,et al.  Capacitive tactile sensor with slip detection capabilities for robotic applications , 2015, 2015 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) Proceedings.

[15]  Haolin Yang,et al.  A new slip-detection method based on pairwise high frequency components of capacitive sensor signals , 2015, 2015 5th International Conference on Information Science and Technology (ICIST).

[16]  Satoru Takenawa,et al.  A magnetic type tactile sensor using a two-dimensional array of inductors , 2009, 2009 IEEE International Conference on Robotics and Automation.

[17]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[18]  Heinz Wörn,et al.  Tactile sensor and algorithm to detect slip in robot grasping processes , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[19]  Hiroyuki Shinoda,et al.  Acoustic resonant tensor cell for tactile sensing , 1997, Proceedings of International Conference on Robotics and Automation.

[20]  Mark R. Cutkosky,et al.  Sensing skin acceleration for slip and texture perception , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[21]  E. Rabinowicz.  The Intrinsic Variables affecting the Stick-Slip Process , 1958 .

[22]  L. Breiman.  Random Forests , 2001, Machine Learning.

[23]  R. S. Johansson,et al.  Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects , 2004, Experimental Brain Research.

[24]  Masahiko Inami,et al.  A Vision-based Tactile Sensor , 2001 .