Tactile Sensors for Friction Estimation and Incipient Slip Detection—Toward Dexterous Robotic Manipulation: A Review

Humans can handle and manipulate objects with ease; however, human dexterity has yet to be matched by artificial systems. Receptors in our fingers and hands provide essential tactile information to the motor control system during dexterous manipulation such that the grip force is scaled to the tangential forces according to the coefficient of friction. Likewise, tactile sensing will become essential for robotic and prosthetic gripping performance as applications move toward unstructured environments. However, most existing research ignores the need to sense the frictional properties of the sensor–object interface, which (along with contact forces and torques) is essential for finding the minimum grip force required to securely grasp an object. Here, we review this problem by surveying the field of tactile sensing from the perspective that sensors should: 1) detect gross slip (to adjust the grip force); 2) detect incipient slip (dependent on the frictional properties of the sensor–object interface and the geometries and mechanics of the sensor and the object) as an indication of grip security; or 3) measure friction on contact with an object and/or following a gross or incipient slip event while manipulating an object. Recommendations are made to help focus future sensor design efforts toward a generalizable and practical solution to sense, and hence control grip security. Specifically, we propose that the sensor mechanics should encourage incipient slip, by allowing parts of the sensor to slip while other parts remain stuck, and that instrumentation should measure displacement and deformation to complement conventional force, pressure, and vibration tactile sensing.

[1]  Jay Fineberg,et al.  Detachment fronts and the onset of dynamic friction , 2004, Nature.

[2]  I. Fujimoto,et al.  Development of artificial finger skin to detect incipient slip for realization of static friction sensation , 2003, Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI2003..

[3]  Vaughan G. Macefield,et al.  Cutaneous mechanoreceptors, functional behaviour , 2009 .

[4]  Wei Chen,et al.  An Eight-Legged Tactile Sensor to Estimate Coefficient of Static Friction: Improvements in Design and Evaluation , 2016, EuroHaptics.

[5]  R. Johansson,et al.  Properties of cutaneous mechanoreceptors in the human hand related to touch sensation. , 1984, Human neurobiology.

[6]  Sungchul Kang,et al.  Development of tactile sensor for detecting contact force and slip , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Carsten Schürmann,et al.  Modular high speed tactile sensor system with video interface , 2009, Humanoids 2009.

[8]  Jianhua Li,et al.  GelSlim: A High-Resolution, Compact, Robust, and Calibrated Tactile-sensing Finger , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Claudio Melchiorri,et al.  Incipient Slip Detection and Control Using a Rubber-Based Tactile Sensor , 1996 .

[10]  E M Arruda,et al.  Finite element modeling of human skin using an isotropic, nonlinear elastic constitutive model. , 2000, Journal of biomechanics.

[11]  Jonathan Rossiter,et al.  Development of a tactile sensor based on biologically inspired edge encoding , 2009, 2009 International Conference on Advanced Robotics.

[12]  Vincent Hayward,et al.  Why pens have rubbery grips , 2017, Proceedings of the National Academy of Sciences.

[13]  S. Derler,et al.  Tribology of Skin: Review and Analysis of Experimental Results for the Friction Coefficient of Human Skin , 2011, Tribology Letters.

[14]  N. Lovell,et al.  Characterization of a capacitive tactile shear sensor for application in robotic and upper limb prostheses , 2011 .

[15]  N. Yamazaki,et al.  Sensing mechanisms of the partial incipient slip at the surface of cylindrical fingers during the precision grip , 1997 .

[16]  Stephen J. Redmond,et al.  PapillArray: An incipient slip sensor for dexterous robotic or prosthetic manipulation – design and prototype validation , 2018 .

[17]  A. M. Smith,et al.  Friction, not texture, dictates grip forces used during object manipulation. , 1996, Journal of neurophysiology.

[18]  Katsuhiko Nakamura,et al.  Instantaneous evaluation of friction based on ARTC tactile sensor , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[19]  Heinz Wörn,et al.  Tactile sensor and algorithm to detect slip in robot grasping processes , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[20]  Aiguo Ming,et al.  Grasping force control of multi-fingered robot hand based on slip detection using tactile sensor , 2007, 2008 IEEE International Conference on Robotics and Automation.

[21]  Tsukasa Ogasawara,et al.  Grip force control for an elastic finger using vision-based incipient slip feedback , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[22]  R. Johansson,et al.  Signals in tactile afferents from the fingers eliciting adaptive motor responses during precision grip , 2004, Experimental Brain Research.

[23]  Alan W. L. Chiu,et al.  Slippage Sensory Feedback and Nonlinear Force Control System for a Low- Cost Prosthetic Hand , 2009 .

[24]  Vaughan G. Macefield,et al.  Tactile afferents encode grip safety before slip for different frictions , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  S. J. Calabrese,et al.  Some parameters affecting tactile friction , 1991 .

[26]  Mark R. Cutkosky,et al.  Force and Tactile Sensing , 2016, Springer Handbook of Robotics, 2nd Ed..

[27]  Takashi Maeno,et al.  Artificial finger skin having ridges and distributed tactile sensors used for grasp force control , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[28]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[29]  Ingvars Birznieks,et al.  Decoding tactile afferent activity to obtain an estimate of instantaneous force and torque applied to the fingerpad. , 2015, Journal of neurophysiology.

[30]  Isao Shimoyama,et al.  A Tactile Sensor Using Piezoresistive Beams for Detection of the Coefficient of Static Friction , 2016, Sensors.

[31]  H. William,et al.  A Tactile Sensor for Incipient Slip Detection , 2007 .

[32]  Takashi Maeno,et al.  Friction estimation by pressing an elastic finger-shaped sensor against a surface , 2004, IEEE Transactions on Robotics and Automation.

[33]  Philippe Lefèvre,et al.  Dynamics of fingertip contact during the onset of tangential slip , 2014, Journal of The Royal Society Interface.

[34]  Jeremy A. Fishel,et al.  Evaluation of force, vibration and thermal tactile feedback in prosthetic limbs , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[35]  Tsukasa Ogasawara,et al.  Grip-force control of an elastic object by vision-based slip-margin feedback during the incipient slip , 2005, IEEE Transactions on Robotics.

[36]  Gaurav S. Sukhatme,et al.  Force estimation and slip detection/classification for grip control using a biomimetic tactile sensor , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[37]  V. Hayward,et al.  Finger pad friction and its role in grip and touch , 2013, Journal of The Royal Society Interface.

[38]  A. Ruina,et al.  Stability of Steady Frictional Slipping , 1983 .

[39]  Jonathan Becedas,et al.  Micro-Vibration-Based Slip Detection in Tactile Force Sensors , 2014, Sensors.

[40]  Brian J. Briscoe,et al.  The friction and lubrication of human stratum corneum. , 1993 .

[41]  Van Anh Ho,et al.  Modeling and Analysis of a Frictional Sliding Soft Fingertip, and Experimental Validations , 2011, Adv. Robotics.

[42]  Koh Hosoda,et al.  Detection and prevention of slip using sensors with different properties embedded in elastic artificial skin on the basis of previous experience , 2011, 2011 15th International Conference on Advanced Robotics (ICAR).

[43]  Mark R. Cutkosky,et al.  Biologically inspired tactile classification of object-hand and object-world interactions , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[44]  Mark R. Cutkosky,et al.  Estimating friction using incipient slip sensing during a manipulation task , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[45]  G. Debrégeas,et al.  The Role of Fingerprints in the Coding of Tactile Information Probed with a Biomimetic Sensor , 2009, Science.

[46]  Robert D. Howe,et al.  Tactile sensing and control of robotic manipulation , 1993, Adv. Robotics.

[47]  J. Fineberg,et al.  The Dynamics of the Onset of Frictional Slip , 2010, Science.

[48]  David Dornfeld,et al.  Slip detection using acoustic emission signal analysis , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[49]  Antonio Bicchi,et al.  Intrinsic contact sensing for soft fingers , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[50]  Koh Hosoda,et al.  Acquisition of Multi-Modal Expression of Slip through Pick-Up Experiences , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[51]  G. Obinata,et al.  Grip Force Control Based on the Degree of Slippage Using Optical Tactile Sensor , 2007, 2007 International Symposium on Micro-NanoMechatronics and Human Science.

[52]  M. Yousef Ibrahim,et al.  New approach to detection of incipient slip using inductive sensory system , 2010, 2010 IEEE International Symposium on Industrial Electronics.

[53]  S. Roccella,et al.  Bio-inspired sensorization of a biomechatronic robot hand for the grasp-and-lift task , 2008, Brain Research Bulletin.

[54]  Hannes P. Saal,et al.  Touch is a team effort: interplay of submodalities in cutaneous sensibility , 2014, Trends in Neurosciences.

[55]  V. Hayward,et al.  In vivo biomechanics of the fingerpad skin under local tangential traction. , 2007, Journal of biomechanics.

[56]  A. R. Ennos,et al.  Fingerprints are unlikely to increase the friction of primate fingerpads , 2009, Journal of Experimental Biology.

[57]  Mark R. Cutkosky,et al.  Sensing skin acceleration for slip and texture perception , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[58]  Javad Dargahi,et al.  Advances in tactile sensors design/manufacturing and its impact on robotics applications - a review , 2005, Ind. Robot.

[59]  Takashi Maeno,et al.  Analysis and design of a tactile sensor detecting strain distribution inside an elastic finger , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[60]  Jan Peters,et al.  Grip Stabilization of Novel Objects Using Slip Prediction , 2018, IEEE Transactions on Haptics.

[61]  Helge J. Ritter,et al.  Tactile Convolutional Networks for Online Slip and Rotation Detection , 2016, ICANN.

[62]  Matteo Campanella,et al.  Detection of incipient object slippage by skin-like sensing and neural network processing , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[63]  Hiroyuki Shinoda,et al.  Ultrasonic emission tactile sensing , 1995 .

[64]  Kiyoshi Komoriya,et al.  Static friction coefficient determination by force sensing and its application , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[65]  James A. Norris,et al.  An introduction to tribology. , 2008, Journal of surgical orthopaedic advances.

[66]  Mark R. Cutkosky,et al.  Slip classification for dynamic tactile array sensors , 2016, Int. J. Robotics Res..

[67]  Helge J. Ritter,et al.  Using a Piezo-Resistive Tactile Sensor for Detection of Incipient Slippage , 2010, ISR/ROBOTIK.

[68]  Nigel H. Lovell,et al.  A review of tactile sensing technologies with applications in biomedical engineering , 2012 .

[69]  Yoji Yamada,et al.  Slip phase isolating: impulsive signal generating vibrotactile sensor and its application to real-time object regrip control , 2000, Robotica.

[70]  Matt Carré,et al.  Review of the frictional properties of finger-object contact when gripping , 2007 .

[71]  Tao Liu,et al.  A Novel Tactile Sensor with Electromagnetic Induction and Its Application on Stick-Slip Interaction Detection , 2016, Sensors.

[72]  Katsuhiko Nakamura,et al.  A Tactile Sensor Instantaneously Evaluating Friction Coefficients , 2001 .

[73]  R. S. Johansson,et al.  Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects , 2004, Experimental Brain Research.

[74]  Mark R. Cutkosky,et al.  Design and testing of a selectively compliant underactuated hand , 2014, Int. J. Robotics Res..

[75]  Van Anh Ho,et al.  Beam bundle model of human-like fingertip for investigation of tactile mechanism , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[76]  Jan Wikander,et al.  Tactile sensing in intelligent robotic manipulation - a review , 2005, Ind. Robot.

[77]  Robert D. Howe,et al.  A tactile sensor for localizing transient events in manipulation , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[78]  Nathan F. Lepora,et al.  Addition of a Biomimetic Fingerprint on an Artificial Fingertip Enhances Tactile Spatial Acuity , 2017, IEEE Robotics and Automation Letters.

[79]  Y. Ito,et al.  Robust Slippage Degree Estimation Based on Reference Update of Vision-Based Tactile Sensor , 2011, IEEE Sensors Journal.

[80]  R. Johansson,et al.  Encoding of Direction of Fingertip Forces by Human Tactile Afferents , 2001, The Journal of Neuroscience.

[81]  P Lefèvre,et al.  Fingertip moisture is optimally modulated during object manipulation. , 2010, Journal of neurophysiology.

[82]  R. Johansson,et al.  Control of Grip Force When Tilting Objects: Effect of Curvature of Grasped Surfaces and Applied Tangential Torque , 1998, The Journal of Neuroscience.

[83]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[84]  Ingvars Birznieks,et al.  Encoding of tangential torque in responses of tactile afferent fibres innervating the fingerpad of the monkey , 2010, The Journal of physiology.

[85]  Michael J. Adams,et al.  Friction of the Human Finger Pad: Influence of Moisture, Occlusion and Velocity , 2011 .

[86]  Vincent Hayward,et al.  Haptic Edge Detection Through Shear , 2016, Scientific Reports.

[87]  Mark Lee,et al.  Review Article Tactile sensing for mechatronics—a state of the art survey , 1999 .

[88]  O M Braun,et al.  Dynamics of transition from static to kinetic friction. , 2009, Physical review letters.

[89]  Véronique Perdereau,et al.  Tactile sensing in dexterous robot hands - Review , 2015, Robotics Auton. Syst..

[90]  Vaughan G. Macefield,et al.  Classification of Texture and Frictional Condition at Initial Contact by Tactile Afferent Responses , 2014, EuroHaptics.

[91]  R. Johansson,et al.  Factors influencing the force control during precision grip , 2004, Experimental Brain Research.

[92]  Hua Deng,et al.  A simple method for slip detection of prosthetic hand , 2015, 2015 IEEE International Conference on Information and Automation.

[93]  Karl Van Wyk,et al.  Calibration and Analysis of Tactile Sensors as Slip Detectors , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[94]  Katsuhiko Nakamura,et al.  Tactile Sensing Device Instantaneously Evaluating Friction Coefficients , 2001 .

[95]  Octavian Postolache,et al.  Tactile Sensors for Robotic Applications , 2013 .

[96]  Takashi Maeno,et al.  Control of grasping force by detecting stick/slip distribution at the curved surface of an elastic finger , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[97]  Edward H. Adelson,et al.  Measurement of shear and slip with a GelSight tactile sensor , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[98]  Edward H. Adelson,et al.  Improved GelSight tactile sensor for measuring geometry and slip , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[99]  Kaspar Althoefer,et al.  Tactile sensing for dexterous in-hand manipulation in robotics-A review , 2011 .

[100]  Nathan F. Lepora,et al.  Slip Detection With a Biomimetic Tactile Sensor , 2018, IEEE Robotics and Automation Letters.

[101]  T. Lejeune,et al.  Importance of cutaneous feedback in maintaining a secure grip during manipulation of hand-held objects. , 2003, Journal of neurophysiology.

[102]  Wei Chen,et al.  An eight-legged tactile sensor to estimate coefficient of static friction , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[103]  R. Johansson,et al.  Influences of Cutaneous Sensory Input on the Motor Coordination During Precision Manipulation , 1984 .

[104]  E. Guglielmelli,et al.  Artificial Sense of Slip—A Review , 2013, IEEE Sensors Journal.

[105]  Lorenzo Marconi,et al.  Slip detection by tactile sensors: algorithms and experimental results , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[106]  Ingvars Birznieks,et al.  Design Principles for Building a Soft, Compliant, High Spatial Resolution Tactile Sensor Array , 2016, EuroHaptics.

[107]  Cwj Cees Oomens,et al.  A numerical‐experimental method to characterize the non‐linear mechanical behaviour of human skin , 2003, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[108]  Shinichi Hirai,et al.  Challenges in developing soft tactile sensors for robots that detect incipient slip , 2014, 7th International Conference on Information and Automation for Sustainability.