Distinguishing sliding from slipping during object pushing

The advent of advanced tactile sensing technology triggered the development of methods to employ them for grasp evaluation, online slip detection, and tactile servoing. In contrast to recent approaches to slip detection, distinguishing slip from non-slip conditions, we consider the more difficult task of distinguishing different types of slippage. Particularly we consider an object pushing task, where forces can only be applied from the top. In that case, the robot needs to notice when the object successfully moves vs. when the object gets stuck while the finger slips over its surface. As an example, consider the task of pushing around a piece of paper. We propose and evaluate three different convolutional network architectures and proof the applicability of the method for online classification in a robot pushing task.

[1]  John Kenneth Salisbury,et al.  Contact Sensing from Force Measurements , 1990, Int. J. Robotics Res..

[2]  Kaspar Althoefer,et al.  A novel dynamic slip prediction and compensation approach based on haptic surface exploration , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Gaurav S. Sukhatme,et al.  Force estimation and slip detection/classification for grip control using a biomimetic tactile sensor , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[4]  R. Johansson,et al.  Responses of mechanoreceptive afferent units in the glabrous skin of the human hand to sinusoidal skin displacements , 1982, Brain Research.

[5]  Gordon Cheng,et al.  Fast adaptation for effect-aware pushing , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[6]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[7]  Helge J. Ritter,et al.  Augmenting curved robot surfaces with soft tactile skin , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  Helge J. Ritter,et al.  Tactile Convolutional Networks for Online Slip and Rotation Detection , 2016, ICANN.

[9]  Kevin M. Lynch,et al.  The mechanics of fine manipulation by pushing , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[10]  Mark R. Cutkosky,et al.  Sensing skin acceleration for slip and texture perception , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[11]  Robert Hecht-Nielsen,et al.  Theory of the backpropagation neural network , 1989, International 1989 Joint Conference on Neural Networks.

[12]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Jan Peters,et al.  Stabilizing novel objects by learning to predict tactile slip , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Tamim Asfour,et al.  Representation of pre-grasp strategies for object manipulation , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[15]  Véronique Perdereau,et al.  Tactile sensing in dexterous robot hands - Review , 2015, Robotics Auton. Syst..

[16]  Gerald Penn,et al.  Convolutional Neural Networks for Speech Recognition , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[17]  G.E. Loeb,et al.  A robust micro-vibration sensor for biomimetic fingertips , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[18]  Helge J. Ritter,et al.  A highly sensitive 3D-shaped tactile sensor , 2013, 2013 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[19]  Matthew T. Mason,et al.  Mechanics of Robotic Manipulation , 2001 .

[20]  Helge J. Ritter,et al.  Using a Piezo-Resistive Tactile Sensor for Detection of Incipient Slippage , 2010, ISR/ROBOTIK.

[21]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.