Exploiting Sensor Symmetry for Generalized Tactile Perception in Biomimetic Touch

Tactile perception methods rely on creating mappings from tactile data to percepts. In many approaches to artificial tactile perception, this involves extensive sampling of the object during the training phase. We introduce here a method to instead generalize tactile features across different orientations. This method is applied to the TacTip v2, a three-dimensional printed optical tactile sensor with internal pins acting as taxels arranged with a 12-fold rotational symmetry. By rotating a small sample of tactile images, we are able to generalize tactile stimuli to new orientations. The method was validated across several tactile stimuli on an edge orientation classification task. Data were then generalized for a combination of orientations and locations of one of these stimuli, and this dataset was used as the basis for an exploratory control task: contour following around a circular disk. The generalization method leads to a strong reduction in the time needed to gather training data and only a moderate increase in classification error, and is particularly suited for multidimensional tactile data sampling in complex tasks such as tactile manipulation. We expect the method to generalize well to other tactile stimuli.

[1]  Nathan F. Lepora,et al.  Active touch for robust perception under position uncertainty , 2013, 2013 IEEE International Conference on Robotics and Automation.

[2]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Jonathan Rossiter,et al.  Development of a tactile sensor based on biologically inspired edge encoding , 2009, 2009 International Conference on Advanced Robotics.

[4]  Gregory D. Hager,et al.  Tactile-Object Recognition From Appearance Information , 2011, IEEE Transactions on Robotics.

[5]  Nathan F. Lepora,et al.  Tactile Manipulation With a TacThumb Integrated on the Open-Hand M2 Gripper , 2016, IEEE Robotics and Automation Letters.

[6]  Nathan F. Lepora,et al.  Active Bayesian Perception for Simultaneous Object Localization and Identification , 2013, Robotics: Science and Systems.

[7]  Nathan F. Lepora,et al.  Brain-inspired Bayesian perception for biomimetic robot touch , 2012, 2012 IEEE International Conference on Robotics and Automation.

[8]  Jonathan Rossiter,et al.  TACTIP — Tactile fingertip device, challenges in reduction of size to ready for robot hand integration , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[9]  Chris Melhuish,et al.  Seeing by Touch: Evaluation of a Soft Biologically-Inspired Artificial Fingertip in Real-Time Active Touch , 2014, Sensors.

[10]  Justin A. Harris,et al.  The Topography of Tactile Learning in Humans , 2001, The Journal of Neuroscience.

[11]  Robin Andrew Russell,et al.  Object recognition by a 'smart' tactile sensor , 2000 .

[12]  Wolfram Burgard,et al.  Object identification with tactile sensors using bag-of-features , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Amit Konar,et al.  Object-shape recognition from tactile images using a feed-forward neural network , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[14]  Nancy Byl,et al.  Practice-Related Improvements in Somatosensory Interval Discrimination Are Temporally Specific But Generalize across Skin Location, Hemisphere, and Modality , 1998, The Journal of Neuroscience.

[15]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[16]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[17]  Kaspar Althoefer,et al.  Rotation and translation invariant object recognition with a tactile sensor , 2014, IEEE SENSORS 2014 Proceedings.

[18]  Giorgio Metta,et al.  Active contour following to explore object shape with robot touch , 2013, 2013 World Haptics Conference (WHC).

[19]  Giorgio Metta,et al.  Tactile Superresolution and Biomimetic Hyperacuity , 2015, IEEE Transactions on Robotics.

[20]  Edward H. Adelson,et al.  Sensing and Recognizing Surface Textures Using a GelSight Sensor , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Maurizio Valle,et al.  The ROBOSKIN Project: Challenges and Results , 2013 .

[22]  Nathan F. Lepora,et al.  Superresolution with an optical tactile sensor , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Gunther Heidemann,et al.  Dynamic tactile sensing for object identification , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.