Pose-Based Tactile Servoing: Controlled Soft Touch Using Deep Learning

This article describes a new way of controlling robots using soft tactile sensors: pose-based tactile servo (PBTS) control. The basic idea is to embed a tactile perception model for estimating the sensor pose within a servo control loop that is applied to local object features, such as edges and surfaces. PBTS control is implemented with a soft, curved optical tactile sensor [the Bristol Robotics Laboratory (BRL) TacTip] using a convolutional neural network trained to be insensitive to shear. As a consequence, robust and accurate controlled motion over various complex 3D objects is attained.

[1]  Pradeep K. Khosla,et al.  Using Tactile Data for Real- Time Feedback , 1989, International Symposium on Experimental Robotics.

[2]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[3]  Nathan F. Lepora,et al.  A Robust Controller for Stable 3D Pinching Using Tactile Sensing , 2021, IEEE Robotics and Automation Letters.

[4]  Leon D. Harmon,et al.  Automated Tactile Sensing , 1982 .

[5]  Hong Zhang,et al.  Control of contact via tactile sensing , 2000, IEEE Trans. Robotics Autom..

[6]  Nathan F. Lepora,et al.  Optimal Deep Learning for Robot Touch: Training Accurate Pose Models of 3D Surfaces and Edges , 2020, IEEE Robotics & Automation Magazine.

[7]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[8]  Véronique Perdereau,et al.  Touch driven controller and tactile features for physical interactions , 2020, Robotics Auton. Syst..

[9]  Nathan F. Lepora,et al.  Soft Biomimetic Optical Tactile Sensing With the TacTip: A Review , 2021, IEEE Sensors Journal.

[10]  Jonathan Rossiter,et al.  Development of a tactile sensor based on biologically inspired edge encoding , 2009, 2009 International Conference on Advanced Robotics.

[11]  Rs Roel Pieters,et al.  Visual Servo Control , 2012 .

[12]  William J. Wilson,et al.  Relative end-effector control using Cartesian position based visual servoing , 1996, IEEE Trans. Robotics Autom..

[13]  Kaspar Althoefer,et al.  Finger contact sensing and the application in dexterous hand manipulation , 2015, Autonomous Robots.

[14]  Nathan F. Lepora,et al.  Exploratory Tactile Servoing With Active Touch , 2017, IEEE Robotics and Automation Letters.

[15]  Ning Chen,et al.  Edge tracking using tactile servo , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[16]  Raia Hadsell,et al.  From Pixels to Percepts: Highly Robust Edge Perception and Contour Following Using Deep Learning and an Optical Biomimetic Tactile Sensor , 2018, IEEE Robotics and Automation Letters.

[17]  Giorgio Metta,et al.  Active contour following to explore object shape with robot touch , 2013, 2013 World Haptics Conference (WHC).

[18]  Marc Toussaint,et al.  Active Multi-Contact Continuous Tactile Exploration with Gaussian Process Differential Entropy , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[19]  Nathan F. Lepora,et al.  Slip detection for grasp stabilisation with a multi-fingered tactile robot hand , 2020, ArXiv.

[20]  N. Lepora,et al.  Goal-Driven Robotic Pushing Using Tactile and Proprioceptive Feedback , 2020, IEEE Transactions on Robotics.

[21]  Tony J. Dodd,et al.  Active sensorimotor control for tactile exploration , 2017, Robotics Auton. Syst..

[22]  Jonathan Rossiter,et al.  The TacTip Family: Soft Optical Tactile Sensors with 3D-Printed Biomimetic Morphologies , 2018, Soft robotics.

[23]  Steve Sutphen,et al.  Tactile Servo: Control of Touch-Driven Robot Motion , 1993, ISER.

[24]  J. S. Son,et al.  Tactile sensing and stiffness control with multifingered hands , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[25]  Helge J. Ritter,et al.  A Control Framework for Tactile Servoing , 2013, Robotics: Science and Systems.

[26]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[27]  Nathan F. Lepora,et al.  Shear-invariant Sliding Contact Perception with a Soft Tactile Sensor , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[28]  Claudio Zito,et al.  GPAtlasRRT: A Local Tactile Exploration Planner for Recovering the Shape of Novel Objects , 2018, Int. J. Humanoid Robotics.

[29]  John Kenneth Salisbury,et al.  Contact Sensing from Force Measurements , 1990, Int. J. Robotics Res..