Magnetic-based Soft Tactile Sensors with Deformable Continuous Force Transfer Medium for Resolving Contact Locations in Robotic Grasping and Manipulation

The resolution of contact location is important in many applications in robotics and automation. This is generally done by using an array of contact or tactile receptors, which increases cost and complexity as the required resolution or area is increased. Tactile sensors have also been developed using a continuous deformable medium between the contact and the receptors, which allows few receptors to interpolate the information among them, avoiding the weakness highlighted in the former approach. The latter is generally used to measure contact force intensity or magnitude but rarely used to identify the contact locations. This paper presents a systematic design and characterisation procedure for magnetic-based soft tactile sensors (utilizing the latter approach with the deformable contact medium) with the goal of locating the contact force location. This systematic procedure provides conditions under which design parameters can be selected, supported by a selected machine learning algorithm, to achieve the desired performance of the tactile sensor in identifying the contact location. An illustrative example, which combines a particular sensor configuration (magnetic hall effect sensor as the receptor, a selected continuous medium and a selected sensing resolution) and a specific data-driven algorithm, is used to illustrate the proposed design procedure. The results of the illustrative example design demonstrates the efficacy of the proposed design procedure and the proposed sensing strategy in identifying a contact location. The resulting sensor is also tested on a robotic hand (Allegro Hand, SimLab Co) to demonstrate its application in real-world scenarios.

[1]  Alessandro Tognetti,et al.  Touch Position Detection in Electrical Tomography Tactile Sensors Through Quadratic Classifier , 2019, IEEE Sensors Journal.

[2]  Bernard Roth,et al.  Analysis of Multifingered Hands , 1986 .

[3]  Hideki Hashimoto,et al.  Dextrous hand grasping force optimization , 1996, IEEE Trans. Robotics Autom..

[4]  Denny Oetomo,et al.  X-Limb: A Soft Prosthetic Hand with User-Friendly Interface , 2018, Converging Clinical and Engineering Research on Neurorehabilitation III.

[5]  Shigeki Sugano,et al.  Design and Characterization of a Three-Axis Hall Effect-Based Soft Skin Sensor , 2016, Sensors.

[6]  Tetsuyou Watanabe,et al.  Grasp Input Optimization Taking Contact Position and Object Information Uncertainties into Consideration , 2012, IEEE Transactions on Robotics.

[7]  Chris Manzie,et al.  Tactile-Based Blind Grasping: A Discrete-Time Object Manipulation Controller for Robotic Hands , 2018, IEEE Robotics and Automation Letters.

[8]  Jonathan Rossiter,et al.  TACTIP — Tactile fingertip device, challenges in reduction of size to ready for robot hand integration , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[9]  Véronique Perdereau,et al.  Tactile sensing in dexterous robot hands - Review , 2015, Robotics Auton. Syst..

[10]  Hongbo Wang,et al.  Design Methodology for Magnetic Field-Based Soft Tri-Axis Tactile Sensors , 2016, Sensors.

[11]  Cagdas D. Onal,et al.  Design, Modeling, and Validation of a Soft Magnetic 3-D Force Sensor , 2018, IEEE Sensors Journal.

[12]  Matteo Bianchi,et al.  The SoftHand Pro: Functional evaluation of a novel, flexible, and robust myoelectric prosthesis , 2018, PloS one.

[13]  Ryo Kurazume,et al.  Dynamic grasping for an arbitrary polyhedral object by a multi-fingered hand-arm system , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Mark R. Cutkosky,et al.  Comparison of contact sensor localization abilities during manipulation , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[15]  Massimo Totaro,et al.  Toward Perceptive Soft Robots: Progress and Challenges , 2018, Advanced science.

[16]  I. Shimoyama,et al.  MEMS on robot applications , 2009, TRANSDUCERS 2009 - 2009 International Solid-State Sensors, Actuators and Microsystems Conference.

[17]  Jonathan Rossiter,et al.  The TacTip Family: Soft Optical Tactile Sensors with 3D-Printed Biomimetic Morphologies , 2018, Soft robotics.

[18]  Chris Manzie,et al.  Control Barrier Functions for Mechanical Systems: Theory and Application to Robotic Grasping , 2019, IEEE Transactions on Control Systems Technology.

[19]  Chris Manzie,et al.  Robust object manipulation for tactile-based blind grasping , 2017, Control Engineering Practice.

[20]  Shigeki Sugano,et al.  A New Silicone Structure for uSkin—A Soft, Distributed, Digital 3-Axis Skin Sensor and Its Integration on the Humanoid Robot iCub , 2018, IEEE Robotics and Automation Letters.

[21]  Heinz Wörn,et al.  Development of a flexible tactile sensor system for a humanoid robot , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[22]  Takayuki Okatani,et al.  Sensing method of total-internal-reflection-based tactile sensor , 2011, 2011 IEEE World Haptics Conference.

[23]  Yong Xu,et al.  A novel intelligent textile technology based on silicon flexible skins , 2005, 2007 IEEE 20th International Conference on Micro Electro Mechanical Systems (MEMS).

[24]  Gaurav S. Sukhatme,et al.  Contact localization on grasped objects using tactile sensing , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Tetsuya Ogata,et al.  Morphology-Specific Convolutional Neural Networks for Tactile Object Recognition with a Multi-Fingered Hand , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[26]  Jorge Angeles,et al.  Real-time force optimization in parallel kinematic chains under inequality constraints , 1992, IEEE Trans. Robotics Autom..

[27]  Denny Oetomo,et al.  Unilateral Manipulability Quality Indices: Generalized Manipulability Measures for Unilaterally Actuated Robots , 2019, Journal of Mechanical Design.