Contact Localization and Force Estimation of Soft Tactile Sensors Using Artificial Intelligence

Soft artificial skin sensors that can detect contact forces as well as their locations are attractive in various soft robotics applications. However, soft sensors made of polymer materials have inherent limitations of hysteresis and nonlinearity in response, which makes it highly difficult to implement traditional calibration techniques and yields poor estimation performance. In this paper, we propose intelligent algorithms based on machine learning and logics that can improve the performance of soft sensors. The proposed methods in this paper could be solutions to the aforementioned long-standing problems. They can also be used to simplify the system complexity by reducing the number of signal wires. Three machine learning techniques are discussed in this paper: an artificial neural network (ANN), the k-nearest neighbors (k-NN) algorithm, and a recurrent neural network (RNN). The Preisach model of hysteresis and simple logics were used to support these algorithms. We proved that classifying contact locations on a soft sensor is possible using simple algorithms in real time. Also, force estimation of a single contact was possible using an ANN with the Preisach method. Finally, we successfully estimated forces of multiple contact locations by predicting the outputs of mixed RNN results.

[1]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[2]  Yong-Lae Park,et al.  Design and Fabrication of Soft Artificial Skin Using Embedded Microchannels and Liquid Conductors , 2012, IEEE Sensors Journal.

[3]  Yo Kato,et al.  Tactile Sensor Without Wire and Sensing Element in the Tactile Region Using New Rubber Material , 2008 .

[4]  Jerome J. Connor,et al.  Soft capacitive sensor for structural health monitoring of large‐scale systems , 2012 .

[5]  Rebecca K. Kramer,et al.  Hyperelastic pressure sensing with a liquid-embedded elastomer , 2010 .

[6]  Clément Gosselin,et al.  Characterization of the electrical resistance of carbon-black-filled silicone: Application to a flexible and stretchable robot skin , 2010, 2010 IEEE International Conference on Robotics and Automation.

[7]  Daniel M. Vogt,et al.  Capacitive Soft Strain Sensors via Multicore–Shell Fiber Printing , 2015, Advanced materials.

[8]  Saeed Bagheri Shouraki,et al.  Hysteresis Nonlinearity Identification Using New Preisach Model-Based Artificial Neural Network Approach , 2011, J. Appl. Math..

[9]  Carmel Majidi,et al.  Enhanced performance of microfluidic soft pressure sensors with embedded solid microspheres , 2016 .

[10]  Yasuo Kuniyoshi,et al.  A deformable and deformation sensitive tactile distribution sensor , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[11]  Kaspar Althoefer,et al.  Soft and Stretchable Sensor Using Biocompatible Electrodes and Liquid for Medical Applications , 2015, Soft robotics.

[12]  Jan Tommy Gravdahl,et al.  On Implementation of the Preisach Model Identification and Inversion for Hysteresis Compensation , 2015 .

[13]  Andrew G. Gillies,et al.  Nanowire active-matrix circuitry for low-voltage macroscale artificial skin. , 2010, Nature materials.

[14]  Robert J. Wood,et al.  Influence of cross-sectional geometry on the sensitivity and hysteresis of liquid-phase electronic pressure sensors , 2012 .

[15]  Vincent Duchaine,et al.  Soft Tactile Skin Using an Embedded Ionic Liquid and Tomographic Imaging , 2015 .

[16]  Robert J. Wood,et al.  Wearable tactile keypad with stretchable artificial skin , 2011, 2011 IEEE International Conference on Robotics and Automation.

[17]  Sungho Jo,et al.  Use of Deep Learning for Characterization of Microfluidic Soft Sensors , 2018, IEEE Robotics and Automation Letters.