Artificial skin through super-sensing method and electrical impedance data from conductive fabric with aid of deep learning

Sense of touch is a major part of man’s communication with their environment. Artificial skins can help robots to have the same sense of touch, especially for their social interactions. This paper presents a pressure mapping sensing using piezo-resistive fabric to represent aspects of the sense of touch. In past few years’ electrical impedance tomography (EIT) is considered to be able offer a good alternative for artificial skin in particular for its ease of adaptation for large area skin compared to individual matrix based sensors. The EIT has also very good temporal performance in data collection allowing for monitoring of fast responses to touch stimulation, enabling a truly real time touch sensing. Electromechanical responses of a conductive fabric can be exploited using EIT to create a low cost and large area touch sensing. Such electromechanical properties are often very complex, so to improve the imaging resolution and touch visibility an artificial intelligent (AI) was used in addition to the state of the art spatio-temporal imaging algorithm. This work demonstrates a step towards an integrated seamless skin with large area sensing in dynamical settings, closer to natural human skin’s behaviour. For the first time a dynamical touch sensing are studies by means of a spatio-temporal based electrical impedance tomography (EIT) imaging on a conductive fabric. The experimental results demonstrated the successful results by a combined AI with dynamical EIT imaging results in single and multiple points of touch.

[1]  Y. Kato,et al.  Tactile Sensor without Wire and Sensing Element in the Tactile Region Based on EIT Method , 2007, 2007 IEEE Sensors.

[2]  Sungchul Kang,et al.  Development of Anthropomorphic Robot Hand with Tactile Sensor : SKKU Hand II , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Bo Chen,et al.  Electrical Resistance Tomography for Visualization of Moving Objects Using a Spatiotemporal Total Variation Regularization Algorithm , 2018, Sensors.

[4]  Andy Adler,et al.  In Vivo Impedance Imaging With Total Variation Regularization , 2010, IEEE Transactions on Medical Imaging.

[5]  E. Somersalo,et al.  Existence and uniqueness for electrode models for electric current computed tomography , 1992 .

[6]  Giorgio Metta,et al.  Methods and Technologies for the Implementation of Large-Scale Robot Tactile Sensors , 2011, IEEE Transactions on Robotics.

[7]  M. Soleimani,et al.  A pressure mapping imaging device based on electrical impedance tomography of conductive fabrics , 2012 .

[8]  L M Heikkinen,et al.  A MATLAB package for the EIDORS project to reconstruct two-dimensional EIT images , 2001, Physiological measurement.

[9]  Octavian Postolache,et al.  Tactile Sensors for Robotic Applications , 2013 .

[10]  Yasuo Kuniyoshi,et al.  Conformable and scalable tactile sensor skin for curved surfaces , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[11]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[12]  B. Brown,et al.  Recent Developments in Applied Potential Tomography-APT , 1986 .

[13]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[14]  A. Cheng,et al.  Heritage and early history of the boundary element method , 2005 .

[15]  Manuel Desco,et al.  Application of the compressed sensing technique to self‐gated cardiac cine sequences in small animals , 2014, Magnetic resonance in medicine.

[16]  Jin Keun Seo,et al.  EIT-Based Fabric Pressure Sensing , 2013, Comput. Math. Methods Medicine.

[17]  Yasuo Kuniyoshi,et al.  A tactile distribution sensor which enables stable measurement under high and dynamic stretch , 2009, 2009 IEEE Symposium on 3D User Interfaces.

[18]  J. Lima,et al.  A large area force sensor for smart skin applications , 2002, Proceedings of IEEE Sensors.

[19]  B. Brandstatter,et al.  Jacobian calculation for electrical impedance tomography based on the reciprocity principle , 2003 .

[20]  H. Worn,et al.  The working principle of resistive tactile sensor cells , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[21]  B H Brown,et al.  Electrical impedance tomography (EIT): a review , 2003, Journal of medical engineering & technology.

[22]  Manuchehr Soleimani,et al.  Electrical Impedance Tomography for Artificial Sensitive Robotic Skin: A Review , 2015, IEEE Sensors Journal.

[23]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[24]  Lee Sang-Hun,et al.  Development of Anthropomorphic Robot Hand with Tactile Sensor: SKKU Hand II , 2006 .

[25]  Per Christian Hansen,et al.  Analysis of Discrete Ill-Posed Problems by Means of the L-Curve , 1992, SIAM Rev..

[26]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[27]  Yasuo Kuniyoshi,et al.  A deformable and deformation sensitive tactile distribution sensor , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).