Smart electronic skin having gesture recognition function by LSTM neural network

Rapid growth of soft electronics has enabled various approaches for developing artificial skin. However, currently existing electronic skin is still facing some problems such as high fabrication complexity, high production cost, and smartness of recognizing the stimulus automatically. In this work, we report a simple, low-cost Polydimethylsiloxane (PDMS)-based smart electronic skin system, consisting of a sensor array and a data processing system. The sensor array can be easily mounted on the human body or robot hand as a result of excellent softness, stretchability, and bendability of PDMS. Signals from the sensor array are processed by a Long and Short Term Memory neural network algorithm in the data processing system. The trained data processing system can recognize four types of gestures at an accuracy of 85 ± 5%, even taking into account environmental variations including folding, curvature, tensile strength, temperature, and endurance cycles. This work proves that this type of skin can be endowed with intelligence with a proper neural network algorithm and fabricated at low cost and reduced complexity.

[1]  Zhenan Bao,et al.  Pursuing prosthetic electronic skin. , 2016, Nature materials.

[2]  Sarah Bergbreiter,et al.  Effect of finger geometries on strain response of interdigitated capacitor based soft strain sensors , 2018 .

[3]  Halbert White,et al.  Learning in Artificial Neural Networks: A Statistical Perspective , 1989, Neural Computation.

[4]  Gordon Cheng,et al.  New materials and advances in making electronic skin for interactive robots , 2015, Adv. Robotics.

[5]  Ranran Wang,et al.  Stretchable electronic skin based on silver nanowire composite fiber electrodes for sensing pressure, proximity, and multidirectional strain. , 2017, Nanoscale.

[6]  Fabian J Theis,et al.  Prospective identification of hematopoietic lineage choice by deep learning , 2017, Nature Methods.

[7]  Lili Wang,et al.  An ultra-sensitive and rapid response speed graphene pressure sensors for electronic skin and health monitoring , 2016 .

[8]  Igor Aleksander,et al.  Building machines more like humans , 2002, Nature.

[9]  M. Sitti,et al.  Untethered micro-robotic coding of three-dimensional material composition , 2014, Nature Communications.

[10]  Andrew G. Gillies,et al.  Nanowire active-matrix circuitry for low-voltage macroscale artificial skin. , 2010, Nature materials.

[11]  Byeong Kwon Ju,et al.  The vertically stacked organic sensor-transistor on a flexible substrate , 2010 .

[12]  Benjamin C. K. Tee,et al.  An electrically and mechanically self-healing composite with pressure- and flexion-sensitive properties for electronic skin applications. , 2012, Nature nanotechnology.

[13]  Zhenan Bao,et al.  A chameleon-inspired stretchable electronic skin with interactive colour changing controlled by tactile sensing , 2015, Nature Communications.

[14]  Sanlin S. Robinson,et al.  Highly stretchable electroluminescent skin for optical signaling and tactile sensing , 2016, Science.

[15]  Christian Antfolk,et al.  Sensory feedback in upper limb prosthetics , 2013, Expert review of medical devices.

[16]  Liang Gao,et al.  Wearable and sensitive heart-rate detectors based on PbS quantum dot and multiwalled carbon nanotube blend film , 2014 .

[17]  Haopeng Wang,et al.  Development of a conformable electronic skin based on silver nanowires and PDMS , 2017 .

[18]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[19]  Xiaodong Zhu,et al.  Flexible strain sensors with high performance based on metallic glass thin film , 2017 .

[20]  Bernd Klosterhalfen,et al.  Introduction of a Flexible Polymeric Heart Valve Prosthesis With Special Design for Mitral Position , 2003, Circulation.

[21]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[22]  Hiroshi Toshiyoshi,et al.  A pressure sensitive ionic gel FET for tactile sensing , 2017 .

[23]  Namsoo Shin,et al.  An extremely simple macroscale electronic skin realized by deep machine learning , 2017, Scientific Reports.

[24]  Jidong Shi,et al.  Tactile Sensing System Based on Arrays of Graphene Woven Microfabrics: Electromechanical Behavior and Electronic Skin Application. , 2015, ACS nano.