Fingerprint‐Enhanced Capacitive‐Piezoelectric Flexible Sensing Skin to Discriminate Static and Dynamic Tactile Stimuli

Inspired by the structure and functions of the human skin, a highly sensitive capacitive‐piezoelectric flexible sensing skin with fingerprint‐like patterns to detect and discriminate between spatiotemporal tactile stimuli including static and dynamic pressures and textures is presented. The capacitive‐piezoelectric tandem sensing structure is embedded in the phalange of a 3D‐printed robotic hand, and a tempotron classifier system is used for tactile exploration. The dynamic tactile sensor, interfaced with an extended gate configuration to a common source metal oxide semiconductor field effect transistor (MOSFET), exhibits a sensitivity of 2.28 kPa−1. The capacitive sensing structure has nonlinear characteristics with sensitivity varying from 0.25 kPa−1 in the low‐pressure range (<100 Pa) to 0.002 kPa−1 in high pressure (≈2.5 kPa). The output from the presented sensor under a closed‐loop tactile scan, carried out with an industrial robotic arm, is used as latency‐coded spike trains in a spiking neural network (SNN) tempotron classifier system. With the capability of performing a real‐time binary naturalistic texture classification with a maximum accuracy of 99.45%, the presented bioinspired skin finds applications in robotics, prosthesis, wearable sensors, and medical devices.

[1]  C. Keplinger,et al.  25th Anniversary Article: A Soft Future: From Robots and Sensor Skin to Energy Harvesters , 2013, Advanced materials.

[2]  Yi Zhengkun,et al.  Recognizing tactile surface roughness with a biomimetic fingertip: A soft neuromorphic approach , 2017 .

[3]  R. Johansson,et al.  Tactile Sensory Control of Object Manipulation in Humans , 2020, The Senses: A Comprehensive Reference.

[4]  H. Sompolinsky,et al.  The tempotron: a neuron that learns spike timing–based decisions , 2006, Nature Neuroscience.

[5]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[6]  Zhenan Bao,et al.  A bioinspired flexible organic artificial afferent nerve , 2018, Science.

[7]  Jonghwa Park,et al.  Fingertip skin–inspired microstructured ferroelectric skins discriminate static/dynamic pressure and temperature stimuli , 2015, Science Advances.

[8]  Ravinder Dahiya,et al.  Energy autonomous electronic skin , 2019, npj Flexible Electronics.

[9]  Hynek Hermansky,et al.  Automatic Speech Recognition: an Auditory Perspective , 2004 .

[10]  Ravinder Dahiya,et al.  Wafer Scale Transfer of Ultrathin Silicon Chips on Flexible Substrates for High Performance Bendable Systems , 2018 .

[11]  B. Berglund,et al.  Feeling Small: Exploring the Tactile Perception Limits , 2013, Scientific Reports.

[12]  G. Metta,et al.  Towards Tactile Sensing System on Chip for Robotic Applications , 2011, IEEE Sensors Journal.

[13]  Gordon Cheng,et al.  New materials and advances in making electronic skin for interactive robots , 2015, Adv. Robotics.

[14]  Ravinder Dahiya,et al.  E-Skin: From Humanoids to Humans , 2019, Proc. IEEE.

[15]  Alberto Mazzoni,et al.  Neuromorphic Artificial Touch for Categorization of Naturalistic Textures , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[16]  R. Dahiya,et al.  Transforming the short-term sensing stimuli to long-term e-skin memory , 2017, 2017 IEEE SENSORS.

[17]  Ravinder Dahiya,et al.  Ultra-thin chips for high-performance flexible electronics , 2018, npj Flexible Electronics.

[18]  Nitish V. Thakor,et al.  Discrimination of Dynamic Tactile Contact by Temporally Precise Event Sensing in Spiking Neuromorphic Networks , 2017, Front. Neurosci..

[19]  Qing Wan,et al.  Proton‐Conducting Graphene Oxide‐Coupled Neuron Transistors for Brain‐Inspired Cognitive Systems , 2015, Advanced materials.

[20]  E. O. Polat,et al.  Energy‐Autonomous, Flexible, and Transparent Tactile Skin , 2017 .

[21]  Charles F Stevens Preserving properties of object shape by computations in primary visual cortex. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Ravinder Dahiya,et al.  Graphene–Graphite Polyurethane Composite Based High‐Energy Density Flexible Supercapacitors , 2019, Advanced science.

[23]  Ravinder Dahiya,et al.  Prosthetic Hand with Biomimetic Tactile Sensing and Force Feedback , 2019, 2019 IEEE International Symposium on Circuits and Systems (ISCAS).

[24]  J. F. Dammann,et al.  Temporal Frequency Channels Are Linked across Audition and Touch , 2009, Current Biology.

[25]  Ravinder Dahiya,et al.  Heterogeneous integration of contact-printed semiconductor nanowires for high-performance devices on large areas , 2018, Microsystems & Nanoengineering.

[26]  Jonghwa Park,et al.  Flexible Ferroelectric Sensors with Ultrahigh Pressure Sensitivity and Linear Response over Exceptionally Broad Pressure Range. , 2018, ACS nano.

[27]  Powen Ru,et al.  Multiresolution spectrotemporal analysis of complex sounds. , 2005, The Journal of the Acoustical Society of America.

[28]  Allister F. McGuire,et al.  A skin-inspired organic digital mechanoreceptor , 2015, Science.

[29]  L. Lorenzelli,et al.  Piezoelectric graphene field effect transistor pressure sensors for tactile sensing , 2018, Applied Physics Letters.

[30]  R. Johansson,et al.  First spikes in ensembles of human tactile afferents code complex spatial fingertip events , 2004, Nature Neuroscience.

[31]  Benjamin C. K. Tee,et al.  25th Anniversary Article: The Evolution of Electronic Skin (E‐Skin): A Brief History, Design Considerations, and Recent Progress , 2013, Advanced materials.

[32]  Yonggang Huang,et al.  Conformable amplified lead zirconate titanate sensors with enhanced piezoelectric response for cutaneous pressure monitoring , 2014, Nature Communications.

[33]  Nitish V. Thakor,et al.  An Extreme Learning Machine-Based Neuromorphic Tactile Sensing System for Texture Recognition , 2018, IEEE Transactions on Biomedical Circuits and Systems.

[34]  Angelika Peer,et al.  Human-Inspired Neurorobotic System for Classifying Surface Textures by Touch , 2016, IEEE Robotics and Automation Letters.

[35]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[36]  M. Hollins,et al.  Evidence for the duplex theory of tactile texture perception , 2000, Perception & psychophysics.

[37]  E. Adrian,et al.  The impulses produced by sensory nerve endings , 1926, The Journal of physiology.

[38]  Gordon Cheng,et al.  Directions Toward Effective Utilization of Tactile Skin: A Review , 2013, IEEE Sensors Journal.

[39]  Monica Gori,et al.  Probing with and into fingerprints. , 2010, Journal of neurophysiology.

[40]  G. Debrégeas,et al.  The Role of Fingerprints in the Coding of Tactile Information Probed with a Biomimetic Sensor , 2009, Science.

[41]  Benjamin C. K. Tee,et al.  Highly sensitive flexible pressure sensors with microstructured rubber dielectric layers. , 2010, Nature materials.

[42]  Nitish V. Thakor,et al.  Prosthesis with neuromorphic multilayered e-dermis perceives touch and pain , 2018, Science Robotics.

[43]  R. Dahiya,et al.  Multifunctional sensor based on organic field-effect transistor and ferroelectric poly(vinylidene fluoride trifluoroethylene) , 2018 .

[44]  Fabrice Labeau,et al.  Nanowire FET Based Neural Element for Robotic Tactile Sensing Skin , 2017, Front. Neurosci..

[45]  Taejin Jung,et al.  Development of the Humanoid Disaster Response Platform DRC-HUBO+ , 2018, IEEE Transactions on Robotics.

[46]  Ravinder Dahiya,et al.  Robotic Tactile Perception of Object Properties: A Review , 2017, ArXiv.

[47]  Hadi Heidari,et al.  Multisensory Smart Glove for Tactile Feedback in Prosthetic Hand , 2016 .

[48]  M. Acree Is there a gender difference in fingerprint ridge density? , 1999, Forensic science international.

[49]  Maurizio Valle,et al.  Spike-Based Readout of POSFET Tactile Sensors , 2017, IEEE Transactions on Circuits and Systems I: Regular Papers.