Wearable Triboelectric-Human-Machine-Interface (THMI) Using Robust Nanophotonic Readout.

With the rapid advances in wearable electronics and photonics, self-sustainable wearable systems are desired to increase service life and reduce maintenance frequency. Triboelectric technology stands out as a promising versatile technology due to its flexibility, self-sustainability, broad material availability, low-cost, and good scalability. Various triboelectric-human-machine-interfaces (THMIs) have been developed including interactive gloves, eye blinking/body motion triggered interfaces, voice/breath monitors, and self-induced wireless interfaces. Nonetheless, THMIs conventionally use electrical readout and produce pulse-like signals due to the transient charge flows, leading to unstable and lossy transfer of interaction information. To address this issue, we propose a strategy by equipping THMIs with robust nanophotonic aluminum nitride (AlN) modulators for readout. The electrically capacitive nature of AlN modulators enable THMIs to work in the open-circuit condition with negligible charge flows. Meanwhile, the interaction information is transduced from THMIs' voltage to AlN modulators' optical output via the electro-optic Pockels effect. Thanks to the negligible charge flow and the high-speed optical information carrier, stable, information-lossless, and real-time THMIs are achieved. Leveraging the design flexibility of THMIs and nanophotonic readout circuits, various linear sensitivities independent of force speeds are achieved in different interaction force ranges. Toward practical applications, we develop a smart glove to realize continuous real-time robotics control and virtual/augmented reality interaction. Our work demonstrates a generic approach for developing self-sustainable HMIs with stable, information-lossless, and real-time features for wearable systems.

[1]  Wojciech Matusik,et al.  Learning the signatures of the human grasp using a scalable tactile glove , 2019, Nature.

[2]  Joon-Kyu Han,et al.  Self-powered wearable keyboard with fabric based triboelectric nanogenerator , 2018, Nano Energy.

[3]  Zhibin Yu,et al.  User-interactive electronic skin for instantaneous pressure visualization. , 2013, Nature materials.

[4]  Hyeonhee Roh,et al.  Willow-like portable triboelectric respiration sensor based on polyethylenimine-assisted CO2 capture , 2019, Nano Energy.

[5]  Dong Hyun Kim,et al.  Nanopillar-array architectured PDMS-based triboelectric nanogenerator integrated with a windmill model for effective wind energy harvesting , 2017 .

[6]  Jin-Woo Han,et al.  Ferrofluid-based triboelectric-electromagnetic hybrid generator for sensitive and sustainable vibration energy harvesting , 2017 .

[7]  Chengkuo Lee,et al.  Machine Learning Glove Using Self‐Powered Conductive Superhydrophobic Triboelectric Textile for Gesture Recognition in VR/AR Applications , 2020, Advanced science.

[8]  Qiongfeng Shi,et al.  Self-powered glove-based intuitive interface for diversified control applications in real/cyber space , 2019, Nano Energy.

[9]  Qiongfeng Shi,et al.  Self‐Sustainable Wearable Textile Nano‐Energy Nano‐System (NENS) for Next‐Generation Healthcare Applications , 2019, Advanced science.

[10]  Dechun Zou,et al.  Wearable Power‐Textiles by Integrating Fabric Triboelectric Nanogenerators and Fiber‐Shaped Dye‐Sensitized Solar Cells , 2016 .

[11]  Yue Wang,et al.  Highly Elastic Organic Crystals for Flexible Optical Waveguides. , 2018, Angewandte Chemie.

[12]  Haiyang Zou,et al.  A Highly Stretchable and Washable All-Yarn-Based Self-Charging Knitting Power Textile Composed of Fiber Triboelectric Nanogenerators and Supercapacitors. , 2017, ACS nano.

[13]  Chang Bao Han,et al.  Tribotronic Phototransistor for Enhanced Photodetection and Hybrid Energy Harvesting , 2016 .

[14]  Ning Wang,et al.  Energy harvesting and wireless power transmission by a hybridized electromagnetic–triboelectric nanogenerator , 2019, Energy & Environmental Science.

[15]  Zhou Li,et al.  Recent progress of nanogenerators acting as biomedical sensors in vivo. , 2019, Science bulletin.

[16]  Ali Javey,et al.  Wearable sweat sensors , 2018 .

[17]  Jie Chen,et al.  A highly sensitive, self-powered triboelectric auditory sensor for social robotics and hearing aids , 2018, Science Robotics.

[18]  Xiujian Chou,et al.  Highly skin-conformal wearable tactile sensor based on piezoelectric-enhanced triboelectric nanogenerator , 2019, Nano Energy.

[19]  C. R. Giles,et al.  Transient gain and cross talk in erbium-doped fiber amplifiers. , 1989, Optics letters.

[20]  Zhong Lin Wang,et al.  Keystroke Dynamics Identification Based on Triboelectric Nanogenerator for Intelligent Keyboard Using Deep Learning Method , 2018, Advanced Materials Technologies.

[21]  Wonjoon Choi,et al.  Rational Design for Optimizing Hybrid Thermo-triboelectric Generators Targeting Human Activities , 2019, ACS Energy Letters.

[22]  Xue Wang,et al.  Two voltages in contact-separation triboelectric nanogenerator: From asymmetry to symmetry for maximum output , 2020 .

[23]  Mehmet C. Öztürk,et al.  Review of wearable thermoelectric energy harvesting: From body temperature to electronic systems , 2020 .

[24]  Qiongfeng Shi,et al.  Self-powered multifunctional monitoring system using hybrid integrated triboelectric nanogenerators and piezoelectric microsensors , 2019, Nano Energy.

[25]  Youngoh Lee,et al.  Skin-Inspired Hierarchical Polymer Architectures with Gradient Stiffness for Spacer-Free, Ultrathin, and Highly Sensitive Triboelectric Sensors. , 2018, ACS nano.

[26]  Woon-Ha Yoon,et al.  A high output magneto-mechano-triboelectric generator enabled by accelerated water-soluble nano-bullets for powering a wireless indoor positioning system , 2019, Energy & Environmental Science.

[27]  Sung Kyun Kim,et al.  Shape memory polymer-based self-healing triboelectric nanogenerator , 2015 .

[28]  Jihoon Chung,et al.  Ion‐Enhanced Field Emission Triboelectric Nanogenerator , 2019, Advanced Energy Materials.

[29]  Jianjun Luo,et al.  Recent advances in triboelectric nanogenerator based self-charging power systems , 2019, Energy Storage Materials.

[30]  Zhong Lin Wang,et al.  Progress in triboelectric nanogenerators as a new energy technology and self-powered sensors , 2015 .

[31]  Yang Zou,et al.  Body-Integrated Self-Powered System for Wearable and Implantable Applications. , 2019, ACS nano.

[32]  Sanlin S. Robinson,et al.  Highly stretchable electroluminescent skin for optical signaling and tactile sensing , 2016, Science.

[33]  Viktor Malyarchuk,et al.  Digital cameras with designs inspired by the arthropod eye , 2013, Nature.

[34]  Qiongfeng Shi,et al.  Self‐Powered Bio‐Inspired Spider‐Net‐Coding Interface Using Single‐Electrode Triboelectric Nanogenerator , 2019, Advanced science.

[35]  Yuanwen Jiang,et al.  A wireless body area sensor network based on stretchable passive tags , 2019, Nature Electronics.

[36]  Qiongfeng Shi,et al.  From flexible electronics technology in the era of IoT and artificial intelligence toward future implanted body sensor networks , 2019, APL Materials.

[37]  Chengkuo Lee,et al.  A rotational pendulum based electromagnetic/triboelectric hybrid-generator for ultra-low-frequency vibrations aiming at human motion and blue energy applications , 2019, Nano Energy.

[38]  Qifa Zhou,et al.  Monitoring of the central blood pressure waveform via a conformal ultrasonic device , 2018, Nature Biomedical Engineering.

[39]  Yang Zou,et al.  A bionic stretchable nanogenerator for underwater sensing and energy harvesting , 2019, Nature Communications.

[40]  Zhong Lin Wang,et al.  Eye motion triggered self-powered mechnosensational communication system using triboelectric nanogenerator , 2017, Science Advances.

[41]  Hengyu Guo,et al.  Triboelectric Nanogenerator: A Foundation of the Energy for the New Era , 2018, Advanced Energy Materials.

[42]  Chengkuo Lee,et al.  Triboelectric Self-Powered Wearable Flexible Patch as 3D Motion Control Interface for Robotic Manipulator. , 2018, ACS nano.

[43]  Chunkai Qiu,et al.  Self-powered control interface based on Gray code with hybrid triboelectric and photovoltaics energy harvesting for IoT smart home and access control applications , 2020, Nano Energy.

[44]  Hong-Joon Yoon,et al.  Transcutaneous ultrasound energy harvesting using capacitive triboelectric technology , 2019, Science.

[45]  Xuhui Sun,et al.  Liquid-Metal-Based Super-Stretchable and Structure-Designable Triboelectric Nanogenerator for Wearable Electronics. , 2018, ACS nano.

[46]  Tricia Breen Carmichael,et al.  Stretchable Ultrasheer Fabrics as Semitransparent Electrodes for Wearable Light-Emitting e-Textiles with Changeable Display Patterns , 2020 .

[47]  Haojie Wang,et al.  Low Detection Limit and High Sensitivity Wind Speed Sensor Based on Triboelectrification‐Induced Electroluminescence , 2019, Advanced science.

[48]  Qiongfeng Shi,et al.  More than energy harvesting – Combining triboelectric nanogenerator and flexible electronics technology for enabling novel micro-/nano-systems , 2019, Nano Energy.

[49]  Wei Gao,et al.  Wearable and flexible electronics for continuous molecular monitoring. , 2019, Chemical Society reviews.

[50]  Weidong Zhou,et al.  Flexible Transient Optical Waveguides and Surface‐Wave Biosensors Constructed from Monocrystalline Silicon , 2018, Advanced materials.

[51]  Xuhui Sun,et al.  Flexible Self-Powered Real-Time Ultraviolet Photodetector by Coupling Triboelectric and Photoelectric Effects. , 2020, ACS applied materials & interfaces.

[52]  Yang Zou,et al.  A Battery‐Like Self‐Charge Universal Module for Motional Energy Harvest , 2019, Advanced Energy Materials.

[53]  Hyunhyub Ko,et al.  Sewing machine stitching of polyvinylidene fluoride fibers: programmable textile patterns for wearable triboelectric sensors , 2018 .

[54]  Guofa Cai,et al.  Extremely stretchable and self-healing conductor based on thermoplastic elastomer for all-three-dimensional printed triboelectric nanogenerator , 2019, Nature Communications.

[55]  Zhenan Bao,et al.  A bioinspired flexible organic artificial afferent nerve , 2018, Science.

[56]  Jayoung Kim,et al.  Wearable biosensors for healthcare monitoring , 2019, Nature Biotechnology.

[57]  Zhong Lin Wang,et al.  Skin-inspired highly stretchable and conformable matrix networks for multifunctional sensing , 2018, Nature Communications.

[58]  David Vera Anaya,et al.  Self-powered eye motion sensor based on triboelectric interaction and near-field electrostatic induction for wearable assistive technologies , 2020, Nano Energy.

[59]  Andris Šutka,et al.  Inversely polarised ferroelectric polymer contact electrodes for triboelectric-like generators from identical materials , 2018 .

[60]  D. Meena,et al.  Mitigation of EDFA transient effects in variable duty cycle pulsed signals , 2019, Defence Technology.

[61]  Tao Jiang,et al.  Fully Packaged Self‐Powered Triboelectric Pressure Sensor Using Hemispheres‐Array , 2016 .

[62]  Lining Sun,et al.  Novel augmented reality interface using a self-powered triboelectric based virtual reality 3D-control sensor , 2018, Nano Energy.

[63]  D. Diao,et al.  Intelligently detecting and identifying liquids leakage combining triboelectric nanogenerator based self-powered sensor with machine learning , 2019, Nano Energy.

[64]  Qiongfeng Shi,et al.  Battery-free short-range self-powered wireless sensor network (SS-WSN) using TENG based direct sensory transmission (TDST) mechanism , 2020 .

[65]  Keren Dai,et al.  Self-powered gait pattern-based identity recognition by a soft and stretchable triboelectric band , 2019, Nano Energy.

[66]  Zhong Lin Wang,et al.  Conjuncted Pyro‐Piezoelectric Effect for Self‐Powered Simultaneous Temperature and Pressure Sensing , 2019, Advanced materials.

[67]  Zhong Lin Wang On the first principle theory of nanogenerators from Maxwell's equations , 2020 .

[68]  Lu Yin,et al.  Sweat-based wearable energy harvesting-storage hybrid textile devices , 2018 .

[69]  Zhong Lin Wang,et al.  Flexible triboelectric generator , 2012 .

[70]  Yuyan Zhu,et al.  Toward self-powered photodetection enabled by triboelectric nanogenerators , 2018 .

[71]  Chengkuo Lee,et al.  Self-Powered Dual-Mode Amenity Sensor Based on the Water-Air Triboelectric Nanogenerator. , 2017, ACS nano.

[72]  Dirk Englund,et al.  High-performance flexible waveguide-integrated photodetectors , 2018 .

[73]  Zhong Lin Wang,et al.  Keystroke dynamics enabled authentication and identification using triboelectric nanogenerator array , 2018 .

[74]  Guoliang Yuan,et al.  All-inorganic flexible piezoelectric energy harvester enabled by two-dimensional mica , 2018 .

[75]  Richard V. Penty,et al.  High-Speed Data Transmission Over Flexible Multimode Polymer Waveguides Under Flexure , 2018, IEEE Photonics Technology Letters.

[76]  Gyu-Hyeong Cho,et al.  Self-sustainable wind speed sensor system with omni-directional wind based triboelectric generator , 2019, Nano Energy.

[77]  Qiongfeng Shi,et al.  Beyond energy harvesting - multi-functional triboelectric nanosensors on a textile , 2019, Nano Energy.

[78]  John Baldacchino,et al.  Learning to Be , 2014 .

[79]  Yang Zou,et al.  A wearable noncontact free‐rotating hybrid nanogenerator for self‐powered electronics , 2020 .

[80]  Shurong Dong,et al.  Switchable textile-triboelectric nanogenerators (S-TENGs) for continuous profile sensing application without environmental interferences , 2020 .

[81]  Zhenan Bao,et al.  Electronic Skin: Recent Progress and Future Prospects for Skin‐Attachable Devices for Health Monitoring, Robotics, and Prosthetics , 2019, Advanced materials.

[82]  Yingjie Tang,et al.  Breath-based human–machine interaction system using triboelectric nanogenerator , 2019, Nano Energy.

[83]  Tao Jiang,et al.  Spherical triboelectric nanogenerator integrated with power management module for harvesting multidirectional water wave energy , 2020 .

[84]  Inyeol Yun,et al.  Stretchable triboelectric multimodal tactile interface simultaneously recognizing various dynamic body motions , 2019, Nano Energy.

[85]  Dukhyun Choi,et al.  Design of Mechanical Frequency Regulator for Predictable Uniform Power from Triboelectric Nanogenerators , 2018 .

[86]  Qiongfeng Shi,et al.  Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications , 2020, Science Advances.

[87]  J. Brugger,et al.  All-fiber hybrid piezoelectric-enhanced triboelectric nanogenerator for wearable gesture monitoring , 2018, Nano Energy.

[88]  Markus Karl,et al.  Flexible and ultra-lightweight polymer membrane lasers , 2018, 2019 Conference on Lasers and Electro-Optics Europe & European Quantum Electronics Conference (CLEO/Europe-EQEC).

[89]  Qiongfeng Shi,et al.  Self-powered liquid triboelectric microfluidic sensor for pressure sensing and finger motion monitoring applications , 2016 .