Triboelectric nanogenerator sensors for soft robotics aiming at digital twin applications

Designing efficient sensors for soft robotics aiming at human machine interaction remains a challenge. Here, we report a smart soft-robotic gripper system based on triboelectric nanogenerator sensors to capture the continuous motion and tactile information for soft gripper. With the special distributed electrodes, the tactile sensor can perceive the contact position and area of external stimuli. The gear-based length sensor with a stretchable strip allows the continuous detection of elongation via the sequential contact of each tooth. The triboelectric sensory information collected during the operation of soft gripper is further trained by support vector machine algorithm to identify diverse objects with an accuracy of 98.1%. Demonstration of digital twin applications, which show the object identification and duplicate robotic manipulation in virtual environment according to the real-time operation of the soft-robotic gripper system, is successfully created for virtual assembly lines and unmanned warehouse applications.

[1]  Chengkuo Lee,et al.  Wearable Triboelectric-Human-Machine-Interface (THMI) Using Robust Nanophotonic Readout. , 2020, ACS nano.

[2]  Ying-Chih Lai,et al.  Actively Perceiving and Responsive Soft Robots Enabled by Self‐Powered, Highly Extensible, and Highly Sensitive Triboelectric Proximity‐ and Pressure‐Sensing Skins , 2018, Advanced materials.

[3]  Qiongfeng Shi,et al.  Progress in wearable electronics/photonics—Moving toward the era of artificial intelligence and internet of things , 2020, InfoMat.

[4]  Massimo Totaro,et al.  Toward Perceptive Soft Robots: Progress and Challenges , 2018, Advanced science.

[5]  D. Rus,et al.  Design, fabrication and control of soft robots , 2015, Nature.

[6]  I. Anderson,et al.  Capacitive Stretch Sensing for Robotic Skins. , 2019, Soft robotics.

[7]  YapHong Kai,et al.  High-Force Soft Printable Pneumatics for Soft Robotic Applications , 2016 .

[8]  Zhong Lin Wang,et al.  Keystroke dynamics enabled authentication and identification using triboelectric nanogenerator array , 2018 .

[9]  Neil M. Bajaj,et al.  State of the Art in Artificial Wrists: A Review of Prosthetic and Robotic Wrist Design , 2019, IEEE Transactions on Robotics.

[10]  L. O’Dell,et al.  A High‐Energy Aqueous Aluminum‐Manganese Battery , 2019, Advanced Functional Materials.

[11]  Joe Cecil,et al.  A next-generation IoT-based collaborative framework for electronics assembly , 2018 .

[12]  Shuang Song,et al.  Real-Time Shape Estimation for Wire-Driven Flexible Robots With Multiple Bending Sections Based on Quadratic Bézier Curves , 2015, IEEE Sensors Journal.

[13]  Fei Tao,et al.  Digital Twin and Big Data Towards Smart Manufacturing and Industry 4.0: 360 Degree Comparison , 2018, IEEE Access.

[14]  Xue Wang,et al.  Rotation sensing and gesture control of a robot joint via triboelectric quantization sensor , 2018, Nano Energy.

[15]  Zhong Lin Wang,et al.  Flexible sliding sensor for simultaneous monitoring deformation and displacement on a robotic hand/arm , 2020 .

[16]  Brian Byunghyun Kang,et al.  Eyes are faster than hands: A soft wearable robot learns user intention from the egocentric view , 2019, Science Robotics.

[17]  Qiongfeng Shi,et al.  From flexible electronics technology in the era of IoT and artificial intelligence toward future implanted body sensor networks , 2019, APL Materials.

[18]  MajidiCarmel,et al.  Soft Robotics: A Perspective—Current Trends and Prospects for the Future , 2014 .

[19]  Leslie Y Yeo,et al.  Ultrafast Acoustofluidic Exfoliation of Stratified Crystals , 2018, Advanced materials.

[20]  Takafumi Yamaguchi,et al.  Human‐Like Electronic Skin‐Integrated Soft Robotic Hand , 2019, Adv. Intell. Syst..

[21]  E. Kauppinen,et al.  Scalable and Solid‐State Redox Functionalization of Transparent Single‐Walled Carbon Nanotube Films for Highly Efficient and Stable Solar Cells , 2017 .

[22]  Wojciech Matusik,et al.  Learning the signatures of the human grasp using a scalable tactile glove , 2019, Nature.

[23]  K. Choi,et al.  Retracted Article: 3D printed highly flexible strain sensor based on TPU–graphene composite for feedback from high speed robotic applications , 2019, Journal of Materials Chemistry C.

[24]  Yang Wang,et al.  Hierarchically patterned self-powered sensors for multifunctional tactile sensing , 2020, Science Advances.

[25]  Wei Wang,et al.  Progress in Triboelectric Materials: Toward High Performance and Widespread Applications , 2019, Advanced Functional Materials.

[26]  Chengkuo Lee,et al.  Machine Learning Glove Using Self‐Powered Conductive Superhydrophobic Triboelectric Textile for Gesture Recognition in VR/AR Applications , 2020, Advanced science.

[27]  Oussama Khatib,et al.  A hierarchically patterned, bioinspired e-skin able to detect the direction of applied pressure for robotics , 2018, Science Robotics.

[28]  Zhong Lin Wang,et al.  Keystroke Dynamics Identification Based on Triboelectric Nanogenerator for Intelligent Keyboard Using Deep Learning Method , 2018, Advanced Materials Technologies.

[29]  Kevin O'Brien,et al.  Optoelectronically innervated soft prosthetic hand via stretchable optical waveguides , 2016, Science Robotics.

[30]  Qiongfeng Shi,et al.  Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications , 2020, Science Advances.

[31]  Jianhua Liu,et al.  Digital twin-based smart production management and control framework for the complex product assembly shop-floor , 2018, The International Journal of Advanced Manufacturing Technology.

[32]  Tianyiyi He,et al.  Technologies toward next generation human machine interfaces: From machine learning enhanced tactile sensing to neuromorphic sensory systems , 2020, Applied Physics Reviews.

[33]  C. Majidi.  Soft Robotics: A Perspective—Current Trends and Prospects for the Future , 2014 .

[34]  Robert J. Wood,et al.  Toward a modular soft sensor-embedded glove for human hand motion and tactile pressure measurement , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[35]  Tianyiyi He,et al.  Advances in chemical sensing technology for enabling the next-generation self-sustainable integrated wearable system in the IoT era , 2020 .

[36]  Dong-weon Lee,et al.  A novel energy conversion method based on hydrogel material for self-powered sensor system applications , 2016 .

[37]  John Baldacchino,et al.  Learning to Be , 2014 .

[38]  Qiongfeng Shi,et al.  Self-powered glove-based intuitive interface for diversified control applications in real/cyber space , 2019, Nano Energy.

[39]  C. K. Suzuki,et al.  Flexible Optical Fiber Bending Transducer for Application in Glove-Based Sensors , 2014, IEEE Sensors Journal.

[40]  Wei Wang,et al.  Large-scale fabrication of robust textile triboelectric nanogenerators , 2020 .

[41]  Yantao Shen,et al.  Integrated sensing for ionic polymer–metal composite actuators using PVDF thin films , 2007 .

[42]  Huichan Zhao,et al.  Curvature control of soft orthotics via low cost solid-state optics , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[43]  Wei Tang,et al.  A Triboelectric Nanogenerator as a Self‐Powered Sensor for a Soft–Rigid Hybrid Actuator , 2019, Advanced Materials Technologies.

[44]  Cecilia Laschi,et al.  Soft robot perception using embedded soft sensors and recurrent neural networks , 2019, Science Robotics.

[45]  Yan Wang,et al.  Visual recognition system of cherry picking robot based on Lab color model , 2017 .

[46]  Qiongfeng Shi,et al.  Wearable Triboelectric/Aluminum Nitride Nano‐Energy‐Nano‐System with Self‐Sustainable Photonic Modulation and Continuous Force Sensing , 2020, Advanced science.

[47]  Nicolas Andreff,et al.  Review on Otological Robotic Systems: Toward Microrobot-Assisted Cholesteatoma Surgery , 2018, IEEE Reviews in Biomedical Engineering.

[48]  D. Diao,et al.  Intelligently detecting and identifying liquids leakage combining triboelectric nanogenerator based self-powered sensor with machine learning , 2019, Nano Energy.

[49]  Naghmeh Bandari,et al.  Tactile Sensors for Minimally Invasive Surgery: A Review of the State-of-the-Art, Applications, and Perspectives , 2020, IEEE Access.

[50]  Jianhua Hao,et al.  Environmentally Friendly Hydrogel‐Based Triboelectric Nanogenerators for Versatile Energy Harvesting and Self‐Powered Sensors , 2017 .