Soft Robots’ Dynamic Posture Perception Using Kirigami-Inspired Flexible Sensors with Porous Structures and Long Short-Term Memory (LSTM) Neural Networks

Soft robots can create complicated structures and functions for rehabilitation. The posture perception of soft actuators is critical for performing closed-loop control for a precise location. It is essential to have a sensor with both soft and flexible characteristics that does not affect the movement of a soft actuator. This paper presents a novel end-to-end posture perception method that employs flexible sensors with kirigami-inspired structures and long short-term memory (LSTM) neural networks. The sensors were developed with conductive sponge materials. With one-step calibration from the sensor output, the posture of the soft actuator could be calculated by the LSTM network. The method was validated by attaching the developed sensors to a soft fiber-reinforced bending actuator. The results showed the accuracy of posture prediction of sponge sensors with three kirigami-inspired structures ranged from 0.91 to 0.97 in terms of R2. The sponge sensors only generated a resistive torque value of 0.96 mNm at the maximum bending position when attached to a soft actuator, which would minimize the effect on actuator movement. The kirigami-inspired flexible sponge sensor could in future enhance soft robotic development.

[1]  Zheng Li,et al.  An End-to-end Posture Perception Method for Soft Bending Actuators Based on Kirigami-inspired Piezoresistive Sensors , 2022, 2022 IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[2]  Xiaogang Guo,et al.  Laser-induced porous graphene on Polyimide/PDMS composites and its kirigami-inspired strain sensor , 2021 .

[3]  Yong-Lae Park,et al.  Heterogeneous sensing in a multifunctional soft sensor for human-robot interfaces , 2020, Science Robotics.

[4]  Ameer Hamza Khan,et al.  Obstacle Avoidance and Tracking Control of Redundant Robotic Manipulator: An RNN-Based Metaheuristic Approach , 2020, IEEE Transactions on Industrial Informatics.

[5]  Carmel Majidi,et al.  Machine Learning for Soft Robotic Sensing and Control , 2020, Adv. Intell. Syst..

[6]  Cosimo Della Santina,et al.  Distributed Proprioception of 3D Configuration in Soft, Sensorized Robots via Deep Learning , 2020, IEEE Robotics and Automation Letters.

[7]  Chun-Hui Wang,et al.  Strategies for Designing Stretchable Strain Sensors and Conductors , 2020, Advanced Materials Technologies.

[8]  K. Koida,et al.  Donut‐Shaped Stretchable Kirigami: Enabling Electronics to Integrate with the Deformable Muscle , 2019, Advanced healthcare materials.

[9]  Hyosang Lee,et al.  Deep Neural Network Approach in Electrical Impedance Tomography-based Real-time Soft Tactile Sensor , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Min Pan,et al.  Carbon fibre based flexible piezoresistive composites to empower inherent sensing capabilities for soft actuators. , 2019, Soft matter.

[11]  Sunho Lee,et al.  Pneumatic actuator and flexible piezoelectric sensor for soft virtual reality glove system , 2019, Scientific Reports.

[12]  Pakpong Chirarattananon,et al.  A Quadrotor With an Origami-Inspired Protective Mechanism , 2019, IEEE Robotics and Automation Letters.

[13]  D. Vella Buffering by buckling as a route for elastic deformation , 2019, Nature Reviews Physics.

[14]  Zheng Li,et al.  Robotic Glove with Soft-Elastic Composite Actuators for Assisting Activities of Daily Living. , 2019, Soft robotics.

[15]  Wei Chen,et al.  Highly Sensitive and Large-Range Strain Sensor with a Self-Compensated Two-Order Structure for Human Motion Detection. , 2019, ACS applied materials & interfaces.

[16]  Cecilia Laschi,et al.  Soft robot perception using embedded soft sensors and recurrent neural networks , 2019, Science Robotics.

[17]  Soon Moon Jeong,et al.  Highly twisted supercoils for superelastic multi-functional fibres , 2019, Nature Communications.

[18]  Andrew McDaid,et al.  Embedded piezoresistive pressure sensitive pillars from piezoresistive carbon black composites towards a soft large-strain compressive load sensor , 2019, Sensors and Actuators A: Physical.

[19]  P. Szurgott,et al.  Selection of a Hyper-Elastic Material Model - a Case Study for a Polyurethane Component , 2019, Latin American Journal of Solids and Structures.

[20]  Jonathan Rossiter,et al.  Kirigami stretchable strain sensors with enhanced piezoelectricity induced by topological electrodes , 2018, Applied Physics Letters.

[21]  Daniela Rus,et al.  Design, fabrication and control of origami robots , 2018, Nature Reviews Materials.

[22]  Chang Liu,et al.  Minimally Actuated Transformation of Origami Machines , 2018, IEEE Robotics and Automation Letters.

[23]  Sungho Jo,et al.  Use of Deep Learning for Characterization of Microfluidic Soft Sensors , 2018, IEEE Robotics and Automation Letters.

[24]  Wei Zhang,et al.  Editable Supercapacitors with Customizable Stretchability Based on Mechanically Strengthened Ultralong MnO2 Nanowire Composite , 2018, Advanced materials.

[25]  Yanhuai Ding,et al.  Morphology and Mechanical Properties of Polyimide Films: The Effects of UV Irradiation on Microscale Surface , 2017, Materials.

[26]  Mable P Fok,et al.  Dual-layer orthogonal fiber Bragg grating mesh based soft sensor for 3-dimensional shape sensing. , 2017, Optics express.

[27]  Mats Jackson,et al.  Bending angle prediction and control of soft pneumatic actuators with embedded flex sensors: a data-driven approach , 2017 .

[28]  Yu Song,et al.  Omnidirectional Bending and Pressure Sensor Based on Stretchable CNT‐PU Sponge , 2017 .

[29]  Ling Zhang,et al.  Fabrication of Highly Stretchable Conductors Based on 3D Printed Porous Poly(dimethylsiloxane) and Conductive Carbon Nanotubes/Graphene Network. , 2016, ACS applied materials & interfaces.

[30]  Robert J. Wood,et al.  Soft robotic glove for combined assistance and at-home rehabilitation , 2015, Robotics Auton. Syst..

[31]  Jun Chen,et al.  Highly Compressible and All‐Solid‐State Supercapacitors Based on Nanostructured Composite Sponge , 2015, Advanced materials.

[32]  P. Damasceno,et al.  A kirigami approach to engineering elasticity in nanocomposites through patterned defects. , 2015, Nature materials.

[33]  D. Rus,et al.  Design, fabrication and control of soft robots , 2015, Nature.

[34]  Jonghwa Park,et al.  Directed self-assembly of rhombic carbon nanotube nanomesh films for transparent and stretchable electrodes , 2015 .

[35]  Hao Jiang,et al.  Highly Stretchable Conductors Integrated with a Conductive Carbon Nanotube/Graphene Network and 3D Porous Poly(dimethylsiloxane) , 2014 .

[36]  Jonathan A. Fan,et al.  Experimental and Theoretical Studies of Serpentine Microstructures Bonded To Prestrained Elastomers for Stretchable Electronics , 2014 .

[37]  Daniel M. Vogt,et al.  Design and Characterization of a Soft Multi-Axis Force Sensor Using Embedded Microfluidic Channels , 2013, IEEE Sensors Journal.

[38]  Xiaodong He,et al.  Super‐Stretchable Spring‐Like Carbon Nanotube Ropes , 2012, Advanced materials.

[39]  John A Rogers,et al.  Three-dimensional nanonetworks for giant stretchability in dielectrics and conductors , 2012, Nature Communications.

[40]  R. Wood,et al.  A non-differential elastomer curvature sensor for softer-than-skin electronics , 2011 .

[41]  Raeed H. Chowdhury,et al.  Epidermal Electronics , 2011, Science.

[42]  John A Rogers,et al.  Optimized structural designs for stretchable silicon integrated circuits. , 2009, Small.