An End-to-End Dynamic Posture Perception Method for Soft Actuators Based on Distributed Thin Flexible Porous Piezoresistive Sensors

This paper proposes a method for accurate 3D posture sensing of the soft actuators, which could be applied to the closed-loop control of soft robots. To achieve this, the method employs an array of miniaturized sponge resistive materials along the soft actuator, which uses long short-term memory (LSTM) neural networks to solve the end-to-end 3D posture for the soft actuators. The method takes into account the hysteresis of the soft robot and non-linear sensing signals from the flexible bending sensors. The proposed approach uses a flexible bending sensor made from a thin layer of conductive sponge material designed for posture sensing. The LSTM network is used to model the posture of the soft actuator. The effectiveness of the method has been demonstrated on a finger-size 3 degree of freedom (DOF) pneumatic bellow-shaped actuator, with nine flexible sponge resistive sensors placed on the soft actuator’s outer surface. The sensor-characterizing results show that the maximum bending torque of the sensor installed on the actuator is 4.7 Nm, which has an insignificant impact on the actuator motion based on the working space test of the actuator. Moreover, the sensors exhibit a relatively low error rate in predicting the actuator tip position, with error percentages of 0.37%, 2.38%, and 1.58% along the x-, y-, and z-axes, respectively. This work is expected to contribute to the advancement of soft robot dynamic posture perception by using thin sponge sensors and LSTM or other machine learning methods for control.

[1]  Kaichen Xu,et al.  Highly Stretchable and Sensitive Strain Sensor Based on Porous Materials and Rhombic‐Mesh Structures for Robot Teleoperation , 2023, Advanced Sensor Research.

[2]  Kelvin H. L. Heung,et al.  Soft Robots’ Dynamic Posture Perception Using Kirigami-Inspired Flexible Sensors with Porous Structures and Long Short-Term Memory (LSTM) Neural Networks , 2022, Sensors.

[3]  D. Rus,et al.  Fluidic innervation sensorizes structures from a single build material , 2022, Science advances.

[4]  Benjamin W. K. Ang,et al.  A Learning-Based Approach to Sensorize Soft Robots. , 2022, Soft robotics.

[5]  Fei Wang,et al.  Bioinspired Co‐Design of Tactile Sensor and Deep Learning Algorithm for Human–Robot Interaction , 2022, Adv. Intell. Syst..

[6]  Kaichen Xu,et al.  Soft Robot Skin With Conformal Adaptability for On-Body Tactile Perception of Collaborative Robots , 2022, IEEE Robotics and Automation Letters.

[7]  Changshui Huang,et al.  Ultrasensitive Pressure Sensor Sponge Using Liquid Metal Modulated Nitrogen-Doped Graphene Nanosheets. , 2022, Nano letters.

[8]  Haochuan Wan,et al.  A Soft Sponge Sensor for Multimodal Sensing and Distinguishing of Pressure, Strain, and Temperature. , 2022, ACS applied materials & interfaces.

[9]  W. Kim,et al.  Emerging wearable flexible sensors for sweat analysis , 2021, Bio-Design and Manufacturing.

[10]  Yuanjie Su,et al.  MXene-Sponge Based High-Performance Piezoresistive Sensor for Wearable Biomonitoring and Real-Time Tactile Sensing. , 2021, Small methods.

[11]  Tao Liu,et al.  Soft Actuators and Robotic Devices for Rehabilitation and Assistance , 2021, Adv. Intell. Syst..

[12]  Mengying Xie,et al.  Multifunctional Soft Robotic Finger Based on a Nanoscale Flexible Temperature-Pressure Tactile Sensor for Material Recognition. , 2021, ACS applied materials & interfaces.

[13]  Jicai Zhang,et al.  Wearable, Washable, and Highly Sensitive Piezoresistive Pressure Sensor Based on a 3D Sponge Network for Real-Time Monitoring Human Body Activities. , 2021, ACS applied materials & interfaces.

[14]  Zheng Li,et al.  Design and Preliminary Evaluation of an Electromagnetically Actuated Soft-Tethered Colonoscope , 2021, IEEE Transactions on Medical Robotics and Bionics.

[15]  T. Arie,et al.  A Wearable Body Condition Sensor System with Wireless Feedback Alarm Functions , 2021, Advanced materials.

[16]  K. Takei,et al.  Flexible Hybrid Sensor Systems with Feedback Functions , 2020, Advanced Functional Materials.

[17]  Huayong Yang,et al.  Design and Implementation of Robot Skin Using Highly Sensitive Sponge Sensor , 2020, IEEE Transactions on Medical Robotics and Bionics.

[18]  Christopher R. Bowen,et al.  Soft Controllable Carbon Fibre-based Piezoresistive Self-Sensing Actuators , 2020, Actuators.

[19]  Cosimo Della Santina,et al.  Distributed Proprioception of 3D Configuration in Soft, Sensorized Robots via Deep Learning , 2020, IEEE Robotics and Automation Letters.

[20]  Min Pan,et al.  Carbon fibre based flexible piezoresistive composites to empower inherent sensing capabilities for soft actuators. , 2019, Soft matter.

[21]  Kevin C. Galloway,et al.  Fiber Optic Shape Sensing for Soft Robotics , 2019, Soft robotics.

[22]  Zheng Li,et al.  Model-based online learning and adaptive control for a “human-wearable soft robot” integrated system , 2019, Int. J. Robotics Res..

[23]  Seiji Akita,et al.  Highly stable kirigami-structured stretchable strain sensors for perdurable wearable electronics , 2019, Journal of Materials Chemistry C.

[24]  Pakpong Chirarattananon,et al.  A Quadrotor With an Origami-Inspired Protective Mechanism , 2019, IEEE Robotics and Automation Letters.

[25]  Hongen Liao,et al.  Worm-Like Soft Robot for Complicated Tubular Environments. , 2019, Soft robotics.

[26]  D. Vella Buffering by buckling as a route for elastic deformation , 2019, Nature Reviews Physics.

[27]  Cecilia Laschi,et al.  Soft robot perception using embedded soft sensors and recurrent neural networks , 2019, Science Robotics.

[28]  Xiaochen Dong,et al.  A flexible pressure sensor based on rGO/polyaniline wrapped sponge with tunable sensitivity for human motion detection. , 2018, Nanoscale.

[29]  Yingtian Li,et al.  Novel Variable-Stiffness Robotic Fingers with Built-In Position Feedback. , 2017, Soft robotics.

[30]  Mats Jackson,et al.  Bending angle prediction and control of soft pneumatic actuators with embedded flex sensors: a data-driven approach , 2017 .

[31]  Kevin O'Brien,et al.  Optoelectronically innervated soft prosthetic hand via stretchable optical waveguides , 2016, Science Robotics.

[32]  Sanlin S. Robinson,et al.  Highly stretchable electroluminescent skin for optical signaling and tactile sensing , 2016, Science.

[33]  Robert J. Wood,et al.  Soft robotic glove for combined assistance and at-home rehabilitation , 2015, Robotics Auton. Syst..

[34]  D. Rus,et al.  Design, fabrication and control of soft robots , 2015, Nature.

[35]  Robert J. Webster,et al.  Design and Kinematic Modeling of Constant Curvature Continuum Robots: A Review , 2010, Int. J. Robotics Res..

[36]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[37]  Yu Song,et al.  Omnidirectional Bending and Pressure Sensor Based on Stretchable CNT‐PU Sponge , 2017 .