Learning-Based Fingertip Force Estimation for Soft Wearable Hand Robot With Tendon-Sheath Mechanism

Soft wearable hand robots with tendon-sheath mechanisms are being actively developed to assist people with lost hand mobility. For these robots, accurately estimating fingertip forces leads to successful object grasping. An approach can utilize information from actuators assuming quasi-static environments. However, non-linearity and hysteresis with regards to the dynamic changes of the tendon-sheath mechanism hinder accurate fingertip force estimation. This paper proposes a learning-based method to estimate fingertip forces by integrating dynamic information of motor encoders, wire tension, and sheath bending angles. The model is modified from Long Short-Term Memory by incorporating a residual term that governs the dynamic changes in sheath bending angles. Using a tendon-driven soft wearable hand robot, the proposed model obtained RMSE less than 0.44 N. It was further evaluated under criteria ranging from different object sizes, bending angle ranges, and forces. Finally, a repeatability test (0.46 N in RMSE), real-time applicability (125 Hz), and force control (12.7% in MAPE) were performed to verify the feasibility of the proposed method.

[1]  Olivier Lambercy,et al.  Design and Evaluation of a Bowden-Cable-Based Remote Actuation System for Wearable Robotics , 2018, IEEE Robotics and Automation Letters.

[2]  Robert J. Wood,et al.  Soft robotic glove for combined assistance and at-home rehabilitation , 2015, Robotics Auton. Syst..

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  Philippe Zanne,et al.  Improvements in the control of a flexible endoscopic system , 2012, 2012 IEEE International Conference on Robotics and Automation.

[5]  Edoardo Battaglia,et al.  ThimbleSense: A Fingertip-Wearable Tactile Sensor for Grasp Analysis , 2016, IEEE Transactions on Haptics.

[6]  Brian Byunghyun Kang,et al.  Exo-Glove Poly II: A Polymer-Based Soft Wearable Robot for the Hand with a Tendon-Driven Actuation System. , 2019, Soft robotics.

[7]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[8]  Brian Byunghyun Kang,et al.  Exo-Glove: A Wearable Robot for the Hand with a Soft Tendon Routing System , 2015, IEEE Robotics & Automation Magazine.

[9]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[10]  Sungho Jo,et al.  Use of Deep Learning for Characterization of Microfluidic Soft Sensors , 2018, IEEE Robotics and Automation Letters.

[11]  Brian Byunghyun Kang,et al.  Development of a polymer-based tendon-driven wearable robotic hand , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Elif Hocaoglu WeFiTS: Wearable Fingertip Tactile Sensor , 2018 .

[13]  Chen-Hua Yeow,et al.  Soft Fabric-Based Pneumatic Sensor for Bending Angles and Contact Force Detection , 2019, IEEE Sensors Journal.

[14]  Kyu-Jin Cho,et al.  A Novel Low-Cost, Large Curvature Bend Sensor Based on a Bowden-Cable , 2016, Sensors.

[15]  Jee-Hwan Ryu,et al.  Portable Exoskeleton Glove With Soft Structure for Hand Assistance in Activities of Daily Living , 2017, IEEE/ASME Transactions on Mechatronics.

[16]  Wojciech Matusik,et al.  Learning the signatures of the human grasp using a scalable tactile glove , 2019, Nature.

[17]  Jumpei Arata,et al.  Design and Characterization of a Lightweight and Fully Portable Remote Actuation System for Use With a Hand Exoskeleton , 2016, IEEE Robotics and Automation Letters.

[18]  M. Kaneko,et al.  Basic considerations on transmission characteristics for tendon drive robots , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[19]  Kyu-Jin Cho,et al.  A feasibility study on tension control of Bowden-cable based on a dual-wire scheme , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Deqing Mei,et al.  Three-Axis Contact Force Measurement of a Flexible Tactile Sensor Array for Hand Grasping Applications , 2017 .

[21]  Giorgio De Pasquale,et al.  Wearable system with embedded force sensors for neurologic rehabilitation trainings , 2018, 2018 Symposium on Design, Test, Integration & Packaging of MEMS and MOEMS (DTIP).

[22]  Gianluca Palli,et al.  Modeling, Identification, and Control of Tendon-Based Actuation Systems , 2012, IEEE Transactions on Robotics.

[23]  Lin Cao,et al.  Distal-end force prediction of tendon-sheath mechanisms for flexible endoscopic surgical robots using deep learning , 2019, Mechanism and Machine Theory.

[24]  Shigeki Sugano,et al.  A Wearable Three-Axis Tactile Sensor for Human Fingertips , 2018, IEEE Robotics and Automation Letters.

[25]  Useok Jeong,et al.  Control of a Bowden-Cable Actuation System With Embedded BoASensor for Soft Wearable Robots , 2020, IEEE Transactions on Industrial Electronics.

[26]  Domenico Prattichizzo,et al.  Fingertip force estimation via inertial and magnetic sensors in deformable object manipulation , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[27]  Brian Byunghyun Kang,et al.  Eyes are faster than hands: A soft wearable robot learns user intention from the egocentric view , 2019, Science Robotics.

[28]  Octavian Postolache,et al.  Tactile Sensors for Robotic Applications , 2013 .

[29]  M. Nilsson,et al.  The Soft Extra Muscle system for improving the grasping capability in neurological rehabilitation , 2012, 2012 IEEE-EMBS Conference on Biomedical Engineering and Sciences.

[30]  Serafeim Perdikis,et al.  mano: A Wearable Hand Exoskeleton for Activities of Daily Living and Neurorehabilitation , 2018, IEEE Robotics and Automation Letters.