Model-Agnostic Personalized Knowledge Adaptation for Soft Exoskeleton Robot

Personalized control strategies can improve the overall performance of exoskeleton robots by providing adaptive assistance to different individuals. However, current personalized strategies require accurate models or large amounts of training data, which are not suitable for soft exoskeletons due to human-robot interaction uncertainties and low data acquisition efficiency. This paper presents a framework of Model-Agnostic Personalized Knowledge Adaptation (MPKA) consisting of two modules of Soft-to-Rigid Kinematics Model (SRKM) and Data-Driven Personalized Adaptation (DDPA) to generate a personalized strategy. Specifically, the first SRKM module is used to simplify and convert uncertain and time-varying HRI model to a certain and fixed model. The second DDPA module is used to accelerate model adaptation to new individuals using meta-learning with less data, based on the learned knowledge from the previous subjects. The experiments were conducted on three different sized platforms, four healthy and one post-stroke subjects, respectively. The results demonstrate that the MPKA can generate personalized models for new individuals more rapidly with less data than a pre-trained neural network, and the personalized models can obtain better control accuracy by over 62% than mechanism-based mathematical model. The proposed method has the potential to provide personalized rehabilitation strategies, which can improve effectiveness of rehabilitation.

[1]  J. Desai,et al.  Review: Hand Exoskeleton Systems, Clinical Rehabilitation Practices, and Future Prospects , 2021, IEEE Transactions on Medical Robotics and Bionics.

[2]  Samia Nefti-Meziani,et al.  A review: A Comprehensive Review of Soft and Rigid Wearable Rehabilitation and Assistive Devices with a Focus on the Shoulder Joint , 2021, Journal of Intelligent & Robotic Systems.

[3]  Jacob Rosen,et al.  Sensor Reduction, Estimation, and Control of an Upper-Limb Exoskeleton , 2021, IEEE Robotics and Automation Letters.

[4]  Imad H. Elhajj,et al.  Bioinspired Musculoskeletal Model-based Soft Wrist Exoskeleton for Stroke Rehabilitation , 2020, Journal of Bionic Engineering.

[5]  Emek Barış Küçüktabak,et al.  Towards Dynamic Transparency: Robust Interaction Force Tracking Using Multi-Sensory Control on an Arm Exoskeleton , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[6]  Jennie Si,et al.  Online Reinforcement Learning Control for the Personalization of a Robotic Knee Prosthesis , 2020, IEEE Transactions on Cybernetics.

[7]  Nicola Vitiello,et al.  Performance Evaluation of Lower Limb Exoskeletons: A Systematic Review , 2020, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Xiaowei Xu,et al.  What Can Be Transferred: Unsupervised Domain Adaptation for Endoscopic Lesions Segmentation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Zheng Li,et al.  Model-based online learning and adaptive control for a “human-wearable soft robot” integrated system , 2019, Int. J. Robotics Res..

[10]  Dongdong Hou,et al.  Semantic-Transferable Weakly-Supervised Endoscopic Lesions Segmentation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[11]  Robert Riener,et al.  ANYexo: A Versatile and Dynamic Upper-Limb Rehabilitation Robot , 2019, IEEE Robotics and Automation Letters.

[12]  Chen Wang,et al.  A Greedy Assist-as-Needed Controller for Upper Limb Rehabilitation , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Hong Cheng,et al.  Learning Physical Human–Robot Interaction With Coupled Cooperative Primitives for a Lower Exoskeleton , 2019, IEEE Transactions on Automation Science and Engineering.

[14]  S. Micera,et al.  Personalizing Exoskeleton-Based Upper Limb Rehabilitation Using a Statistical Model: A Pilot Study , 2018, Converging Clinical and Engineering Research on Neurorehabilitation III.

[15]  Lianqing Liu,et al.  Bio-inspired upper limb soft exoskeleton to reduce stroke-induced complications , 2018, Bioinspiration & biomimetics.

[16]  Darwin Gouwanda,et al.  Moving toward Soft Robotics: A Decade Review of the Design of Hand Exoskeletons , 2018, Biomimetics.

[17]  Sergey Levine,et al.  Learning to Adapt in Dynamic, Real-World Environments through Meta-Reinforcement Learning , 2018, ICLR.

[18]  Chenguang Yang,et al.  Physical Human–Robot Interaction of a Robotic Exoskeleton By Admittance Control , 2018, IEEE Transactions on Industrial Electronics.

[19]  Jun Morimoto,et al.  Learning assistive strategies for exoskeleton robots from user-robot physical interaction , 2017, Pattern Recognit. Lett..

[20]  Rachel W Jackson,et al.  Human-in-the-loop optimization of exoskeleton assistance during walking , 2017, Science.

[21]  Sergey Levine,et al.  Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks , 2017, ICML.

[22]  Zhicong Huang,et al.  Adaptive Impedance Control for an Upper Limb Robotic Exoskeleton Using Biological Signals , 2017, IEEE Transactions on Industrial Electronics.

[23]  Janne M. Veerbeek,et al.  Effects of Robot-Assisted Therapy for the Upper Limb After Stroke , 2017, Neurorehabilitation and neural repair.

[24]  Pinhas Ben-Tzvi,et al.  Hand Rehabilitation Learning System With an Exoskeleton Robotic Glove , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  Hongliang Guo,et al.  Hierarchical Interactive Learning for a HUman-Powered Augmentation Lower EXoskeleton , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Jun Morimoto,et al.  Learning assistive strategies from a few user-robot interactions: Model-based reinforcement learning approach , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Agnes Roby-Brami,et al.  Upper-Limb Robotic Exoskeletons for Neurorehabilitation: A Review on Control Strategies , 2016, IEEE Reviews in Biomedical Engineering.

[28]  S. Micera,et al.  Evaluation of the effects of the Arm Light Exoskeleton on movement execution and muscle activities: a pilot study on healthy subjects , 2016, Journal of NeuroEngineering and Rehabilitation.

[29]  Guanglin Li,et al.  Fuzzy Approximation-Based Adaptive Backstepping Control of an Exoskeleton for Human Upper Limbs , 2015, IEEE Transactions on Fuzzy Systems.

[30]  Carl E. Rasmussen,et al.  Gaussian Processes for Data-Efficient Learning in Robotics and Control , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Tomohiro Shibata,et al.  Assist-as-needed robotic trainer based on reinforcement learning and its application to dart-throwing , 2014, Neural Networks.

[32]  V. Dietz,et al.  Three-dimensional, task-specific robot therapy of the arm after stroke: a multicentre, parallel-group randomised trial , 2014, The Lancet Neurology.

[33]  R. Riener,et al.  Path Control: A Method for Patient-Cooperative Robot-Aided Gait Rehabilitation , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  Xiaoli Chu,et al.  A Learning-Based Hierarchical Control Scheme for an Exoskeleton Robot in Human–Robot Cooperative Manipulation , 2020, IEEE Transactions on Cybernetics.

[35]  Zhijun Li,et al.  Design and Adaptive Control for an Upper Limb Robotic Exoskeleton in Presence of Input Saturation , 2019, IEEE Transactions on Neural Networks and Learning Systems.