Human–robot interactive control based on reinforcement learning for gait rehabilitation training robot

A human–robot interactive control is proposed to govern the assistance provided by a lower limb exoskeleton robot to patients in the gait rehabilitation training. The rehabilitation training robot with two lower limb exoskeletons is driven by the pneumatic proportional servo system and has two rotational degrees of freedom of each lower limb. An adaptive admittance model is adopted considering its suitability for human–robot interaction. The adaptive law of the admittance parameters is designed with Sigmoid function and the reinforcement learning algorithm. Individualized admittance parameters suitable for patients are obtained by reinforcement learning. Experiments in passive and active rehabilitation training modes were carried out to verify the proposed control method. The passive rehabilitation training experimental results verify the effectiveness of the inner-loop position control strategy, which can meet the demands of gait tracking accuracy in rehabilitation training. The active rehabilitation training experimental results demonstrate that the personal adaption and active compliance are provided by the interactive controller in the robot-assistance for patients. The combined effects of flexibility of pneumatic actuators and compliance provided by the controller contribute to the training comfort, safety, and therapeutic outcome in the gait rehabilitation.

[1]  Daniel Vélez Día,et al.  Biomechanics and Motor Control of Human Movement , 2013 .

[2]  Pei Zhongcai,et al.  Swing motion control of lower extremity exoskeleton based on admittance method , 2015 .

[3]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[4]  S.K. Agrawal,et al.  Robot assisted gait training with active leg exoskeleton (ALEX) , 2009, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[5]  Yoshiyuki Sankai,et al.  Pilot study of locomotion improvement using hybrid assistive limb in chronic stroke patients , 2013, BMC Neurology.

[6]  S. Hesse,et al.  Gait rehabilitation machines based on programmable footplates , 2007, Journal of NeuroEngineering and Rehabilitation.

[7]  Mergen H. Ghayesh,et al.  Assist-as-Needed Control of an Intrinsically Compliant Robotic Gait Training Orthosis , 2017, IEEE Transactions on Industrial Electronics.

[8]  Sheng Quan Xie,et al.  Robot assisted treadmill training: mechanisms and training strategies. , 2011, Medical engineering & physics.

[9]  R. Riener,et al.  Path Control: A Method for Patient-Cooperative Robot-Aided Gait Rehabilitation , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Mustafa Suphi Erden,et al.  Assisting manual welding with robot , 2011 .

[11]  Bing Chen,et al.  Recent developments and challenges of lower extremity exoskeletons , 2015, Journal of orthopaedic translation.

[12]  Wei Meng,et al.  Recent development of mechanisms and control strategies for robot-assisted lower limb rehabilitation , 2015 .

[13]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[14]  Jinghui Cao,et al.  Control strategies for effective robot assisted gait rehabilitation: the state of art and future prospects. , 2014, Medical engineering & physics.

[15]  Zhizheng Wu,et al.  A control algorithm of treadmill speed adaptation for lower extremity rehabilitation robot system , 2014, 2014 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[16]  Herman van der Kooij,et al.  LOPES II—Design and Evaluation of an Admittance Controlled Gait Training Robot With Shadow-Leg Approach , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Ronglei Sun,et al.  Control methods for exoskeleton rehabilitation robot driven with pneumatic muscles , 2009, Ind. Robot.

[18]  Tingfang Yan,et al.  Review of assistive strategies in powered lower-limb orthoses and exoskeletons , 2015, Robotics Auton. Syst..

[19]  Peng Wu,et al.  A wearable somatosensory teaching device with adjustable operating force for gait rehabilitation training robot , 2017 .

[20]  Robert Riener,et al.  Patient-cooperative control increases active participation of individuals with SCI during robot-aided gait training , 2010, Journal of NeuroEngineering and Rehabilitation.

[21]  Wei Meng,et al.  Adaptive Patient-Cooperative Control of a Compliant Ankle Rehabilitation Robot (CARR) With Enhanced Training Safety , 2018, IEEE Transactions on Industrial Electronics.

[22]  Olavi Airaksinen,et al.  Effects of intensive therapy using gait trainer or floor walking exercises early after stroke. , 2009, Journal of rehabilitation medicine.

[23]  Yoshiyuki Sankai,et al.  Wearable Gait Measurement System with an Instrumented Cane for Exoskeleton Control , 2014, Sensors.

[24]  Sunil Kumar Agrawal,et al.  Adaptive assist-as-needed controller to improve gait symmetry in robot-assisted gait training , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Volker Dietz,et al.  Recovery from a spinal cord injury: significance of compensation, neural plasticity, and repair. , 2008, Journal of neurotrauma.

[26]  Rob den Otter,et al.  The combined effects of guidance force, bodyweight support and gait speed on muscle activity during able-bodied walking in the Lokomat. , 2016, Clinical biomechanics.

[27]  Shane S. Q. Xie,et al.  Advanced Robotics for Medical Rehabilitation - Current State of the Art and Recent Advances , 2015, Springer Tracts in Advanced Robotics.

[28]  M. Eyssen,et al.  A systematic review and meta-analysis of acute stroke unit care: What’s beyond the statistical significance? , 2013, BMC Medical Research Methodology.

[29]  J. Mehrholz,et al.  Gait training with the newly developed ‘LokoHelp’-system is feasible for non-ambulatory patients after stroke, spinal cord and brain injury. A feasibility study , 2008, Brain injury.