Learning a Control Policy for Fall Prevention on an Assistive Walking Device

Fall prevention is one of the most important components in senior care. We present a technique to augment an assistive walking device with the ability to prevent falls. Given an existing walking device, our method develops a fall predictor and a recovery policy by utilizing the onboard sensors and actuators. The key component of our method is a robust human walking policy that models realistic human gait under a moderate level of perturbations. We use this human walking policy to provide training data for the fall predictor, as well as to teach the recovery policy how to best modify the person’s gait when a fall is imminent. Our evaluation shows that the human walking policy generates walking sequences similar to those reported in biomechanics literature. Our experiments in simulation show that the augmented assistive device can indeed help recover balance from a variety of external perturbations. We also provide a quantitative method to evaluate the design choices for an assistive device.

[1]  Steven H Collins,et al.  A universal ankle-foot prosthesis emulator for human locomotion experiments. , 2014, Journal of biomechanical engineering.

[2]  Alec Radford,et al.  Proximal Policy Optimization Algorithms , 2017, ArXiv.

[3]  Levi J. Hargrove,et al.  Minimum jerk swing control allows variable cadence in powered transfemoral prostheses , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Nitish Thatte,et al.  A Sample-Efficient Black-Box Optimizer to Train Policies for Human-in-the-Loop Systems With User Preferences , 2017, IEEE Robotics and Automation Letters.

[5]  Sergey Levine,et al.  DeepMimic , 2018, ACM Trans. Graph..

[6]  Jessica K. Hodgins,et al.  Simulating balance recovery responses to trips based on biomechanical principles , 2009, SCA '09.

[7]  Tingfang Yan,et al.  Review of assistive strategies in powered lower-limb orthoses and exoskeletons , 2015, Robotics Auton. Syst..

[8]  Steven H. Collins,et al.  Design of Lower-Limb Exoskeletons and Emulator Systems , 2020 .

[9]  A. Kuo,et al.  Direction-dependent control of balance during walking and standing. , 2009, Journal of neurophysiology.

[10]  Siddhartha S. Srinivasa,et al.  DART: Dynamic Animation and Robotics Toolkit , 2018, J. Open Source Softw..

[11]  Sergey V. Drakunov,et al.  Capture Point: A Step toward Humanoid Push Recovery , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[12]  Silvestro Micera,et al.  Direction-Dependent Adaptation of Dynamic Gait Stability Following Waist-Pull Perturbations , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Sergey Levine,et al.  Trust Region Policy Optimization , 2015, ICML.

[14]  C. Karen Liu,et al.  Synthesis of biologically realistic human motion using joint torque actuation , 2019, ACM Trans. Graph..

[15]  Yan Lin,et al.  Human–robot interactive control based on reinforcement learning for gait rehabilitation training robot , 2019, International Journal of Advanced Robotic Systems.

[16]  S. Micera,et al.  An ecologically-controlled exoskeleton can improve balance recovery after slippage , 2017, Scientific Reports.

[17]  Thurmon E. Lockhart,et al.  Biomechanics of Human Gait – Slip and Fall Analysis , 2013 .

[18]  Jun Morimoto,et al.  Learning assistive strategies for exoskeleton robots from user-robot physical interaction , 2017, Pattern Recognit. Lett..

[19]  M S Redfern,et al.  Biomechanics of trailing leg response to slipping - evidence of interlimb and intralimb coordination. , 2009, Gait & posture.

[20]  Minh Tran,et al.  Design and Experimental Verification of Hip Exoskeleton With Balance Capacities for Walking Assistance , 2018, IEEE/ASME Transactions on Mechatronics.

[21]  L. Rubenstein Falls in older people: epidemiology, risk factors and strategies for prevention. , 2006, Age and ageing.

[22]  Nitish Thatte,et al.  Real-Time Reactive Trip Avoidance for Powered Transfemoral Prostheses , 2019, Robotics: Science and Systems.

[23]  H.A. Varol,et al.  Preliminary Evaluations of a Self-Contained Anthropomorphic Transfemoral Prosthesis , 2009, IEEE/ASME Transactions on Mechatronics.

[24]  H. Herr,et al.  Adaptive control of a variable-impedance ankle-foot orthosis to assist drop-foot gait , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  Jonathon W. Sensinger,et al.  Virtual Constraint Control of a Powered Prosthetic Leg: From Simulation to Experiments With Transfemoral Amputees , 2014, IEEE Transactions on Robotics.

[26]  Lihua Huang,et al.  Hybrid Control of the Berkeley Lower Extremity Exoskeleton (BLEEX) , 2006, Int. J. Robotics Res..

[27]  R. Brand,et al.  The biomechanics and motor control of human gait: Normal, elderly, and pathological , 1992 .

[28]  Juanjuan Zhang,et al.  Design of two lightweight, high-bandwidth torque-controlled ankle exoskeletons , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[29]  D. De Clercq,et al.  Exoskeleton plantarflexion assistance for elderly. , 2017, Gait & posture.

[30]  A. Hof,et al.  Balance responses to lateral perturbations in human treadmill walking , 2010, Journal of Experimental Biology.

[31]  Jonathon W. Sensinger,et al.  Speed-Adaptation Mechanism: Robotic Prostheses Can Actively Regulate Joint Torque , 2014, IEEE Robotics & Automation Magazine.

[32]  Xiaobo Zhang,et al.  Design and Control of a Powered Hip Exoskeleton for Walking Assistance , 2015 .

[33]  C. Karen Liu,et al.  Learning symmetric and low-energy locomotion , 2018, ACM Trans. Graph..

[34]  Manfred Morari,et al.  Automatic gait-pattern adaptation algorithms for rehabilitation with a 4-DOF robotic orthosis , 2004, IEEE Transactions on Robotics and Automation.

[35]  Shiqian Wang,et al.  Design and Control of the MINDWALKER Exoskeleton , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  Nitish Thatte,et al.  Toward Balance Recovery With Leg Prostheses Using Neuromuscular Model Control , 2016, IEEE Transactions on Biomedical Engineering.

[37]  Richard A. Brand,et al.  The biomechanics and motor control of human gait: Normal, elderly, and pathological , 1992 .

[38]  M. Srinivasan,et al.  Stepping in the direction of the fall: the next foot placement can be predicted from current upper body state in steady-state walking , 2014, Biology Letters.

[39]  R. Riener,et al.  Path Control: A Method for Patient-Cooperative Robot-Aided Gait Rehabilitation , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[40]  Martin Buss,et al.  Compliant actuation of rehabilitation robots , 2008, IEEE Robotics & Automation Magazine.