Heuristic-Based Ankle Exoskeleton Control for Co-Adaptive Assistance of Human Locomotion

Assisting human locomotion with exoskeletons is challenging, largely due to the complexity of the neuromusculoskeletal system, the time-varying dynamics that accompany motor learning, and the uniqueness of every individual’s response to device assistance. Assistance strategies designed to keep the human “in-the-loop” can help overcome many of these challenges. The purpose of this study was to develop a human-in-the-loop assistance strategy that uses co-adaptive control to slowly and continuously respond to biomechanical changes thought to encode the user’s needs. Online measurements of muscle activity and joint kinematics were used to guide the evolution of an exoskeleton torque pattern based on the following heuristics: 1) muscle activity that acts cooperatively with the exoskeleton indicates the user wants more torque; 2) muscle activity that acts antagonistically to the exoskeleton indicates the user wants less torque; and 3) torque should stop increasing if the user is not adapting. We applied our controller to tethered, bilateral ankle exoskeletons worn by naïve participants as they walked on a treadmill at 1.25 m $\cdot$ s−1 for 30 minutes. The evolved torque profiles reduced the root-mean-square of soleus muscle activity by 35±12% and metabolic rate by 22±8% compared to walking with the exoskeletons while they provided no torque. This was equivalent to a 9±12% reduction in metabolic rate when compared to normal walking. Furthermore, the algorithm was responsive to changes in each user’s coordination patterns. These results confirm the effectiveness of the controller and suggest a new approach to exoskeleton assistance aimed at fostering co-adaptation with the user. This technique might particularly benefit individuals with age-related muscle weakness.

[1]  Mikhail Kuznetsov,et al.  Filtering the surface EMG signal: Movement artifact and baseline noise contamination. , 2010, Journal of biomechanics.

[2]  S. Collins,et al.  Recycling Energy to Restore Impaired Ankle Function during Human Walking , 2010, PloS one.

[3]  Daniel P. Ferris,et al.  Learning to walk with an adaptive gain proportional myoelectric controller for a robotic ankle exoskeleton , 2015, Journal of NeuroEngineering and Rehabilitation.

[4]  Arthur D Kuo,et al.  Energetics of actively powered locomotion using the simplest walking model. , 2002, Journal of biomechanical engineering.

[5]  Rachel W Jackson,et al.  An experimental comparison of the relative benefits of work and torque assistance in ankle exoskeletons. , 2015, Journal of applied physiology.

[6]  Daniel P. Ferris,et al.  'Body-in-the-Loop' Optimization of Assistive Robotic Devices: A Validation Study , 2016, Robotics: Science and Systems.

[7]  Scott Kuindersma,et al.  Human-in-the-loop optimization of hip assistance with a soft exosuit during walking , 2018, Science Robotics.

[8]  Scott Kuindersma,et al.  Human-in-the-loop Bayesian optimization of wearable device parameters , 2017, PloS one.

[9]  Anil K. Raj,et al.  Mina: A Sensorimotor Robotic Orthosis for Mobility Assistance , 2011, J. Robotics.

[10]  Rachel W Jackson,et al.  Human-in-the-loop optimization of exoskeleton assistance during walking , 2017, Science.

[11]  Jusuk Lee,et al.  Fully autonomous hip exoskeleton saves metabolic cost of walking , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[12]  J. Higginson,et al.  Assist-as-Needed Robot-Aided Gait Training Improves Walking Function in Individuals Following Stroke , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Hugh M Herr,et al.  Autonomous exoskeleton reduces metabolic cost of human walking , 2014, Journal of NeuroEngineering and Rehabilitation.

[14]  J. Maxwell Donelan,et al.  "Body-In-The-Loop": Optimizing Device Parameters Using Measures of Instantaneous Energetic Cost , 2015, PloS one.

[15]  Juanjuan Zhang,et al.  Design of two lightweight, high-bandwidth torque-controlled ankle exoskeletons , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[16]  R. Kram,et al.  The effects of adding mass to the legs on the energetics and biomechanics of walking. , 2007, Medicine and science in sports and exercise.

[17]  Conor J. Walsh,et al.  Assistance magnitude versus metabolic cost reductions for a tethered multiarticular soft exosuit , 2017, Science Robotics.

[18]  J. Brockway Derivation of formulae used to calculate energy expenditure in man. , 1987, Human nutrition. Clinical nutrition.

[19]  D. De Clercq,et al.  Exoskeleton plantarflexion assistance for elderly. , 2017, Gait & posture.

[20]  Jessica C. Selinger,et al.  Humans Can Continuously Optimize Energetic Cost during Walking , 2015, Current Biology.

[21]  Steven H Collins,et al.  A universal ankle-foot prosthesis emulator for human locomotion experiments. , 2014, Journal of biomechanical engineering.

[22]  Chien Chern Cheah,et al.  Torque Control in Legged Locomotion , 2017 .

[23]  K. Jellinger,et al.  Aids to the Examination of the Peripheral Nervous System , 2001 .

[24]  Soha Pouya,et al.  Simulating Ideal Assistive Devices to Reduce the Metabolic Cost of Running , 2016, PloS one.

[25]  C. Walsh,et al.  A soft robotic exosuit improves walking in patients after stroke , 2017, Science Translational Medicine.

[26]  Daniel P. Ferris,et al.  Learning to walk with a robotic ankle exoskeleton. , 2007, Journal of biomechanics.

[27]  Daniel P Ferris,et al.  Biomechanics and energetics of walking in powered ankle exoskeletons using myoelectric control versus mechanically intrinsic control , 2018, Journal of NeuroEngineering and Rehabilitation.

[28]  Alena M. Grabowski,et al.  Independent metabolic costs of supporting body weight and accelerating body mass during walking. , 2005, Journal of applied physiology.

[29]  Daniel P Ferris,et al.  An improved powered ankle-foot orthosis using proportional myoelectric control. , 2006, Gait & posture.

[30]  R. Kram,et al.  Metabolic cost of generating muscular force in human walking: insights from load-carrying and speed experiments. , 2003, Journal of applied physiology.

[31]  Sunil K. Agrawal,et al.  Powered Hip Exoskeletons Can Reduce the User's Hip and Ankle Muscle Activations During Walking , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Dirk De Clercq,et al.  Reducing the metabolic cost of walking with an ankle exoskeleton: interaction between actuation timing and power , 2017, Journal of NeuroEngineering and Rehabilitation.

[33]  Gregory S. Sawicki,et al.  Reducing the energy cost of human walking using an unpowered exoskeleton , 2015, Nature.

[34]  A. Looker,et al.  Prevalence of reduced muscle strength in older U.S. adults: United States, 2011-2012. , 2015, NCHS data brief.

[35]  Scott L Delp,et al.  Simulating ideal assistive devices to reduce the metabolic cost of walking with heavy loads , 2017, PloS one.

[36]  D. De Clercq,et al.  A Simple Exoskeleton That Assists Plantarflexion Can Reduce the Metabolic Cost of Human Walking , 2013, PloS one.

[37]  Daniel P. Ferris,et al.  Mechanics and energetics of level walking with powered ankle exoskeletons , 2008, Journal of Experimental Biology.

[38]  DR McCluskey,et al.  Aids to the examination of the peripheral nervous system , 1989, Practical Neurology.

[39]  A. Ijspeert,et al.  A multidirectional gravity-assist algorithm that enhances locomotor control in patients with stroke or spinal cord injury , 2017, Science Translational Medicine.