Real-Time On-Board Recognition of Continuous Locomotion Modes for Amputees With Robotic Transtibial Prostheses

Human intent recognition is important to the control of robotic prosthesis. In this paper, we propose a multi-level real-time on-board system to recognize continuous locomotion modes. A cascaded classification strategy is designed for the recognition of six steady locomotion modes and 10 transitions. On-board signals of the robotic prosthesis include two inertial measurement units and one load cell. Three transtibial amputees are recruited in the experiments. The prediction decision time of the real-time on-board cascaded classification system is about 3.3 ms, which is enough short compared with the sliding window increment 10 ms. It is easy to recognize the standing and ambulation in the first-level classification with a 99.86% accuracy by quadratic discriminant analysis (QDA) classifier. In the second-level classification, threshold method is adopted to divide one stride into swing and stance phases. In swing phase, five steady modes are recognized with a total accuracy of 96.40%. In stance phase, all these five steady modes are recognized with a total accuracy of 91.21%. The average recognition accuracy of the three subjects is 93.21% by QDA classifier. Besides, for transitions, the proposed system could recognize all transitions rightly. The designed system is feasible and effective to realize real-time on-board recognition of continuous locomotion modes, which is promising for the further control of the prosthesis.

[1]  R Jiménez-Fabián,et al.  Review of control algorithms for robotic ankle systems in lower-limb orthoses, prostheses, and exoskeletons. , 2012, Medical engineering & physics.

[2]  Long Wang,et al.  A Noncontact Capacitive Sensing System for Recognizing Locomotion Modes of Transtibial Amputees , 2014, IEEE Transactions on Biomedical Engineering.

[3]  Baojun Chen,et al.  A Locomotion Intent Prediction System Based on Multi-Sensor Fusion , 2014, Sensors.

[4]  Aaron J. Young,et al.  Analysis of using EMG and mechanical sensors to enhance intent recognition in powered lower limb prostheses , 2014, Journal of neural engineering.

[5]  Ming Liu,et al.  Effects of Locomotion Mode Recognition Errors on Volitional Control of Powered Above-Knee Prostheses , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Levi J. Hargrove,et al.  A Classification Method for User-Independent Intent Recognition for Transfemoral Amputees Using Powered Lower Limb Prostheses , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Enhao Zheng,et al.  Noncontact Capacitive Sensing-Based Locomotion Transition Recognition for Amputees With Robotic Transtibial Prostheses , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Andrea Parri,et al.  Gait Phase Estimation Based on Noncontact Capacitive Sensing and Adaptive Oscillators , 2017, IEEE Transactions on Biomedical Engineering.

[9]  Uriel Martinez-Hernandez,et al.  Adaptive Bayesian inference system for recognition of walking activities and prediction of gait events using wearable sensors , 2018, Neural Networks.

[10]  Nicholas P. Fey,et al.  Intent Recognition in a Powered Lower Limb Prosthesis Using Time History Information , 2013, Annals of Biomedical Engineering.

[11]  Kimberly A. Ingraham,et al.  Delaying Ambulation Mode Transition Decisions Improves Accuracy of a Flexible Control System for Powered Knee-Ankle Prosthesis , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Qining Wang,et al.  Combining Push-Off Power and Nonlinear Damping Behaviors for a Lightweight Motor-Driven Transtibial Prosthesis , 2017, IEEE/ASME Transactions on Mechatronics.

[13]  Rohit Gupta,et al.  Continuous human locomotion identification for lower limb prosthesis control , 2018, CSI Transactions on ICT.

[14]  Long Wang,et al.  Walk the Walk: A Lightweight Active Transtibial Prosthesis , 2015, IEEE Robotics & Automation Magazine.

[15]  Long Wang,et al.  Energy-Efficient Braking Torque Control of Robotic Transtibial Prosthesis , 2017, IEEE/ASME Transactions on Mechatronics.

[16]  Suzanne B. Finucane,et al.  Online adaptive neural control of a robotic lower limb prosthesis , 2018, Journal of neural engineering.

[17]  Fan Zhang,et al.  Source Selection for Real-Time User Intent Recognition Toward Volitional Control of Artificial Legs , 2013, IEEE Journal of Biomedical and Health Informatics.

[18]  J. Rafiee,et al.  Feature extraction of forearm EMG signals for prosthetics , 2011, Expert Syst. Appl..

[19]  Fan Zhang,et al.  An Adaptive Classification Strategy for Reliable Locomotion Mode Recognition , 2017, Sensors.

[20]  Deepak Joshi,et al.  Terrain and Direction Classification of Locomotion Transitions Using Neuromuscular and Mechanical Input , 2015, Annals of Biomedical Engineering.

[21]  Hugh M. Herr,et al.  Powered Ankle--Foot Prosthesis Improves Walking Metabolic Economy , 2009, IEEE Transactions on Robotics.

[22]  Levi J. Hargrove,et al.  Detection of and Compensation for EMG Disturbances for Powered Lower Limb Prosthesis Control , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[24]  Jason D. Miller,et al.  Myoelectric Walking Mode Classification for Transtibial Amputees , 2013, IEEE Transactions on Biomedical Engineering.

[25]  Deepak Joshi,et al.  High energy spectrogram with integrated prior knowledge for EMG-based locomotion classification. , 2015, Medical engineering & physics.

[26]  Ann M. Simon,et al.  A Training Method for Locomotion Mode Prediction Using Powered Lower Limb Prostheses , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  Levi J. Hargrove,et al.  Neuromechanical sensor fusion yields highest accuracies in predicting ambulation mode transitions for trans-tibial amputees , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[28]  Kimberly A. Ingraham,et al.  Intuitive control of a powered prosthetic leg during ambulation: a randomized clinical trial. , 2015, JAMA.

[29]  Michael Goldfarb,et al.  Variable Cadence Walking and Ground Adaptive Standing With a Powered Ankle Prosthesis , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  Raja Ariffin Raja Ghazilla,et al.  Reviews on Various Inertial Measurement Unit (IMU) Sensor Applications , 2013, SiPS 2013.

[31]  Angkoon Phinyomark,et al.  EMG feature evaluation for improving myoelectric pattern recognition robustness , 2013, Expert Syst. Appl..

[32]  Fan Zhang,et al.  Continuous Locomotion-Mode Identification for Prosthetic Legs Based on Neuromuscular–Mechanical Fusion , 2011, IEEE Transactions on Biomedical Engineering.

[33]  He Huang,et al.  A Strategy for Identifying Locomotion Modes Using Surface Electromyography , 2009, IEEE Transactions on Biomedical Engineering.

[34]  Zhaohui Wu,et al.  Accelerometer-Based Gait Recognition by Sparse Representation of Signature Points With Clusters , 2015, IEEE Transactions on Cybernetics.

[35]  Deok-Hwan Kim,et al.  Real‐Time Locomotion Mode Recognition Employing Correlation Feature Analysis Using EMG Pattern , 2014 .

[36]  Long Wang,et al.  Fuzzy-Logic-Based Terrain Identification with Multisensor Fusion for Transtibial Amputees , 2015, IEEE/ASME Transactions on Mechatronics.