Walking Gait Phase Detection Based on Acceleration Signals Using LSTM-DNN Algorithm

Gait phase detection is a new biometric method which is of great significance in gait correction, disease diagnosis, and exoskeleton assisted robots. Especially for the development of bone assisted robots, gait phase recognition is an indispensable key technology. In this study, the main characteristics of the gait phases were determined to identify each gait phase. A long short-term memory-deep neural network (LSTM-DNN) algorithm is proposed for gate detection. Compared with the traditional threshold algorithm and the LSTM, the proposed algorithm has higher detection accuracy for different walking speeds and different test subjects. During the identification process, the acceleration signals obtained from the acceleration sensors were normalized to ensure that the different features had the same scale. Principal components analysis (PCA) was used to reduce the data dimensionality and the processed data were used to create the input feature vector of the LSTM-DNN algorithm. Finally, the data set was classified using the Softmax classifier in the full connection layer. Different algorithms were applied to the gait phase detection of multiple male and female subjects. The experimental results showed that the gait-phase recognition accuracy and F-score of the LSTM-DNN algorithm are over 91.8% and 92%, respectively, which is better than the other three algorithms and also verifies the effectiveness of the LSTM-DNN algorithm in practice.

[1]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Rubita Sudirman,et al.  Features extraction of electromyography signals in time domain on biceps brachii muscle , 2013 .

[3]  Ali Shariq Imran,et al.  A Comparative Study of Deep Learning Techniques on Frame-Level Speech Data Classification , 2019, Circuits Syst. Signal Process..

[4]  T. Kiryu,et al.  An Internet-based cycle ergometer system by using distributed computing , 2003, 4th International IEEE EMBS Special Topic Conference on Information Technology Applications in Biomedicine, 2003..

[5]  Bernd Markert,et al.  A systematic review of gait analysis methods based on inertial sensors and adaptive algorithms. , 2017, Gait & posture.

[6]  Eduardo Palermo,et al.  A Novel HMM Distributed Classifier for the Detection of Gait Phases by Means of a Wearable Inertial Sensor Network , 2014, Sensors.

[7]  Huayong Yang,et al.  Proportion-based fuzzy gait phase detection using the smart insole , 2018 .

[8]  Maxim A. Batalin,et al.  Incremental Diagnosis Method for Intelligent Wearable Sensor Systems , 2007, IEEE Transactions on Information Technology in Biomedicine.

[9]  Marcela Munera,et al.  Gait Phase Detection for Lower-Limb Exoskeletons using Foot Motion Data from a Single Inertial Measurement Unit in Hemiparetic Individuals , 2019, Sensors.

[10]  Wei-Yi Yang,et al.  Research on Improved PCA Face Recognition Algorithm , 2019 .

[11]  Marco Donati,et al.  An enhanced estimate of initial contact and final contact instants of time using lower trunk inertial sensor data. , 2012, Gait & posture.

[12]  Tingli Su,et al.  Compound Autoregressive Network for Prediction of Multivariate Time Series , 2019, Complex..

[13]  Hung T. Nguyen,et al.  Unsupervised nonparametric method for gait analysis using a waist-worn inertial sensor , 2014, Appl. Soft Comput..

[14]  Gabriella Balestra,et al.  Muscle activation patterns during gait: A hierarchical clustering analysis , 2017, Biomed. Signal Process. Control..

[15]  Guido Pasquini,et al.  Online Phase Detection Using Wearable Sensors for Walking with a Robotic Prosthesis , 2014, Sensors.

[16]  Giancarlo Ferrigno,et al.  A Novel Adaptive, Real-Time Algorithm to Detect Gait Events From Wearable Sensors , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Tingfang Yan,et al.  Review of assistive strategies in powered lower-limb orthoses and exoskeletons , 2015, Robotics Auton. Syst..

[18]  Hylton B Menz,et al.  Accelerometry: a technique for quantifying movement patterns during walking. , 2008, Gait & posture.

[19]  Stephen R Lord,et al.  Step training improves reaction time, gait and balance and reduces falls in older people: a systematic review and meta-analysis , 2016, British Journal of Sports Medicine.

[20]  Ming Tang,et al.  Automatic Hypernasality Detection in Cleft Palate Speech Using CNN , 2019, Circuits, systems, and signal processing.

[21]  Michael Goldfarb,et al.  Towards the use of a lower limb exoskeleton for locomotion assistance in individuals with neuromuscular locomotor deficits , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[22]  Hongnian Yu,et al.  Optimal Foot Location for Placing Wearable IMU Sensors and Automatic Feature Extraction for Gait Analysis , 2018, IEEE Sensors Journal.

[23]  H. van der Kooij,et al.  Design and Evaluation of the LOPES Exoskeleton Robot for Interactive Gait Rehabilitation , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Iván González,et al.  An Ambulatory System for Gait Monitoring Based on Wireless Sensorized Insoles , 2015, Sensors.

[25]  Yoichi Shimada,et al.  Clinical application of acceleration sensor to detect the swing phase of stroke gait in functional electrical stimulation. , 2005, The Tohoku journal of experimental medicine.

[26]  Anselmo Frizera,et al.  Estimation of gait parameters by measuring upper limb–walker interaction forces , 2010 .

[27]  Eduardo Palermo,et al.  Real-time gait detection based on Hidden Markov Model: Is it possible to avoid training procedure? , 2015, 2015 IEEE International Symposium on Medical Measurements and Applications (MeMeA) Proceedings.

[28]  Hanghang Tong,et al.  Activity recognition with smartphone sensors , 2014 .

[29]  Eduardo Palermo,et al.  Gait Partitioning Methods: A Systematic Review , 2016, Sensors.

[30]  Tuo Zhao,et al.  Review wearable sensing system for gait recognition , 2019, Cluster Computing.

[31]  Cristina P. Santos,et al.  Real-Time Gait Events Detection during Walking of Biped Model and Humanoid Robot through Adaptive Thresholds , 2016, 2016 International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[32]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[33]  Cheng Wang,et al.  Aitken-Based Stochastic Gradient Algorithm for ARX Models with Time Delay , 2019, Circuits Syst. Signal Process..

[34]  Jan Rueterbories,et al.  Gait event detection for use in FES rehabilitation by radial and tangential foot accelerations. , 2014, Medical engineering & physics.

[35]  Shamik Sural,et al.  Information fusion from multiple cameras for gait-based re-identification and recognition , 2015, IET Image Process..

[36]  Hassan Ghasemzadeh,et al.  A Method for Extracting Temporal Parameters Based on Hidden Markov Models in Body Sensor Networks With Inertial Sensors , 2009, IEEE Transactions on Information Technology in Biomedicine.

[37]  Bram Vanderborght,et al.  ED-FNN: A New Deep Learning Algorithm to Detect Percentage of the Gait Cycle for Powered Prostheses , 2018, Sensors.

[38]  Myeongkyu Kim,et al.  Development of an IMU-based foot-ground contact detection (FGCD) algorithm , 2017, Ergonomics.

[39]  Tingli Su,et al.  Integrated Predictor Based on Decomposition Mechanism for PM2.5 Long-Term Prediction , 2019, Applied Sciences.

[40]  Axel Coussement,et al.  Assessment of different chemistry reduction methods based on principal component analysis: Comparison of the MG-PCA and score-PCA approaches , 2016 .

[41]  Qian Sun,et al.  Spatio-Temporal Prediction for the Monitoring-Blind Area of Industrial Atmosphere Based on the Fusion Network , 2019, International journal of environmental research and public health.

[42]  Allon Goldberg,et al.  Gait disorders: search for multiple causes. , 2005, Cleveland Clinic journal of medicine.

[43]  Zaccaria Del Prete,et al.  Measuring Gait Quality in Parkinson’s Disease through Real-Time Gait Phase Recognition , 2018, Sensors.

[44]  Axel Coussement,et al.  PCA and Kriging for the efficient exploration of consistency regions in Uncertainty Quantification , 2019 .

[45]  Carlotta Mummolo,et al.  Quantifying dynamic characteristics of human walking for comprehensive gait cycle. , 2013, Journal of biomechanical engineering.

[46]  Tingli Su,et al.  Probability Fusion Decision Framework of Multiple Deep Neural Networks for Fine-Grained Visual Classification , 2019, IEEE Access.

[47]  Min Zuo,et al.  CropDeep: The Crop Vision Dataset for Deep-Learning-Based Classification and Detection in Precision Agriculture , 2019, Sensors.