Walking Gait Phase Detection Based on Acceleration Signals Using Voting-Weighted Integrated Neural Network

Human gait phase recognition is a significant technology for rehabilitation training robot, human disease diagnosis, artificial prosthesis, and so on. The efficient design of the recognition method for gait information is the key issue in the current gait phase division and eigenvalues extraction research. In this paper, a novel voting-weighted integrated neural network (VWI-DNN) is proposed to detect different gait phases from multidimensional acceleration signals. More specifically, it first employs a gait information acquisition system to collect different IMU sensors data fixed on the human lower limb. Then, with dimensionality reduction and four-phase division preprocessing, key features are selected and merged as unified vectors to learn common and domain knowledge in time domain. Next, multiple refined DNNs are transferred to design a multistream integrated neural network, which utilizes the mixture-granularity information to exploit high-dimensional feature representative. Finally, a voting-weighted function is developed to fuse different submodels as a unified representation for distinguishing small discrepancy among different gait phases. The end-to-end implementation of the VWI-DNN model is fine-tuned by the loss optimization of gradient back-propagation. Experimental results demonstrate the outperforming performance of the proposed method with higher classification accuracy compared with the other methods, of which classification accuracy and macro-F1 is up to 99.5%. More discussions are provided to indicate the potential applications in combination with other works.

[1]  Omer T. Inan,et al.  Instrumented Ankle–Foot Orthosis: Toward a Clinical Assessment Tool for Patient-Specific Optimization of Orthotic Ankle Stiffness , 2017, IEEE/ASME Transactions on Mechatronics.

[2]  Hung T. Nguyen,et al.  Unsupervised nonparametric method for gait analysis using a waist-worn inertial sensor , 2014, Appl. Soft Comput..

[3]  Gabriella Balestra,et al.  Muscle activation patterns during gait: A hierarchical clustering analysis , 2017, Biomed. Signal Process. Control..

[4]  R. Kram,et al.  Changing the demand on specific muscle groups affects the walk–run transition speed , 2008, Journal of Experimental Biology.

[5]  Shamik Sural,et al.  Information fusion from multiple cameras for gait-based re-identification and recognition , 2015, IET Image Process..

[6]  M. Benedetti,et al.  Gait analysis contribution to problems identification and surgical planning in CP patients: an agreement study. , 2015, European journal of physical and rehabilitation medicine.

[7]  Tingfang Yan,et al.  Review of assistive strategies in powered lower-limb orthoses and exoskeletons , 2015, Robotics Auton. Syst..

[8]  Yoichi Shimada,et al.  Clinical application of acceleration sensor to detect the swing phase of stroke gait in functional electrical stimulation. , 2005, The Tohoku journal of experimental medicine.

[9]  Marcela Munera,et al.  Gait Phase Detection for Lower-Limb Exoskeletons using Foot Motion Data from a Single Inertial Measurement Unit in Hemiparetic Individuals , 2019, Sensors.

[10]  Ryang-Hee Sohn,et al.  Development of an active ankle foot orthosis to prevent foot drop and toe drag in hemiplegic patients: A preliminary study , 2011 .

[11]  Carlotta Mummolo,et al.  Quantifying dynamic characteristics of human walking for comprehensive gait cycle. , 2013, Journal of biomechanical engineering.

[12]  Bernd Markert,et al.  A systematic review of gait analysis methods based on inertial sensors and adaptive algorithms. , 2017, Gait & posture.

[13]  Nurhazimah Nazmi,et al.  Walking gait event detection based on electromyography signals using artificial neural network , 2019, Biomed. Signal Process. Control..

[14]  George D. C. Cavalcanti,et al.  A global-ranking local feature selection method for text categorization , 2012, Expert Syst. Appl..

[15]  Ji Ma,et al.  Dimension reduction of image deep feature using PCA , 2019, J. Vis. Commun. Image Represent..

[16]  Tingli Su,et al.  Probability Fusion Decision Framework of Multiple Deep Neural Networks for Fine-Grained Visual Classification , 2019, IEEE Access.

[17]  Renzo Capitani,et al.  An integrated artificial neural network–unscented Kalman filter vehicle sideslip angle estimation based on inertial measurement unit measurements , 2018, Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering.

[18]  Stephen R Lord,et al.  Step training improves reaction time, gait and balance and reduces falls in older people: a systematic review and meta-analysis , 2016, British Journal of Sports Medicine.

[19]  K. V. Krishna Kishore,et al.  Performance evaluation of DNN with other machine learning techniques in a cluster using Apache Spark and MLlib , 2018 .

[20]  Lei Wang,et al.  Research on Face Recognition Method Based on Combination of SVM and LDA-PCA , 2014 .

[21]  Xi Chen,et al.  Application of an Improved Correlation Method in Electrostatic Gait Recognition of Hemiparetic Patients , 2019, Sensors.

[22]  Michael Goldfarb,et al.  Towards the use of a lower limb exoskeleton for locomotion assistance in individuals with neuromuscular locomotor deficits , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Eduardo Palermo,et al.  Real-time gait detection based on Hidden Markov Model: Is it possible to avoid training procedure? , 2015, 2015 IEEE International Symposium on Medical Measurements and Applications (MeMeA) Proceedings.

[24]  Eduardo Palermo,et al.  A Novel HMM Distributed Classifier for the Detection of Gait Phases by Means of a Wearable Inertial Sensor Network , 2014, Sensors.

[25]  Heitor Silvério Lopes,et al.  Neural networks for protein classification , 2004, Applied bioinformatics.

[26]  M. Hanlon,et al.  Real-time gait event detection using wearable sensors. , 2006, Gait & posture.

[27]  Xiaohui Zhang,et al.  Parallel training of Deep Neural Networks with Natural Gradient and Parameter Averaging , 2014, ICLR.

[28]  Huayong Yang,et al.  Proportion-based fuzzy gait phase detection using the smart insole , 2018 .

[29]  Min Zuo,et al.  CropDeep: The Crop Vision Dataset for Deep-Learning-Based Classification and Detection in Precision Agriculture , 2019, Sensors.

[30]  Ron Kohavi,et al.  The Case against Accuracy Estimation for Comparing Induction Algorithms , 1998, ICML.

[31]  Bram Vanderborght,et al.  ED-FNN: A New Deep Learning Algorithm to Detect Percentage of the Gait Cycle for Powered Prostheses , 2018, Sensors.

[32]  Hailong Zhu,et al.  Support vector machine for classification of walking conditions of persons after stroke with dropped foot. , 2009, Human movement science.

[33]  Gracián Triviño,et al.  Walking pattern classification using a granular linguistic analysis , 2015, Appl. Soft Comput..

[34]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[35]  Trevor Hastie,et al.  Multi-class AdaBoost ∗ , 2009 .

[36]  Eduardo Palermo,et al.  Gait Partitioning Methods: A Systematic Review , 2016, Sensors.

[37]  Tingli Su,et al.  Integrated Predictor Based on Decomposition Mechanism for PM2.5 Long-Term Prediction , 2019, Applied Sciences.

[38]  Giancarlo Ferrigno,et al.  A Novel Adaptive, Real-Time Algorithm to Detect Gait Events From Wearable Sensors , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Tingli Su,et al.  Compound Autoregressive Network for Prediction of Multivariate Time Series , 2019, Complex..