A Deep Learning Approach for Foot Trajectory Estimation in Gait Analysis Using Inertial Sensors

Gait performance is an important marker of motor and cognitive decline in older adults. An instrumented gait analysis resorting to inertial sensors allows the complete evaluation of spatiotemporal gait parameters, offering an alternative to laboratory-based assessments. To estimate gait parameters, foot trajectories are typically obtained by integrating acceleration two times. However, to deal with cumulative integration errors, additional error handling strategies are required. In this study, we propose an alternative approach based on a deep recurrent neural network to estimate heel and toe trajectories. We propose a coordinate frame transformation for stride trajectories that eliminates the dependency from previous strides and external inputs. Predicted trajectories are used to estimate an extensive set of spatiotemporal gait parameters. We evaluate the results in a dataset comprising foot-worn inertial sensor data acquired from a group of young adults, using an optical motion capture system as a reference. Heel and toe trajectories are predicted with low errors, in line with reference trajectories. A good agreement is also achieved between the reference and estimated gait parameters, in particular when turning strides are excluded from the analysis. The performance of the method is shown to be robust to imperfect sensor-foot alignment conditions.

[1]  Julius Hannink,et al.  Towards Mobile Gait Analysis: Concurrent Validity and Test-Retest Reliability of an Inertial Measurement System for the Assessment of Spatio-Temporal Gait Parameters , 2017, Sensors.

[2]  Daniel Hamacher,et al.  Towards the importance of minimum toe clearance in level ground walking in a healthy elderly population. , 2014, Gait & posture.

[3]  Kamiar Aminian,et al.  Heel and Toe Clearance Estimation for Gait Analysis Using Wireless Inertial Sensors , 2012, IEEE Transactions on Biomedical Engineering.

[4]  Manuel J. Marín-Jiménez,et al.  An End-to-End Multi-Task and Fusion CNN for Inertial-Based Gait Recognition , 2019, IEEE Access.

[5]  Bernd Markert,et al.  Prediction of lower limb joint angles and moments during gait using artificial neural networks , 2019, Medical & Biological Engineering & Computing.

[6]  Cem Ersoy,et al.  Deep Learning for Fall Risk Assessment With Inertial Sensors: Utilizing Domain Knowledge in Spatio-Temporal Gait Parameters , 2019, IEEE Journal of Biomedical and Health Informatics.

[7]  Bernd Markert,et al.  A Comparison of Three Neural Network Approaches for Estimating Joint Angles and Moments from Inertial Measurement Units , 2021, Sensors.

[8]  William I. Sellers,et al.  Locomotion pattern and foot pressure adjustments during gentle turns in healthy subjects. , 2017, Journal of biomechanics.

[9]  Vânia Guimarães,et al.  Gait events detection from heel and toe trajectories: comparison of methods using multiple datasets , 2021, 2021 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[10]  Isaac Skog,et al.  Evaluation of zero-velocity detectors for foot-mounted inertial navigation systems , 2010, 2010 International Conference on Indoor Positioning and Indoor Navigation.

[11]  O. Beauchet,et al.  Comprehensive Quantitative Spatiotemporal Gait Analysis Identifies Gait Characteristics for Early Dementia Subtyping in Community Dwelling Older Adults , 2019, Front. Neurol..

[12]  Cuili Wang,et al.  Predictive value of intrinsic capacity on adverse outcomes among community-dwelling older adults. , 2021, Geriatric nursing.

[13]  Ameet Talwalkar,et al.  Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization , 2016, J. Mach. Learn. Res..

[14]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[15]  Nicu Sebe,et al.  Explainable deep learning for efficient and robust pattern recognition: A survey of recent developments , 2021, Pattern Recognit..

[16]  Björn Eskofier,et al.  Inertial sensor based and shoe size independent gait analysis including heel and toe clearance estimation , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[17]  Julius Hannink,et al.  Benchmarking Foot Trajectory Estimation Methods for Mobile Gait Analysis , 2017, Sensors.

[18]  Andrew Markham,et al.  Deep Neural Network Based Inertial Odometry Using Low-Cost Inertial Measurement Units , 2021, IEEE Transactions on Mobile Computing.

[19]  Hanyu Wang,et al.  LSTM-CNN Architecture for Human Activity Recognition , 2020, IEEE Access.

[20]  Yong Yu,et al.  A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures , 2019, Neural Computation.

[21]  Angelo M. Sabatini,et al.  Assessment of walking features from foot inertial sensing , 2005, IEEE Transactions on Biomedical Engineering.

[22]  M. Mukaka,et al.  Statistics corner: A guide to appropriate use of correlation coefficient in medical research. , 2012, Malawi medical journal : the journal of Medical Association of Malawi.

[23]  F Huxham,et al.  Defining spatial parameters for non-linear walking. , 2006, Gait & posture.

[24]  Guang-Zhong Yang,et al.  Toward Pervasive Gait Analysis With Wearable Sensors: A Systematic Review , 2016, IEEE Journal of Biomedical and Health Informatics.

[25]  Luay Alawneh,et al.  A Comparison of Unidirectional and Bidirectional LSTM Networks for Human Activity Recognition , 2020, 2020 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[26]  L. Fratiglioni,et al.  Measuring gait speed to better identify prodromal dementia , 2019, Experimental Gerontology.

[27]  Han Wang,et al.  OriNet: Robust 3-D Orientation Estimation With a Single Particular IMU , 2020, IEEE Robotics and Automation Letters.

[28]  Luis Pastor Sánchez Fernández,et al.  Fuzzy inference model evaluating turn for Parkinson's disease patients , 2017, Comput. Biol. Medicine.

[29]  Bernd Markert,et al.  Artificial Neural Networks in Motion Analysis—Applications of Unsupervised and Heuristic Feature Selection Techniques , 2020, Sensors.

[30]  Itzik Klein,et al.  PDRNet: A Deep-Learning Pedestrian Dead Reckoning Framework , 2021, IEEE Sensors Journal.

[31]  Alexander J. Casson,et al.  Human activity recognition from inertial sensor time-series using batch normalized deep LSTM recurrent networks , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[32]  Rin-ichiro Taniguchi,et al.  End-to-End Learning Framework for IMU-Based 6-DOF Odometry , 2019, Sensors.

[33]  Sanam Moghaddamnia,et al.  Efficiency of deep neural networks for joint angle modeling in digital gait assessment , 2021, EURASIP Journal on Advances in Signal Processing.

[34]  Ken Shoemake,et al.  Uniform Random Rotations , 1992, Graphics Gems III.

[35]  Haiyong Luo,et al.  Pedestrian Stride-Length Estimation Based on LSTM and Denoising Autoencoders , 2019, Sensors.

[36]  Deokjai Choi,et al.  Data Augmentation for Inertial Sensor-Based Gait Deep Neural Network , 2020, IEEE Access.

[37]  Björn Eskofier,et al.  Inertial Sensor-Based Stride Parameter Calculation From Gait Sequences in Geriatric Patients , 2015, IEEE Transactions on Biomedical Engineering.

[38]  Jonathan Camargo,et al.  Automated gap-filling for marker-based biomechanical motion capture data , 2020, Computer methods in biomechanics and biomedical engineering.

[39]  Vânia Guimarães,et al.  Orientation-Invariant Spatio-Temporal Gait Analysis Using Foot-Worn Inertial Sensors , 2021, Sensors.

[40]  U. Lindemann Spatiotemporal gait analysis of older persons in clinical practice and research , 2019, Zeitschrift für Gerontologie und Geriatrie.

[41]  Cem Ersoy,et al.  Inertial Sensor-Based Robust Gait Analysis in Non-Hospital Settings for Neurological Disorders , 2017, Sensors.

[42]  Daniel T H Lai,et al.  A machine learning approach to estimate Minimum Toe Clearance using Inertial Measurement Units. , 2015, Journal of biomechanics.

[43]  Kamiar Aminian,et al.  On-Shoe Wearable Sensors for Gait and Turning Assessment of Patients With Parkinson's Disease , 2013, IEEE Transactions on Biomedical Engineering.

[44]  Bjoern M. Eskofier,et al.  Mobile Stride Length Estimation With Deep Convolutional Neural Networks , 2018, IEEE Journal of Biomedical and Health Informatics.

[45]  Stephanie A. Bridenbaugh,et al.  Laboratory Review: The Role of Gait Analysis in Seniors’ Mobility and Fall Prevention , 2010, Gerontology.

[46]  D. Pradon,et al.  Dynamic Stability and Risk of Tripping during the Timed Up and Go Test in Hemiparetic and Healthy Subjects , 2015, PloS one.

[47]  Kamiar Aminian,et al.  3D gait assessment in young and elderly subjects using foot-worn inertial sensors. , 2010, Journal of biomechanics.

[48]  Douglas G. Altman,et al.  Measurement in Medicine: The Analysis of Method Comparison Studies , 1983 .

[49]  E. Freiberger,et al.  Mobility in Older Community-Dwelling Persons: A Narrative Review , 2020, Frontiers in Physiology.

[50]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[51]  Wolfram Burgard,et al.  Online marker labeling for fully automatic skeleton tracking in optical motion capture , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[52]  Qiang Zhang,et al.  Usual walking speed and all-cause mortality risk in older people: A systematic review and meta-analysis. , 2016, Gait & posture.

[53]  Julius Hannink,et al.  Sensor-Based Gait Parameter Extraction With Deep Convolutional Neural Networks , 2016, IEEE Journal of Biomedical and Health Informatics.

[54]  Bernd Markert,et al.  A systematic review of gait analysis methods based on inertial sensors and adaptive algorithms. , 2017, Gait & posture.