Automatic real-time gait event detection in children using deep neural networks

Annotation of foot-contact and foot-off events is the initial step in post-processing for most quantitative gait analysis workflows. If clean force plate strikes are present, the events can be automatically detected. Otherwise, annotation of gait events is performed manually, since reliable automatic tools are not available. Automatic annotation methods have been proposed for normal gait, but are usually based on heuristics of the coordinates and velocities of motion capture markers placed on the feet. These heuristics do not generalize to pathological gait due to greater variability in kinematics and anatomy of patients, as well as the presence of assistive devices. In this paper, we use a data-driven approach to predict foot-contact and foot-off events from kinematic and marker time series in children with normal and pathological gait. Through analysis of 9092 gait cycle measurements we build a predictive model using Long Short-Term Memory (LSTM) artificial neural networks. The best-performing model identifies foot-contact and foot-off events with an average error of 10 and 13 milliseconds respectively, outperforming popular heuristic-based approaches. We conclude that the accuracy of our approach is sufficient for most clinical and research applications in the pediatric population. Moreover, the LSTM architecture enables real-time predictions, enabling applications for real-time control of active assistive devices, orthoses, or prostheses. We provide the model, usage examples, and the training code in an open-source package.

[1]  Bjoern M. Eskofier,et al.  Mobile Stride Length Estimation With Deep Convolutional Neural Networks , 2018, IEEE Journal of Biomedical and Health Informatics.

[2]  J. Allum,et al.  Gait event detection using linear accelerometers or angular velocity transducers in able-bodied and spinal-cord injured individuals. , 2006, Gait & posture.

[3]  R. B. Davis,et al.  A gait analysis data collection and reduction technique , 1991 .

[4]  J S Higginson,et al.  Two simple methods for determining gait events during treadmill and overground walking using kinematic data. , 2008, Gait & posture.

[5]  Irene S Davis,et al.  Comparison of methods for kinematic identification of footstrike and toe-off during overground and treadmill running. , 2010, Journal of science and medicine in sport.

[6]  M P Kadaba,et al.  Measurement of lower extremity kinematics during level walking , 1990, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[7]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[8]  Ciara M O'Connor,et al.  Automatic detection of gait events using kinematic data. , 2007, Gait & posture.

[9]  Adam Miller,et al.  Gait event detection using a multilayer neural network. , 2009, Gait & posture.

[10]  Joris De Schutter,et al.  Real-Time Gait Event Detection Based on Kinematic Data Coupled to a Biomechanical Model , 2017, Sensors.

[11]  E Yiou,et al.  Detection of swing heel-off event in gait initiation using force-plate data. , 2013, Gait & posture.

[12]  R N Marshall,et al.  Algorithms to determine event timing during normal walking using kinematic data. , 2000, Journal of biomechanics.

[13]  T. Karčnik,et al.  Using motion analysis data for foot-floor contact detection , 2003, Medical and Biological Engineering and Computing.

[14]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[15]  Guido Van Rossum,et al.  Python Tutorial , 1999 .

[16]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[17]  B-J Hsue,et al.  GAIT TIMING EVENT DETERMINATION USING KINEMATIC DATA FOR THE TOE WALKING CHILDREN WITH CEREBREAL PALSY , 2007 .

[18]  Yeh-Liang Hsu,et al.  A Review of Accelerometry-Based Wearable Motion Detectors for Physical Activity Monitoring , 2010, Sensors.

[19]  B. Doval,et al.  On the use of the derivative of electroglottographic signals for characterization of nonpathological phonation. , 2004, The Journal of the Acoustical Society of America.

[20]  J. Reginster,et al.  Smart wearable body sensors for patient self-assessment and monitoring , 2014, Archives of Public Health.

[21]  Hassen Fourati,et al.  Heterogeneous Data Fusion Algorithm for Pedestrian Navigation via Foot-Mounted Inertial Measurement Unit and Complementary Filter , 2015, IEEE Transactions on Instrumentation and Measurement.

[22]  Angelo M. Sabatini,et al.  Online Decoding of Hidden Markov Models for Gait Event Detection Using Foot-Mounted Gyroscopes , 2014, IEEE Journal of Biomedical and Health Informatics.

[23]  Richard Baker,et al.  Measuring distance walked and step count in children with cerebral palsy: an evaluation of two portable activity monitors. , 2009, Gait & posture.

[24]  Dustin A. Bruening,et al.  Comparison of Automated Event Detection Algorithms in Pathological Gait , 2014 .

[25]  Salim Ghoussayni,et al.  Assessment and validation of a simple automated method for the detection of gait events and intervals. , 2004, Gait & posture.

[26]  A. Schache,et al.  A comparison of overground and treadmill running for measuring the three-dimensional kinematics of the lumbo-pelvic-hip complex. , 2001, Clinical biomechanics.

[27]  Arnaud Barré,et al.  Biomechanical ToolKit: Open-source framework to visualize and process biomechanical data , 2014, Comput. Methods Programs Biomed..

[28]  Emil Olsen,et al.  Accuracy and Precision of Equine Gait Event Detection during Walking with Limb and Trunk Mounted Inertial Sensors , 2012, Sensors.

[29]  M.M. Skelly,et al.  Real-time gait event detection for paraplegic FES walking , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  Julius Hannink,et al.  Sensor-Based Gait Parameter Extraction With Deep Convolutional Neural Networks , 2016, IEEE Journal of Biomedical and Health Informatics.

[31]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[32]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[33]  B. Batlkham,et al.  A Kinematic Comparison of Overground and Treadmill Walking. , 2014, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[34]  Brian T. Smith,et al.  Application of a neuro-fuzzy network for gait event detection using electromyography in the child with Cerebral palsy , 2005, IEEE Transactions on Biomedical Engineering.

[35]  Dustin A. Bruening,et al.  Automated event detection algorithms in pathological gait. , 2014, Gait & posture.

[36]  D. Sternad,et al.  Local dynamic stability versus kinematic variability of continuous overground and treadmill walking. , 2001, Journal of biomechanical engineering.