Deep Learning Techniques for Improving Digital Gait Segmentation

Wearable technology for the automatic detection of gait events has recently gained growing interest, enabling advanced analyses that were previously limited to specialist centres and equipment (e.g., instrumented walkway). In this study, we present a novel method based on dilated convolutions for an accurate detection of gait events (initial and final foot contacts) from wearable inertial sensors. A rich dataset has been used to validate the method, featuring 71 people with Parkinson’s disease (PD) and 67 healthy control subjects. Multiple sensors have been considered, one located on the fifth lumbar vertebrae and two on the ankles. The aims of this study were: (i) to apply deep learning (DL) techniques on wearable sensor data for gait segmentation and quantification in older adults and in people with PD; (ii) to validate the proposed technique for measuring gait against traditional gold standard laboratory reference and a widely used algorithm based on wavelet transforms (WT); (iii) to assess the performance of DL methods in assessing high-level gait characteristics, with focus on stride, stance and swing related features. The results showed a high reliability of the proposed approach, which achieves temporal errors considerably smaller than WT, in particular for the detection of final contacts, with an inter-quartile range below 70 ms in the worst case. This study showes encouraging results, and paves the road for further research, addressing the effectiveness and the generalization of data-driven learning systems for accurate event detection in challenging conditions.

[1]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[2]  Marco Donati,et al.  An enhanced estimate of initial contact and final contact instants of time using lower trunk inertial sensor data. , 2012, Gait & posture.

[3]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Alan Godfrey,et al.  Validation of an Accelerometer to Quantify a Comprehensive Battery of Gait Characteristics in Healthy Older Adults and Parkinson's Disease: Toward Clinical and at Home Use , 2016, IEEE Journal of Biomedical and Health Informatics.

[5]  T. Robbins,et al.  Characterizing mild cognitive impairment in incident Parkinson disease , 2014, Neurology.

[6]  Garrison W. Cottrell,et al.  Understanding Convolution for Semantic Segmentation , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[7]  Gert S. Faber,et al.  Validation of a Step Detection Algorithm during Straight Walking and Turning in Patients with Parkinson’s Disease and Older Adults Using an Inertial Measurement Unit at the Lower Back , 2017, Front. Neurol..

[8]  C. Mazzà,et al.  Free‐living monitoring of Parkinson's disease: Lessons from the field , 2016, Movement disorders : official journal of the Movement Disorder Society.

[9]  Julius Hannink,et al.  Sensor-Based Gait Parameter Extraction With Deep Convolutional Neural Networks , 2016, IEEE Journal of Biomedical and Health Informatics.

[10]  Keith D Hill,et al.  Gait variability in younger and older adult women is altered by overground walking protocol. , 2009, Age and ageing.

[11]  Paolo Bonato,et al.  Recent machine learning advancements in sensor-based mobility analysis: Deep learning for Parkinson's disease assessment , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[12]  Saman K. Halgamuge,et al.  Classification of Parkinson's Disease Gait Using Spatial-Temporal Gait Features , 2015, IEEE Journal of Biomedical and Health Informatics.

[13]  Lynn Rochester,et al.  Moving forward on gait measurement: Toward a more refined approach , 2013, Movement disorders : official journal of the Movement Disorder Society.

[14]  Nooritawati Md Tahir,et al.  Parkinson Disease gait classification based on machine learning approach , 2012 .

[15]  Ahmed Al-Jawad,et al.  A systematic review of the characteristics and validity of monitoring technologies to assess Parkinson’s disease , 2016, Journal of NeuroEngineering and Rehabilitation.

[16]  Gammon M Earhart,et al.  Gait coordination in Parkinson disease: effects of step length and cadence manipulations. , 2013, Gait & posture.

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  Lynn Rochester,et al.  Is gait variability reliable in older adults and Parkinson's disease? Towards an optimal testing protocol. , 2013, Gait & posture.

[19]  Jeffrey M. Hausdorff,et al.  Comparative assessment of different methods for the estimation of gait temporal parameters using a single inertial sensor: application to elderly, post-stroke, Parkinson's disease and Huntington's disease subjects. , 2015, Gait & posture.

[20]  B. Galna,et al.  The nature of dual-task interference during gait in incident Parkinson’s disease , 2014, Neuroscience.