Deep Learning for Ground Reaction Force Data Analysis: Application to Wide-Area Floor Sensing

Deep learning methods are proposed to process and fuse raw spatiotemporal ground reaction forces (GRF) to accurately categorize gait pattern. These methods are based on convolutional neural network and long short-term memory networks architectures to learn spatiotemporal features, automatically end-to-end from raw GRF sensor signals. In a case study on Parkinson's disease (PD) data, spatiotemporal signals of gait for PD patient and healthy subjects are processed and classified, resulting an effective gait pattern classification with a precision performance of 96%. Deep learning considerably achieved better classification results, compared to the shallow learning methods with the handcrafted features. This implies that for the purpose of automatic decision-making, it is beneficial to utilize deep learning methods to analyse GRF. This insight is portable across a range of industrial tasks that involve complex spatiotemporal GRF signals classification. The proposed models are computationally efficient and able to achieve high classification precision from a large set of GRF signals.

[1]  Joel S. Perlmutter,et al.  Assessment of Parkinson Disease Manifestations , 2009, Current protocols in neuroscience.

[2]  Jiqing Zhang,et al.  People Identification Using Floor Pressure Sensing and Analysis , 2010, IEEE Sensors Journal.

[3]  Pekka Matilainen,et al.  Evaluation of the confusion matrix method in the validation of an automated system for measuring feeding behaviour of cattle , 2018, Behavioural Processes.

[4]  L. Defebvre,et al.  Clinical syndromes: Parkinsonian gait , 2013, Movement disorders : official journal of the Movement Disorder Society.

[5]  Jeffrey M. Hausdorff,et al.  Dual tasking, gait rhythmicity, and Parkinson's disease: Which aspects of gait are attention demanding? , 2005, The European journal of neuroscience.

[6]  N. Arunkumar,et al.  Gait and tremor investigation using machine learning techniques for the diagnosis of Parkinson disease , 2018, Future Gener. Comput. Syst..

[7]  Darwin Gouwanda,et al.  Emerging Trends of Body-Mounted Sensors in Sports and Human Gait Analysis , 2008 .

[8]  P. Lorenzi,et al.  Smart sensors for the recognition of specific human motion disorders in Parkinson's disease , 2015, 2015 6th International Workshop on Advances in Sensors and Interfaces (IWASI).

[9]  S John Sullivan,et al.  The use of the dual-task paradigm in detecting gait performance deficits following a sports-related concussion: a systematic review and meta-analysis. , 2013, Journal of science and medicine in sport.

[10]  Matthew J Major,et al.  Assessing a low-cost accelerometer-based technique to estimate spatial gait parameters of lower-limb prosthesis users , 2016, Prosthetics and orthotics international.

[11]  Patricia Scully,et al.  Temporal Pattern Recognition in Gait Activities Recorded With a Footprint Imaging Sensor System , 2016, IEEE Sensors Journal.

[12]  J. Kaye,et al.  Talking while walking , 1997, Neurology.

[13]  Jeffrey M. Hausdorff,et al.  Rhythmic auditory stimulation modulates gait variability in Parkinson's disease , 2007, The European journal of neuroscience.

[14]  Rangaraj M. Rangayyan,et al.  Measuring signal fluctuations in gait rhythm time series of patients with Parkinson's disease using entropy parameters , 2017, Biomed. Signal Process. Control..

[15]  C. Tanner,et al.  Levodopa and the progression of Parkinson's disease. , 2004, The New England journal of medicine.

[16]  Yilmaz Kaya,et al.  Detection of Parkinson's disease by Shifted One Dimensional Local Binary Patterns from gait , 2016, Expert Syst. Appl..

[17]  Patricia Scully,et al.  Deep Neural Networks for Learning Spatio-Temporal Features From Tomography Sensors , 2018, IEEE Transactions on Industrial Electronics.

[18]  S. M. Waechter,et al.  The impact of dual tasking on cognitive performance in a Parkinson's disease cohort with and without freezing of gait: An EEG and behavioral based approach , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[19]  Ausif Mahmood,et al.  Improved Gait recognition based on specialized deep convolutional neural networks , 2015, 2015 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[20]  Werner Schiehlen,et al.  Walking dynamics from mechanism models to parameter optimization , 2011 .

[21]  Mirko Perkusich,et al.  A Gait Analysis Approach to Track Parkinson's Disease Evolution Using Principal Component Analysis , 2016, 2016 IEEE 29th International Symposium on Computer-Based Medical Systems (CBMS).

[22]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[23]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.