Explainable Machine Learning in Human Gait Analysis: A Study on Children With Cerebral Palsy

This work investigates the effectiveness of various machine learning (ML) methods in classifying human gait patterns associated with cerebral palsy (CP) and examines the clinical relevance of the learned features using explainability approaches. We trained different ML models, including convolutional neural networks, self-normalizing neural networks, random forests, and decision trees, and generated explanations for the trained models. For the deep neural networks, Grad-CAM explanations were aggregated on different levels to obtain explanations at the decision, class and model level. We investigate which subsets of 3D gait analysis data are particularly suitable for the classification of CP-related gait patterns. The results demonstrate the superiority of kinematic over ground reaction force data for this classification task and show that traditional ML approaches such as random forests and decision trees achieve better results and focus more on clinically relevant regions compared to deep neural networks. The best configuration, using sagittal knee and ankle angles with a random forest, achieved a classification accuracy of 93.4 % over all four CP classes (crouch gait, apparent equinus, jump gait, and true equinus). Deep neural networks utilized not only clinically relevant features but also additional ones for their predictions, which may provide novel insights into the data and raise new research questions. Overall, the article provides insights into the application of ML in clinical practice and highlights the importance of explainability to promote trust and understanding of ML models.

[1]  S. Lapuschkin,et al.  Explaining machine learning models for age classification in human gait analysis , 2022, Gait & Posture.

[2]  A. Rind,et al.  Trustworthy Visual Analytics in Clinical Gait Analysis: A Case Study for Patients with Cerebral Palsy , 2022, 2022 IEEE Workshop on TRust and EXpertise in Visual Analytics (TREX).

[3]  D. Ricard,et al.  A topological data analysis-based method for gait signals with an application to the study of multiple sclerosis , 2022, PloS one.

[4]  G. Giakas,et al.  Leveraging explainable machine learning to identify gait biomechanical parameters associated with anterior cruciate ligament injury , 2022, Scientific reports.

[5]  E. Barnes,et al.  Investigating the fidelity of explainable artificial intelligence methods for applications of convolutional neural networks in geoscience , 2022, Artificial Intelligence for the Earth Systems.

[6]  S. Lapuschkin,et al.  Explaining Machine Learning Models for Clinical Gait Analysis , 2021, ACM Trans. Comput. Heal..

[7]  Igor Fischer,et al.  A Decision Support System to Facilitate Identification of Musculoskeletal Impairments and Propose Recommendations Using Gait Analysis in Children With Cerebral Palsy , 2020, Frontiers in Bioengineering and Biotechnology.

[8]  Neelesh Kumar,et al.  Role of machine learning in gait analysis: a review , 2020, Journal of medical engineering & technology.

[9]  S. Lapuschkin,et al.  Explaining automated gender classification of human gait , 2020, Gait & Posture.

[10]  Bertram Taetz,et al.  Interpretability of Input Representations for Gait Classification in Patients after Total Hip Arthroplasty , 2020, Sensors.

[11]  Farzam Farahmand,et al.  Automatic classification of gait patterns in children with cerebral palsy using fuzzy clustering method. , 2020, Clinical biomechanics.

[12]  Brian Horsak,et al.  Input representations and classification strategies for automated human gait analysis. , 2019, Gait & posture.

[13]  Guillaume-Alexandre Bilodeau,et al.  Deep 1D-Convnet for accurate Parkinson disease detection and severity prediction from gait , 2019, Expert Syst. Appl..

[14]  Amit Dhurandhar,et al.  One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques , 2019, ArXiv.

[15]  Yanxin Zhang,et al.  Application of supervised machine learning algorithms in the classification of sagittal gait patterns of cerebral palsy children with spastic diplegia , 2019, Comput. Biol. Medicine.

[16]  Kaat Desloovere,et al.  Systematic review on gait classifications in children with cerebral palsy: An update. , 2019, Gait & posture.

[17]  K. Müller,et al.  Unmasking Clever Hans predictors and assessing what machines really learn , 2019, Nature Communications.

[18]  Simone Calderara,et al.  Gait-Based Diplegia Classification Using LSMT Networks , 2019, Journal of healthcare engineering.

[19]  Madalina Fiterau,et al.  Machine learning in human movement biomechanics: Best practices, common pitfalls, and new opportunities. , 2018, Journal of biomechanics.

[20]  Been Kim,et al.  Sanity Checks for Saliency Maps , 2018, NeurIPS.

[21]  Amina Adadi,et al.  Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI) , 2018, IEEE Access.

[22]  Klaus-Robert Müller,et al.  Explaining the unique nature of individual gait patterns with deep learning , 2018, Scientific Reports.

[23]  Cynthia Rudin,et al.  This Looks Like That: Deep Learning for Interpretable Image Recognition , 2018 .

[24]  Hao Zhou,et al.  Simultaneous Recognition and Assessment of Post-Stroke Hemiparetic Gait by Fusing Kinematic, Kinetic, and Electrophysiological Data , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  S. Mcintyre The continually changing epidemiology of cerebral palsy , 2018, Acta paediatrica.

[26]  Joana Figueiredo,et al.  Automatic recognition of gait patterns in human motor disorders using machine learning: A review. , 2018, Medical engineering & physics.

[27]  Christian Biemann,et al.  What do we need to build explainable AI systems for the medical domain? , 2017, ArXiv.

[28]  Arnold Baca,et al.  Automatic Classification of Functional Gait Disorders , 2017, IEEE Journal of Biomedical and Health Informatics.

[29]  L. Duffell,et al.  Predicting knee osteoarthritis risk in injured populations , 2017, Clinical biomechanics.

[30]  Markus Wagner,et al.  KAVAGait: Knowledge-Assisted Visual Analytics for Clinical Gait Analysis , 2017, IEEE Transactions on Visualization and Computer Graphics.

[31]  Martin Wattenberg,et al.  SmoothGrad: removing noise by adding noise , 2017, ArXiv.

[32]  Scott Lundberg,et al.  A Unified Approach to Interpreting Model Predictions , 2017, NIPS.

[33]  Denise Paschoal Soares,et al.  Principal component analysis in ground reaction forces and center of pressure gait waveforms of people with transfemoral amputation , 2016, Prosthetics and orthotics international.

[34]  Fenglin Liu,et al.  Parkinson's disease classification using gait analysis via deterministic learning , 2016, Neuroscience Letters.

[35]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[36]  Carlos Guestrin,et al.  "Why Should I Trust You?": Explaining the Predictions of Any Classifier , 2016, ArXiv.

[37]  Alexander Binder,et al.  On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation , 2015, PloS one.

[38]  Saman K. Halgamuge,et al.  Classification of Parkinson's Disease Gait Using Spatial-Temporal Gait Features , 2015, IEEE Journal of Biomedical and Health Informatics.

[39]  Morgan Sangeux,et al.  Sagittal gait patterns in cerebral palsy: the plantarflexor-knee extension couple index. , 2015, Gait & posture.

[40]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[41]  Carole A. Tucker,et al.  Measuring Walking: A Handbook of Clinical Gait Analysis , 2014 .

[42]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[43]  Emil Pitkin,et al.  Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual Conditional Expectation , 2013, 1309.6392.

[44]  Vinzenz von Tscharner,et al.  Gait patterns of asymmetric ankle osteoarthritis patients. , 2012, Clinical biomechanics.

[45]  Thompson Sarkodie-Gyan,et al.  Automatic classification of pathological gait patterns using ground reaction forces and machine learning algorithms , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[46]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[47]  Todd C Pataky,et al.  Generalized n-dimensional biomechanical field analysis using statistical parametric mapping. , 2010, Journal of biomechanics.

[48]  G Cioni,et al.  The term diplegia should be enhanced. Part I: a new rehabilitation oriented classification of cerebral palsy. , 2008, European journal of physical and rehabilitation medicine.

[49]  R Wolfe,et al.  Sagittal gait patterns in spastic diplegia. , 2004, The Journal of bone and joint surgery. British volume.

[50]  J. Rodda,et al.  Classification of gait patterns in spastic hemiplegia and spastic diplegia: a basis for a management algorithm , 2001, European journal of neurology.

[51]  T Chau,et al.  A review of analytical techniques for gait data. Part 1: Fuzzy, statistical and fractal methods. , 2001, Gait & posture.

[52]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[53]  Torsten Bumgarner,et al.  Biomechanics and Motor Control of Human Movement , 2013 .

[54]  Johanna Robertson,et al.  Categorization of gait patterns in adults with cerebral palsy: a clustering approach. , 2014, Gait & posture.

[55]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[56]  J. Nadal,et al.  Application of principal component analysis in vertical ground reaction force to discriminate normal and abnormal gait. , 2009, Gait & posture.

[57]  Cerebral Palsy : Hope Through Research , 2009 .

[58]  P. Grimaud [Cerebral palsy]. , 1972, Pediatrie.