An Exploratory Study on Techniques for Quantitative Assessment of Stroke Rehabilitation Exercises

Technology-assisted systems to monitor and assess rehabilitation exercises have an opportunity of enhancing rehabilitation practices by automatically collecting patient's quantitative performance data. However, even if a complex algorithm (e.g. Neural Network) is applied, it is still challenging to develop such a system due to patients with various physical conditions. The system with a complex algorithm is limited to be a black-box system that cannot provide explanations on its predictions. To address these challenges, this paper presents a hybrid model that integrates a machine learning (ML) model with a rule-based (RB) model as an explainable artificial intelligence (AI) technique for quantitative assessment of stroke rehabilitation exercises. For evaluation, we collected therapist's knowledge on assessment as 15 rules from interviews with therapists and the dataset of three upper-limb stroke rehabilitation exercises from 15 post-stroke and 11 healthy subjects using a Kinect sensor. Experimental results show that a hybrid model can achieve comparable performance with a ML model using Neural Network, but also provide explanations on a model prediction with a RB model. The results indicate the potential of a hybrid model as an explainable AI technique to support the interpretation of a model and fine-tune a model with user-specific rules for personalization.

[1]  Lee Lacy,et al.  Defense Advanced Research Projects Agency (DARPA) Agent Markup Language Computer Aided Knowledge Acquisition , 2005 .

[2]  P. Stratford,et al.  Reliability of the Fugl-Meyer assessment for testing motor performance in patients following stroke. , 1993, Physical therapy.

[3]  Thomas Plötz,et al.  Ensembles of Deep LSTM Learners for Activity Recognition using Wearables , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[4]  Or Biran,et al.  Explanation and Justification in Machine Learning : A Survey Or , 2017 .

[5]  Been Kim,et al.  Towards A Rigorous Science of Interpretable Machine Learning , 2017, 1702.08608.

[6]  V. Feigin,et al.  Global Burden of Stroke. , 2017, Circulation research.

[7]  Min Hun Lee An Intelligent Decision Support System for Stroke Rehabilitation Assessment , 2019, ASSETS.

[8]  Koushik Maharatna,et al.  Rehab-Net: Deep Learning Framework for Arm Movement Classification Using Wearable Sensors for Stroke Rehabilitation , 2019, IEEE Transactions on Biomedical Engineering.

[9]  Alexandre Bernardino,et al.  Interactive hybrid approach to combine machine and human intelligence for personalized rehabilitation assessment , 2020, CHIL.

[10]  N. Hogan,et al.  Movement Smoothness Changes during Stroke Recovery , 2002, The Journal of Neuroscience.

[11]  O. Celik,et al.  Systematic review of Kinect applications in elderly care and stroke rehabilitation , 2014, Journal of NeuroEngineering and Rehabilitation.

[12]  Jessica K. Hodgins,et al.  Quantitative measurement of motor symptoms in Parkinson's disease: A study with full-body motion capture data , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  Kevin Huang,et al.  Exploring In-Home Monitoring of Rehabilitation and Creating an Authoring Tool for Physical Therapists , 2015 .

[14]  Daniel P. Siewiorek,et al.  Learning to assess the quality of stroke rehabilitation exercises , 2019, IUI.

[15]  J. Eng,et al.  Barriers to implementation of stroke rehabilitation evidence: findings from a multi-site pilot project , 2012, Disability and rehabilitation.

[16]  Amina Adadi,et al.  Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI) , 2018, IEEE Access.

[17]  David T. Marc,et al.  Reasons For Physicians Not Adopting Clinical Decision Support Systems: Critical Analysis , 2018, JMIR medical informatics.

[18]  Xia Hu,et al.  Techniques for interpretable machine learning , 2018, Commun. ACM.

[19]  Andreas Holzinger,et al.  From Machine Learning to Explainable AI , 2018, 2018 World Symposium on Digital Intelligence for Systems and Machines (DISA).

[20]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[21]  Louis-Philippe Morency,et al.  Multimodal Machine Learning: A Survey and Taxonomy , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Alexandre Bernardino,et al.  Opportunities of a Machine Learning-based Decision Support System for Stroke Rehabilitation Assessment , 2020, ArXiv.

[23]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..