Wearable-based Parkinson's Disease Severity Monitoring using Deep Learning

One major challenge in the medication of Parkinson's disease is that the severity of the disease, reflected in the patients' motor state, cannot be measured using accessible biomarkers. Therefore, we develop and examine a variety of statistical models to detect the motor state of such patients based on sensor data from a wearable device. We find that deep learning models consistently outperform a classical machine learning model applied on hand-crafted features in this time series classification task. Furthermore, our results suggest that treating this problem as a regression instead of an ordinal regression or a classification task is most appropriate. For consistent model evaluation and training, we adopt the leave-one-subject-out validation scheme to the training of deep learning models. We also employ a class-weighting scheme to successfully mitigate the problem of high multi-class imbalances in this domain. In addition, we propose a customized performance measure that reflects the requirements of the involved medical staff on the model. To solve the problem of limited availability of high quality training data, we propose a transfer learning technique which helps to improve model performance substantially. Our results suggest that deep learning techniques offer a high potential to autonomously detect motor states of patients with Parkinson's disease.

[1]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[2]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Andrew M. Dai,et al.  Wearable sensors for Parkinson’s disease: which data are worth collecting for training symptom detection models , 2018, npj Digital Medicine.

[4]  Martina Mancini,et al.  Levodopa Is a Double‐Edged Sword for Balance and Gait in People With Parkinson's Disease , 2015, Movement disorders : official journal of the Movement Disorder Society.

[5]  Petia Radeva,et al.  Human Activity Recognition from Accelerometer Data Using a Wearable Device , 2011, IbPRIA.

[6]  Andreas W. Kempa-Liehr,et al.  Distributed and parallel time series feature extraction for industrial big data applications , 2016, ArXiv.

[7]  Tim Oates,et al.  Time series classification from scratch with deep neural networks: A strong baseline , 2016, 2017 International Joint Conference on Neural Networks (IJCNN).

[8]  Michelle A. Burack,et al.  Automatic assessment of medication states of patients with Parkinson's disease using wearable sensors , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[9]  N. Jetté,et al.  The prevalence of Parkinson's disease: A systematic review and meta‐analysis , 2014, Movement disorders : official journal of the Movement Disorder Society.

[10]  J. D. Parkes,et al.  "ON-OFF" EFFECTS IN PATIENTS WITH PARKINSON'S DISEASE ON CHRONIC LEVODOPA THERAPY , 1976, The Lancet.

[11]  J. Jankovic,et al.  Movement Disorder Society‐sponsored revision of the Unified Parkinson's Disease Rating Scale (MDS‐UPDRS): Scale presentation and clinimetric testing results , 2008, Movement disorders : official journal of the Movement Disorder Society.

[12]  Max A. Little,et al.  Using and understanding cross-validation strategies. Perspectives on Saeb et al. , 2017, GigaScience.

[13]  Konrad P. Kording,et al.  The need to approximate the use-case in clinical machine learning , 2017, GigaScience.

[14]  Joan Cabestany,et al.  Dyskinesia and motor state detection in Parkinson's Disease patients with a single movement sensor , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  T. Ploetz,et al.  Unsupervised home monitoring of Parkinson's disease motor symptoms using body-worn accelerometers. , 2016, Parkinsonism & related disorders.

[16]  J. Ghika,et al.  Portable system for quantifying motor abnormalities in Parkinson's disease , 1993, IEEE Transactions on Biomedical Engineering.

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[20]  Pedro Antonio Gutiérrez,et al.  Ordinal Regression Methods: Survey and Experimental Study , 2016, IEEE Transactions on Knowledge and Data Engineering.

[21]  A. Lang,et al.  Clinical diagnostic criteria. , 2000, Advances in neurology.

[22]  S. I. Kramer,et al.  Assessment of Tardive Dyskinesia Using the Abnormal Involuntary Movement Scale , 1985, The Journal of nervous and mental disease.

[23]  Eibe Frank,et al.  A Simple Approach to Ordinal Classification , 2001, ECML.

[24]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[25]  Thomas Plötz,et al.  Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables , 2016, IJCAI.

[26]  Klaus Obermayer,et al.  Support vector learning for ordinal regression , 1999 .

[27]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[28]  Ming Dong,et al.  Using Ranking-CNN for Age Estimation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Gang Hua,et al.  Ordinal Regression with Multiple Output CNN for Age Estimation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Michelle A. Burack,et al.  Wearable-based Mediation State Detection in Individuals with Parkinson's Disease , 2018, ArXiv.

[31]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[32]  G. Deuschl,et al.  MDS clinical diagnostic criteria for Parkinson's disease , 2015, Movement disorders : official journal of the Movement Disorder Society.

[33]  Bo Yu,et al.  Convolutional Neural Networks for human activity recognition using mobile sensors , 2014, 6th International Conference on Mobile Computing, Applications and Services.

[34]  Michelle A. Burack,et al.  Assessment of response to medication in individuals with Parkinson's disease. , 2019, Medical engineering & physics.

[35]  S. Gielen,et al.  Automatic assessment of levodopa‐induced dyskinesias in daily life by neural networks , 2003, Movement disorders : official journal of the Movement Disorder Society.

[36]  Germain Forestier,et al.  Transfer learning for time series classification , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[37]  Dana Kulic,et al.  Parkinson's Disease Assessment from a Wrist-Worn Wearable Sensor in Free-Living Conditions: Deep Ensemble Learning and Visualization , 2018, ArXiv.

[38]  Dimitrios I. Fotiadis,et al.  On automated assessment of Levodopa-induced dyskinesia in Parkinson's disease , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[39]  Stan C A M Gielen,et al.  Ambulatory motor assessment in Parkinson's disease , 2006, Movement disorders : official journal of the Movement Disorder Society.

[40]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[41]  Germain Forestier,et al.  Deep learning for time series classification: a review , 2018, Data Mining and Knowledge Discovery.

[42]  Richard Walker,et al.  PD Disease State Assessment in Naturalistic Environments Using Deep Learning , 2015, AAAI.

[43]  Michael Lawo,et al.  Parkinson's Disease Motor Symptoms in Machine Learning: A Review , 2013, ArXiv.

[44]  Allan Timmermann,et al.  Estimation and Testing of Forecast Rationality under Flexible Loss , 2005 .