Detecting Parkinsonian Tremor From IMU Data Collected in-the-Wild Using Deep Multiple-Instance Learning

Parkinson's Disease (PD) is a slowly evolving neurological disease that affects about $\text{1}\%$ of the population above 60 years old, causing symptoms that are subtle at first, but whose intensity increases as the disease progresses. Automated detection of these symptoms could offer clues as to the early onset of the disease, thus improving the expected clinical outcomes of the patients via appropriately targeted interventions. This potential has led many researchers to develop methods that use widely available sensors to measure and quantify the presence of PD symptoms such as tremor, rigidity and braykinesia. However, most of these approaches operate under controlled settings, such as in lab or at home, thus limiting their applicability under free-living conditions. In this work, we present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device. We propose a Multiple-Instance Learning approach, wherein a subject is represented as an unordered bag of accelerometer signal segments and a single, expert-provided, tremor annotation. Our method combines deep feature learning with a learnable pooling stage that is able to identify key instances within the subject bag, while still being trainable end-to-end. We validate our algorithm on a newly introduced dataset of 45 subjects, containing accelerometer signals collected entirely in-the-wild. The good classification performance obtained in the conducted experiments suggests that the proposed method can efficiently navigate the noisy environment of in-the-wild recordings.

[1]  Abbas F. Sadikot,et al.  Using a Smart Phone as a Standalone Platform for Detection and Monitoring of Pathological Tremors , 2013, Front. Hum. Neurosci..

[2]  Wenyu Liu,et al.  Revisiting multiple instance neural networks , 2016, Pattern Recognit..

[3]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[4]  Peng Tang,et al.  Bag similarity network for deep multi-instance learning , 2019, Inf. Sci..

[5]  Dimitrios Iakovakis,et al.  Touchscreen typing-pattern analysis for detecting fine motor skills decline in early-stage Parkinson’s disease , 2018, Scientific reports.

[6]  Konstantinos Kyritsis,et al.  Multiple-Instance Learning for In-The-Wild Parkinsonian Tremor Detection , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[7]  Eric Granger,et al.  Multiple instance learning: A survey of problem characteristics and applications , 2016, Pattern Recognit..

[8]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[9]  Tim Lüth,et al.  Quantitative Assessment of Parkinsonian Tremor Based on an Inertial Measurement Unit , 2015, Sensors.

[10]  Hakan Gunduz,et al.  Deep Learning-Based Parkinson’s Disease Classification Using Vocal Feature Sets , 2019, IEEE Access.

[11]  Diego Torricelli,et al.  IMU-Based Classification of Parkinson's Disease From Gait: A Sensitivity Analysis on Sensor Location and Feature Selection , 2018, IEEE Journal of Biomedical and Health Informatics.

[12]  Max Welling,et al.  Attention-based Deep Multiple Instance Learning , 2018, ICML.

[13]  José Luis Pons Rovira,et al.  Real-Time Estimation of Pathological Tremor Parameters from Gyroscope Data , 2010, Sensors.

[14]  Jue Wang,et al.  Classification of parkinsonian and essential tremor using empirical mode decomposition and support vector machine , 2011, Digit. Signal Process..

[15]  Xiu-Shen Wei,et al.  Scalable Algorithms for Multi-Instance Learning , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Diane C. Tsai Recent Developments in Parkinson's Disease , 1986, The Yale Journal of Biology and Medicine.

[17]  Max A. Little,et al.  High accuracy discrimination of Parkinson's disease participants from healthy controls using smartphones , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  Max A. Little,et al.  Detecting and monitoring the symptoms of Parkinson's disease using smartphones: A pilot study. , 2015, Parkinsonism & related disorders.

[19]  Jessica K. Hodgins,et al.  Detecting Parkinsons' symptoms in uncontrolled home environments: A multiple instance learning approach , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Thomas Mensink,et al.  Image Classification with the Fisher Vector: Theory and Practice , 2013, International Journal of Computer Vision.

[21]  Jessica K. Hodgins,et al.  Weakly-supervised learning for Parkinson's Disease tremor detection , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[22]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[23]  Max A. Little,et al.  Novel Speech Signal Processing Algorithms for High-Accuracy Classification of Parkinson's Disease , 2012, IEEE Transactions on Biomedical Engineering.

[24]  Ian Butterworth,et al.  Computer keyboard interaction as an indicator of early Parkinson’s disease , 2016, Scientific Reports.

[25]  Thomas G. Dietterich,et al.  Solving the Multiple Instance Problem with Axis-Parallel Rectangles , 1997, Artif. Intell..

[26]  Clayton R. Pereira,et al.  Deep Learning-Aided Parkinson's Disease Diagnosis from Handwritten Dynamics , 2016, 2016 29th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI).

[27]  J. Jankovic Parkinson’s disease: clinical features and diagnosis , 2008, Journal of Neurology, Neurosurgery, and Psychiatry.

[28]  F. Pagan,et al.  Improving outcomes through early diagnosis of Parkinson's disease. , 2012, The American journal of managed care.

[29]  Alexander J. Smola,et al.  Deep Sets , 2017, 1703.06114.

[30]  Thomas Hofmann,et al.  Support Vector Machines for Multiple-Instance Learning , 2002, NIPS.

[31]  Jesús Francisco Vargas-Bonilla,et al.  Voiced/unvoiced transitions in speech as a potential bio-marker to detect parkinson's disease , 2015, INTERSPEECH.