Voice based classification of patients with Amyotrophic Lateral Sclerosis, Parkinson’s Disease and Healthy Controls with CNN-LSTM using transfer learning

In this paper, we consider 2-class and 3-class classification problems for classifying patients with Amyotrophic Lateral Sclerosis (ALS), Parkinson’s Disease (PD), and Healthy Controls (HC) using a CNNLSTM network. Classification performance is examined for three different tasks, namely, Spontaneous speech (SPON), Diadochokinetic rate (DIDK) and Sustained phoneme production (PHON). Experiments are conducted using speech data recorded from 60 ALS, 60 PD, and 60 HC subjects. Classifications using SVM and DNN are considered as baseline schemes. Classification accuracy of ALS and HC (indicated by ALS/HC) using CNN-LSTM has shown an improvement of 10.40%, 4.22% and 0.08% for PHON, SPON and DIDK tasks, respectively over the best of the baseline schemes. Furthermore, the CNN-LSTM network achieves the highest PD/HC classification accuracy of 88.5% for the SPON task and the highest 3-class (ALS/PD/HC) classification accuracy of 85.24% for the DIDK task. Experiments using transfer learning at low resource training data show that data from ALS benefits PD/HC classification and vice-versa. Experiments with fine-tuning weights of 3-class (ALS/PD/HC) classifier for 2-class classification (PD/HC or ALS/HC) gives an absolute improvement of 2% classification accuracy in SPON task when compared with randomly initialized 2-class classifier.

[1]  Raymond D. Kent,et al.  Speech deterioration in amyotrophic lateral sclerosis: a case study. , 1991, Journal of speech and hearing research.

[2]  Christopher A Moore,et al.  The sequential development of jaw and lip control for speech. , 2002, Journal of speech, language, and hearing research : JSLHR.

[3]  Anil Kumar,et al.  Classification of normal, ALS, and myopathy EMG signals using ELM classifier , 2016, 2016 2nd International Conference on Advances in Electrical, Electronics, Information, Communication and Bio-Informatics (AEEICB).

[4]  M. Swash,et al.  El Escorial revisited: Revised criteria for the diagnosis of amyotrophic lateral sclerosis , 2000, Amyotrophic lateral sclerosis and other motor neuron disorders : official publication of the World Federation of Neurology, Research Group on Motor Neuron Diseases.

[5]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Jordan R. Green,et al.  Speaking rate effects on articulatory pattern consistency in talkers with mild ALS , 2014, Clinical linguistics & phonetics.

[7]  R. Guiloff,et al.  Dysarthria in amyotrophic lateral sclerosis: A review , 2010, Amyotrophic lateral sclerosis : official publication of the World Federation of Neurology Research Group on Motor Neuron Diseases.

[8]  J. Cedarbaum,et al.  The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function , 1999, Journal of the Neurological Sciences.

[9]  K. Thennarasu,et al.  Clinical characteristics and survival pattern of 1153 patients with amyotrophic lateral sclerosis: Experience over 30 years from India , 2008, Journal of the Neurological Sciences.

[10]  Stéphane Mallat,et al.  Understanding deep convolutional networks , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[11]  M Sawashima,et al.  Patterns of dysarthric movement in patients with amyotrophic lateral sclerosis and pseudobulbar palsy. , 1982, Folia phoniatrica.

[12]  María Victoria Rodellar Biarge,et al.  Articulation acoustic kinematics in ALS speech , 2017, 2017 International Conference and Workshop on Bioinspired Intelligence (IWOBI).

[13]  Raymond D. Kent Hearing and Believing , 1996 .

[14]  F BUCHTHAL,et al.  Action potential parameters in normal human muscle and their dependence on physical variables. , 1954, Acta physiologica Scandinavica.

[15]  A. Ludolph,et al.  Amyotrophic lateral sclerosis. , 2012, Current opinion in neurology.

[16]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[17]  E. Beghi,et al.  Prognostic factors in ALS: A critical review , 2009, Amyotrophic lateral sclerosis : official publication of the World Federation of Neurology Research Group on Motor Neuron Diseases.

[18]  Prasanta Kumar Ghosh,et al.  Comparison of Speech Tasks and Recording Devices for Voice Based Automatic Classification of Healthy Subjects and Patients with Amyotrophic Lateral Sclerosis , 2019, INTERSPEECH.

[19]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[20]  J. Duffy,et al.  The diagnosis and understanding of apraxia of speech: why including neurodegenerative etiologies may be important. , 2012, Journal of speech, language, and hearing research : JSLHR.

[21]  Prasanta Kumar Ghosh,et al.  Comparison of Speech Tasks for Automatic Classification of Patients with Amyotrophic Lateral Sclerosis and Healthy Subjects , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).