Comparison of Speech Tasks for Automatic Classification of Patients with Amyotrophic Lateral Sclerosis and Healthy Subjects

In this work, we consider the task of acoustic and articulatory feature based automatic classification of Amyotrophic Lateral Sclerosis (ALS) patients and healthy subjects using speech tasks. In particular, we compare the roles of different types of speech tasks, namely rehearsed speech, spontaneous speech and repeated words for this purpose. Simultaneous articulatory and speech data were recorded from 8 healthy controls and 8 ALS patients using AG501 for the classification experiments. In addition to typical acoustic and articulatory features, new articulatory features are proposed for classification. As classifiers, both Deep Neural Networks (DNN) and Support Vector Machines (SVM) are examined. Classification experiments reveal that the proposed articulatory features outperform other acoustic and articulatory features using both DNN and SVM classifier. However, SVM performs better than DNN classifier using the proposed feature. Among three different speech tasks considered, the rehearsed speech was found to provide the highest F-score of 1, followed by an F-score of 0.92 when both repeated words and spontaneous speech are used for classification.

[1]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[2]  Prasanta Kumar Ghosh,et al.  Optimal sensor placement in electromagnetic articulography recording for speech production study , 2018, Comput. Speech Lang..

[3]  J. Wade Davis,et al.  Statistical Pattern Recognition , 2003, Technometrics.

[4]  Jacqueline Ann Bauman-Wängler Articulatory and Phonological Impairments: A Clinical Focus , 1999 .

[5]  J. Cedarbaum,et al.  The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function , 1999, Journal of the Neurological Sciences.

[6]  J. Abbs,et al.  Force transducers for the evaluation of labial, lingual, and mandibular motor impairments. , 1983, Journal of speech and hearing research.

[7]  Björn W. Schuller,et al.  Paralinguistics in speech and language - State-of-the-art and the challenge , 2013, Comput. Speech Lang..

[8]  Mili Kuruvilla-Dugdale,et al.  An investigation of clear speech effects on articulatory kinematics in talkers with ALS , 2017, Clinical linguistics & phonetics.

[9]  M. Lindstrom,et al.  Articulatory movements during vowels in speakers with dysarthria and healthy controls. , 2008, Journal of speech, language, and hearing research : JSLHR.

[10]  G. Turner,et al.  Acoustic differences between content and function words in amyotrophic lateral sclerosis. , 2000, Journal of speech, language, and hearing research : JSLHR.

[11]  B. Brooks,et al.  Multiple orofacial indices in amyotrophic lateral sclerosis. , 1993, Journal of speech and hearing research.

[12]  R Netsell,et al.  Cineradiographic assessment of articulatory mobility in the dysarthrias. , 1975, The Journal of speech and hearing disorders.

[13]  Raymond D. Kent,et al.  Formant trajectory characteristics of males with amyotrophic lateral sclerosis. , 1992, The Journal of the Acoustical Society of America.

[14]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[15]  Björn Schuller,et al.  Opensmile: the munich versatile and fast open-source audio feature extractor , 2010, ACM Multimedia.

[16]  G. Weismer,et al.  The influence of speaking rate on vowel space and speech intelligibility for individuals with amyotrophic lateral sclerosis. , 1995, Journal of speech and hearing research.

[17]  Velocity of articulatory movements in normal and dysarthric subjects. , 1982, Folia phoniatrica.

[18]  Shrikanth Narayanan,et al.  A generalized smoothness criterion for acoustic-to-articulatory inversion. , 2010, The Journal of the Acoustical Society of America.

[19]  G. Badger,et al.  Intelligibility and the acoustic characteristics of speech in amyotrophic lateral sclerosis (ALS). , 1994, Journal of speech and hearing research.

[20]  M. Swash,et al.  El Escorial revisited: Revised criteria for the diagnosis of amyotrophic lateral sclerosis , 2000, Amyotrophic lateral sclerosis and other motor neuron disorders : official publication of the World Federation of Neurology, Research Group on Motor Neuron Diseases.

[21]  A. Ludolph,et al.  Amyotrophic lateral sclerosis. , 2012, Current opinion in neurology.

[22]  Jordan R. Green,et al.  Bulbar and speech motor assessment in ALS: Challenges and future directions , 2013, Amyotrophic lateral sclerosis & frontotemporal degeneration.

[23]  A. Chiò ISIS Survey: an international study on the diagnostic process and its implications in amyotrophic lateral sclerosis , 1999, Journal of Neurology.

[24]  Jun Wang,et al.  Towards Automatic Detection of Amyotrophic Lateral Sclerosis from Speech Acoustic and Articulatory Samples , 2016, INTERSPEECH.

[25]  Bruce E. Murdoch,et al.  Dysarthria : a physiological approach to assessment and treatment , 1998 .