Classification of Bulbar ALS from Kinematic Features of the Jaw and Lips: Towards Computer-Mediated Assessment

Recent studies demonstrated that lip and jaw movements during speech may provide important information for the diagnosis of amyotrophic lateral sclerosis (ALS) and for understanding its progression. A thorough investigation of these movements is essential for the development of intelligent videoor optically-based facial tracking systems that could assist with early diagnosis and progress monitoring. In this paper, we investigated the potential for a novel and expanded set of kinematic features obtained from lips and jaw to classify articulatory data into three stages of bulbar disease progression (i.e., pre-symptomatic, early symptomatic, and late symptomatic). Feature selection methods (Relief-F and mRMR) and classification algorithm (SVM) were used for this purpose. Results showed that even with a limited number of kinematic features it was possible to obtain good classification accuracy (nearly 80%). Given the recent development of video-based markerless methods for tracking speech movements, these results provide strong rationale for supporting the development of portable and cheap systems for monitoring the orofacial function in ALS.

[1]  J. Cummings,et al.  The Montreal Cognitive Assessment, MoCA: A Brief Screening Tool For Mild Cognitive Impairment , 2005, Journal of the American Geriatrics Society.

[2]  G. Zaccara,et al.  Markerless Analysis of Articulatory Movements in Patients With Parkinson's Disease. , 2016, Journal of voice : official journal of the Voice Foundation.

[3]  Elizabeth K. Hanson,et al.  Dysarthria in Amyotrophic Lateral Sclerosis: A Systematic Review of Characteristics, Speech Treatment, and Augmentative and Alternative Communication Options , 2011 .

[4]  B. Brooks,et al.  Multiple orofacial indices in amyotrophic lateral sclerosis. , 1993, Journal of speech and hearing research.

[5]  Larry A. Rendell,et al.  A Practical Approach to Feature Selection , 1992, ML.

[6]  J. Cedarbaum,et al.  The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function , 1999, Journal of the Neurological Sciences.

[7]  G. Weismer,et al.  The influence of speaking rate on vowel space and speech intelligibility for individuals with amyotrophic lateral sclerosis. , 1995, Journal of speech and hearing research.

[8]  Panying Rong,et al.  Speech Movement Measures as Markers of Bulbar Disease in Amyotrophic Lateral Sclerosis. , 2016, Journal of speech, language, and hearing research : JSLHR.

[9]  R Netsell,et al.  Acceleration and weakness in parkinsonian dysarthria. , 1975, The Journal of speech and hearing disorders.

[10]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Laura J. Ball,et al.  Kinematics of disease progression in bulbar ALS. , 2010, Journal of communication disorders.

[12]  M. Lindstrom,et al.  Articulatory movements during vowels in speakers with dysarthria and healthy controls. , 2008, Journal of speech, language, and hearing research : JSLHR.

[13]  B. Crum,et al.  The diagnostic pathway and prognosis in bulbar-onset amyotrophic lateral sclerosis , 2010 .

[14]  Giorgio Roffo,et al.  Feature Selection Library (MATLAB Toolbox) , 2016, 1607.01327.

[15]  Claudia Manfredi,et al.  Analysis of facial expressions in parkinson's disease through video-based automatic methods , 2017, Journal of Neuroscience Methods.

[16]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[17]  Panying Rong,et al.  Predicting Speech Intelligibility Decline in Amyotrophic Lateral Sclerosis Based on the Deterioration of Individual Speech Subsystems , 2016, PloS one.

[18]  David E. Krebs,et al.  High curvature and jerk analyses of arm ataxia , 2001, Biological Cybernetics.

[19]  C. Gaelyn Garrett,et al.  Otolaryngologic presentations of amyotrophic lateral sclerosis , 2005, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[20]  Laura J. Ball,et al.  A protocol for identification of early bulbar signs in amyotrophic lateral sclerosis , 2001, Journal of the Neurological Sciences.

[21]  Panying Rong,et al.  Predicting Early Bulbar Decline in Amyotrophic Lateral Sclerosis: A Speech Subsystem Approach , 2015, Behavioural neurology.

[22]  M. Swash,et al.  El Escorial revisited: Revised criteria for the diagnosis of amyotrophic lateral sclerosis , 2000, Amyotrophic lateral sclerosis and other motor neuron disorders : official publication of the World Federation of Neurology, Research Group on Motor Neuron Diseases.

[23]  Marko Robnik-Sikonja,et al.  Theoretical and Empirical Analysis of ReliefF and RReliefF , 2003, Machine Learning.

[24]  Max A. Little,et al.  Novel Speech Signal Processing Algorithms for High-Accuracy Classification of Parkinson's Disease , 2012, IEEE Transactions on Biomedical Engineering.

[25]  Claudia Manfredi,et al.  Accuracy of a markerless acquisition technique for studying speech articulators , 2015, INTERSPEECH.

[26]  Jun Wang,et al.  Predicting Intelligible Speaking Rate in Individuals with Amyotrophic Lateral Sclerosis from a Small Number of Speech Acoustic and Articulatory Samples. , 2016, Workshop on Speech and Language Processing for Assistive Technologies.

[27]  Marco Cristani,et al.  Infinite Feature Selection , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[28]  O. Hardiman,et al.  Amyotrophic lateral sclerosis , 2011, The Lancet.

[29]  Jun Wang,et al.  SMASH: a tool for articulatory data processing and analysis , 2013, INTERSPEECH.

[30]  Gary L. Pattee,et al.  Bulbar and speech motor assessment in ALS: Challenges and future directions , 2013, Amyotrophic lateral sclerosis & frontotemporal degeneration.

[31]  M. Niimi.  Changes over time in dysarthric patients with amyotrophic lateral sclerosis (ALS): a study of changes in speaking rate and maximum repetition rate (MRR) , 2000 .