Kinematic Features of Jaw and Lips Distinguish Symptomatic From Presymptomatic Stages of Bulbar Decline in Amyotrophic Lateral Sclerosis.

Purpose The goals of this study were to (a) classify speech movements of patients with amyotrophic lateral sclerosis (ALS) in presymptomatic and symptomatic phases of bulbar function decline relying solely on kinematic features of lips and jaw and (b) identify the most important measures that detect the transition between early and late bulbar changes. Method One hundred ninety-two recordings obtained from 64 patients with ALS were considered for the analysis. Feature selection and classification algorithms were used to analyze lip and jaw movements recorded with Optotrak Certus (Northern Digital Inc.) during a sentence task. A feature set, which included 35 measures of movement range, velocity, acceleration, jerk, and area measures of lips and jaw, was used to classify sessions according to the speaking rate into presymptomatic (> 160 words per minute) and symptomatic (< 160 words per minute) groups. Results Presymptomatic and symptomatic phases of bulbar decline were distinguished with high accuracy (87%), relying only on lip and jaw movements. The best features that allowed detecting the differences between early and later bulbar stages included cumulative path of lower lip and jaw, peak values of velocity, acceleration, and jerk of lower lip and jaw. Conclusion The results established a relationship between facial kinematics and bulbar function decline in ALS. Considering that facial movements can be recorded by means of novel inexpensive and easy-to-use, video-based methods, this work supports the development of an automatic system for facial movement analysis to help clinicians in tracking the disease progression in ALS.

[1]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[2]  I. Jolliffe Principal Component Analysis , 2002 .

[3]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[4]  David G. Stork,et al.  Pattern Classification , 1973 .

[5]  Panying Rong,et al.  Speech Movement Measures as Markers of Bulbar Disease in Amyotrophic Lateral Sclerosis. , 2016, Journal of speech, language, and hearing research : JSLHR.

[6]  S. Langmore,et al.  Physiologic deficits in the orofacial system underlying dysarthria in amyotrophic lateral sclerosis. , 1994, Journal of speech and hearing research.

[7]  Laura J. Ball,et al.  A protocol for identification of early bulbar signs in amyotrophic lateral sclerosis , 2001, Journal of the Neurological Sciences.

[8]  J. Cummings,et al.  The Montreal Cognitive Assessment, MoCA: A Brief Screening Tool For Mild Cognitive Impairment , 2005, Journal of the American Geriatrics Society.

[9]  Claudia Manfredi,et al.  Accuracy of a markerless acquisition technique for studying speech articulators , 2015, INTERSPEECH.

[10]  M. Niimi Changes over time in dysarthric patients with amyotrophic lateral sclerosis (ALS): a study of changes in speaking rate and maximum repetition rate (MRR) , 2000 .

[11]  Elizabeth K. Hanson,et al.  Dysarthria in Amyotrophic Lateral Sclerosis: A Systematic Review of Characteristics, Speech Treatment, and Augmentative and Alternative Communication Options , 2011 .

[12]  H. Mitsumoto,et al.  Clinical trials in amyotrophic lateral sclerosis: why so many negative trials and how can trials be improved? , 2014, The Lancet Neurology.

[13]  H. Mitsumoto,et al.  Improving the quality of life for people with ALS: The challenge ahead , 2000, Amyotrophic lateral sclerosis and other motor neuron disorders : official publication of the World Federation of Neurology, Research Group on Motor Neuron Diseases.

[14]  G. Weismer,et al.  The influence of speaking rate on vowel space and speech intelligibility for individuals with amyotrophic lateral sclerosis. , 1995, Journal of speech and hearing research.

[15]  S. Schot,et al.  Jerk: The time rate of change of acceleration , 1978 .

[16]  Jun Wang,et al.  Predicting Intelligible Speaking Rate in Individuals with Amyotrophic Lateral Sclerosis from a Small Number of Speech Acoustic and Articulatory Samples. , 2016, Workshop on Speech and Language Processing for Assistive Technologies.

[17]  Laura J. Ball,et al.  Kinematics of disease progression in bulbar ALS. , 2010, Journal of communication disorders.

[18]  Yana Yunusova,et al.  The diagnostic utility of patient-report and speech-language pathologists’ ratings for detecting the early onset of bulbar symptoms due to ALS , 2017, Amyotrophic lateral sclerosis & frontotemporal degeneration.

[19]  Jordan R. Green,et al.  Speaking rate effects on articulatory pattern consistency in talkers with mild ALS , 2014, Clinical linguistics & phonetics.

[20]  Yana Yunusova,et al.  Classifications of vocalic segments from articulatory kinematics: healthy controls and speakers with dysarthria. , 2011, Journal of speech, language, and hearing research : JSLHR.

[21]  Yana Yunusova,et al.  Video-Based Tracking of Jaw Movements During Speech: Preliminary Results and Future Directions , 2017, INTERSPEECH.

[22]  Amparo Alonso-Betanzos,et al.  Filter Methods for Feature Selection - A Comparative Study , 2007, IDEAL.

[23]  Claudia Manfredi,et al.  Analysis of facial expressions in parkinson's disease through video-based automatic methods , 2017, Journal of Neuroscience Methods.

[24]  J. Cedarbaum,et al.  The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function , 1999, Journal of the Neurological Sciences.

[25]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[26]  Panying Rong,et al.  Predicting Speech Intelligibility Decline in Amyotrophic Lateral Sclerosis Based on the Deterioration of Individual Speech Subsystems , 2016, PloS one.

[27]  Jordan R. Green,et al.  A novel fixed-target task to determine articulatory speed constraints in persons with amyotrophic lateral sclerosis. , 2012, Journal of communication disorders.

[28]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[29]  Silvia Orlandi,et al.  Automatic Detection of Amyotrophic Lateral Sclerosis (ALS) from Video-Based Analysis of Facial Movements: Speech and Non-Speech Tasks , 2018, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[30]  M. Lindstrom,et al.  Articulatory movements during vowels in speakers with dysarthria and healthy controls. , 2008, Journal of speech, language, and hearing research : JSLHR.

[31]  O. Hardiman,et al.  Amyotrophic lateral sclerosis , 2011, The Lancet.

[32]  M. Swash,et al.  El Escorial revisited: Revised criteria for the diagnosis of amyotrophic lateral sclerosis , 2000, Amyotrophic lateral sclerosis and other motor neuron disorders : official publication of the World Federation of Neurology, Research Group on Motor Neuron Diseases.

[33]  Panying Rong,et al.  Speech intelligibility decline in individuals with fast and slow rates of ALS progression , 2015, INTERSPEECH.

[34]  Jun Wang,et al.  Towards Automatic Detection of Amyotrophic Lateral Sclerosis from Speech Acoustic and Articulatory Samples , 2016, INTERSPEECH.

[35]  Melanie Fried-Oken,et al.  Supporting communication for patients with neurodegenerative disease. , 2015, NeuroRehabilitation.

[36]  Gary L. Pattee,et al.  Bulbar and speech motor assessment in ALS: Challenges and future directions , 2013, Amyotrophic lateral sclerosis & frontotemporal degeneration.

[37]  Tsuhan Chen,et al.  Audiovisual speech processing , 2001, IEEE Signal Process. Mag..

[38]  R Netsell,et al.  Acceleration and weakness in parkinsonian dysarthria. , 1975, The Journal of speech and hearing disorders.

[39]  Sara Dahmani,et al.  Is markerless acquisition technique adequate for speech production? , 2016, The Journal of the Acoustical Society of America.

[40]  Yana Yunusova,et al.  Interarticulator coordination in dysarthria: an X-ray microbeam study. , 2003, Journal of speech, language, and hearing research : JSLHR.

[41]  Bernhard Neundörfer,et al.  Subjective experience and coping in ALS , 2002, Amyotrophic lateral sclerosis and other motor neuron disorders : official publication of the World Federation of Neurology, Research Group on Motor Neuron Diseases.

[42]  Yana Yunusova,et al.  Classification of Bulbar ALS from Kinematic Features of the Jaw and Lips: Towards Computer-Mediated Assessment , 2017, INTERSPEECH.

[43]  Marco Cristani,et al.  Infinite Feature Selection , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[44]  Max A. Little,et al.  Novel Speech Signal Processing Algorithms for High-Accuracy Classification of Parkinson's Disease , 2012, IEEE Transactions on Biomedical Engineering.

[45]  Samuel H. Huang Supervised feature selection: A tutorial , 2015, Artif. Intell. Res..

[46]  Panying Rong,et al.  Predicting Early Bulbar Decline in Amyotrophic Lateral Sclerosis: A Speech Subsystem Approach , 2015, Behavioural neurology.

[47]  B. Brooks,et al.  Multiple orofacial indices in amyotrophic lateral sclerosis. , 1993, Journal of speech and hearing research.

[48]  J R Orozco-Arroyave,et al.  Automatic detection of Parkinson's disease in running speech spoken in three different languages. , 2016, The Journal of the Acoustical Society of America.

[49]  Marko Robnik-Sikonja,et al.  Theoretical and Empirical Analysis of ReliefF and RReliefF , 2003, Machine Learning.

[50]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Roman Cmejla,et al.  Automatic Evaluation of Articulatory Disorders in Parkinson’s Disease , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[52]  David E. Krebs,et al.  High curvature and jerk analyses of arm ataxia , 2001, Biological Cybernetics.

[53]  R. Guiloff,et al.  Dysarthria in amyotrophic lateral sclerosis: A review , 2010, Amyotrophic lateral sclerosis : official publication of the World Federation of Neurology Research Group on Motor Neuron Diseases.

[54]  Howard N. Zelaznik,et al.  Spatiotemporal stability and patterning of speech movement sequences , 2004, Experimental Brain Research.

[55]  G. Zaccara,et al.  Markerless Analysis of Articulatory Movements in Patients With Parkinson's Disease. , 2016, Journal of voice : official journal of the Voice Foundation.