Tongue and Lip Acceleration as a Measure of Speech Decline in Amyotrophic Lateral Sclerosis

Purpose: The goal of this study was to examine the efficacy of acceleration-based articulatory measures in characterizing the decline in speech motor control due to amyotrophic lateral sclerosis (ALS). Method: Electromagnetic articulography was used to record tongue and lip movements during the production of 20 phrases. Data were collected from 50 individuals diagnosed with ALS. Articulatory kinematic variability was measured using the spatiotemporal index of both instantaneous acceleration and speed signals. Linear regression models were used to analyze the relationship between variability measures and intelligible speaking rate (a clinical measure of disease progression). A machine learning algorithm (support vector regression, SVR) was used to assess whether acceleration or speed features (e.g., mean, median, maximum) showed better performance at predicting speech severity in patients with ALS. Results: As intelligible speaking rate declined, the variability of acceleration of tongue and lip movement patterns significantly increased (p < 0.001). The variability of speed and vertical displacement did not significantly predict speech performance measures. Additionally, based on R2 and root mean square error (RMSE) values, the SVR model was able to predict speech severity more accurately from acceleration features (R2 = 0.601, RMSE = 38.453) and displacement features (R2 = 0.218, RMSE = 52.700) than from speed features (R2 = 0.554, RMSE = 40.772). Conclusion: Results from these models highlight differences in speech motor control in participants with ALS. The variability in acceleration of tongue and lip movements increases as speech performance declines, potentially reflecting physiological deviations due to the progression of ALS. Our findings suggest that acceleration is a more sensitive indicator of speech deterioration due to ALS than displacement and speed and may contribute to improved algorithm designs for monitoring disease progression from speech signals.

[1]  Ling Zhang,et al.  Influences of Methodological Decisions on Assessing the Spatiotemporal Stability of Speech Movement Sequences. , 2022, Journal of speech, language, and hearing research : JSLHR.

[2]  Kaila L. Stipancic,et al.  "You Say Severe, I Say Mild": Toward an Empirical Classification of Dysarthria Severity. , 2021, Journal of speech, language, and hearing research : JSLHR.

[3]  G. Le Masson,et al.  Minimizing the Diagnostic Delay in Amyotrophic Lateral Sclerosis: The Role of Nonneurologist Practitioners , 2020, Neurology research international.

[4]  G. Mora,et al.  Association between maximum tongue pressure and swallowing safety and efficacy in amyotrophic lateral sclerosis , 2020, Neurogastroenterology and motility : the official journal of the European Gastrointestinal Motility Society.

[5]  Jaehoon Lee,et al.  Effects of utterance rate and length on the spatiotemporal index in Parkinson’s disease , 2020, International journal of speech-language pathology.

[6]  James D. Berry,et al.  Assessing Oromotor Capacity in ALS: The Effect of a Fixed-Target Task on Lip Biomechanics , 2019, Front. Neurol..

[7]  Prasanna V. Kothalkar,et al.  Automatic prediction of intelligible speaking rate for individuals with ALS from speech acoustic and articulatory samples , 2018, International journal of speech-language pathology.

[8]  Myung Jong Kim,et al.  Automatic Early Detection of Amyotrophic Lateral Sclerosis from Intelligible Speech Using Convolutional Neural Networks , 2018, INTERSPEECH.

[9]  Yana Yunusova,et al.  Kinematic Features of Jaw and Lips Distinguish Symptomatic From Presymptomatic Stages of Bulbar Decline in Amyotrophic Lateral Sclerosis. , 2018, Journal of speech, language, and hearing research : JSLHR.

[10]  Yana Yunusova,et al.  Classification of Bulbar ALS from Kinematic Features of the Jaw and Lips: Towards Computer-Mediated Assessment , 2017, INTERSPEECH.

[11]  Mili Kuruvilla-Dugdale,et al.  An investigation of clear speech effects on articulatory kinematics in talkers with ALS , 2017, Clinical linguistics & phonetics.

[12]  Antje Mefferd,et al.  Spatiotemporal movement variability in ALS: Speaking rate effects on tongue, lower lip, and jaw motor control. , 2017, Journal of communication disorders.

[13]  Yana Yunusova,et al.  The diagnostic utility of patient-report and speech-language pathologists’ ratings for detecting the early onset of bulbar symptoms due to ALS , 2017, Amyotrophic lateral sclerosis & frontotemporal degeneration.

[14]  A. Mefferd Associations between tongue movement pattern consistency and formant movement pattern consistency in response to speech behavioral modifications. , 2016, The Journal of the Acoustical Society of America.

[15]  Panying Rong,et al.  Speech Movement Measures as Markers of Bulbar Disease in Amyotrophic Lateral Sclerosis. , 2016, Journal of speech, language, and hearing research : JSLHR.

[16]  Jun Wang,et al.  Towards Automatic Detection of Amyotrophic Lateral Sclerosis from Speech Acoustic and Articulatory Samples , 2016, INTERSPEECH.

[17]  Jun Wang,et al.  Predicting Intelligible Speaking Rate in Individuals with Amyotrophic Lateral Sclerosis from a Small Number of Speech Acoustic and Articulatory Samples. , 2016, Workshop on Speech and Language Processing for Assistive Technologies.

[18]  Ashok Samal,et al.  An Optimal Set of Flesh Points on Tongue and Lips for Speech-Movement Classification. , 2016, Journal of speech, language, and hearing research : JSLHR.

[19]  Gary L. Pattee,et al.  Electrical impedance myography in the evaluation of the tongue musculature in amyotrophic lateral sclerosis , 2015, Muscle & nerve.

[20]  Jun Wang,et al.  Parkinson's condition estimation using speech acoustic and inversely mapped articulatory data , 2015, INTERSPEECH.

[21]  Thomas F. Quatieri,et al.  A review of depression and suicide risk assessment using speech analysis , 2015, Speech Commun..

[22]  Jordan R. Green,et al.  Speaking rate effects on articulatory pattern consistency in talkers with mild ALS , 2014, Clinical linguistics & phonetics.

[23]  Elmar Nöth,et al.  New computer aided device for real time analysis of speech of people with Parkinson’s disease , 2014, Revista Facultad de Ingeniería Universidad de Antioquia.

[24]  Gary L. Pattee,et al.  Bulbar and speech motor assessment in ALS: Challenges and future directions , 2013, Amyotrophic lateral sclerosis & frontotemporal degeneration.

[25]  Christian Poellabauer,et al.  Using isolated vowel sounds for classification of Mild Traumatic Brain Injury , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[26]  A. Geurts,et al.  Prognostic value of decreased tongue strength on survival time in patients with amyotrophic lateral sclerosis , 2012, Journal of Neurology.

[27]  Max A. Little,et al.  Novel Speech Signal Processing Algorithms for High-Accuracy Classification of Parkinson's Disease , 2012, IEEE Transactions on Biomedical Engineering.

[28]  Jeffrey J Berry,et al.  Accuracy of the NDI wave speech research system. , 2011, Journal of speech, language, and hearing research : JSLHR.

[29]  M. Turner,et al.  The diagnostic pathway and prognosis in bulbar-onset amyotrophic lateral sclerosis , 2010, Journal of the Neurological Sciences.

[30]  M. Lindstrom,et al.  Articulatory movements during vowels in speakers with dysarthria and healthy controls. , 2008, Journal of speech, language, and hearing research : JSLHR.

[31]  M. McHenry,et al.  The effect of pacing strategies on the variability of speech movement sequences in dysarthria. , 2003, Journal of speech, language, and hearing research : JSLHR.

[32]  Christopher A Moore,et al.  The sequential development of jaw and lip control for speech. , 2002, Journal of speech, language, and hearing research : JSLHR.

[33]  A Smith,et al.  Speech motor stability in IPD: effects of rate and loudness manipulations. , 2001, Journal of speech, language, and hearing research : JSLHR.

[34]  Jeffrey M. Hausdorff,et al.  Dynamic markers of altered gait rhythm in amyotrophic lateral sclerosis. , 2000, Journal of applied physiology.

[35]  A. Smith,et al.  Kinematic correlates of speaking rate changes in stuttering and normally fluent adults. , 2000, Journal of speech, language, and hearing research : JSLHR.

[36]  A Smith,et al.  On the assessment of stability and patterning of speech movements. , 2000, Journal of speech, language, and hearing research : JSLHR.

[37]  V. Meininger Getting the diagnosis right: Beyond El Escorial , 1999, Journal of Neurology.

[38]  J. Cedarbaum,et al.  The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function , 1999, Journal of the Neurological Sciences.

[39]  P. Andres,et al.  The relationship of lower-limb muscle force to walking ability in patients with amyotrophic lateral sclerosis. , 1999, Physical therapy.

[40]  J Finsterer,et al.  Needle EMG of the tongue: motor unit action potential versus peak ratio analysis in limb and bulbar onset amyotrophic lateral sclerosis , 1997, Journal of neurology, neurosurgery, and psychiatry.

[41]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[42]  S. Langmore,et al.  Physiologic deficits in the orofacial system underlying dysarthria in amyotrophic lateral sclerosis. , 1994, Journal of speech and hearing research.

[43]  B. Brooks,et al.  Multiple orofacial indices in amyotrophic lateral sclerosis. , 1993, Journal of speech and hearing research.

[44]  B. Patten,et al.  Amyotrophic lateral sclerosis: Abnormalities of the tongue on magnetic resonance imaging , 1989, Annals of neurology.

[45]  J. Abbs,et al.  Hypoglossal, trigeminal, and facial motoneuron involvement in amyotrophic lateral sclerosis , 1988, Neurology.

[46]  J. Perkell,et al.  Mandible movements during increasingly rapid articulations of single syllables: preliminary observations. , 1984, The Journal of the Acoustical Society of America.

[47]  W. L. Nelson Physical principles for economies of skilled movements , 1983, Biological Cybernetics.

[48]  D R Beukelman,et al.  Communication efficiency of dysarthric speakers as measured by sentence intelligibility and speaking rate. , 1981, The Journal of speech and hearing disorders.

[49]  R Netsell,et al.  Acceleration and weakness in parkinsonian dysarthria. , 1975, The Journal of speech and hearing disorders.

[50]  I. Newton,et al.  Isaac Newton's Philosophiae naturalis principia mathematica , 1973 .

[51]  Jordan R. Green,et al.  Can Machines Learn Continuous Measures of Speech Severity from Ordinal Training Labels? , 2020, FLAIRS.

[52]  Jun Wang,et al.  Speech-based Estimation of Bulbar Regression in Amyotrophic Lateral Sclerosis , 2019, SLPAT@NAACL-HLT.

[53]  Christopher Brooks,et al.  Statistical Approaches to the Model Comparison Task in Learning Analytics , 2017, MLA/BLAC@LAK.

[54]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[55]  Jun Wang,et al.  SMASH: a tool for articulatory data processing and analysis , 2013, INTERSPEECH.

[56]  Thomas F. Quatieri,et al.  Vocal-Source Biomarkers for Depression: A Link to Psychomotor Activity , 2012, INTERSPEECH.

[57]  A. Ludolph,et al.  Amyotrophic lateral sclerosis. , 2012, Current opinion in neurology.

[58]  Jordan R. Green,et al.  A novel fixed-target task to determine articulatory speed constraints in persons with amyotrophic lateral sclerosis. , 2012, Journal of communication disorders.

[59]  Volkmar Schüller Newton, Isaac: Philosophiae naturalis principia mathematica , 2009 .

[60]  D. Basak,et al.  Support Vector Regression , 2008 .

[61]  Howard N. Zelaznik,et al.  Spatiotemporal stability and patterning of speech movement sequences , 2004, Experimental Brain Research.

[62]  K. E. Herbrich,et al.  Evaluation of the speech motor control system in amyotrophic lateral sclerosis , 1991 .