Towards Automated Assessment of Stuttering and Stuttering Therapy

Stuttering is a complex speech disorder that can be identified by repetitions, prolongations of sounds, syllables or words, and blocks while speaking. Severity assessment is usually done by a speech therapist. While attempts at automated assessment were made, it is rarely used in therapy. Common methods for the assessment of stuttering severity include percent stuttered syllables (% SS), the average of the three longest stuttering symptoms during a speech task, or the recently introduced Speech Efficiency Score (SES). This paper introduces the Speech Control Index (SCI), a new method to evaluate the severity of stuttering. Unlike SES, it can also be used to assess therapy success for fluency shaping. We evaluate both SES and SCI on a new comprehensively labeled dataset containing stuttered German speech of clients prior to, during, and after undergoing stuttering therapy. Phone alignments of an automatic speech recognition system are statistically evaluated in relation to their relative position to labeled stuttering events. The results indicate that phone length distributions differ with respect to their position in and around labeled stuttering events

[1]  Ann Packman,et al.  The Lidcombe Program of Early Stuttering Intervention: A Clinician's Guide , 2003 .

[2]  Mark Onslow,et al.  Absolute and relative reliability of percentage of syllables stuttered and severity rating scales. , 2014, Journal of speech, language, and hearing research : JSLHR.

[3]  Bharti Gawali,et al.  Recognition and Classification Of Speech And Its Related Fluency Disorders , 2014 .

[4]  Keiko Ochi,et al.  Automatic Evaluation of Soft Articulatory Contact for Stuttering Treatment , 2018, INTERSPEECH.

[5]  Arne Köhn,et al.  Open Source Automatic Speech Recognition for German , 2018, ITG Symposium on Speech Communication.

[6]  Phil D. Green,et al.  A Lightly Supervised Approach to Detect Stuttering in Children's Speech , 2018, INTERSPEECH.

[7]  A. Packman,et al.  Theoretical Issues in Stuttering , 2015 .

[8]  Nicole Propst,et al.  Fluency And Stuttering , 2016 .

[9]  Yair Shapira,et al.  The Speech Efficiency Score (SES): A time-domain measure of speech fluency. , 2018, Journal of fluency disorders.

[10]  Katrin Neumann,et al.  Computergestützte Therapie bei Redeflussstörungen: Die langfristige Wirksamkeit der Kasseler Stottertherapie (KST) , 2009 .

[11]  E. Yairi,et al.  Early childhood stuttering I: persistency and recovery rates. , 1999, Journal of speech, language, and hearing research : JSLHR.

[12]  Robin J. Lickley,et al.  Disfluency in typical and stuttered speech , 2017 .

[13]  M. Hariharan,et al.  MFCC based recognition of repetitions and prolongations in stuttered speech using k-NN and LDA , 2009, 2009 IEEE Student Conference on Research and Development (SCOReD).

[14]  Hagen Soltau,et al.  Fast speaker adaptive training for speech recognition , 2008, INTERSPEECH.

[15]  Elmar Nöth,et al.  Automatic stuttering recognition using hidden Markov models , 2000, INTERSPEECH.

[16]  Daniel Povey,et al.  The Kaldi Speech Recognition Toolkit , 2011 .

[17]  H. Euler,et al.  Die Kasseler Stottertherapie (KST). Ergebnisse einer computer-gestützten Biofeedbacktherapie für Erwachsene* 1 , 2000 .

[18]  G J Borden,et al.  Onset of voicing in stuttered and fluent utterances. , 1985, Journal of speech and hearing research.

[19]  Ronald L. Webster,et al.  An Operant Response Shaping Program for the Establishment of Fluency in Stutterers. Final Report. , 1972 .

[20]  R. Ingham,et al.  Evaluation of a stuttering treatment based on reduction of short phonation intervals. , 2001, Journal of speech, language, and hearing research : JSLHR.

[21]  G. Riley Stuttering Severity Instrument , 2020 .

[22]  A. Packman,et al.  Prolonged speech and modification of stuttering: perceptual, acoustic, and electroglottographic data. , 1994, Journal of speech and hearing research.

[23]  J. Kelley,et al.  The precision fluency shaping program: Replication and evaluation , 1982 .

[24]  Wieslawa Kuniszyk-Józkowiak,et al.  Hierarchical ANN system for stuttering identification , 2013, Comput. Speech Lang..