Using Ultrasound Imaging to Create Augmented Visual Biofeedback for Articulatory Practice

Ultrasound images of the tongue surface can be used to provide real-time visual feedback for clinical practitioners and speakers adjusting pronunciation patterns. However, rapid and complex movements of the tongue can be difficult to interpret and directly relate to desired changes. We are developing a method for simplified visual feedback controlled by efficient, real-time tracking of tongue contours in ultrasound images. Our feedback and control paradigm are briefly discussed, and video of a potential game-like biofeedback stimulus is demonstrated.

[1]  W. Prinz,et al.  Instructions for motor learning: differential effects of internal versus external focus of attention. , 1998, Journal of motor behavior.

[2]  Michael A. Riley,et al.  DIFFERENTIATING NORMAL VS MISARTICULATED TONGUE TRAJECTORIES FROM ULTRASOUND FOR FAST AUTOMATIC ARTICULATORY BIOFEEDBACK , 2019 .

[3]  Ahmed Rivera-Campos,et al.  Acquiring rhoticity across languages: An ultrasound study of differentiating tongue movements , 2016, Clinical linguistics & phonetics.

[4]  S. Boyce,et al.  The Articulatory Phonetics of /r/ for Residual Speech Errors , 2015, Seminars in Speech and Language.

[5]  Suzanne Boyce,et al.  A magnetic resonance imaging-based articulatory and acoustic study of "retroflex" and "bunched" American English /r/. , 2008, The Journal of the Acoustical Society of America.

[6]  W. Hardcastle,et al.  Quantifying lingual coarticulation using ultrasound imaging data collected with and without head stabilisation , 2015, Clinical linguistics & phonetics.

[7]  Michael T. Turvey,et al.  Skill Acquisition: An Event Approach with Special Reference to Searching for the Optimum of a Function of Several Variables , 1978 .

[8]  P. Delattre,et al.  A DIALECT STUDY OF AMERICAN R’S BY X-RAY MOTION PICTURE , 1968 .

[9]  Shrikanth S. Narayanan,et al.  Toward articulatory-acoustic models for liquid approximants based on MRI and EPG data. Part II. The rhotics. , 1997, The Journal of the Acoustical Society of America.

[10]  Tara McAllister Byun,et al.  Retroflex versus bunched in treatment for rhotic misarticulation: evidence from ultrasound biofeedback intervention. , 2014, Journal of speech, language, and hearing research : JSLHR.

[11]  G L Culton,et al.  Speech disorders among college freshmen: a 13-year survey. , 1986, The Journal of speech and hearing disorders.