A New Model of Speech Motor Control Based on Task Dynamics and State Feedback

We present a new model of speech motor control (TD-SFC) based on articulatory goals that explicitly incorporates acoustic sensory feedback using a framework for state-based control. We do this by combining two existing, complementary models of speech motor control – the Task Dynamics model [1] and the State Feedback Control model of speech [2]. We demonstrate the effectiveness of the combined model by simulating a simple formant perturbation study, and show that the model qualitatively reproduces the behavior of online compensation for unexpected perturbations reported in human subjects.

[1]  Louis Goldstein,et al.  Dynamics and articulatory phonology , 1996 .

[2]  P. Rubin,et al.  CASY: The Haskins Configurable Articulatory Synthesizer , 2003 .

[3]  Frank H Guenther,et al.  The DIVA model: A neural theory of speech acquisition and production , 2011, Language and cognitive processes.

[4]  S. Haykin.  Kalman Filtering and Neural Networks , 2001 .

[5]  Kevin G Munhall,et al.  Adaptive control of vowel formant frequency: evidence from real-time formant manipulation. , 2006, The Journal of the Acoustical Society of America.

[6]  S. Nagarajan,et al.  What Does Motor Efference Copy Represent? Evidence from Speech Production , 2013, The Journal of Neuroscience.

[7]  T. Gelder,et al.  Mind as Motion: Explorations in the Dynamics of Cognition , 1995 .

[8]  Mark Hasegawa-Johnson,et al.  A procedure for estimating gestural scores from speech acoustics. , 2012, The Journal of the Acoustical Society of America.

[9]  Srikantan S. Nagarajan,et al.  Speech Production as State Feedback Control , 2011, Front. Hum. Neurosci..

[10]  O. Jacobs,et al.  Introduction to Control Theory , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  Pascal Perrier,et al.  Motor Equivalence in Speech Production , 2015 .

[12]  Sethu Vijayakumar,et al.  Adaptive Optimal Feedback Control with Learned Internal Dynamics Models , 2010, From Motor Learning to Interaction Learning in Robots.

[13]  David J. Ostry,et al.  Somatosensory function in speech perception , 2009, Proceedings of the National Academy of Sciences.

[14]  Jason A. Tourville,et al.  Neural mechanisms underlying auditory feedback control of speech , 2008, NeuroImage.

[15]  Louis Goldstein,et al.  A task-dynamic toolkit for modeling the effects of prosodic structure on articulation , 2008, Speech Prosody 2008.

[16]  L Saltzman Elliot,et al.  A Dynamical Approach to Gestural Patterning in Speech Production , 1989 .