The relation between the continuous and the discrete: A note on the first principles of speech dynamics

Abstract The goal of this paper is to show how dynamical theories of phonetics and phonology bridge the dualistic gap between discrete phonological descriptions and continuous phonetic descriptions. By delving into the first principles of dynamics, it is shown that dynamical theories do not assume separate sets of principles to describe discrete and continuous aspects of a system. Rather, the discrete description is shown to predict the continuous one, using the concept of a differential equation, which is thoroughly explained. Linear and nonlinear differential equations are introduced using a discrete approximation, and then used to show how phonological contrast has been accounted for using dynamical systems analysis. A dynamical recurrent neural network model of word formation is then discussed to show how linguistic plans for words are serialized and coordinated into motoric word plans for different articulatory systems in the vocal tract. Furthermore, it is shown that many aspects of the discrete, time-invariant phonological description can be predicted from observed variable continuous phonetic functions, using the principle of least squares and recurrent neural networks.

[1]  James P. Crutchfield,et al.  Geometry from a Time Series , 1980 .

[2]  Matthew Goldrick,et al.  Optimization and Quantization in Gradient Symbol Systems: A Framework for Integrating the Continuous and the Discrete in Cognition , 2014, Cogn. Sci..

[3]  J. Kelso,et al.  A qualitative dynamic analysis of reiterant speech production: phase portraits, kinematics, and dynamic modeling. , 1985, The Journal of the Acoustical Society of America.

[4]  Alexei Kochetov,et al.  Durational characteristics and timing patterns of Russian onset clusters at two speaking rates , 2015, INTERSPEECH.

[5]  Louis Goldstein,et al.  A task-dynamic toolkit for modeling the effects of prosodic structure on articulation , 2008, Speech Prosody 2008.

[6]  A. Gafos,et al.  The Gesture as an Autonomous Nonlinear Dynamical System , 2016 .

[7]  Adamantios I. Gafos,et al.  Stochastic Time Models of Syllable Structure , 2015, PloS one.

[8]  Shrikanth S. Narayanan,et al.  Timing effects of syllable structure and stress on nasals: A real-time MRI examination , 2009, J. Phonetics.

[9]  L Saltzman Elliot,et al.  A Dynamical Approach to Gestural Patterning in Speech Production , 1989 .

[10]  Sam Tilsen,et al.  Selection and coordination: The articulatory basis for the emergence of phonological structure , 2016, J. Phonetics.

[11]  Louis Goldstein,et al.  The coordination of boundary tones and its interaction with prominence , 2014, J. Phonetics.

[12]  Dani Byrd,et al.  Dynamic action units slip in speech production errors , 2007, Cognition.

[13]  Shinji Maeda,et al.  Multi-pulse LPC modeling of articulatory movements , 1998, Speech Commun..

[14]  Adamantios I. Gafos,et al.  Dynamics of Phonological Cognition , 2006, Cogn. Sci..

[15]  Gregor Schöner,et al.  Dynamic Thinking : A Primer on Dynamic Field Theory , 2015 .

[16]  J A Kelso,et al.  The nonlinear dynamics of speech categorization. , 1994, Journal of experimental psychology. Human perception and performance.

[17]  Jürgen Kurths,et al.  Synchronization - A Universal Concept in Nonlinear Sciences , 2001, Cambridge Nonlinear Science Series.

[18]  Armin Fuchs,et al.  Nonlinear Dynamics in Complex Systems: Theory and Applications for the Life-, Neuro- and Natural Sciences , 2012 .

[19]  P Catherine,et al.  Phonological Structure and Phonetic Form: Lip aperture and consonant releases , 1994 .

[20]  Louis Goldsteina,et al.  SYLLABLE STRUCTURE AS COUPLED OSCILLATOR MODES : EVIDENCE FROM GEORGIAN VS . TASHLHIYT BERBER , 2007 .

[21]  Khalil Iskarous,et al.  Compatible Dynamical Models of Environmental, Sensory, and Perceptual Systems , 2016 .

[22]  Gary S. Dell,et al.  Connectionist models of language production: lexical access and grammatical encoding , 1999, Cogn. Sci..

[23]  C. Browman,et al.  Competing constraints on intergestural coordination and self-organization of phonological structures , 2000 .

[24]  C. Browman,et al.  Some Notes on Syllable Structure in Articulatory Phonology , 1988, Phonetica.

[25]  Dani Byrd,et al.  The elastic phrase: modeling the dynamics of boundary-adjacent lengthening , 2003, J. Phonetics.

[27]  D. Ostry,et al.  Characteristics of velocity profiles of speech movements. , 1985, Journal of experimental psychology. Human perception and performance.

[28]  Björn Lindblom,et al.  Economy of Speech Gestures , 1983 .

[29]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[30]  Louis Goldstein,et al.  Articulatory gestures as phonological units , 1989, Phonology.

[31]  R. Kalaba,et al.  Analytical Dynamics: A New Approach , 1996 .

[32]  M. Pouplier,et al.  Temporal organization of complex onsets and codas in American English: testing the predictions of a gestural coupling model. , 2010, Motor control.

[33]  Louis Goldstein,et al.  Self-organization of Syllable Structure: a Coupled Oscillator Model , 2007 .

[34]  Dani Byrd,et al.  Intragestural dynamics of multiple prosodic boundaries , 1998 .

[35]  P. Smolensky,et al.  Optimality Theory: Constraint Interaction in Generative Grammar , 2004 .

[36]  D. Ostry,et al.  The equilibrium point hypothesis and its application to speech motor control. , 1996, Journal of speech and hearing research.

[37]  J. Kelso,et al.  Functionally specific articulatory cooperation following jaw perturbations during speech: evidence for coordinative structures. , 1984, Journal of experimental psychology. Human perception and performance.

[38]  Jelena Krivokapić,et al.  Gestural coordination at prosodic boundaries and its role for prosodic structure and speech planning processes , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[39]  Phil Hoole,et al.  The coarticulation/invariance scale: mutual information as a measure of coarticulation resistance, motor synergy, and articulatory invariance. , 2013, The Journal of the Acoustical Society of America.

[40]  Eric Vatikiotis-Bateson,et al.  Rhythm type and articulatory dynamics in English, French and Japanese , 1993 .

[41]  Hisashi Wakita,et al.  chapter 1 – Instrumentation for the Study of Speech Acoustics , 1976 .

[42]  Juraj Simko,et al.  Embodied task dynamics. , 2010, Psychological review.

[43]  A. L. Sumi,et al.  Language as a Dynamical System : Sensitive Dependence on Error Conditions , 2004 .

[44]  Sherman Wilcox,et al.  Dynamic Modeling of Phonetic Structure , 1992 .

[45]  Kevin D. Roon,et al.  Perceiving while producing: Modeling the dynamics of phonological planning. , 2016, Journal of memory and language.