A Dynamical Approach to Gestural Patterning in Speech Production

In this article, we attempt to reconcile the linguistic hypothesis that speech involves an underlying sequencing of abstract, discrete, context-independent units, with the empirical observation of continuous, context-dependent interleaving of articulatory movements. To this end, we first review a previously proposed task-dynamic model for the coordination and control of the speech articulators. We then describe an extension of this model in which invariant speech units (gestural primitives) are identified with context-independent sets of parameters in a dynamical system having two functionally distinct but interacting levels. The intergestural level is defined according to a set of activation coordinates; the interarticulator level is defined according to both model articulator and tractvariable coordinates. In the framework of this extended model, coproduction effects in speech are described in terms of the blending dynamics defined among a set of temporally overlapping active units; the relative timing ...

[1]  R. H. Stetson.  Motor phonetics : a study of speech movements in action , 1951 .

[2]  L. Lisker,et al.  A Cross-Language Study of Voicing in Initial Stops: Acoustical Measurements , 1964 .

[3]  S. Ohman.  Coarticulation in VCV utterances: spectrographic measurements. , 1966, The Journal of the Acoustical Society of America.

[4]  William L. Henke,et al.  Dynamic articulatory model of speech production using computer simulation. , 1966 .

[5]  S. Ohman.  Numerical model of coarticulation. , 1967, The Journal of the Acoustical Society of America.

[6]  Noam Chomsky,et al.  The Sound Pattern of English , 1968 .

[7]  F. Cooper,et al.  Transillumination of the larynx in running speech. , 1966, The Journal of the Acoustical Society of America.

[8]  J. Perkell.  Physiology of speech production: results and implications of a quantitative cineradiographic study , 1969 .

[9]  P. MacNeilage.  Motor control of serial ordering of speech. , 1970, Psychological review.

[10]  D. E. Whitney,et al.  The mathematics of coordinated control of prosthetic arms and manipulators. , 1972 .

[11]  I. Gartside.  Models of the Structural—Functional Organization of Certain Biological Systems , 1973 .

[12]  A. Kristofferson,et al.  Response delays and the timing of discrete motor responses , 1973 .

[13]  R. J. Hanson,et al.  Labial and mandibular dynamics during the production of bilabial consonants: preliminary observations. , 1973, Journal of speech and hearing research.

[14]  J H Abbs,et al.  Lip and jaw motor control during speech: responses to resistive loading of the jaw. , 1975, Journal of speech and hearing research.

[15]  C.H. Coker,et al.  A model of articulatory dynamics and control , 1976, Proceedings of the IEEE.

[16]  Raymond D. Kent,et al.  Coarticulation in recent speech production models , 1977 .

[17]  Elliot Saltzman,et al.  Levels of sensorimotor representation , 1979 .

[18]  P. N. Kugler,et al.  1 On the Concept of Coordinative Structures as Dissipative Structures: I. Theoretical Lines of Convergence* , 1980 .

[19]  Anders Löfqvist,et al.  Interarticulator programming in stop production , 1980 .

[20]  B. Lindblom,et al.  Production of bite‐block vowels: Acoustic equivalence by selective compensation , 1980 .

[21]  A. Löfqvist,et al.  Laryngeal activity in Swedish obstruent clusters. , 1980, The Journal of the Acoustical Society of America.

[22]  A. Winfree.  The geometry of biological time , 1991 .

[23]  Carol A. Fowler,et al.  Coarticulation and theories of extrinsic timing , 1980 .

[24]  A. Wing.  28 The Long and Short of Timing in Response Sequences , 1980 .

[25]  K. Harris,et al.  A Temporal Model of Speech Production , 1981, Phonetica.

[26]  I. Mattingly.  Phonetic Representation and Speech Synthesis by Rule , 1981 .

[27]  A. Löfqvist,et al.  Laryngeal Activity in Icelandic Obstruent Production , 1981, Nordic Journal of Linguistics.

[28]  A. Löfqvist,et al.  Interarticulator Programming in Obstruent Production , 1981, Phonetica.

[29]  B. Lindblom,et al.  Production of bite-block vowels: acoustic equivalence by selective compensation. , 1981, The Journal of the Acoustical Society of America.

[30]  Anders Löfqvist,et al.  Laryngeal adjustments in the production of consonant clusters and geminates in American English , 1981 .

[31]  Donald A. Norman,et al.  Simulating a Skilled Typist: A Study of Skilled Cognitive-Motor Performance , 1982, Cogn. Sci..

[32]  S. Grossberg.  Studies of mind and brain : neural principles of learning, perception, development, cognition, and motor control , 1982 .

[33]  Stephen Grossberg,et al.  A Theory of Human Memory: Self-Organization and Performance of Sensory-Motor Codes, Maps, and Plans , 1982 .

[34]  J. Abbs,et al.  Sensorimotor actions in the control of multi-movement speech gestures , 1983, Trends in Neurosciences.

[35]  J. Kelso,et al.  Toward a Dynamical Account of Motor Memory and Control , 1983 .

[36]  P. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[37]  Björn Lindblom,et al.  Economy of Speech Gestures , 1983 .

[38]  C. Fowler.  Converging sources of evidence on spoken and perceived rhythms of speech: cyclic production of vowels in monosyllabic stress feet. , 1983, Journal of experimental psychology. General.

[39]  Charles A. Klein,et al.  Review of pseudoinverse control for use with kinematically redundant manipulators , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[40]  J. Kelso,et al.  Functionally specific articulatory cooperation following jaw perturbations during speech: evidence for coordinative structures. , 1984, Journal of experimental psychology. Human perception and performance.

[41]  Anders Löfqvist,et al.  Intrasegmental timing: Laryngeal-oral coordination in voiceless consonant production , 1984, Speech Commun..

[42]  N. A. Bernshteĭn,et al.  Human motor actions : Bernstein reassessed , 1984 .

[43]  J. Kelso,et al.  Articulatory synthesis from underlying dynamics , 1984 .

[44]  M. Arbib.  Chapter VIa from Synergies and Embryos to Motor Schemas , 1984 .

[45]  J. Hollerbach,et al.  Programming and control of kinematically redundant manipulators , 1984, The 23rd IEEE Conference on Decision and Control.

[46]  P. R. Lennard.  Afferent perturbations during "monopodal" swimming movements in the turtle: phase-dependent cutaneous modulation and proprioceptive resetting of the locomotor rhythm , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[47]  M. Macchi.  Segmental and suprasegmental features and lip and jaw articulators , 1985 .

[48]  K. G. Munhall,et al.  Phase‐dependent sensitivity to perturbation reveals the nature of speech coordinative structures , 1985 .

[49]  J. Kelso,et al.  A qualitative dynamic analysis of reiterant speech production: phase portraits, kinematics, and dynamic modeling. , 1985, The Journal of the Acoustical Society of America.

[50]  P. R. Lennard,et al.  Central reflex modulation during locomotion , 1985, Trends in Neurosciences.

[51]  William J. Hardcastle,et al.  Some phonetic and syntactic constraints on lingual coarticulation during /kl/ sequences , 1985, Speech Commun..

[52]  Stephen Grossberg,et al.  CHAPTER 6 – The Adaptive Self-organization of Serial Order in Behavior: Speech, Language, and Motor Control* , 1986 .

[53]  E. Saltzman,et al.  GEST: A computational model of speech production using dynamically defined articulatory gestures , 1986 .

[54]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[55]  J. Kelso,et al.  Laryngeal compensation following sudden oral perturbation , 1986 .

[56]  E. Saltzman,et al.  Acoustic and articulatory evidence for consonant‐vowel interactions , 1986 .

[57]  J. Hopfield,et al.  Computing with neural circuits: a model. , 1986, Science.

[58]  J. Kelso,et al.  Intentional contents, communicative context, and task dynamics: a reply to the commentators , 1986 .

[59]  J. Thompson,et al.  Nonlinear Dynamics and Chaos: Geometrical Methods for Engineers and Scientists , 1986 .

[60]  Dana H. Ballard,et al.  Cortical connections and parallel processing: Structure and function , 1986, Behavioral and Brain Sciences.

[61]  Elliot Saltzman,et al.  Task Dynamic Coordination of the Speech Articulators: A Preliminary Model , 1986 .

[62]  Bruce Andrew Kay,et al.  DYNAMIC MODELING OF RHYTHMIC LIMB MOVEMENTS: CONVERGING ON A DESCRIPTION OF THE COMPONENT OSCILLATORS , 1986 .

[63]  Louis Goldstein,et al.  Towards an articulatory phonology , 1986, Phonology.

[64]  S. Grossberg,et al.  Computer simulation of neural networks for perceptual psychology , 1988 .

[65]  P. N. Kugler,et al.  Fluctuations and phase symmetry in coordinated rhythmic movements. , 1986, Journal of experimental psychology. Human perception and performance.

[66]  Elliot Saltzman,et al.  The dynamical perspectives on speech production: Data and theory , 1986 .

[67]  Geoffrey E. Hinton,et al.  A general framework for parallel distributed processing , 1986 .

[68]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[69]  J A Kelso,et al.  Space-time behavior of single and bimanual rhythmical movements: data and limit cycle model. , 1987, Journal of experimental psychology. Human perception and performance.

[70]  E. Saltzman,et al.  Space-time behavior of single and bimanual rhythmical movements: data and limit cycle model. , 1987 .

[71]  S. Grossberg.  The Adaptive Self-Organization of Serial Order in Behavior: Speech, Language, And Motor Control , 1987 .

[72]  E. Saltzman,et al.  Task‐dynamic modeling of interarticulator coordination , 1987 .

[73]  Stephen Grossberg,et al.  Speech Perception and Production by a Self-Organizing Neural Network. , 1987 .

[74]  Geoffrey E. Hinton,et al.  Connectionist Architectures for Artificial Intelligence , 1990, Computer.

[75]  Björn Lindblom,et al.  The Concept of Target and Speech Timing , 1987 .

[76]  J. Kelso,et al.  Skilled actions: a task-dynamic approach. , 1987, Psychological review.

[77]  Alan Garfinkel,et al.  Self-organizing systems : the emergence of order , 1987 .

[78]  J J Hopfield,et al.  Neural computation by concentrating information in time. , 1987, Proceedings of the National Academy of Sciences of the United States of America.

[79]  E. Vatikiotis-Bateson.  Linguistic structure and articulatory dynamics : a cross-language study , 1987 .

[80]  Yoshiro Miyata,et al.  The learning and planning of actions , 1988 .

[81]  H Sompolinsky,et al.  Associative neural network model for the generation of temporal patterns. Theory and application to central pattern generators. , 1988, Biophysical journal.

[82]  A. Löfqvist,et al.  Laryngeal kinematics in voiceless obstruents produced by hearing-impaired speakers. , 1988, Journal of speech and hearing research.

[83]  Stephen Grossberg,et al.  The Vite Model: A Neural Command Circuit for Generating Arm and Articulator Trajectories, , 1988 .

[84]  Jerome A. Feldman,et al.  Connectionist Models and Their Properties , 1982, Cogn. Sci..

[85]  R. S. McGowan,et al.  Applying the program NEWPAR to extract dynamic parameters from movement trajectories , 1988 .

[86]  Louis Goldstein,et al.  Modeling speech production using dynamic gestural structures , 1988 .

[87]  K. Harris,et al.  Patterns of interarticulator phasing and their relation to linguistic structure. , 1988, The Journal of the Acoustical Society of America.

[88]  S. Grossberg,et al.  Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation. , 1988, Psychological review.

[89]  K. Munhall,et al.  Gestural aggregation in speech , 1988 .

[90]  J. Kelso,et al.  Phase Transitions in Speech Production and Their Perceptual Consequences , 1989, Attention and Performance XIII.

[91]  Barak A. Pearlmutter.  Learning State Space Trajectories in Recurrent Neural Networks , 1989, Neural Computation.

[92]  S. Boyce.  The influence of phonological structure on articulatory organization in Turkish and in English : vowel harmony and coarticulation , 1989 .

[93]  C. Browman,et al.  Papers in Laboratory Phonology: Tiers in articulatory phonology, with some implications for casual speech , 1990 .

[94]  E. Saltzman,et al.  Steady-state and perturbed rhythmical movements: a dynamical analysis. , 1991, Journal of experimental psychology. Human perception and performance.