Coupling relations underlying the production of speech articulator movements and their invariance to speech rate

Since the seminal works of Bernstein (The coordination and regulation of movements. Pergamon Press, Oxford, 1967) several authors have supported the idea that, to produce a goal-oriented movement in general, and a movement of the organs responsible for the production of speech sounds in particular, individuals activate a set of coupling relations that coordinate the behavior of the elements of the motor system involved in the production of the target movement or sound. In order to characterize the configurations of the coupling relations underlying speech production articulator movements, we introduce an original method based on recurrence analysis. The method is validated through the analysis of simulated dynamical systems adapted to reproduce the features of speech gesture kinematics and it is applied to the analysis of speech articulator movements recorded in five German speakers during the production of labial and coronal plosive and fricative consonants at variable speech rates. We were able to show that the underlying coupling relations change systematically between labial and coronal consonants, but are not affected by speech rate, despite the presence of qualitative changes observed in the trajectory of the jaw at fast speech rate.

[1]  Gerda Claeskens,et al.  Simultaneous Confidence Bands for Penalized Spline Estimators , 2009 .

[2]  Pascal Perrier,et al.  A critical evaluation of gestural stiffness estimations in speech production based on a linear second-order model. , 2011, Journal of speech, language, and hearing research : JSLHR.

[3]  B. Silverman,et al.  Functional Data Analysis , 1997 .

[4]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[5]  Jürgen Kurths,et al.  Hypothesis test for synchronization: twin surrogates revisited. , 2009, Chaos.

[6]  Leonardo Lancia,et al.  Characterization of laryngealization as irregular vocal fold vibration and interaction with prosodic prominence , 2016, J. Phonetics.

[7]  Louis Goldstein,et al.  Articulatory gestures as phonological units , 1989, Phonology.

[8]  Frank H. Guenther,et al.  A neural network model of speech acquisition and motor equivalent speech production , 2004, Biological Cybernetics.

[9]  Leonardo Lancia,et al.  Inter-speaker articulatory variability during vowel-consonant-vowel sequences in twins and unrelated speakers. , 2013, The Journal of the Acoustical Society of America.

[10]  Rasmus Larsen,et al.  Convolution approach for feature detection in topological skeletons obtained from vascular patterns , 2011, 2011 IEEE Workshop on Computational Intelligence in Biometrics and Identity Management (CIBIM).

[11]  Phil Hoole,et al.  The coarticulation/invariance scale: mutual information as a measure of coarticulation resistance, motor synergy, and articulatory invariance. , 2013, The Journal of the Acoustical Society of America.

[12]  M T Turvey,et al.  Interleg Coordination in Quiet Standing: Influence of Age and Visual Environment on Noise and Stability , 2011, Journal of motor behavior.

[13]  J H Abbs,et al.  Lip and jaw motor control during speech: responses to resistive loading of the jaw. , 1975, Journal of speech and hearing research.

[14]  P. Hoole,et al.  Jaw and Order , 2007, Language and speech.

[15]  J. Abbs,et al.  Dynamic control of the perioral system during speech: kinematic analyses of autogenic and nonautogenic sensorimotor processes. , 1985, Journal of neurophysiology.

[16]  Jürgen Kurths,et al.  Inferring Indirect Coupling by Means of Recurrences , 2011, Int. J. Bifurc. Chaos.

[17]  G Papcun,et al.  Inferring articulation and recognizing gestures from acoustics with a neural network trained on x-ray microbeam data. , 1992, The Journal of the Acoustical Society of America.

[18]  Jürgen Kurths,et al.  Estimation of the direction of the coupling by conditional probabilities of recurrence. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  D H McFarland,et al.  Speech compensation to structural modifications of the oral cavity. , 1996, The Journal of the Acoustical Society of America.

[20]  Jean-Luc Schwartz,et al.  An articulatory basis for the labial-to-coronal effect: /pata/ seems a more stable articulatory pattern than /tapa/. , 2007, The Journal of the Acoustical Society of America.

[21]  M. Turvey The bernstein perspective I , 1982 .

[22]  Anders Löfqvist,et al.  Studying articulatory variability using Functional Data Analysis , 2002 .

[23]  Ramesh Balasubramaniam,et al.  On the control of unstable objects: the dynamics of human stick balancing. , 2013, Advances in experimental medicine and biology.

[24]  Gregor Schöner,et al.  Toward a new theory of motor synergies. , 2007, Motor control.

[25]  Jürgen Kurths,et al.  Recurrence plots for the analysis of complex systems , 2009 .

[26]  L Saltzman Elliot,et al.  A Dynamical Approach to Gestural Patterning in Speech Production , 1989 .

[27]  Susanne Fuchs,et al.  The labial coronal effect revisited , 2011 .

[28]  Takayuki Ito,et al.  Dynamical simulation of speech cooperative articulation by muscle linkages , 2004, Biological Cybernetics.

[29]  C. Kroos,et al.  Are there compensatory effects in natural speech , 1999 .

[30]  Philip J. B. Jackson,et al.  Statistical identification of articulation constraints in the production of speech , 2009, Speech Commun..

[31]  Frank H Guenther,et al.  The DIVA model: A neural theory of speech acquisition and production , 2011, Language and cognitive processes.

[32]  George Sugihara,et al.  Detecting Causality in Complex Ecosystems , 2012, Science.

[33]  J. S. Rao,et al.  Spike and slab variable selection: Frequentist and Bayesian strategies , 2005, math/0505633.

[34]  J. Kelso,et al.  Skilled actions: a task-dynamic approach. , 1987, Psychological review.

[35]  Leonardo Lancia,et al.  Application of Concepts From Cross-Recurrence Analysis in Speech Production: An Overview and Comparison With Other Nonlinear Methods , 2013 .

[36]  N. Marwan,et al.  Nonlinear analysis of bivariate data with cross recurrence plots , 2002, physics/0201061.

[37]  L. Tsimring,et al.  Generalized synchronization of chaos in directionally coupled chaotic systems. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[38]  Gregor Schöner,et al.  Limb versus speech motor control: a conceptual review. , 2011, Motor control.

[39]  J. Kelso,et al.  Functionally specific articulatory cooperation following jaw perturbations during speech: evidence for coordinative structures. , 1984, Journal of experimental psychology. Human perception and performance.

[40]  E. Bradley,et al.  Recurrence plots of experimental data: To embed or not to embed? , 1998, Chaos.

[41]  Simon King,et al.  ASR - articulatory speech recognition , 2001, INTERSPEECH.

[42]  J. Abbs,et al.  Control of complex motor gestures: orofacial muscle responses to load perturbations of lip during speech. , 1984, Journal of neurophysiology.

[43]  Jeffrey S. Morris,et al.  Wavelet‐based functional mixed models , 2006, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[44]  H. Abarbanel,et al.  Determining embedding dimension for phase-space reconstruction using a geometrical construction. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[45]  Jorge C Lucero,et al.  Comparison of measures of variability of speech movement trajectories using synthetic records. , 2005, Journal of speech, language, and hearing research : JSLHR.

[46]  John P. Scholz,et al.  Motor equivalence and the uncontrolled manifold , 2008 .

[47]  Joseph S. Perkell,et al.  Movement goals and feedback and feedforward control mechanisms in speech production , 2012, Journal of Neurolinguistics.

[48]  J. Kurths,et al.  Estimation of dynamical invariants without embedding by recurrence plots. , 2004, Chaos.

[49]  Philip Hoole Issues in the acquisition , processing , reduction and parameterization of articulographic data , 2001 .

[50]  D H McFarland,et al.  Incomplete compensation to articulatory perturbation. , 1995, The Journal of the Acoustical Society of America.

[51]  B. Lindblom,et al.  Variability in jaw height for segments in English and Swedish VCVs , 1994 .