Focal Manipulations of Formant Trajectories Reveal a Role of Auditory Feedback in the Online Control of Both Within-Syllable and Between-Syllable Speech Timing

Within the human motor repertoire, speech production has a uniquely high level of spatiotemporal complexity. The production of running speech comprises the traversing of spatial positions with precisely coordinated articulator movements to produce 10–15 sounds/s. How does the brain use auditory feedback, namely the self-perception of produced speech sounds, in the online control of spatial and temporal parameters of multisyllabic articulation? This question has important bearings on the organizational principles of sequential actions, yet its answer remains controversial due to the long latency of the auditory feedback pathway and technical challenges involved in manipulating auditory feedback in precisely controlled ways during running speech. In this study, we developed a novel technique for introducing time-varying, focal perturbations in the auditory feedback during multisyllabic, connected speech. Manipulations of spatial and temporal parameters of the formant trajectory were tested separately on two groups of subjects as they uttered “I owe you a yo-yo.” Under these perturbations, significant and specific changes were observed in both the spatial and temporal parameters of the produced formant trajectories. Compensations to spatial perturbations were bidirectional and opposed the perturbations. Furthermore, under perturbations that manipulated the timing of auditory feedback trajectory (slow-down or speed-up), significant adjustments in syllable timing were observed in the subjects' productions. These results highlight the systematic roles of auditory feedback in the online control of a highly over-learned action as connected speech articulation and provide a first look at the properties of this type of sensorimotor interaction in sequential movements.

[1]  Carolyn J. Brown,et al.  The association between acoustic and articulatory events in a delayed auditory feedback paradigm , 1988 .

[2]  Dani Byrd,et al.  The Distinctions Between State, Parameter and Graph Dynamics in Sensorimotor Control and Coordination , 2006 .

[3]  Michael I. Jordan,et al.  Sensorimotor adaptation in speech production. , 1998, Science.

[4]  Feng Rong,et al.  Sensorimotor Integration in Speech Processing: Computational Basis and Neural Organization , 2011, Neuron.

[5]  C. Larson,et al.  Voice F0 responses to manipulations in pitch feedback. , 1998, The Journal of the Acoustical Society of America.

[6]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[7]  Jason A. Tourville,et al.  Neural mechanisms underlying auditory feedback control of speech , 2008, NeuroImage.

[8]  L. Christensen,et al.  University of Birmingham Disruption of state estimation in the human lateral cerebellum , 2007 .

[9]  F. Guenther Cortical interactions underlying the production of speech sounds. , 2006, Journal of communication disorders.

[10]  Hiroaki Gomi,et al.  Rapid Change in Articulatory Lip Movement Induced by Preceding Auditory Feedback during Production of Bilabial Plosives , 2010, PloS one.

[11]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[12]  H. Lane,et al.  The Lombard Sign and the Role of Hearing in Speech , 1971 .

[13]  F. Guenther,et al.  A theoretical investigation of reference frames for the planning of speech movements. , 1998, Psychological review.

[14]  IEEE Recommended Practice for Speech Quality Measurements , 1969, IEEE Transactions on Audio and Electroacoustics.

[15]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[16]  Kenneth N. Stevens,et al.  On the quantal nature of speech , 1972 .

[17]  Thomas M Donath,et al.  Effects of frequency-shifted auditory feedback on voice F0 contours in syllables. , 2002, The Journal of the Acoustical Society of America.

[18]  W. Grodd,et al.  Differential Contributions of Motor Cortex, Basal Ganglia, and Cerebellum to Speech Motor Control: Effects of Syllable Repetition Rate Evaluated by fMRI , 2001, NeuroImage.

[19]  Scott T. Grafton,et al.  Forward modeling allows feedback control for fast reaching movements , 2000, Trends in Cognitive Sciences.

[20]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[21]  Satrajit S. Ghosh,et al.  Adaptive auditory feedback control of the production of formant trajectories in the Mandarin triphthong /iau/ and its pattern of generalization. , 2010, The Journal of the Acoustical Society of America.

[22]  R. H. Bernacki,et al.  Effects of noise on speech production: acoustic and perceptual analyses. , 1988, The Journal of the Acoustical Society of America.

[23]  Yi Xu,et al.  Compensation for pitch-shifted auditory feedback during the production of Mandarin tone sequences. , 2004, The Journal of the Acoustical Society of America.

[24]  J. Saunders,et al.  Humans use continuous visual feedback from the hand to control fast reaching movements , 2003, Experimental Brain Research.

[25]  G. Fairbanks,et al.  Selective vocal effects of delayed auditory feedback. , 1955, The Journal of speech and hearing disorders.

[26]  G. J. Borden An interpretation of research on feedback interruption in speech , 1979, Brain and Language.

[27]  Hermann Ackermann,et al.  Cerebellar contributions to speech production and speech perception: psycholinguistic and neurobiological perspectives , 2008, Trends in Neurosciences.

[28]  Joseph S Perkell,et al.  Time course of speech changes in response to unanticipated short-term changes in hearing state. , 2007, The Journal of the Acoustical Society of America.

[29]  T. Crystal,et al.  Segmental durations in connected‐speech signals: Current results , 1988 .

[30]  L Saltzman Elliot,et al.  A Dynamical Approach to Gestural Patterning in Speech Production , 1989 .

[31]  J A Kelso,et al.  Lip-larynx coordination in speech: effects of mechanical perturbations to the lower lip. , 1994, The Journal of the Acoustical Society of America.

[32]  Jeffery A. Jones,et al.  Sex-related differences in vocal responses to pitch feedback perturbations during sustained vocalization. , 2010, The Journal of the Acoustical Society of America.

[33]  C. Larson,et al.  Voice F0 responses to pitch-shifted voice feedback during English speech. , 2007, The Journal of the Acoustical Society of America.

[34]  Peter Howell,et al.  Timing interference to speech in altered listening conditions. , 2002, The Journal of the Acoustical Society of America.

[35]  Peter Q. Pfordresher,et al.  Effects of delayed auditory feedback on timing of music performance , 2002, Psychological research.

[36]  J. Abbs,et al.  Sensorimotor characteristics of speech motor sequences , 2004, Experimental Brain Research.

[37]  K. Munhall,et al.  Compensation following real-time manipulation of formants in isolated vowels. , 2006, The Journal of the Acoustical Society of America.

[38]  Carol A. Fowler,et al.  Coarticulation and theories of extrinsic timing , 1980 .