Rapid Change in Articulatory Lip Movement Induced by Preceding Auditory Feedback during Production of Bilabial Plosives

Background There has been plentiful evidence of kinesthetically induced rapid compensation for unanticipated perturbation in speech articulatory movements. However, the role of auditory information in stabilizing articulation has been little studied except for the control of voice fundamental frequency, voice amplitude and vowel formant frequencies. Although the influence of auditory information on the articulatory control process is evident in unintended speech errors caused by delayed auditory feedback, the direct and immediate effect of auditory alteration on the movements of articulators has not been clarified. Methodology/Principal Findings This work examined whether temporal changes in the auditory feedback of bilabial plosives immediately affects the subsequent lip movement. We conducted experiments with an auditory feedback alteration system that enabled us to replace or block speech sounds in real time. Participants were asked to produce the syllable /pa/ repeatedly at a constant rate. During the repetition, normal auditory feedback was interrupted, and one of three pre-recorded syllables /pa/, /Φa/, or /pi/, spoken by the same participant, was presented once at a different timing from the anticipated production onset, while no feedback was presented for subsequent repetitions. Comparisons of the labial distance trajectories under altered and normal feedback conditions indicated that the movement quickened during the short period immediately after the alteration onset, when /pa/ was presented 50 ms before the expected timing. Such change was not significant under other feedback conditions we tested. Conclusions/Significance The earlier articulation rapidly induced by the progressive auditory input suggests that a compensatory mechanism helps to maintain a constant speech rate by detecting errors between the internally predicted and actually provided auditory information associated with self movement. The timing- and context-dependent effects of feedback alteration suggest that the sensory error detection works in a temporally asymmetric window where acoustic features of the syllable to be produced may be coded.

[1]  J. Abbs,et al.  Control of complex motor gestures: orofacial muscle responses to load perturbations of lip during speech. , 1984, Journal of neurophysiology.

[2]  R. Peters The effect of changes in side-tone delay and level upon rate of oral reading of normal speakers. , 1954, The Journal of speech and hearing disorders.

[3]  Charles R Larson,et al.  Early pitch-shift response is active in both steady and dynamic voice pitch control. , 2002, The Journal of the Acoustical Society of America.

[4]  Eric Vatikiotis-Bateson,et al.  Rhythm type and articulatory dynamics in English, French and Japanese , 1993 .

[5]  J. Ford,et al.  Fine-tuning of auditory cortex during speech production. , 2005, Psychophysiology.

[6]  Michael I. Jordan,et al.  Sensorimotor adaptation in speech production. , 1998, Science.

[7]  F. Fabbro,et al.  Speaking Speed Effects on Delayed Auditory Feedback Disruption of Speech Fluency , 1999, Perceptual and motor skills.

[8]  Anders Löfqvist,et al.  Dynamics of intergestural timing: a perturbation study of lip-larynx coordination , 1998, Experimental Brain Research.

[9]  J. Abbs,et al.  Central patterning of speech movements , 2004, Experimental Brain Research.

[10]  W R TIFFANY,et al.  Delayed speech feedback as a test for auditory malingering. , 1952, Science.

[11]  J. Abbs,et al.  Dynamic control of the perioral system during speech: kinematic analyses of autogenic and nonautogenic sensorimotor processes. , 1985, Journal of neurophysiology.

[12]  Xiaoqin Wang,et al.  Dynamics of auditory-vocal interaction in monkey auditory cortex. , 2005, Cerebral cortex.

[13]  F. Guenther,et al.  A theoretical investigation of reference frames for the planning of speech movements. , 1998, Psychological review.

[14]  M. Merzenich,et al.  Modulation of the Auditory Cortex during Speech: An MEG Study , 2002, Journal of Cognitive Neuroscience.

[15]  A. Postma Detection of errors during speech production: a review of speech monitoring models , 2000, Cognition.

[16]  Jason A. Tourville,et al.  Neural mechanisms underlying auditory feedback control of speech , 2008, NeuroImage.

[17]  S. Hibi,et al.  Rhythm perception in repetitive sound sequence , 1983 .

[18]  C. Larson,et al.  Human laryngeal responses to auditory stimulation. , 1983, The Journal of the Acoustical Society of America.

[19]  S. Blumstein,et al.  Acoustic invariance in speech production: evidence from measurements of the spectral characteristics of stop consonants. , 1979, The Journal of the Acoustical Society of America.

[20]  G. Fairbanks,et al.  Selective vocal effects of delayed auditory feedback. , 1955, The Journal of speech and hearing disorders.

[21]  J. Kelso,et al.  Functionally specific articulatory cooperation following jaw perturbations during speech: evidence for coordinative structures. , 1984, Journal of experimental psychology. Human perception and performance.

[22]  Bernard S. Lee Effects of delayed speech feedback , 1950 .

[23]  G. J. Borden An interpretation of research on feedback interruption in speech , 1979, Brain and Language.

[24]  Akihiro Katada,et al.  Lombard reflex during PAG-induced vocalization in decerebrate cats , 1997, Neuroscience Research.

[25]  H. Gustav Mueller,et al.  CIC Hearing Aids: What Is Their Impact On The Occlusion Effect? , 1994 .

[26]  C. Larson,et al.  Voice F0 responses to manipulations in pitch feedback. , 1998, The Journal of the Acoustical Society of America.

[27]  J. Kelso,et al.  A qualitative dynamic analysis of reiterant speech production: phase portraits, kinematics, and dynamic modeling. , 1985, The Journal of the Acoustical Society of America.

[28]  F. Guenther Cortical interactions underlying the production of speech sounds. , 2006, Journal of communication disorders.

[29]  Jeffery A. Jones,et al.  Remapping Auditory-Motor Representations in Voice Production , 2005, Current Biology.

[30]  J. Kalinowski,et al.  Effect of delayed auditory feedback on normal speakers at two speech rates. , 2002, The Journal of the Acoustical Society of America.

[31]  J. Perkell,et al.  Sensorimotor adaptation to feedback perturbations of vowel acoustics and its relation to perception. , 2007, The Journal of the Acoustical Society of America.

[32]  G. Curio,et al.  Speaking modifies voice‐evoked activity in the human auditory cortex , 2000, Human brain mapping.

[33]  Neville H Fletcher,et al.  Vocal fold physiology: Controlling complexity and chaos , 1996 .

[34]  Raymond D. Kent,et al.  An auditory-feedback-based neural network model of speech production that is robust to developmental changes in the size and shape of the articulatory system. , 2000, Journal of speech, language, and hearing research : JSLHR.