The Effect of Pitch Auditory Feedback Perturbations on the Production of Anticipatory Phrasal Prominence and Boundary.

Purpose In this study, we investigated how the direction and timing of a perturbation in voice pitch auditory feedback during phrasal production modulated the magnitude and latency of the pitch-shift reflex as well as the scaling of acoustic production of anticipatory intonation targets for phrasal prominence and boundary. Method Brief pitch auditory feedback perturbations (±200 cents for 200-ms duration) were applied during the production of a target phrase on the first or the second word of the phrase. To replicate previous work, we first measured the magnitude and latency of the pitch-shift reflex as a function of the direction and timing of the perturbation within the phrase. As a novel approach, we also measured the adjustment in the production of the phrase-final prominent word as a function of perturbation direction and timing by extracting the acoustic correlates of pitch, loudness, and duration. Results The pitch-shift reflex was greater in magnitude after perturbations on the first word of the phrase, replicating the results from Mandarin speakers in an American English-speaking population. Additionally, the production of the phrase-final prominent word was acoustically enhanced (lengthened vowel duration and increased intensity and fundamental frequency) after perturbations earlier in the phrase, but more so after perturbations on the first word in the phrase. Conclusion The timing of the pitch perturbation within the phrase modulated both the magnitude of the pitch-shift reflex and the production of the prominent word, supporting our hypothesis that speakers use auditory feedback to correct for immediate production errors and to scale anticipatory intonation targets during phrasal production.

[1]  C. Larson,et al.  Error-dependent modulation of speech-induced auditory suppression for pitch-shifted voice feedback , 2011, BMC Neuroscience.

[2]  G. Fairbanks,et al.  Effects of delayed auditory feedback upon articulation. , 1958, Journal of speech and hearing research.

[3]  Charles R. Larson,et al.  Effects of electrical stimulation of cricothyroid and thyroarytenoid muscles on voice fundamental frequency , 1988 .

[4]  Charles R Larson,et al.  Modulation of auditory-vocal feedback control due to planned changes in voice fo. , 2019, The Journal of the Acoustical Society of America.

[5]  J. Cole,et al.  Prosody in context: a review , 2015 .

[6]  O. Räsänen,et al.  Making predictable unpredictable with style – Behavioral and electrophysiological evidence for the critical role of prosodic expectations in the perception of prominence in speech , 2018, Neuropsychologia.

[7]  Oleg Korzyukov,et al.  Opposing and following vocal responses to pitch-shifted auditory feedback: evidence for different mechanisms of voice pitch control. , 2012, The Journal of the Acoustical Society of America.

[8]  C. Larson,et al.  Voice F0 responses to manipulations in pitch feedback. , 1998, The Journal of the Acoustical Society of America.

[9]  T. Hothorn,et al.  Simultaneous Inference in General Parametric Models , 2008, Biometrical journal. Biometrische Zeitschrift.

[10]  Yi Xu,et al.  Compensation for pitch-shifted auditory feedback during the production of Mandarin tone sequences. , 2004, The Journal of the Acoustical Society of America.

[11]  Paul-Christian Bürkner,et al.  Advanced Bayesian Multilevel Modeling with the R Package brms , 2017, R J..

[12]  C. Larson,et al.  Changes in voice fundamental frequency following discharge of single motor units in cricothyroid and thyroarytenoid muscles. , 1987, Journal of speech and hearing research.

[13]  A Cutler,et al.  The strong/weak syllable distinction in English. , 1995, The Journal of the Acoustical Society of America.

[14]  Ewen N. MacDonald,et al.  Talkers alter vowel production in response to real-time formant perturbation even when instructed not to compensate. , 2009, The Journal of the Acoustical Society of America.

[15]  K. Kalveram,et al.  Effects of frequency-shifted auditory feedback on fundamental frequency of long stressed and unstressed syllables. , 2001, Journal of speech, language, and hearing research : JSLHR.

[16]  Jeffrey N. Rouder,et al.  The fallacy of placing confidence in confidence intervals , 2015, Psychonomic bulletin & review.

[17]  Ian C. Marschner,et al.  glm2: Fitting Generalized Linear Models with Convergence Problems , 2011, R J..

[18]  Hanjun Liu,et al.  Effects of perturbation magnitude and voice F0 level on the pitch-shift reflex. , 2007, The Journal of the Acoustical Society of America.

[19]  P. Boersma Praat : doing phonetics by computer (version 5.1.05) , 2009 .

[20]  C. Larson,et al.  Audio-vocal responses to repetitive pitch-shift stimulation during a sustained vocalization: improvements in methodology for the pitch-shifting technique. , 2003, The Journal of the Acoustical Society of America.

[21]  Jay J Bauer,et al.  Vocal responses to unanticipated perturbations in voice loudness feedback: an automatic mechanism for stabilizing voice amplitude. , 2006, The Journal of the Acoustical Society of America.

[22]  Jiqiang Guo,et al.  Stan: A Probabilistic Programming Language. , 2017, Journal of statistical software.

[23]  C. Larson,et al.  Effects of pitch-shift velocity on voice Fo responses. , 2000, The Journal of the Acoustical Society of America.

[24]  Edward Gibson,et al.  Inter-transcriber reliability for two systems of prosodic annotation: ToBI (Tones and Break Indices) and RaP (Rhythm and Pitch) , 2012 .

[25]  Ladislas Nalborczyk,et al.  An Introduction to Bayesian Multilevel Models Using brms: A Case Study of Gender Effects on Vowel Variability in Standard Indonesian. , 2019, Journal of speech, language, and hearing research : JSLHR.

[26]  B. Rosner,et al.  Loudness predicts prominence: fundamental frequency lends little. , 2005, The Journal of the Acoustical Society of America.

[27]  Laura C. Dilley,et al.  Distal prosodic context affects word segmentation and lexical processing , 2008 .

[28]  C. Larson,et al.  Voice F0 responses to pitch-shifted voice feedback during English speech. , 2007, The Journal of the Acoustical Society of America.

[29]  Anne Cutler,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[30]  A. Friederici The cortical language circuit: from auditory perception to sentence comprehension , 2012, Trends in Cognitive Sciences.

[31]  F. Guenther,et al.  Responses to Intensity-Shifted Auditory Feedback During Running Speech. , 2015, Journal of speech, language, and hearing research : JSLHR.

[32]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[33]  C. Larson,et al.  Instructing subjects to make a voluntary response reveals the presence of two components to the audio-vocal reflex , 1999, Experimental Brain Research.

[34]  Laura C. Dilley,et al.  Potent prosody: Comparing the effects of distal prosody, proximal prosody, and semantic context on word segmentation☆ , 2010 .

[35]  Jay J Bauer,et al.  Voice responses to changes in pitch of voice or tone auditory feedback. , 2005, The Journal of the Acoustical Society of America.

[36]  A. Perlman,et al.  Comparative study of the physiological properties of the vocalis and cricothyroid muscles. , 1988, Acta oto-laryngologica.

[37]  A. Friederici Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[38]  Stefan Ie Shattuck-Hufnagel,et al.  Phrase-Level Phonology in Speech Production Planning: Evidence for the Role of Prosodic Structure , 2000 .

[39]  Hanjun Liu,et al.  Voice fundamental frequency modulates vocal response to pitch perturbations during English speech. , 2010, The Journal of the Acoustical Society of America.

[40]  F. Guenther,et al.  Prosodic adaptations to pitch perturbation in running speech. , 2011, Journal of speech, language, and hearing research : JSLHR.

[41]  C. Larson,et al.  Attenuation of vocal responses to pitch perturbations during Mandarin speech. , 2009, The Journal of the Acoustical Society of America.

[42]  Laura C. Dilley,et al.  Metrical expectations from preceding prosody influence perception of lexical stress. , 2015, Journal of experimental psychology. Human perception and performance.