The predictability of frequency‐altered auditory feedback changes the weighting of feedback and feedforward input for speech motor control

Speech production requires the combined effort of a feedback control system driven by sensory feedback, and a feedforward control system driven by internal models. However, the factors that dictate the relative weighting of these feedback and feedforward control systems are unclear. In this event‐related potential (ERP) study, participants produced vocalisations while being exposed to blocks of frequency‐altered feedback (FAF) perturbations that were either predictable in magnitude (consistently either 50 or 100 cents) or unpredictable in magnitude (50‐ and 100‐cent perturbations varying randomly within each vocalisation). Vocal and P1–N1–P2 ERP responses revealed decreases in the magnitude and trial‐to‐trial variability of vocal responses, smaller N1 amplitudes, and shorter vocal, P1 and N1 response latencies following predictable FAF perturbation magnitudes. In addition, vocal response magnitudes correlated with N1 amplitudes, vocal response latencies, and P2 latencies. This pattern of results suggests that after repeated exposure to predictable FAF perturbations, the contribution of the feedforward control system increases. Examination of the presentation order of the FAF perturbations revealed smaller compensatory responses, smaller P1 and P2 amplitudes, and shorter N1 latencies when the block of predictable 100‐cent perturbations occurred prior to the block of predictable 50‐cent perturbations. These results suggest that exposure to large perturbations modulates responses to subsequent perturbations of equal or smaller size. Similarly, exposure to a 100‐cent perturbation prior to a 50‐cent perturbation within a vocalisation decreased the magnitude of vocal and N1 responses, but increased P1 and P2 latencies. Thus, exposure to a single perturbation can affect responses to subsequent perturbations.

[1]  Jeffery A. Jones,et al.  ERP correlates of the magnitude of pitch errors detected in the human voice , 2013, Neuroscience.

[2]  Jeffery A. Jones,et al.  Learning to produce speech with an altered vocal tract: the role of auditory feedback. , 2003, The Journal of the Acoustical Society of America.

[3]  C. Larson,et al.  ERP correlates of auditory processing during automatic correction of unexpected perturbations in voice auditory feedback. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[4]  C. Larson,et al.  Voice F0 responses to pitch-shifted auditory feedback: a preliminary study. , 1997, Journal of voice : official journal of the Voice Foundation.

[5]  S. Nagarajan,et al.  Magnetoencephalographic evidence for a precise forward model in speech production , 2006, Neuroreport.

[6]  Gérard Bailly,et al.  Learning to speak. Sensori-motor control of speech movements , 1997, Speech Commun..

[7]  Jeffery A. Jones,et al.  Perceptual calibration of F0 production: evidence from feedback perturbation. , 2000, The Journal of the Acoustical Society of America.

[8]  Jeffery A. Jones,et al.  The sensitivity of auditory-motor representations to subtle changes in auditory feedback while singing. , 2009, The Journal of the Acoustical Society of America.

[9]  David Poeppel,et al.  Auditory M50 and M100 responses to broadband noise: functional implications , 2004, Neuroreport.

[10]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[11]  Daniel H. Mathalon,et al.  Action planning and predictive coding when speaking , 2014, NeuroImage.

[12]  J. Elman Effects of frequency-shifted feedback on the pitch of vocal productions. , 1981, The Journal of the Acoustical Society of America.

[13]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[14]  Hanjun Liu,et al.  Effect of temporal predictability on the neural processing of self-triggered auditory stimulation during vocalization , 2012, BMC Neuroscience.

[15]  J. Belliveau,et al.  Short-term plasticity in auditory cognition , 2007, Trends in Neurosciences.

[16]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[17]  R A Scheidt,et al.  Impedance control and internal model formation when reaching in a randomly varying dynamical environment. , 2001, Journal of neurophysiology.

[18]  Xiaoqin Wang,et al.  Dynamics of auditory-vocal interaction in monkey auditory cortex. , 2005, Cerebral cortex.

[19]  R A Scheidt,et al.  Learning to move amid uncertainty. , 2001, Journal of neurophysiology.

[20]  F. Guenther Cortical interactions underlying the production of speech sounds. , 2006, Journal of communication disorders.

[21]  Thomas M Donath,et al.  Control of voice fundamental frequency in speaking versus singing. , 2003, The Journal of the Acoustical Society of America.

[22]  D. Tucker,et al.  Scalp electrode impedance, infection risk, and EEG data quality , 2001, Clinical Neurophysiology.

[23]  Koji Inui,et al.  Change-related auditory P50: A MEG study , 2014, NeuroImage.

[24]  C. Larson,et al.  Voice F0 responses to manipulations in pitch feedback. , 1998, The Journal of the Acoustical Society of America.

[25]  Jeffery A. Jones,et al.  Remapping Auditory-Motor Representations in Voice Production , 2005, Current Biology.

[26]  Daniel H. Mathalon,et al.  Auditory Cortex Processes Variation in Our Own Speech , 2013, PloS one.

[27]  Jeffery A. Jones,et al.  Control of vocalization at utterance onset and mid-utterance: Different mechanisms for different goals , 2009, Brain Research.

[28]  Xiaoqin Wang,et al.  Neural substrates of vocalization feedback monitoring in primate auditory cortex , 2008, Nature.

[29]  Raymond D. Kent,et al.  An auditory-feedback-based neural network model of speech production that is robust to developmental changes in the size and shape of the articulatory system. , 2000, Journal of speech, language, and hearing research : JSLHR.

[30]  C. Larson,et al.  Auditory feedback control of voice fundamental frequency in school children. , 2010, The Journal of the Acoustical Society of America.

[31]  J. Ford,et al.  Fine-tuning of auditory cortex during speech production. , 2005, Psychophysiology.

[32]  Jeffery A. Jones,et al.  Contextual cuing contributes to the independent modification of multiple internal models for vocal control. , 2011, Journal of neurophysiology.

[33]  Theresa A. Burnett,et al.  Reflexive and volitional voice fundamental frequency responses to an anticipated feedback pitch error , 2008, Experimental Brain Research.

[34]  F. Guenther,et al.  Overreliance on auditory feedback may lead to sound/syllable repetitions: simulations of stuttering and fluency-inducing conditions with a neural model of speech production. , 2010, Journal of fluency disorders.

[35]  R. Butler Effect of changes in stimulus frequency and intensity on habituation of the human vertex potential. , 1968, The Journal of the Acoustical Society of America.

[36]  J. Greenlee,et al.  Human Auditory Cortical Activation during Self-Vocalization , 2011, PloS one.

[37]  Kevin G. Munhall,et al.  The role of auditory feedback during phonation: studies of Mandarin tone production , 2002, J. Phonetics.

[38]  C. Larson,et al.  Instructing subjects to make a voluntary response reveals the presence of two components to the audio-vocal reflex , 1999, Experimental Brain Research.

[39]  E. Chang,et al.  Human cortical sensorimotor network underlying feedback control of vocal pitch , 2013, Proceedings of the National Academy of Sciences.

[40]  Jason A. Tourville,et al.  Neural mechanisms underlying auditory feedback control of speech , 2008, NeuroImage.

[41]  D. Ostry,et al.  Somatosensory basis of speech production , 2003, Nature.

[42]  Jeffery A. Jones,et al.  The relationship between vocal accuracy and variability to the level of compensation to altered auditory feedback , 2012, Neuroscience Letters.

[43]  C. Rennie,et al.  Decrement of the N1 auditory event-related potential with stimulus repetition: habituation vs. refractoriness. , 1998, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[44]  Jeffery A. Jones,et al.  Auditory-motor mapping for pitch control in singers and nonsingers , 2008, Experimental Brain Research.

[45]  M. Merzenich,et al.  Modulation of the Auditory Cortex during Speech: An MEG Study , 2002, Journal of Cognitive Neuroscience.

[46]  Vincent L. Gracco,et al.  Speech-induced suppression of evoked auditory fields in children who stutter , 2011, NeuroImage.

[47]  Daniel M Wolpert,et al.  Computational principles of sensorimotor control that minimize uncertainty and variability , 2007, The Journal of physiology.

[48]  H. Neville,et al.  Auditory and visual refractory period effects in children and adults: An ERP study , 2005, Clinical Neurophysiology.

[49]  A. Dale,et al.  Human posterior auditory cortex gates novel sounds to consciousness. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[50]  S. Geisser,et al.  On methods in the analysis of profile data , 1959 .

[51]  Jeffery A. Jones,et al.  The developmental trajectory of vocal and event‐related potential responses to frequency‐altered auditory feedback , 2013, The European journal of neuroscience.

[52]  Joseph S. Perkell,et al.  Movement goals and feedback and feedforward control mechanisms in speech production , 2012, Journal of Neurolinguistics.

[53]  Carey Y. L. Huh,et al.  Experimentally constrained network model of hippocampal fast-firing parvalbumin-positive interneurons , 2012, BMC Neuroscience.

[54]  Charles R. Larson,et al.  Differential effects of perturbation direction and magnitude on the neural processing of voice pitch feedback , 2011, Clinical Neurophysiology.

[55]  Elvira Brattico,et al.  Effects of brief discrimination-training on the auditory N1 wave , 2003, Neuroreport.

[56]  Daniel R. Lametti,et al.  Sensory Preference in Speech Production Revealed by Simultaneous Alteration of Auditory and Somatosensory Feedback , 2012, The Journal of Neuroscience.

[57]  C. Larson,et al.  Vocalization-induced enhancement of the auditory cortex responsiveness during voice F0 feedback perturbation , 2009, Clinical Neurophysiology.

[58]  C. Larson,et al.  Neuronal Mechanisms of Voice Control Are Affected by Implicit Expectancy of Externally Triggered Perturbations in Auditory Feedback , 2012, PloS one.