Time-dependent Neural Processing of Auditory Feedback during Voice Pitch Error Detection

The neural responses to sensory consequences of a self-produced motor act are suppressed compared with those in response to a similar but externally generated stimulus. Previous studies in the somatosensory and auditory systems have shown that the motor-induced suppression of the sensory mechanisms is sensitive to delays between the motor act and the onset of the stimulus. The present study investigated time-dependent neural processing of auditory feedback in response to self-produced vocalizations. ERPs were recorded in response to normal and pitch-shifted voice auditory feedback during active vocalization and passive listening to the playback of the same vocalizations. The pitch-shifted stimulus was delivered to the subjects' auditory feedback after a randomly chosen time delay between the vocal onset and the stimulus presentation. Results showed that the neural responses to delayed feedback perturbations were significantly larger than those in response to the pitch-shifted stimulus occurring at vocal onset. Active vocalization was shown to enhance neural responsiveness to feedback alterations only for nonzero delays compared with passive listening to the playback. These findings indicated that the neural mechanisms of auditory feedback processing are sensitive to timing between the vocal motor commands and the incoming auditory feedback. Time-dependent neural processing of auditory feedback may be an important feature of the audio-vocal integration system that helps to improve the feedback-based monitoring and control of voice structure through vocal error detection and correction.

[1]  Judith M Ford,et al.  Synch before you speak: auditory hallucinations in schizophrenia. , 2007, The American journal of psychiatry.

[2]  C. Larson,et al.  Cross-modality influences in speech motor control: the use of pitch shifting for the study of F0 control. , 1998, Journal of communication disorders.

[3]  Berthold Hedwig,et al.  The Cellular Basis of a Corollary Discharge , 2006, Science.

[4]  M. Merzenich,et al.  Modulation of the Auditory Cortex during Speech: An MEG Study , 2002, Journal of Cognitive Neuroscience.

[5]  Michael I. Jordan,et al.  Sensorimotor adaptation of speech I: Compensation and adaptation. , 2002, Journal of speech, language, and hearing research : JSLHR.

[6]  D. Wolpert,et al.  Why can't you tickle yourself? , 2000, Neuroreport.

[7]  V. Gracco,et al.  Regional heterogeneity in the processing and the production of speech in the human planum temporale , 2013, Cortex.

[8]  Kevin G Munhall,et al.  Adaptive control of vowel formant frequency: evidence from real-time formant manipulation. , 2006, The Journal of the Acoustical Society of America.

[9]  T. Picton,et al.  The N1 wave of the human electric and magnetic response to sound: a review and an analysis of the component structure. , 1987, Psychophysiology.

[10]  Michael I. Jordan,et al.  Sensorimotor adaptation in speech production. , 1998, Science.

[11]  Internal models in human motor control: A computational and psychophysical perspective , 1997 .

[12]  J. D. Newman,et al.  Anatomical and physiological evidence for a relationship between the ‘cingular’ vocalization area and the auditory cortex in the squirrel monkey , 1980, Brain Research.

[13]  Xiaoqin Wang,et al.  Sensory-motor interaction in the primate auditory cortex during self-initiated vocalizations. , 2003, Journal of neurophysiology.

[14]  Thomas M Donath,et al.  Effects of frequency-shifted auditory feedback on voice F0 contours in syllables. , 2002, The Journal of the Acoustical Society of America.

[15]  John F. Houde,et al.  Compensatory responses to brief perturbations of speech amplitude , 2005 .

[16]  E Donchin,et al.  The effects of temporal and event uncertainty in determining the waveforms of the auditory event related potential (ERP). , 1976, Psychophysiology.

[17]  Kazuo Okanoya,et al.  Feedback-based error monitoring processes during musical performance: An ERP study , 2008, Neuroscience Research.

[18]  Yi Xu,et al.  Compensation for pitch-shifted auditory feedback during the production of Mandarin tone sequences. , 2004, The Journal of the Acoustical Society of America.

[19]  Judith M Ford,et al.  Dissecting corollary discharge dysfunction in schizophrenia. , 2007, Psychophysiology.

[20]  Jonathan R. Folstein,et al.  Influence of cognitive control and mismatch on the N2 component of the ERP: a review. , 2007, Psychophysiology.

[21]  C. Larson,et al.  Audio-vocal responses to repetitive pitch-shift stimulation during a sustained vocalization: improvements in methodology for the pitch-shifting technique. , 2003, The Journal of the Acoustical Society of America.

[22]  P. Mu¨ller-Preuss,et al.  Inhibition of auditory cortical neurons during phonation , 1981, Brain Research.

[23]  R. Hari,et al.  Auditory evoked transient and sustained magnetic fields of the human brain localization of neural generators , 1980, Experimental Brain Research.

[24]  S. Nagarajan,et al.  Magnetoencephalographic evidence for a precise forward model in speech production , 2006, Neuroreport.

[25]  D M Wolpert,et al.  Predicting the Consequences of Our Own Actions: The Role of Sensorimotor Context Estimation , 1998, The Journal of Neuroscience.

[26]  O. Creutzfeldt,et al.  Neuronal activity in the human lateral temporal lobe , 2004, Experimental Brain Research.

[27]  J. Perkell,et al.  Sensorimotor adaptation to feedback perturbations of vowel acoustics and its relation to perception. , 2007, The Journal of the Acoustical Society of America.

[28]  Jay J Bauer,et al.  Voice responses to changes in pitch of voice or tone auditory feedback. , 2005, The Journal of the Acoustical Society of America.

[29]  Srikantan S. Nagarajan,et al.  Motor-induced Suppression of the Auditory Cortex , 2009, Journal of Cognitive Neuroscience.

[30]  C. Larson,et al.  Voice F0 responses to manipulations in pitch feedback. , 1998, The Journal of the Acoustical Society of America.

[31]  Robert J. Zatorre,et al.  Experience-dependent neural substrates involved in vocal pitch regulation during singing , 2008, NeuroImage.

[32]  E. Schafer,et al.  Self-Stimulation Alters Human Sensory Brain Responses , 1973, Science.

[33]  J. Poulet,et al.  New insights into corollary discharges mediated by identified neural pathways , 2007, Trends in Neurosciences.

[34]  Jonathan R. Folstein,et al.  Novelty and conflict in the categorization of complex stimuli. , 2008, Psychophysiology.

[35]  E. Schröger,et al.  Early electrophysiological indicators for predictive processing in audition: a review. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[36]  K. Munhall,et al.  Compensation following real-time manipulation of formants in isolated vowels. , 2006, The Journal of the Acoustical Society of America.

[37]  C. Larson,et al.  Voice F0 responses to pitch-shifted voice feedback during English speech. , 2007, The Journal of the Acoustical Society of America.

[38]  D. Wolpert,et al.  Central cancellation of self-produced tickle sensation , 1998, Nature Neuroscience.

[39]  C. Larson,et al.  Voice F0 responses to pitch-shifted auditory feedback: a preliminary study. , 1997, Journal of voice : official journal of the Voice Foundation.

[40]  Riitta Salmelin,et al.  Subject's own speech reduces reactivity of the human auditory cortex , 1999, Neuroscience Letters.

[41]  J. Ford,et al.  Neurophysiological evidence of corollary discharge dysfunction in schizophrenia. , 2001, The American journal of psychiatry.

[42]  Berthold Hedwig,et al.  A corollary discharge maintains auditory sensitivity during sound production , 2002, Nature.

[43]  Yang Jiang,et al.  Preliminary findings on the relation between the personality trait of stress reaction and the central neural control of human vocalization , 2012, International journal of speech-language pathology.

[44]  G. Curio,et al.  Speaking modifies voice‐evoked activity in the human auditory cortex , 2000, Human brain mapping.

[45]  Hanjun Liu,et al.  Effect of temporal predictability on the neural processing of self-triggered auditory stimulation during vocalization , 2012, BMC Neuroscience.

[46]  J. Ford,et al.  Fine-tuning of auditory cortex during speech production. , 2005, Psychophysiology.

[47]  Jay J Bauer,et al.  Vocal responses to unanticipated perturbations in voice loudness feedback: an automatic mechanism for stabilizing voice amplitude. , 2006, The Journal of the Acoustical Society of America.

[48]  J. Elman.  Effects of frequency-shifted feedback on the pitch of vocal productions. , 1981, The Journal of the Acoustical Society of America.

[49]  Xiaoqin Wang,et al.  Dynamics of auditory-vocal interaction in monkey auditory cortex. , 2005, Cerebral cortex.

[50]  R. Hari,et al.  Suppressed responses to self-triggered sounds in the human auditory cortex. , 2004, Cerebral cortex.

[51]  C. Frith,et al.  How do we predict the consequences of our actions? a functional imaging study , 1998, Neuropsychologia.

[52]  K. Kalveram,et al.  Effects of frequency-shifted auditory feedback on fundamental frequency of long stressed and unstressed syllables. , 2001, Journal of speech, language, and hearing research : JSLHR.

[53]  Gabriel Curio,et al.  Differential effects of overt, covert and replayed speech on vowel-evoked responses of the human auditory cortex , 1999, Neuroscience Letters.

[54]  J. Eggermont,et al.  Auditory Evoked Potentials: Basic Principles and Clinical Application , 2006 .

[55]  Kevin G. Munhall,et al.  The role of auditory feedback during phonation: studies of Mandarin tone production , 2002, J. Phonetics.

[56]  F. Guenther.  Cortical interactions underlying the production of speech sounds. , 2006, Journal of communication disorders.

[57]  C. Larson,et al.  Compensatory responses to loudness-shifted voice feedback during production of Mandarin speech. , 2007, The Journal of the Acoustical Society of America.

[58]  Xiaoqin Wang,et al.  Neural substrates of vocalization feedback monitoring in primate auditory cortex , 2008, Nature.

[59]  Charles R Larson,et al.  Early pitch-shift response is active in both steady and dynamic voice pitch control. , 2002, The Journal of the Acoustical Society of America.

[60]  C. Larson,et al.  Instructing subjects to make a voluntary response reveals the presence of two components to the audio-vocal reflex , 1999, Experimental Brain Research.