Dynamics of Self-monitoring and Error Detection in Speech Production: Evidence from Mental Imagery and MEG

Abstract A critical subroutine of self-monitoring during speech production is to detect any deviance between expected and actual auditory feedback. Here we investigated the associated neural dynamics using MEG recording in mental-imagery-of-speech paradigms. Participants covertly articulated the vowel /a/; their own (individually recorded) speech was played back, with parametric manipulation using four levels of pitch shift, crossed with four levels of onset delay. A nonmonotonic function was observed in early auditory responses when the onset delay was shorter than 100 msec: Suppression was observed for normal playback, but enhancement for pitch-shifted playback; however, the magnitude of enhancement decreased at the largest level of pitch shift that was out of pitch range for normal conversion, as suggested in two behavioral experiments. No difference was observed among different types of playback when the onset delay was longer than 100 msec. These results suggest that the prediction suppresses the response to normal feedback, which mediates source monitoring. When auditory feedback does not match the prediction, an “error term” is generated, which underlies deviance detection. We argue that, based on the observed nonmonotonic function, a frequency window (addressing spectral difference) and a time window (constraining temporal difference) jointly regulate the comparison between prediction and feedback in speech.

[1]  S. Purdy,et al.  Effects of altered auditory feedback (AAF) on stuttering frequency during monologue speech production. , 2008, Journal of fluency disorders.

[2]  M. Jeannerod The representing brain: Neural correlates of motor intention and imagery , 1994, Behavioral and Brain Sciences.

[3]  David E. Huber,et al.  Measures of Spatial Similarity and Response Magnitude in MEG and Scalp EEG , 2007, Brain Topography.

[4]  Self-masking effects from live and recorded vowels. , 1978 .

[5]  Christopher C. Berger,et al.  Mental Imagery Changes Multisensory Perception , 2013, Current Biology.

[6]  Keith Johnson,et al.  Partial Compensation for Altered Auditory Feedback: A Tradeoff with Somatosensory Feedback? , 2012, Language and speech.

[7]  P. Dechent,et al.  Is the human primary motor cortex involved in motor imagery? , 2004, Brain research. Cognitive brain research.

[8]  V. Gracco,et al.  Effects of Alterations in Auditory Feedback and Speech Rate on Stuttering Frequency , 1993, Language and speech.

[9]  Riitta Salmelin,et al.  Subject's own speech reduces reactivity of the human auditory cortex , 1999, Neuroscience Letters.

[10]  J. W. Black,et al.  The effect of delayed side-tone upon vocal rate and intensity. , 1951, The Journal of speech disorders.

[11]  M. Desmurget,et al.  A parietal-premotor network for movement intention and motor awareness , 2009, Trends in Cognitive Sciences.

[12]  M. Jeannerod Mental imagery in the motor context , 1995, Neuropsychologia.

[13]  D. Poeppel,et al.  Neural Response Phase Tracks How Listeners Learn New Acoustic Representations , 2013, Current Biology.

[14]  P. Boersma ACCURATE SHORT-TERM ANALYSIS OF THE FUNDAMENTAL FREQUENCY AND THE HARMONICS-TO-NOISE RATIO OF A SAMPLED SOUND , 1993 .

[15]  D. Poeppel,et al.  Temporal window of integration in auditory-visual speech perception , 2007, Neuropsychologia.

[16]  David Poeppel,et al.  The analysis of speech in different temporal integration windows: cerebral lateralization as 'asymmetric sampling in time' , 2003, Speech Commun..

[17]  Elia Formisano,et al.  The Sensory Consequences of Speaking: Parametric Neural Cancellation during Speech in Auditory Cortex , 2011, PloS one.

[18]  M. Erb,et al.  Activation of Cortical and Cerebellar Motor Areas during Executed and Imagined Hand Movements: An fMRI Study , 1999, Journal of Cognitive Neuroscience.

[19]  Jeffery A. Jones,et al.  ERP correlates of the magnitude of pitch errors detected in the human voice , 2013, Neuroscience.

[20]  Charles R. Larson,et al.  Differential effects of perturbation direction and magnitude on the neural processing of voice pitch feedback , 2011, Clinical Neurophysiology.

[21]  Jonathan Z. Simon,et al.  Denoising based on time-shift PCA , 2007, Journal of Neuroscience Methods.

[22]  Annika Miller Duck, Duck, Goose , 2011 .

[23]  E. Chang,et al.  Human cortical sensorimotor network underlying feedback control of vocal pitch , 2013, Proceedings of the National Academy of Sciences.

[24]  Frank H. Guenther,et al.  Unstable or Insufficiently Activated Internal Models and Feedback-Biased Motor Control as Sources of Dysfluency: A Theoretical Model of Stuttering , 2004 .

[25]  Xiaoqin Wang,et al.  Neural substrates of vocalization feedback monitoring in primate auditory cortex , 2008, Nature.

[26]  G. Fairbanks,et al.  Selective vocal effects of delayed auditory feedback. , 1955, The Journal of speech and hearing disorders.

[27]  D. Poeppel,et al.  Latency of the auditory evoked neuromagnetic field components: stimulus dependence and insights toward perception. , 2000, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[28]  P. Gribble,et al.  Temporal constraints on the McGurk effect , 1996, Perception & psychophysics.

[29]  M. Hallett,et al.  Functional properties of brain areas associated with motor execution and imagery. , 2003, Journal of neurophysiology.

[30]  J. Kalinowski,et al.  Fluency effect of frequency alterations of plus/minus one-half and one-quarter octave shifts in auditory feedback of people who stutter. , 1996, Journal of speech and hearing research.

[31]  R. L. Webster,et al.  Changes in stuttering frequency as a function of various intervals of delayed auditory feedback. , 1970, Journal of abnormal psychology.

[32]  Zoubin Ghahramani,et al.  Computational principles of movement neuroscience , 2000, Nature Neuroscience.

[33]  M. Hallett,et al.  Cerebral Processes Related to Visuomotor Imagery and Generation of Simple Finger Movements Studied with Positron Emission Tomography , 1998, NeuroImage.

[34]  M. Scott Corollary Discharge Provides the Sensory Content of Inner Speech , 2013, Psychological science.

[35]  S. Hargrave,et al.  Effect of frequency-altered feedback on stuttering frequency at normal and fast speech rates. , 1994, Journal of speech and hearing research.

[36]  M. Merzenich,et al.  Modulation of the Auditory Cortex during Speech: An MEG Study , 2002, Journal of Cognitive Neuroscience.

[37]  Stefan Geyer,et al.  Imagery of voluntary movement of fingers, toes, and tongue activates corresponding body-part-specific motor representations. , 2003, Journal of neurophysiology.

[38]  P Howell,et al.  Susceptibility to the effects of delayed auditory feedback , 1984, Perception & psychophysics.

[39]  D. Poeppel,et al.  Health, USA Reviewed by: , 2010 .

[40]  D. Huber,et al.  Playing “Duck Duck Goose” With Neurons , 2013, Psychological science.

[41]  R. Wurtz,et al.  Brain circuits for the internal monitoring of movements. , 2008, Annual review of neuroscience.

[42]  A. J. Yates Delayed auditory feedback. , 1963 .

[43]  Jason A. Tourville,et al.  Neural mechanisms underlying auditory feedback control of speech , 2008, NeuroImage.

[44]  B D Burke,et al.  Variables affecting stutterer's initial reactions to delayed auditory feedback. , 1975, Journal of communication disorders.

[45]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[46]  John D Durrant,et al.  Toward a better understanding of the perception of self-produced speech. , 2003, Journal of communication disorders.

[47]  Rick Grush,et al.  The emulation theory of representation: Motor control, imagery, and perception , 2004, Behavioral and Brain Sciences.

[48]  D. Wolpert,et al.  Central cancellation of self-produced tickle sensation , 1998, Nature Neuroscience.

[49]  David Poeppel,et al.  TopoToolbox: Using Sensor Topography to Calculate Psychologically Meaningful Measures from Event-Related EEG/MEG , 2011, Comput. Intell. Neurosci..

[50]  S. Nagarajan,et al.  Speech target modulates speaking induced suppression in auditory cortex , 2009, BMC Neuroscience.

[51]  Xiaoqin Wang,et al.  Sensory-motor interaction in the primate auditory cortex during self-initiated vocalizations. , 2003, Journal of neurophysiology.

[52]  Satrajit S. Ghosh,et al.  Neural modeling and imaging of the cortical interactions underlying syllable production , 2006, Brain and Language.

[53]  Feng Rong,et al.  Sensorimotor Integration in Speech Processing: Computational Basis and Neural Organization , 2011, Neuron.

[54]  Robert H. Wurtz,et al.  Influence of the thalamus on spatial visual processing in frontal cortex , 2006, Nature.

[55]  C. Larson,et al.  Vocalization-induced enhancement of the auditory cortex responsiveness during voice F0 feedback perturbation , 2009, Clinical Neurophysiology.

[56]  H. Peters,et al.  Speech Motor Dynamics in Stuttering , 1987, Springer Vienna.

[57]  Srikantan S. Nagarajan,et al.  Speech Production as State Feedback Control , 2011, Front. Hum. Neurosci..

[58]  David Poeppel,et al.  Mental imagery of speech: linking motor and perceptual systems through internal simulation and estimation , 2012, Front. Hum. Neurosci..

[59]  Xiaoqin Wang,et al.  Dynamics of auditory-vocal interaction in monkey auditory cortex. , 2005, Cerebral cortex.

[60]  J. Kalinowski,et al.  Stuttering amelioration at various auditory feedback delays and speech rates. , 1996, European journal of disorders of communication : the journal of the College of Speech and Language Therapists, London.

[61]  Tim Curran,et al.  The dynamics of integration and separation: ERP, MEG, and neural network studies of immediate repetition effects. , 2008, Journal of experimental psychology. Human perception and performance.

[62]  Eric Moulines,et al.  Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones , 1989, Speech Commun..

[63]  R. V. Naylor A comparative study of methods of estimating the severity of stuttering. , 1953, The Journal of speech and hearing disorders.

[64]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[65]  G. Hickok Computational neuroanatomy of speech production , 2012, Nature Reviews Neuroscience.

[66]  A. J. Yates Delayed Auditory Feedback , 1958, Psychological bulletin.

[67]  Eddy J. Davelaar,et al.  A habituation account of change detection in same/different judgments , 2011, Cognitive, affective & behavioral neuroscience.

[68]  A Thron,et al.  Playing piano in the mind--an fMRI study on music imagery and performance in pianists. , 2004, Brain research. Cognitive brain research.

[69]  R. Wurtz,et al.  A Pathway in Primate Brain for Internal Monitoring of Movements , 2002, Science.

[70]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[71]  Daniel R. Hansen,et al.  Sensory-Motor Interactions for Vocal Pitch Monitoring in Non-Primary Human Auditory Cortex , 2013, PloS one.

[72]  Hanjun Liu,et al.  Time-dependent Neural Processing of Auditory Feedback during Voice Pitch Error Detection , 2011, Journal of Cognitive Neuroscience.

[73]  J B Poline,et al.  Partially overlapping neural networks for real and imagined hand movements. , 2000, Cerebral cortex.

[74]  D. Wolpert,et al.  Why can't you tickle yourself? , 2000, Neuroreport.

[75]  David Poeppel,et al.  The Effect of Imagination on Stimulation: The Functional Specificity of Efference Copies in Speech Processing , 2013, Journal of Cognitive Neuroscience.

[76]  Self-masking effects from live and recorded vowels. , 1978, The Journal of auditory research.

[77]  Peter Howell,et al.  Factors Affecting Fluency in Stutterers when Speaking under Altered Auditory Feedback , 1987 .