Auditory-Motor Processing of Speech Sounds

The motor regions that control movements of the articulators activate during listening to speech and contribute to performance in demanding speech recognition and discrimination tasks. Whether the articulatory motor cortex modulates auditory processing of speech sounds is unknown. Here, we aimed to determine whether the articulatory motor cortex affects the auditory mechanisms underlying discrimination of speech sounds in the absence of demanding speech tasks. Using electroencephalography, we recorded responses to changes in sound sequences, while participants watched a silent video. We also disrupted the lip or the hand representation in left motor cortex using transcranial magnetic stimulation. Disruption of the lip representation suppressed responses to changes in speech sounds, but not piano tones. In contrast, disruption of the hand representation had no effect on responses to changes in speech sounds. These findings show that disruptions within, but not outside, the articulatory motor cortex impair automatic auditory discrimination of speech sounds. The findings provide evidence for the importance of auditory-motor processes in efficient neural analysis of speech sounds.

[1]  K. Watkins,et al.  Using TMS to study the role of the articulatory motor system in speech perception , 2011, Aphasiology.

[2]  L. Fadiga,et al.  Active perception: sensorimotor circuits as a cortical basis for language , 2010, Nature Reviews Neuroscience.

[3]  L. Fadiga,et al.  The Motor Somatotopy of Speech Perception , 2009, Current Biology.

[4]  R. Näätänen,et al.  Psychobiology: Speech sounds learned by sleeping newborns , 2002, Nature.

[5]  M. Tervaniemi,et al.  The mismatch negativity in cognitive and clinical neuroscience: Theoretical and methodological considerations , 2007, Biological Psychology.

[6]  E. T. Possing,et al.  Human temporal lobe activation by speech and nonspeech sounds. , 2000, Cerebral cortex.

[7]  J. Rothwell,et al.  How does transcranial magnetic stimulation modify neuronal activity in the brain? Implications for studies of cognition , 2009, Cortex.

[8]  Lori L. Holt,et al.  Reflections on mirror neurons and speech perception , 2009, Trends in Cognitive Sciences.

[9]  P. Kuhl,et al.  Enhanced discriminability at the phonetic boundaries for the place feature in macaques. , 1983, The Journal of the Acoustical Society of America.

[10]  David Poeppel,et al.  Visual speech speeds up the neural processing of auditory speech. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[11]  M. Iacoboni,et al.  Listening to speech activates motor areas involved in speech production , 2004, Nature Neuroscience.

[12]  Riitta Salmelin,et al.  Cortical differentiation of speech and nonspeech sounds at 100 ms: implications for dyslexia. , 2005, Cerebral cortex.

[13]  R. Ilmoniemi,et al.  Brain responses reveal the learning of foreign language phonemes. , 1999, Psychophysiology.

[14]  D L Woods,et al.  Lesions of frontal cortex diminish the auditory mismatch negativity. , 1994, Electroencephalography and clinical neurophysiology.

[15]  R. Ilmoniemi,et al.  Language-specific phoneme representations revealed by electric and magnetic brain responses , 1997, Nature.

[16]  Feng Rong,et al.  Sensorimotor Integration in Speech Processing: Computational Basis and Neural Organization , 2011, Neuron.

[17]  Sophie K. Scott,et al.  A little more conversation, a little less action — candidate roles for the motor cortex in speech perception , 2009, Nature Reviews Neuroscience.

[18]  F. Perrin,et al.  Brain generators implicated in the processing of auditory stimulus deviance: a topographic event-related potential study. , 1990, Psychophysiology.

[19]  D. Wolpert,et al.  Motor prediction , 2001, Current Biology.

[20]  Stephen M. Wilson,et al.  Speech perception when the motor system is compromised , 2009, Trends in Cognitive Sciences.

[21]  J. D. Miller,et al.  Speech perception by the chinchilla: voiced-voiceless distinction in alveolar plosive consonants , 1975, Science.

[22]  Mismatch Brain Response to Speech Sound Changes in Rats , 2011, Front. Psychology.

[23]  T. Paus,et al.  Seeing and hearing speech excites the motor system involved in speech production , 2003, Neuropsychologia.

[24]  Jeremy I. Skipper,et al.  Seeing Voices : How Cortical Areas Supporting Speech Production Mediate Audiovisual Speech Perception , 2007 .

[25]  Luciano Fadiga,et al.  The role of the motor system in discriminating normal and degraded speech sounds , 2012, Cortex.

[26]  K. Alho,et al.  Separate Time Behaviors of the Temporal and Frontal Mismatch Negativity Sources , 2000, NeuroImage.

[27]  R. Hari,et al.  Cerebral neuromagnetic responses evoked by short auditory stimuli. , 1985, Electroencephalography and clinical neurophysiology.

[28]  Jeffrey R. Binder,et al.  Attentional and linguistic interactions in speech perception , 2008, NeuroImage.

[29]  A M Liberman,et al.  Perception of the speech code. , 1967, Psychological review.

[30]  R. Salmelin,et al.  Cortical processing of change detection: dissociation between natural vowels and two-frequency complex tones. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[31]  M. Hallett,et al.  Depression of motor cortex excitability by low‐frequency transcranial magnetic stimulation , 1997, Neurology.

[32]  E. Schröger,et al.  Is there pre-attentive memory-based comparison of pitch? , 2001, Psychophysiology.

[33]  I. Winkler,et al.  Auditory processing that leads to conscious perception: a unique window to central auditory processing opened by the mismatch negativity and related responses. , 2011, Psychophysiology.

[34]  E. Schröger,et al.  Measuring duration mismatch negativity , 2003, Clinical Neurophysiology.

[35]  F. Guenther.  Cortical interactions underlying the production of speech sounds. , 2006, Journal of communication disorders.

[36]  Marc Brysbaert,et al.  Activation of articulatory information in speech perception , 2009, Proceedings of the National Academy of Sciences.

[37]  Karl J. Friston,et al.  The mismatch negativity: A review of underlying mechanisms , 2009, Clinical Neurophysiology.

[38]  G. Rizzolatti,et al.  Speech listening specifically modulates the excitability of tongue muscles: a TMS study , 2002, The European journal of neuroscience.

[39]  U. Ziemann,et al.  Observation-execution matching and action inhibition in human primary motor cortex during viewing of speech-related lip movements or listening to speech , 2011, Neuropsychologia.

[40]  D Morlet,et al.  Mismatch negativity and late auditory evoked potentials in comatose patients , 1999, Clinical Neurophysiology.

[41]  Friedemann Pulvermüller,et al.  Motor cortex maps articulatory features of speech sounds , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[42]  M. Turvey,et al.  The motor theory of speech perception reviewed , 2006, Psychonomic bulletin & review.

[43]  J. Belliveau,et al.  Short-term plasticity in auditory cognition , 2007, Trends in Neurosciences.

[44]  J. Rauschecker,et al.  Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing , 2009, Nature Neuroscience.

[45]  B. Shinn-Cunningham,et al.  Task-modulated “what” and “where” pathways in human auditory cortex , 2006, Proceedings of the National Academy of Sciences.

[46]  Mikko Sams,et al.  Seeing and hearing others and oneself talk. , 2005, Brain research. Cognitive brain research.

[47]  P. C. Murphy,et al.  Cerebral Cortex , 2017, Cerebral Cortex.

[48]  Ulf Ziemann,et al.  TMS in cognitive neuroscience: Virtual lesion and beyond , 2010, Cortex.

[49]  R. Diehl,et al.  Speech Perception , 2004, Annual review of psychology.

[50]  K. Watkins,et al.  Motor Representations of Articulators Contribute to Categorical Perception of Speech Sounds , 2009, The Journal of Neuroscience.

[51]  Marco Iacoboni,et al.  The Essential Role of Premotor Cortex in Speech Perception , 2007, Current Biology.

[52]  Joanne L. Miller,et al.  Speech Perception , 1990, Springer Handbook of Auditory Research.

[53]  I. Winkler,et al.  ‘Primitive intelligence’ in the auditory cortex , 2001, Trends in Neurosciences.

[54]  R. Ilmoniemi,et al.  Responses of the primary auditory cortex to pitch changes in a sequence of tone pips: Neuromagnetic recordings in man , 1984, Neuroscience Letters.

[55]  R. Näätänen,et al.  The adaptive brain: A neurophysiological perspective , 2010, Progress in Neurobiology.

[56]  R. Näätänen,et al.  Development of language-specific phoneme representations in the infant brain , 1998, Nature Neuroscience.

[57]  Yoshio Bando,et al.  Carbon nanothermometer containing gallium , 2002, Nature.

[58]  Matthew H. Davis,et al.  Hearing speech sounds: Top-down influences on the interface between audition and speech perception , 2007, Hearing Research.

[59]  A. Liberman,et al.  The motor theory of speech perception revised , 1985, Cognition.

[60]  Willy Serniclaes,et al.  Neural correlates of switching from auditory to speech perception , 2005, NeuroImage.

[61]  D. Guthrie,et al.  Significance testing of difference potentials. , 1991, Psychophysiology.

[62]  Albert Costa,et al.  Brain potentials to native phoneme discrimination reveal the origin of individual differences in learning the sounds of a second language , 2008, Proceedings of the National Academy of Sciences.

[63]  R. Näätänen,et al.  Auditory frequency discrimination and event-related potentials. , 1985, Electroencephalography and clinical neurophysiology.

[64]  Vincent L. Gracco,et al.  A mediating role of the premotor cortex in phoneme segmentation , 2009, Brain and Language.