Neural responses to non-native phonemes varying in producibility: Evidence for the sensorimotor nature of speech perception

Neural responses to unfamiliar non-native phonemes varying in the extent to which they can be articulated were studied with functional magnetic resonance imaging (fMRI). Both superior temporal (auditory) and precentral (motor) areas were activated by passive speech perception, and both distinguished non-native from native phonemes, with greater signal change in response to non-native phonemes. Furthermore, speech-responsive motor regions and superior temporal sites were functionally connected. However, only in auditory areas did activity covary with the producibility of non-native phonemes. These data suggest that auditory areas are crucial for the transformation from acoustic signal to phonetic code, but the motor system also plays an active role, which may involve the internal generation of candidate phonemic categorizations. These 'motor' categorizations would then be compared to the acoustic input in auditory areas. The data suggest that speech perception is neither purely sensory nor motor, but rather a sensorimotor process.

[1]  Robert J Zatorre,et al.  Learning new sounds of speech: reallocation of neural substrates , 2004, NeuroImage.

[2]  Toshiaki Imada,et al.  Effects of language experience: Neural commitment to language-specific auditory patterns , 2005, NeuroImage.

[3]  M. Iacoboni,et al.  Listening to speech activates motor areas involved in speech production , 2004, Nature Neuroscience.

[4]  T. Paus,et al.  Seeing and hearing speech excites the motor system involved in speech production , 2003, Neuropsychologia.

[5]  Michael Kenstowicz,et al.  Phonology In Generative Grammar , 1994 .

[6]  D. Poeppel,et al.  Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language , 2004, Cognition.

[7]  A M Liberman,et al.  Perception of the speech code. , 1967, Psychological review.

[8]  Steven L. Small,et al.  Listening to talking faces: motor cortical activation during speech perception , 2005, NeuroImage.

[9]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[10]  R W Cox,et al.  Event‐related fMRI of tasks involving brief motion , 1999, Human brain mapping.

[11]  Andreas Bartels,et al.  Brain dynamics during natural viewing conditions—A new guide for mapping connectivity in vivo , 2005, NeuroImage.

[12]  Carlo Caltagirone,et al.  Some aspects of phonological impairment in aphasia , 1980, Brain and Language.

[13]  G. Hickok,et al.  AuditoryMotor Interaction Revealed by fMRI: Speech, Music, and Working Memory in Area Spt , 2003, Journal of Cognitive Neuroscience.

[14]  G. Rizzolatti,et al.  Neural Circuits Involved in the Recognition of Actions Performed by Nonconspecifics: An fMRI Study , 2004, Journal of Cognitive Neuroscience.

[15]  R. Näätänen.  The perception of speech sounds by the human brain as reflected by the mismatch negativity (MMN) and its magnetic equivalent (MMNm). , 2001, Psychophysiology.

[16]  John Laver,et al.  The Cognitive Representation of Speech , 1982 .

[17]  S. Bookheimer.  Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. , 2002, Annual review of neuroscience.

[18]  Sophie K. Scott,et al.  The functional neuroanatomy of prelexical processing in speech perception , 2004, Cognition.

[19]  Sean Marrett,et al.  Imaging Motor-to-Sensory Discharges in the Human Brain: An Experimental Tool for the Assessment of Functional Connectivity , 1996, NeuroImage.

[20]  G. Hickok,et al.  Auditory–Motor Interaction Revealed by fMRI: Speech, Music, and Working Memory in Area Spt , 2003 .

[21]  N Makris,et al.  Analysis of lesions by MRI in stroke patients with acoustic‐phonetic processing deficits , 1995, Neurology.

[22]  A. Friederici,et al.  The functional neuroanatomy of novelty processing: integrating ERP and fMRI results. , 1999, Cerebral cortex.

[23]  P. Ladefoged,et al.  The sounds of the world's languages , 1996 .

[24]  T. Paus,et al.  Modulation of Motor Excitability during Speech Perception: The Role of Broca's Area , 2004, Journal of Cognitive Neuroscience.

[25]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[26]  R. Ilmoniemi,et al.  Language-specific phoneme representations revealed by electric and magnetic brain responses , 1997, Nature.

[27]  HickokGregory,et al.  AuditoryMotor Interaction Revealed by fMRI: Speech, Music, and Working Memory in Area Spt , 2003 .

[28]  P. Denes.  On the Motor Theory of Speech Perception , 1965 .

[29]  R. Wise,et al.  Sounds do-able: auditory–motor transformations and the posterior temporal plane , 2005, Trends in Neurosciences.

[30]  J. D. Miller,et al.  Speech perception by the chinchilla: voiced-voiceless distinction in alveolar plosive consonants , 1975, Science.

[31]  J. A. Shafer,et al.  Understanding aphasia. , 1954, Archives of Physical Medicine and Rehabilitation.

[32]  G. Dehaene-Lambertz.  Electrophysiological correlates of categorical phoneme perception in adults , 1997, Neuroreport.

[33]  L. Vignolo,et al.  Phonemic Identification Defect in Aphasia , 1977, Cortex.

[34]  Shinobu Masaki,et al.  Learning-induced neural plasticity associated with improved identification performance after training of a difficult second-language phonetic contrast , 2003, NeuroImage.

[35]  Gian Luca Romani,et al.  Neural systems underlying observation of humanly impossible movements: an FMRI study. , 2005, Cerebral cortex.

[36]  S. Keele,et al.  Timing Functions of The Cerebellum , 1989, Journal of Cognitive Neuroscience.

[37]  P. Jusczyk.  The discovery of spoken language , 1997 .

[38]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[39]  A. Jansen,et al.  Crossed cerebro–cerebellar language dominance , 2005, Human brain mapping.

[40]  Alfonso Caramazza,et al.  The perception and production of Voice-Onset Time in aphasia , 1977, Neuropsychologia.

[41]  L. Parsons,et al.  Location-Probability Profiles for the Mouth Region of Human Primary Motor–Sensory Cortex: Model and Validation , 2001, NeuroImage.

[42]  T. Carrell,et al.  Central auditory system plasticity: generalization to novel stimuli following listening training. , 1997, The Journal of the Acoustical Society of America.

[43]  P. Deyn,et al.  The Lateralized Linguistic Cerebellum: A Review and a New Hypothesis , 2001, Brain and Language.

[44]  Paavo Alku,et al.  Background acoustic noise and the hemispheric lateralization of speech processing in the human brain: magnetic mismatch negativity study , 1998, Neuroscience Letters.

[45]  A. Liberman,et al.  The motor theory of speech perception revised , 1985, Cognition.

[46]  R. Passingham,et al.  Action observation and acquired motor skills: an FMRI study with expert dancers. , 2005, Cerebral cortex.

[47]  Kenneth N. Stevens,et al.  Constraints Imposed by the Auditory System on the Properties Used to Classify Speech Sounds: Data from Phonology, Acoustics, and Psychoacoustics , 1981 .

[48]  Satrajit S. Ghosh,et al.  Representation of sound categories in auditory cortical maps. , 2004, Journal of speech, language, and hearing research : JSLHR.

[49]  Mitsuo Kawato,et al.  MOSAIC Model for Sensorimotor Learning and Control , 2001, Neural Computation.

[50]  D. Poeppel,et al.  Towards a functional neuroanatomy of speech perception , 2000, Trends in Cognitive Sciences.

[51]  S. Blumstein,et al.  The Role of Segmentation in Phonological Processing: An fMRI Investigation , 2000, Journal of Cognitive Neuroscience.

[52]  Alan C. Evans,et al.  A general statistical analysis for fMRI data , 2000, NeuroImage.

[53]  W. Grodd,et al.  Cerebellum and Speech Perception: A Functional Magnetic Resonance Imaging Study , 2002, Journal of Cognitive Neuroscience.

[54]  G. Rizzolatti,et al.  Speech listening specifically modulates the excitability of tongue muscles: a TMS study , 2002, The European journal of neuroscience.

[55]  Jeffery A. Jones,et al.  Phonetic perceptual identification by native- and second-language speakers differentially activates brain regions involved with acoustic phonetic processing and those involved with articulatory–auditory/orosensory internal models , 2004, NeuroImage.