Auditory–Motor Interactions for the Production of Native and Non-Native Speech

During speech production, auditory processing of self-generated speech is used to adjust subsequent articulations. The current study investigated how the proposed auditory–motor interactions are manifest at the neural level in native and non-native speakers of English who were overtly naming pictures of objects and reading their written names. Data were acquired with functional magnetic resonance imaging and analyzed with dynamic causal modeling. We found that (1) higher activity in articulatory regions caused activity in auditory regions to decrease (i.e., auditory suppression), and (2) higher activity in auditory regions caused activity in articulatory regions to increase (i.e., auditory feedback). In addition, we were able to demonstrate that (3) speaking in a non-native language involves more auditory feedback and less auditory suppression than speaking in a native language. The difference between native and non-native speakers was further supported by finding that, within non-native speakers, there was less auditory feedback for those with better verbal fluency. Consequently, the networks of more fluent non-native speakers looked more like those of native speakers. Together, these findings provide a foundation on which to explore auditory–motor interactions during speech production in other human populations, particularly those with speech difficulties.

[1]  Satrajit S. Ghosh,et al.  Neural modeling and imaging of the cortical interactions underlying syllable production , 2006, Brain and Language.

[2]  Karl J. Friston.  Causal Modelling and Brain Connectivity in Functional Magnetic Resonance Imaging , 2009, PLoS biology.

[3]  Cathy J. Price,et al.  Lateralization is Predicted by Reduced Coupling from the Left to Right Prefrontal Cortex during Semantic Decisions on Written Words , 2010, Cerebral cortex.

[4]  Karl J. Friston,et al.  Nonlinear Responses in fMRI: The Balloon Model, Volterra Kernels, and Other Hemodynamics , 2000, NeuroImage.

[5]  E. Formisano,et al.  Neural correlates of verbal feedback processing: An fMRI study employing overt speech , 2007, Human brain mapping.

[6]  Sophie K Scott,et al.  The Effect of Delayed Auditory Feedback on Activity in the Temporal Lobe While Speaking: a Positron Emission Tomography Study Pet Scanning Functional Imaging , 2022 .

[7]  Karl J. Friston,et al.  Modelling Geometric Deformations in Epi Time Series , 2022 .

[8]  Karl J. Friston,et al.  Dynamic causal models of neural system dynamics: current state and future extensions , 2007, Journal of Biosciences.

[9]  Gabriel Curio,et al.  Differential effects of overt, covert and replayed speech on vowel-evoked responses of the human auditory cortex , 1999, Neuroscience Letters.

[10]  Kenneth Hugdahl,et al.  Effective connectivity analysis demonstrates involvement of premotor cortex during speech perception , 2011, NeuroImage.

[11]  M. Seghier,et al.  Reading Aloud Boosts Connectivity through the Putamen , 2009, Cerebral cortex.

[12]  A. Mouraux,et al.  Parallel Processing of Nociceptive and Non-nociceptive Somatosensory Information in the Human Primary and Secondary Somatosensory Cortices: Evidence from Dynamic Causal Modeling of Functional Magnetic Resonance Imaging Data , 2011, The Journal of Neuroscience.

[13]  Welch Bl.  THE GENERALIZATION OF ‘STUDENT'S’ PROBLEM WHEN SEVERAL DIFFERENT POPULATION VARLANCES ARE INVOLVED , 1947 .

[14]  F. Gonzalez-Lima,et al.  Structural equation modeling and its application to network analysis in functional brain imaging , 1994 .

[15]  Cathy J. Price,et al.  Neuronal Activation for Semantically Reversible Sentences , 2010, Journal of Cognitive Neuroscience.

[16]  H. Levene.  Robust tests for equality of variances , 1961 .

[17]  Karl J. Friston,et al.  Comparing Families of Dynamic Causal Models , 2010, PLoS Comput. Biol..

[18]  G. Curio,et al.  Speaking modifies voice‐evoked activity in the human auditory cortex , 2000, Human brain mapping.

[19]  Peter Zeidman,et al.  Identifying Abnormal Connectivity in Patients Using Dynamic Causal Modeling of fMRI Responses , 2010, Front. Syst. Neurosci..

[20]  A. J. Yates.  Delayed Auditory Feedback , 1958, Psychological bulletin.

[21]  F. Guenther.  Cortical interactions underlying the production of speech sounds. , 2006, Journal of communication disorders.

[22]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[23]  Karl J. Friston,et al.  Dynamic causal modeling: A generative model of slice timing in fMRI , 2007, NeuroImage.

[24]  M. Seghier,et al.  Developmental dyslexia in Chinese and English populations: dissociating the effect of dyslexia from language differences , 2010, Brain : a journal of neurology.

[25]  Maneesh C. Patel,et al.  Perceptual Systems Controlling Speech Production , 2008, The Journal of Neuroscience.

[26]  Karl J. Friston,et al.  The Importance of Distributed Sampling in Blocked Functional Magnetic Resonance Imaging Designs , 2002, NeuroImage.

[27]  G. J. Borden.  Use of Feedback in Established and Developing Speech , 1980 .

[28]  M. Seghier,et al.  Where, When and Why Brain Activation Differs for Bilinguals and Monolinguals during Picture Naming and Reading Aloud , 2011, Cerebral cortex.

[29]  Michael I. Jordan,et al.  Sensorimotor adaptation in speech production. , 1998, Science.

[30]  B. L. Welch.  THE SIGNIFICANCE OF THE DIFFERENCE BETWEEN TWO MEANS WHEN THE POPULATION VARIANCES ARE UNEQUAL , 1938 .

[31]  Cathy J. Price,et al.  Structural Correlates of Semantic and Phonemic Fluency Ability in First and Second Languages , 2009, Cerebral cortex.

[32]  Cathy J. Price,et al.  A Generative Model of Speech Production in Broca’s and Wernicke’s Areas , 2011, Front. Psychology.

[33]  Alan C. Evans,et al.  Modulation of cerebral blood-flow in the human auditory cortex during speech: role of motor-to-sensory discharges , 1996, NeuroImage.

[34]  Karl J. Friston,et al.  Comparing hemodynamic models with DCM , 2007, NeuroImage.

[35]  Jason A. Tourville,et al.  Neural mechanisms underlying auditory feedback control of speech , 2008, NeuroImage.

[36]  Bill Rogers,et al.  Understanding the neural mechanisms involved in sensory control of voice production , 2012, NeuroImage.

[37]  S. Nagarajan,et al.  Speech target modulates speaking induced suppression in auditory cortex , 2009, BMC Neuroscience.

[38]  J. Rauschecker,et al.  Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing , 2009, Nature Neuroscience.

[39]  Robert Leech,et al.  A comparison of sensory-motor activity during speech in first and second languages. , 2011, Journal of neurophysiology.

[40]  Michael S C Thomas,et al.  Multiple Routes from Occipital to Temporal Cortices during Reading , 2011, The Journal of Neuroscience.

[41]  Karl J. Friston,et al.  Predictive coding under the free-energy principle , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[42]  Elia Formisano,et al.  The Sensory Consequences of Speaking: Parametric Neural Cancellation during Speech in Auditory Cortex , 2011, PloS one.

[43]  Srikantan S. Nagarajan,et al.  Speech Production as State Feedback Control , 2011, Front. Hum. Neurosci..

[44]  Karl J. Friston,et al.  Vowel-specific mismatch responses in the anterior superior temporal gyrus: An fMRI study , 2009, Cortex.

[45]  Jason A. Tourville,et al.  The integration of large-scale neural network modeling and functional brain imaging in speech motor control , 2010, NeuroImage.

[46]  Karl J. Friston,et al.  Ten simple rules for dynamic causal modeling , 2010, NeuroImage.

[47]  R. Buxton,et al.  Dynamics of blood flow and oxygenation changes during brain activation: The balloon model , 1998, Magnetic resonance in medicine.

[48]  Karl J. Friston,et al.  Dynamic causal modelling , 2003, NeuroImage.

[49]  Karl J. Friston,et al.  Modelling functional integration: a comparison of structural equation and dynamic causal models , 2004, NeuroImage.

[50]  J. Rauschecker,et al.  Cortical Representation of Natural Complex Sounds: Effects of Acoustic Features and Auditory Object Category , 2010, The Journal of Neuroscience.

[51]  G. J. Borden.  An interpretation of research on feedback interruption in speech , 1979, Brain and Language.

[52]  N. Schaumberger.  Generalization , 1989, Whitehead and Philosophy of Education.