Neural correlates of phonetic convergence and speech imitation

Speakers unconsciously tend to mimic their interlocutor's speech during communicative interaction. This study aims at examining the neural correlates of phonetic convergence and deliberate imitation, in order to explore whether imitation of phonetic features, deliberate, or unconscious, might reflect a sensory-motor recalibration process. Sixteen participants listened to vowels with pitch varying around the average pitch of their own voice, and then produced the identified vowels, while their speech was recorded and their brain activity was imaged using fMRI. Three degrees and types of imitation were compared (unconscious, deliberate, and inhibited) using a go-nogo paradigm, which enabled the comparison of brain activations during the whole imitation process, its active perception step, and its production. Speakers followed the pitch of voices they were exposed to, even unconsciously, without being instructed to do so. After being informed about this phenomenon, 14 participants were able to inhibit it, at least partially. The results of whole brain and ROI analyses support the fact that both deliberate and unconscious imitations are based on similar neural mechanisms and networks, involving regions of the dorsal stream, during both perception and production steps of the imitation process. While no significant difference in brain activation was found between unconscious and deliberate imitations, the degree of imitation, however, appears to be determined by processes occurring during the perception step. Four regions of the dorsal stream: bilateral auditory cortex, bilateral supramarginal gyrus (SMG), and left Wernicke's area, indeed showed an activity that correlated significantly with the degree of imitation during the perception step.

[1]  Daniel Bendor,et al.  Cortical representations of pitch in monkeys and humans , 2006, Current Opinion in Neurobiology.

[2]  Stephen Webster,et al.  Verifying the primacy of voice fundamental frequency in social status accommodation , 2001 .

[3]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[4]  Jeffery A. Jones,et al.  Phonetic perceptual identification by native- and second-language speakers differentially activates brain regions involved with acoustic phonetic processing and those involved with articulatory–auditory/orosensory internal models , 2004, NeuroImage.

[5]  M. Turvey,et al.  The motor theory of speech perception reviewed , 2006, Psychonomic bulletin & review.

[6]  P. Bessière,et al.  Building a talking baby robot A contribution to the study of speech acquisition and evolution , 2005 .

[7]  M. Mishkin,et al.  Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex , 1999, Nature Neuroscience.

[8]  Kiyotaka Suzuki,et al.  Human primary motor cortex shows hemispheric specialization for speech , 2006, Neuroreport.

[9]  Gérard Bailly,et al.  Speech dominoes and phonetic convergence , 2010, INTERSPEECH.

[10]  G. Rizzolatti,et al.  Speech listening specifically modulates the excitability of tongue muscles: a TMS study , 2002, The European journal of neuroscience.

[11]  S. W. Gregory.  A sociolinguistic indicator of group membership , 1986 .

[12]  L. Nygaard,et al.  Gender Differences in Vocal Accommodation: , 2002 .

[13]  Satrajit S. Ghosh,et al.  A neuroimaging study of premotor lateralization and cerebellar involvement in the production of phonemes and syllables. , 2008, Journal of speech, language, and hearing research : JSLHR.

[14]  David Poeppel,et al.  Towards a new functional anatomy of language , 2004, Cognition.

[15]  Wolfram Ziegler,et al.  Auditory–motor integration during fast repetition: The neuronal correlates of shadowing , 2009, NeuroImage.

[16]  W. Levelt,et al.  The spatial and temporal signatures of word production components , 2004, Cognition.

[17]  Gautam K. Vallabha,et al.  Perceptuomotor bias in the imitation of steady-state vowels. , 2004, The Journal of the Acoustical Society of America.

[18]  Jennifer S. Pardo,et al.  On phonetic convergence during conversational interaction. , 2006, The Journal of the Acoustical Society of America.

[19]  Satrajit S. Ghosh,et al.  fMRI investigation of unexpected somatosensory feedback perturbation during speech , 2011, NeuroImage.

[20]  M. Natale.  CONVERGENCE OF MEAN VOCAL INTENSITY IN DYADIC COMMUNICATION AS A FUNCTION OF SOCIAL DESIRABILITY , 1975 .

[21]  Pär Nyström,et al.  The infant mirror neuron system studied with high density EEG , 2008, Social neuroscience.

[22]  Emese Nagy.  From Imitation to Conversation: The First Dialogues with Human Neonates. , 2006 .

[23]  S. Goldinger.  Echoes of echoes? An episodic theory of lexical access. , 1998, Psychological review.

[24]  M. Brass,et al.  The inhibition of imitative and overlearned responses: a functional double dissociation , 2005, Neuropsychologia.

[25]  S. W. Gregory,et al.  A nonverbal signal in voices of interview partners effectively predicts communication accommodation and social status perceptions. , 1996, Journal of personality and social psychology.

[26]  H. Tajfel,et al.  An integrative theory of intergroup conflict. , 1979 .

[27]  J. Hawks.  Intelligibility of one's own speech relative to the speech of others , 1985 .

[28]  S. W. Gregory,et al.  Conversation partner mutual adaptation as demonstrated by Fourier series analysis , 1982 .

[29]  E. Ngan,et al.  A larynx area in the human motor cortex. , 2008, Cerebral cortex.

[30]  M. Erb,et al.  Individual Differences in Audio-Vocal Speech Imitation Aptitude in Late Bilinguals: Functional Neuro-Imaging and Brain Morphology , 2011, Front. Psychology.

[31]  Satrajit S. Ghosh,et al.  Adaptive auditory feedback control of the production of formant trajectories in the Mandarin triphthong /iau/ and its pattern of generalization. , 2010, The Journal of the Acoustical Society of America.

[32]  Stephen Webster,et al.  Evaluating the Relation of Vocal Accommodation in Conversation Partners' Fundamental Frequencies to Perceptions of Communication Quality , 1997 .

[33]  A R Damasio,et al.  The anatomical basis of conduction aphasia. , 1980, Brain : a journal of neurology.

[34]  J. Perkell,et al.  Sensorimotor adaptation to feedback perturbations of vowel acoustics and its relation to perception. , 2007, The Journal of the Acoustical Society of America.

[35]  A. Liberman,et al.  The motor theory of speech perception revised , 1985, Cognition.

[36]  C. Fowler,et al.  Gestural drift in a bilingual speaker of Brazilian Portuguese and English , 1997 .

[37]  Anthony R. McIntosh,et al.  Clustered functional MRI of overt speech production , 2006, NeuroImage.

[38]  D. Poeppel,et al.  Towards a functional neuroanatomy of speech perception , 2000, Trends in Cognitive Sciences.

[39]  Donn Byrne,et al.  An Overview (and Underview) of Research and Theory within the Attraction Paradigm , 1997 .

[40]  K. Shockley,et al.  Imitation in shadowing words , 2004, Perception & psychophysics.

[41]  K. Shockley,et al.  Mutual interpersonal postural constraints are involved in cooperative conversation. , 2003, Journal of experimental psychology. Human perception and performance.

[42]  Michael I. Jordan,et al.  Sensorimotor adaptation in speech production. , 1998, Science.

[43]  Gottfried Schlaug,et al.  Shared and distinct neural correlates of singing and speaking , 2006, NeuroImage.

[44]  T. Chartrand,et al.  The chameleon effect: the perception-behavior link and social interaction. , 1999, Journal of personality and social psychology.

[45]  J L Lancaster,et al.  Automated Talairach Atlas labels for functional brain mapping , 2000, Human brain mapping.

[46]  W. Sato,et al.  Spontaneous facial mimicry in response to dynamic facial expressions , 2005, Cognition.

[47]  J. Mazziotta,et al.  Functional segregation within pars opercularis of the inferior frontal gyrus: evidence from fMRI studies of imitation and action observation. , 2005, Cerebral cortex.

[48]  Donald M. Taylor,et al.  Towards a theory of interpersonal accommodation through language: some Canadian data , 1973, Language in Society.

[49]  Steven L. Small,et al.  Neural development of networks for audiovisual speech comprehension , 2010, Brain and Language.

[50]  F. Guenther.  Cortical interactions underlying the production of speech sounds. , 2006, Journal of communication disorders.

[51]  Gérard Bailly,et al.  Original objective and subjective characterization of phonetic convergence , 2012 .

[52]  J. Schwartz,et al.  Converging toward a common speech code: imitative and perceptuo-motor recalibration processes in speech production , 2013, Front. Psychol..

[53]  Luciano Fadiga,et al.  Vocal pitch discrimination in the motor system , 2011, Brain and Language.

[54]  A. Meltzoff,et al.  Explaining Facial Imitation: A Theoretical Model. , 1997, Early development & parenting.

[55]  Toshio Inui,et al.  Cortical involvement for action imitation of hand/arm postures versus finger configurations: an fMRI study , 2002, Neuroreport.

[56]  J. Mattingley,et al.  Is the mirror neuron system involved in imitation? A short review and meta-analysis , 2009, Neuroscience & Biobehavioral Reviews.

[57]  Jan Derrfuss,et al.  Imitative response tendencies in patients with frontal brain lesions. , 2003, Neuropsychology.

[58]  J. Schwartz,et al.  Shared and distinct neural correlates of vowel perception and production , 2010, Journal of Neurolinguistics.

[59]  S. W. Gregory,et al.  Voice pitch and amplitude convergence as a metric of quality in dyadic interviews , 1993 .

[60]  Louise Connell,et al.  Accent imitation positively affects language attitudes , 2013, Front. Psychol..

[61]  T. Striano,et al.  Auditory-oral matching behavior in newborns. , 2004, Developmental science.

[62]  G. Rizzolatti,et al.  From mirror neurons to imitation: Facts and speculations , 2002 .

[63]  Jeffery A. Jones,et al.  Perceptual calibration of F0 production: evidence from feedback perturbation. , 2000, The Journal of the Acoustical Society of America.

[64]  J. Mazziotta,et al.  Cortical mechanisms of human imitation. , 1999, Science.

[65]  Alfonso Caramazza,et al.  An investigation of repetition and language processing in a case of conduction aphasia , 1981, Brain and Language.

[66]  H. Giles,et al.  Accommodation theory: Communication, context, and consequence. , 1991 .

[67]  Jason A. Tourville,et al.  Neural mechanisms underlying auditory feedback control of speech , 2008, NeuroImage.

[68]  Noël Nguyen,et al.  Automatic recognition of regional phonological variation in conversational interaction , 2010, Speech Commun..

[69]  J. Rauschecker,et al.  Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing , 2009, Nature Neuroscience.

[70]  Molly Babel,et al.  The Role of Fundamental Frequency in Phonetic Accommodation , 2012, Language and speech.

[71]  J. Sommerville,et al.  Action experience alters 3-month-old infants' perception of others' actions , 2005, Cognition.

[72]  V. Gallese.  The manifold nature of interpersonal relations: the quest for a common mechanism. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[73]  Thomas Benke,et al.  Acute conduction aphasia: An analysis of 20 cases , 2003, Brain and Language.

[74]  Lawrence D. Rosenblum,et al.  Alignment to visual speech information , 2010, Attention, perception & psychophysics.

[75]  S. Krashen.  Second Language Acquisition and Second Language Learning , 1988 .

[76]  C. Fowler,et al.  Functional activation for imitation of seen and heard speech , 2011, Journal of Neurolinguistics.

[77]  D. Poeppel,et al.  Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language , 2004, Cognition.

[78]  Véronique Delvaux,et al.  The Influence of Ambient Speech on Adult Speech Productions through Unintentional Imitation , 2007, Phonetica.

[79]  M. Iacoboni,et al.  Listening to speech activates motor areas involved in speech production , 2004, Nature Neuroscience.

[80]  Peter Q. Pfordresher,et al.  POOR-PITCH SINGING IN THE ABSENCE OF "TONE DEAFNESS" , 2007 .

[81]  G. Rizzolatti,et al.  Neurophysiological mechanisms underlying the understanding and imitation of action , 2001, Nature Reviews Neuroscience.

[82]  Jennifer S. Pardo.  Expressing oneself in conversational interaction , 2009 .

[83]  C. Fowler.  An event approach to the study of speech perception from a direct realist perspective , 1986 .

[84]  K. N. Dollman,et al.  - 1 , 1743 .

[85]  S. Garrod,et al.  The Development of Dialogue Co-ordination Skills in Schoolchildren. , 1993 .

[86]  V. Gracco,et al.  Perceptual recalibration of speech sounds following speech motor learning. , 2009, The Journal of the Acoustical Society of America.

[87]  J. Schwartz,et al.  The Perception-for-Action-Control Theory (PACT): A perceptuo-motor theory of speech perception , 2012, Journal of Neurolinguistics.

[88]  M. Arbib,et al.  Language within our grasp , 1998, Trends in Neurosciences.

[89]  Marcel Brass,et al.  Resisting motor mimicry: Control of imitation involves processes central to social cognition in patients with frontal and temporo-parietal lesions , 2010, Social neuroscience.

[90]  Molly Babel,et al.  Evidence for phonetic and social selectivity in spontaneous phonetic imitation , 2012, J. Phonetics.

[91]  Scott T Grafton,et al.  Functional imaging of face and hand imitation: towards a motor theory of empathy , 2004, NeuroImage.

[92]  G. Rizzolatti,et al.  Neural Circuits Underlying Imitation Learning of Hand Actions An Event-Related fMRI Study , 2004, Neuron.

[93]  W. Ziegler,et al.  Unintended imitation in nonword repetition , 2009, Brain and Language.

[94]  Kuniko Y. Nielsen.  Specificity and abstractness of VOT imitation , 2011, J. Phonetics.

[95]  H. Bekkering,et al.  Imitation Improves Language Comprehension , 2010, Psychological science.

[96]  G. Dogil,et al.  Sociolinguistic factors in language proficiency: phonetic convergence as a signature of pronunciation talent. , 2009 .

[97]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[98]  Derek K. Jones,et al.  Perisylvian language networks of the human brain , 2005, Annals of neurology.

[99]  C Hölscher,et al.  Spontaneous Imitation of Fundamental Frequency and Speech Rate by Nonstutterers and Stutterers , 1997, Journal of psycholinguistic research.

[100]  Jennifer R. Yates,et al.  Self-monitoring and mimicry of positive and negative social behaviors , 2007 .

[101]  Robert F. Coleman,et al.  Normal variations in habitual pitch , 1991 .

[102]  Molly Babel.  Phonetic and social selectivity in speech accommodation , 2009 .

[103]  N. Nguyen,et al.  Does Imitation Facilitate Word Recognition in a Non-Native Regional Accent? , 2012, Front. Psychology.

[104]  David J. Ostry,et al.  Auditory plasticity and speech motor learning , 2009, Proceedings of the National Academy of Sciences.

[105]  K. Nelson,et al.  Neonatal imitation of tongue protrusion and mouth opening: methodological aspects and evidence of early individual differences. , 1989, Scandinavian journal of psychology.

[106]  J. Abbs,et al.  Control of complex motor gestures: orofacial muscle responses to load perturbations of lip during speech. , 1984, Journal of neurophysiology.

[107]  Jeremy I. Skipper,et al.  Speech-associated gestures, Broca’s area, and the human mirror system , 2007, Brain and Language.