Cerebral mechanisms of prosodic integration: evidence from connected speech

Using functional Magnetic Resonance Imaging (fMRI) and long connected speech stimuli, we addressed the question of neuronal networks involved in prosodic integration by comparing (1) differences in brain activity when hearing connected speech stimuli with high and low degrees of prosodic expression; (2) differences in brain activity in two different diotic listening conditions (normal speech delivery to both ears, i.e., NN; and low-pass-filtered speech delivery to both ears, i.e., FF); and (3) effects of high and low degrees of prosodic information in the NN and FF conditions. Twelve right-handed French men listened passively to the stimuli. Each stimulus induced a specific cerebral network, the flat one weakening activations, which were mainly reduced to the bilateral STG for both listening conditions. High degrees of prosodic information were found to trigger right specific activations in a wider neuronal network involved in speech integration (such as BA44, BA21-22 and BA39-40) than low degrees of prosodic information did. More precisely, the right BA44 was found to be specifically involved in the process of F(0) modulations, which are the main acoustic correlate of prosody. Not only do the results achieved in the present experiment using 30-s-long connected speech stimuli show the involvement of a bilateral neuronal network but they also strongly suggest that high degrees of prosodic information elicit activations in a wider neuronal network involved in speech perception than low degrees of prosodic information do.

[1]  Richard S. J. Frackowiak,et al.  The anatomy of phonological and semantic processing in normal subjects. , 1992, Brain : a journal of neurology.

[2]  J. Binder,et al.  Functional magnetic resonance imaging of human auditory cortex , 1994, Annals of neurology.

[3]  J. Sidtis,et al.  The identification of affective-prosodic stimuli by left- and right-hemisphere-damaged subjects: all errors are not created equal. , 1992, Journal of speech and hearing research.

[4]  M. Pell,et al.  The Ability to Perceive and Comprehend Intonation in Linguistic and Affective Contexts by Brain-Damaged Adults , 1997, Brain and Language.

[5]  Tim Shallice,et al.  Neuropsychological impairments of short-term memory: The impairment of auditory–verbal short-term storage , 1990 .

[6]  Jay J. Pillai,et al.  Functional MRI study of semantic and phonological language processing in bilingual subjects: preliminary findings☆ , 2003, NeuroImage.

[7]  A. Friederici,et al.  Functional MR imaging exposes differential brain responses to syntax and prosody during auditory sentence comprehension , 2003, Journal of Neurolinguistics.

[8]  E. T. Possing,et al.  Human temporal lobe activation by speech and nonspeech sounds. , 2000, Cerebral cortex.

[9]  J. Rauschecker,et al.  Mechanisms and streams for processing of "what" and "where" in auditory cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[10]  B. Renault,et al.  Functional Anatomy of Human Auditory Attention Studied with PET , 1997, NeuroImage.

[11]  John J Sidtis,et al.  A Neurobehavioral Approach to Dysprosody , 2003, Seminars in speech and language.

[13]  Wolfgang Grodd,et al.  Lateralized fMRI activation at the level of the motor cortex during linguistic and affective prosody production tasks , 2001, NeuroImage.

[14]  D. Bolinger Intonation: selected readings; , 1972 .

[15]  E. Ross,et al.  Lateralization of Affective Prosody in Brain and the Callosal Integration of Hemispheric Language Functions , 1997, Brain and Language.

[16]  G Hickok,et al.  Role of anterior temporal cortex in auditory sentence comprehension: an fMRI study , 2001, Neuroreport.

[17]  Patric K Stanton,et al.  Postsynaptic phospholipase C activity is required for the induction of homosynaptic long-term depression in rat hippocampus , 1998, Neuroscience Letters.

[18]  Tracy L. Luks,et al.  Hemispheric Involvement in the Perception of Syntactic Prosody Is Dynamically Dependent on Task Demands , 1998, Brain and Language.

[19]  K M Heilman,et al.  Spared comprehension of emotional prosody in a patient with global aphasia. , 1999, Neuropsychiatry, neuropsychology, and behavioral neurology.

[20]  John J. Sidtis,et al.  Music, Pitch Perception, and the Mechanisms of Cortical Hearing , 1984 .

[21]  J. Gandour,et al.  Speech Prosody in Affective Contexts in Thai Patients with Right Hemisphere Lesions , 1995, Brain and Language.

[22]  David Caplan,et al.  Effects of Syntactic Structure and Propositional Number on Patterns of Regional Cerebral Blood Flow , 1998, Journal of Cognitive Neuroscience.

[23]  S R Baum,et al.  The role of fundamental frequency and duration in the perception of linguistic stress by individuals with brain damage. , 1998, Journal of speech, language, and hearing research : JSLHR.

[24]  A. Friederici,et al.  Auditory Language Comprehension: An Event-Related fMRI Study on the Processing of Syntactic and Lexical Information , 2000, Brain and Language.

[25]  E. Bullmore,et al.  Common and Distinct Neural Substrates for Pragmatic, Semantic, and Syntactic Processing of Spoken Sentences: An fMRI Study , 2000, Journal of Cognitive Neuroscience.

[26]  Mary E. Beckman,et al.  The Parsing of Prosody , 1996 .

[27]  Andrew Kertesz,et al.  Lesion localization in acquired deficits of emotional expression and comprehension , 1990, Brain and Cognition.

[28]  B. Volpe,et al.  Selective loss of complex-pitch or speech discrimination after unilateral lesion , 1988, Brain and Language.

[29]  S. Scott,et al.  Identification of a pathway for intelligible speech in the left temporal lobe. , 2000, Brain : a journal of neurology.

[30]  Hiroshi Fukuda,et al.  Changes of regional cerebral blood flow during listening to an unfamiliar spoken language , 1993, Neuroscience Letters.

[31]  R. Zatorre,et al.  Role of the right temporal neocortex in retention of pitch in auditory short-term memory. , 1991, Brain : a journal of neurology.

[32]  G. McCarthy,et al.  Human Brain Mapping 6:1–13(1998) � Functional MRI Studies of Auditory Comprehension , 2022 .

[33]  John J. Sidtis,et al.  Transient Ischemic Attacks Presenting with a Loss of Pitch Perception , 1990, Cortex.

[34]  S. Petersen,et al.  A procedure for identifying regions preferentially activated by attention to semantic and phonological relations using functional magnetic resonance imaging , 2003, Neuropsychologia.

[35]  M. Pell,et al.  The neural bases of prosody: Insights from lesion studies and neuroimaging , 1999 .

[36]  John J. Sidtis,et al.  On the nature of the cortical function underlying right hemisphere auditory perception , 1980, Neuropsychologia.

[37]  James L. McClelland,et al.  The TRACE model of speech perception , 1986, Cognitive Psychology.

[38]  W Grodd,et al.  Opposite hemispheric lateralization effects during speaking and singing at motor cortex, insula and cerebellum , 2000, Neuroreport.

[39]  Alan C. Evans,et al.  Lateralization of phonetic and pitch discrimination in speech processing. , 1992, Science.

[40]  M. E. Raichle,et al.  PET Studies of Auditory and Phonological Processing: Effects of Stimulus Characteristics and Task Demands , 1995, Journal of Cognitive Neuroscience.

[41]  C. Burgess,et al.  Phonological and semantic information in word and nonword reading in a deep dyslexic patient. , 2000, Brain and cognition.

[42]  D. V. von Cramon,et al.  Neurocognition of auditory sentence comprehension: event related fMRI reveals sensitivity to syntactic violations and task demands. , 2000, Brain research. Cognitive brain research.

[43]  P. Tallal,et al.  Neurobiology of speech perception. , 1997, Annual review of neuroscience.

[44]  J. Rauschecker,et al.  A PET study of human auditory spatial processing , 1999, Neuroscience Letters.

[45]  Jonas Beskow,et al.  Wavesurfer - an open source speech tool , 2000, INTERSPEECH.

[46]  A. Friederici,et al.  On the lateralization of emotional prosody: An event-related functional MR investigation , 2003, Brain and Language.

[47]  Alan C. Evans,et al.  Hearing in the Mind's Ear: A PET Investigation of Musical Imagery and Perception , 1996, Journal of Cognitive Neuroscience.

[48]  Tim Shallice,et al.  Neuropsychological impairments of short-term memory , 1992 .

[49]  R G Robinson,et al.  Neuropsychological and neuroradiologic correlates of emotional prosody comprehension , 1994, Neurology.

[50]  A. Syrota,et al.  The Cortical Representation of Speech , 1993, Journal of Cognitive Neuroscience.

[51]  D. Lancker,et al.  Cerebral Lateralization of Pitch Cues in the Linguistic Signal , 1980 .

[52]  Jody Kreiman,et al.  Hemispheric specialization for voice recognition: Evidence from dichotic listening , 1988, Brain and Language.

[53]  F. Grosjean,et al.  Using Prosody to Predict the End of Sentences in English and French: Normal and Brain-damaged Subjects , 1996 .

[54]  D. V. von Cramon,et al.  FMRI reveals brain regions mediating slow prosodic modulations in spoken sentences , 2002, Human brain mapping.

[55]  Richard S. J. Frackowiak,et al.  The neural correlates of the verbal component of working memory , 1993, Nature.

[56]  Connie A. Tompkins,et al.  Influence of Congruent and Incongruent Contexts on Prosodic Mood Recognition by Brain-Damaged Adults , 1985 .

[57]  Richard S. J. Frackowiak,et al.  The structural components of music perception. A functional anatomical study. , 1997, Brain : a journal of neurology.

[58]  R. Poldrack,et al.  Relations between the Neural Bases of Dynamic Auditory Processing and Phonological Processing: Evidence from fMRI , 2001, Journal of Cognitive Neuroscience.

[59]  A. Friederici,et al.  Time Perception and Motor Timing: A Common Cortical and Subcortical Basis Revealed by fMRI , 2000, NeuroImage.

[60]  Karen Bryan,et al.  Language prosody and the right hemisphere , 1989 .

[61]  R. Zatorre,et al.  Structure and function of auditory cortex: music and speech , 2002, Trends in Cognitive Sciences.

[62]  K. Heilman,et al.  The role of the right hemisphere in emotional communication. , 1991, Brain : a journal of neurology.

[63]  Richard S. J. Frackowiak,et al.  Analysis of temporal structure in sound by the human brain , 1998, Nature Neuroscience.

[64]  Susan J. Behrens,et al.  Characterizing sentence intonation in a right hemisphere-damaged population , 1989, Brain and Language.

[65]  David Poeppel,et al.  Pure word deafness and the bilateral processing of the speech code , 2001, Cogn. Sci..

[66]  R. Ivry,et al.  The two sides of perception , 1997 .

[67]  R. Zatorre,et al.  Pitch perception of complex tones and human temporal-lobe function. , 1988, The Journal of the Acoustical Society of America.

[68]  Donald A. Robin,et al.  The role of callosal connections in speech prosody , 1988, Brain and Language.

[69]  U Klose,et al.  Dynamic pattern of brain activation during sequencing of word strings evaluated by fMRI. , 1999, Brain research. Cognitive brain research.

[70]  Hermann Ackermann,et al.  Lateralization of affective speech processing depends on activation of the subvocal rehearsal system: a DC-potential study , 2000, NeuroImage.

[71]  I. Johnsrude,et al.  Spectral and temporal processing in human auditory cortex. , 2002, Cerebral cortex.

[72]  J. Desmond,et al.  Functional Specialization for Semantic and Phonological Processing in the Left Inferior Prefrontal Cortex , 1999, NeuroImage.

[73]  K. Heilman,et al.  Understanding emotional prosody activates right hemisphere regions. , 1996, Archives of neurology.

[74]  O Muzik,et al.  Receptive and expressive language activations for sentences: a PET study , 1997, Neuroreport.

[75]  D. Klatt,et al.  Analysis, synthesis, and perception of voice quality variations among female and male talkers. , 1990, The Journal of the Acoustical Society of America.

[76]  Jane A. Baran,et al.  Hemispheric specialization in processing intonation contours , 1996 .

[77]  D H Klatt,et al.  Review of text-to-speech conversion for English. , 1987, The Journal of the Acoustical Society of America.

[78]  J. Stirling,et al.  Dichotically presented emotionally intoned words produce laterality differences as a function of localisation task , 2000, Laterality.

[79]  Alan C. Evans,et al.  Neural mechanisms underlying melodic perception and memory for pitch , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[80]  Curt von Euler,et al.  Temporal Information Processing in the Nervous System: Special Reference to Dyslexia and Dysphasia. Conference proceedings. New York City, New York, September 12-15, 1992. , 1993, Annals of the New York Academy of Sciences.

[81]  G. Waters,et al.  Activation of Broca's area by syntactic processing under conditions of concurrent articulation , 2000, Human brain mapping.

[82]  S. Dehaene,et al.  Anatomical variability in the cortical representation of first and second language , 1997, Neuroreport.

[83]  A. Nakamura,et al.  Vocal identification of speaker and emotion activates differerent brain regions , 1997, Neuroreport.

[84]  P. Tallal,et al.  Neurobiological Basis of Speech: A Case for the Preeminence of Temporal Processing , 1993, Annals of the New York Academy of Sciences.

[85]  Karl J. Friston,et al.  Spatial registration and normalization of images , 1995 .