A cross‐linguistic fMRI study of perception of intonation and emotion in Chinese

Conflicting data from neurobehavioral studies of the perception of intonation (linguistic) and emotion (affective) in spoken language highlight the need to further examine how functional attributes of prosodic stimuli are related to hemispheric differences in processing capacity. Because of similarities in their acoustic profiles, intonation and emotion permit us to assess to what extent hemispheric lateralization of speech prosody depends on functional instead of acoustical properties. To examine how the brain processes linguistic and affective prosody, an fMRI study was conducted using Chinese, a tone language in which both intonation and emotion may be signaled prosodically, in addition to lexical tones. Ten Chinese and 10 English subjects were asked to perform discrimination judgments of intonation (I: statement, question) and emotion (E: happy, angry, sad) presented in semantically neutral Chinese sentences. A baseline task required passive listening to the same speech stimuli (S). In direct between‐group comparisons, the Chinese group showed left‐sided frontoparietal activation for both intonation (I vs. S) and emotion (E vs. S) relative to baseline. When comparing intonation relative to emotion (I vs. E), the Chinese group demonstrated prefrontal activation bilaterally; parietal activation in the left hemisphere only. The reverse comparison (E vs. I), on the other hand, revealed that activation occurred in anterior and posterior prefrontal regions of the right hemisphere only. These findings show that some aspects of perceptual processing of emotion are dissociable from intonation, and, moreover, that they are mediated by the right hemisphere. Hum. Brain Mapping 18:149–157, 2003. © 2003 Wiley‐Liss, Inc.

[1]  K. Heilman,et al.  Understanding emotional prosody activates right hemisphere regions. , 1996, Archives of neurology.

[2]  D. P. Russell,et al.  Treatment of baseline drifts in fMRI time series analysis. , 1999, Journal of computer assisted tomography.

[3]  M. Pell,et al.  The neural bases of prosody: Insights from lesion studies and neuroimaging , 1999 .

[4]  J. Lurito,et al.  Temporal integration of speech prosody is shaped by language experience: An fMRI study , 2003, Brain and Language.

[5]  Mark J. Lowe,et al.  Quantitative Comparison of Functional Contrast from BOLD-Weighted Spin-Echo and Gradient-Echo Echoplanar Imaging at 1.5 Tesla and H215O PET in the Whole Brain , 2000, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[6]  J. D. E. Gabrieli,et al.  Integration of diverse information in working memory within the frontal lobe , 2000, Nature Neuroscience.

[7]  G. Hutchins,et al.  Functional Heterogeneity of Inferior Frontal Gyrus Is Shaped by Linguistic Experience , 2001, Brain and Language.

[8]  J. Gandour,et al.  Speech Prosody in Affective Contexts in Thai Patients with Right Hemisphere Lesions , 1995, Brain and Language.

[9]  M. Lowe,et al.  Spatially filtering functional magnetic resonance imaging data , 1997, Magnetic resonance in medicine.

[10]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[11]  C. P. Hughes,et al.  Aprosodia in Chinese patients with right cerebral hemisphere lesions. , 1983, Archives of neurology.

[12]  Constance S. Royden,et al.  Motion perception , 1998 .

[13]  K. Zilles,et al.  Recognition of emotional prosody and verbal components of spoken language: an fMRI study. , 2000, Brain research. Cognitive brain research.

[14]  J. Cohen,et al.  Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. , 2000, Science.

[15]  M. Mesulam Principles of Behavioral and Cognitive Neurology , 2000 .

[16]  M. Erb,et al.  Dynamic Brain Activation during Processing of Emotional Intonation: Influence of Acoustic Parameters, Emotional Valence, and Sex , 2002, NeuroImage.

[17]  Aichen T. Ho Intonation Variation in a Mandarin Sentence for Three Expressions: Interrogative, Exclamatory and Declarative , 1977 .

[18]  Hannu J. Aronen,et al.  Working Memory of Identification of Emotional Vocal Expressions: An fMRI Study , 2001, NeuroImage.

[19]  Edward E. Smith,et al.  Dissociation of Storage and Rehearsal in Verbal Working Memory: Evidence From Positron Emission Tomography , 1996 .

[20]  B. Postle,et al.  Maintenance versus Manipulation of Information Held in Working Memory: An Event-Related fMRI Study , 1999, Brain and Cognition.

[21]  M. Pell Recognition of prosody following unilateral brain lesion: influence of functional and structural attributes of prosodic contours , 1998, Neuropsychologia.

[22]  R. Zatorre,et al.  Structure and function of auditory cortex: music and speech , 2002, Trends in Cognitive Sciences.

[23]  Sharlene D. Newman,et al.  The Synchronization of the Human Cortical Working Memory Network , 2002, NeuroImage.

[24]  X. Shen The Prosody of Mandarin Chinese , 1990 .

[25]  N. Geschwind,et al.  Hemispheric asymmetry in the expression of positive and negative emotions. Neurologic evidence. , 1982, Archives of neurology.

[26]  Bruce R. Rosen,et al.  Motion detection and correction in functional MR imaging , 1995 .

[27]  E C Wong,et al.  Processing strategies for time‐course data sets in functional mri of the human brain , 1993, Magnetic resonance in medicine.

[28]  Jerold A. Edmondson,et al.  The effect of right-brain damage on acoustical measures of affective prosody in Taiwanese patients , 1987 .

[29]  J. Jonides,et al.  Storage and executive processes in the frontal lobes. , 1999, Science.

[30]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[31]  B. Postle,et al.  Prefrontal cortical contributions to working memory: evidence from event-related fMRI studies , 2000, Experimental Brain Research.