Differential Influences of Emotion, Task, and Novelty on Brain Regions Underlying the Processing of Speech Melody

We investigated the functional characteristics of brain regions implicated in processing of speech melody by presenting words spoken in either neutral or angry prosody during a functional magnetic resonance imaging experiment using a factorial habituation design. Subjects judged either affective prosody or word class for these vocal stimuli, which could be heard for either the first, second, or third time. Voice-sensitive temporal cortices, as well as the amygdala, insula, and mediodorsal thalami, reacted stronger to angry than to neutral prosody. These stimulus-driven effects were not influenced by the task, suggesting that these brain structures are automatically engaged during processing of emotional information in the voice and operate relatively independent of cognitive demands. By contrast, the right middle temporal gyrus and the bilateral orbito-frontal cortices (OFC) responded stronger during emotion than word classification, but were also sensitive to anger expressed by the voices, suggesting that some perceptual aspects of prosody are also encoded within these regions subserving explicit processing of vocal emotion. The bilateral OFC showed a selective modulation by emotion and repetition, with particularly pronounced responses to angry prosody during the first presentation only, indicating a critical role of the OFC in detection of vocal information that is both novel and behaviorally relevant. These results converge with previous findings obtained for angry faces and suggest a general involvement of the OFC for recognition of anger irrespective of the sensory modality. Taken together, our study reveals that different aspects of voice stimuli and perceptual demands modulate distinct areas involved in the processing of emotional prosody.

[1]  R. Zatorre,et al.  Adaptation to speaker's voice in right anterior temporal lobe , 2003, Neuroreport.

[2]  D. Grandjean,et al.  A cerebral network model of speech prosody comprehension , 2009 .

[3]  H. Scheich,et al.  Phonetic Perception and the Temporal Cortex , 2002, NeuroImage.

[4]  Wolfgang Grodd,et al.  Cerebral processing of emotional prosody—influence of acoustic parameters and arousal , 2008, NeuroImage.

[5]  Michael Erb,et al.  Impact of voice on emotional judgment of faces: An event‐related fMRI study , 2006, Human brain mapping.

[6]  Ingo G. Meister,et al.  A repetition suppression effect lasting several days within the semantic network , 2007, Experimental Brain Research.

[7]  E. Rolls.  The functions of the orbitofrontal cortex , 1999, Brain and Cognition.

[8]  D. Collins,et al.  Automatic 3D Intersubject Registration of MR Volumetric Data in Standardized Talairach Space , 1994, Journal of computer assisted tomography.

[9]  Niels Birbaumer,et al.  Reorganization of functional and effective connectivity during real-time fMRI-BCI modulation of prosody processing , 2011, Brain and Language.

[10]  I. Wambacq,et al.  Non-voluntary and voluntary processing of emotional prosody: an event-related potentials study , 2004, Neuroreport.

[11]  Werner Strik,et al.  The effect of appraisal level on processing of emotional prosody in meaningless speech , 2008, NeuroImage.

[12]  Richard N. A. Henson,et al.  Effect of spatial attention on stimulus-specific haemodynamic repetition effects , 2007, NeuroImage.

[13]  Leslie G. Ungerleider,et al.  Repetition suppression of faces is modulated by emotion. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Gilles Pourtois,et al.  Investigating audiovisual integration of emotional signals in the human brain. , 2006, Progress in brain research.

[15]  Wolfgang Grodd,et al.  Identification of emotional intonation evaluated by fMRI , 2005, NeuroImage.

[16]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[17]  S. Scott,et al.  Positive Emotions Preferentially Engage an Auditory–Motor “Mirror” System , 2006, The Journal of Neuroscience.

[18]  F. Miezin,et al.  Functional anatomical studies of explicit and implicit memory retrieval tasks , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  D. V. von Cramon,et al.  FMRI reveals brain regions mediating slow prosodic modulations in spoken sentences , 2002, Human brain mapping.

[20]  Stanislas Dehaene,et al.  Distinct unimodal and multimodal regions for word processing in the left temporal cortex , 2004, NeuroImage.

[21]  Nico Bunzeck,et al.  Category-specific organization of prefrontal response-facilitation during priming , 2006, Neuropsychologia.

[22]  D. Grandjean,et al.  Peripheral responses to attended and unattended angry prosody: a dichotic listening paradigm. , 2011, Psychophysiology.

[23]  Robert T. Knight,et al.  Orbitofrontal Cortex and Social Behavior: Integrating Self-monitoring and Emotion-Cognition Interactions , 2006, Journal of Cognitive Neuroscience.

[24]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[25]  L Cipolotti,et al.  Impaired social response reversal. A case of 'acquired sociopathy'. , 2000, Brain : a journal of neurology.

[26]  R. Zatorre,et al.  Voice-selective areas in human auditory cortex , 2000, Nature.

[27]  E. N. Sokolov.  Higher nervous functions; the orienting reflex. , 1963, Annual review of physiology.

[28]  Thomas Straube,et al.  Modulation of the neural network involved in the processing of anger prosody: The role of task-relevance and social phobia , 2008, Biological Psychology.

[29]  S. Scott,et al.  Functional Integration across Brain Regions Improves Speech Perception under Adverse Listening Conditions , 2007, The Journal of Neuroscience.

[30]  M. Erb,et al.  Effects of prosodic emotional intensity on activation of associative auditory cortex , 2006, Neuroreport.

[31]  G. Fink,et al.  Neural activation during selective attention to subjective emotional responses , 1997, Neuroreport.

[32]  M. Phillips,et al.  Perception of emotions from faces and voices following unilateral brain damage , 2003, Neuropsychologia.

[33]  Marvin M. Chun,et al.  Attentional modulation of repetition attenuation is anatomically dissociable for scenes and faces , 2006, Brain Research.

[34]  D. Perrett,et al.  Dissociable neural responses to facial expressions of sadness and anger. , 1999, Brain : a journal of neurology.

[35]  Rachel L. C. Mitchell,et al.  fMRI delineation of working memory for emotional prosody in the brain: Commonalities with the lexico-semantic emotion network , 2007, NeuroImage.

[36]  R. Desimone,et al.  The representation of stimulus familiarity in anterior inferior temporal cortex. , 1993, Journal of neurophysiology.

[37]  N. Volkow,et al.  What is in a word? No versus Yes differentially engage the lateral orbitofrontal cortex. , 2007, Emotion.

[38]  Karl J. Friston,et al.  Classical and Bayesian Inference in Neuroimaging: Theory , 2002, NeuroImage.

[39]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[40]  J. Russell,et al.  The neurophysiological bases of emotion: An fMRI study of the affective circumplex using emotion‐denoting words , 2009, Human brain mapping.

[41]  Guillaume P. Dehaene,et al.  Functional segregation of cortical language areas by sentence repetition , 2006, Human brain mapping.

[42]  Patrik Vuilleumier,et al.  Effects of emotional prosody on auditory extinction for voices in patients with spatial neglect , 2008, Neuropsychologia.

[43]  T. Shallice,et al.  Neuroimaging evidence for dissociable forms of repetition priming. , 2000, Science.

[44]  A. Young,et al.  Neural responses to facial and vocal expressions of fear and disgust , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[45]  R. Elliott,et al.  The neural response to emotional prosody, as revealed by functional magnetic resonance imaging , 2003, Neuropsychologia.

[46]  Michael Erb,et al.  Cerebral pathways in processing of affective prosody: A dynamic causal modeling study , 2006, NeuroImage.

[47]  W. Grodd,et al.  Association of trait emotional intelligence and individual fMRI‐activation patterns during the perception of social signals from voice and face , 2009, Human brain mapping.

[48]  Gilles Pourtois,et al.  Emotion and attention interactions in social cognition: Brain regions involved in processing anger prosody , 2005, NeuroImage.

[49]  R. Rosenfeld.  Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[50]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[51]  Karl J. Friston,et al.  A unified statistical approach for determining significant signals in images of cerebral activation , 1996, Human brain mapping.

[52]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[53]  Matthew F Glasser,et al.  DTI tractography of the human brain's language pathways. , 2008, Cerebral cortex.

[54]  A. Braun,et al.  Auditory lexical decision, categorical perception, and FM direction discrimination differentially engage left and right auditory cortex , 2004, Neuropsychologia.

[55]  Pascal Belin,et al.  Amygdala responses to nonlinguistic emotional vocalizations , 2007, NeuroImage.

[56]  R. Weisskoff,et al.  Effect of temporal autocorrelation due to physiological noise and stimulus paradigm on voxel‐level false‐positive rates in fMRI , 1998, Human brain mapping.

[57]  S. Scott,et al.  Saying it with feeling: neural responses to emotional vocalizations , 1999, Neuropsychologia.

[58]  R. C. Oldfield.  THE ASSESSMENT AND ANALYSIS OF HANDEDNESS , 1971 .

[59]  E. Rolls,et al.  Changes in emotion after circumscribed surgical lesions of the orbitofrontal and cingulate cortices. , 2003, Brain : a journal of neurology.

[60]  Patrik Vuilleumier,et al.  Reciprocal links between emotion and attention , 2003 .

[61]  W. Grodd,et al.  The voices of seduction: cross-gender effects in processing of erotic prosody. , 2007, Social cognitive and affective neuroscience.

[62]  R. Zatorre.  Neural Specializations for Tonal Processing , 2001, Annals of the New York Academy of Sciences.

[63]  K. Scherer,et al.  The voices of wrath: brain responses to angry prosody in meaningless speech , 2005, Nature Neuroscience.

[64]  T. Shallice,et al.  Face repetition effects in implicit and explicit memory tests as measured by fMRI. , 2002, Cerebral cortex.

[65]  T. Johnstone,et al.  The voice of emotion: an FMRI study of neural responses to angry and happy vocal expressions. , 2006, Social cognitive and affective neuroscience.

[66]  M Erb,et al.  Distinct frontal regions subserve evaluation of linguistic and emotional aspects of speech intonation. , 2004, Cerebral cortex.

[67]  N. Volkow,et al.  What is in a word? No versus Yes differentially engage the lateral orbitofrontal cortex. , 2007, Emotion.

[68]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[69]  Gang Chen,et al.  Functional imaging analysis contest (FIAC) analysis according to AFNI and SUMA , 2006, Human brain mapping.

[70]  M. Chee,et al.  Stimulus repetition and hemodynamic response refractoriness in event‐related fMRI , 2003, Human brain mapping.

[71]  Michael Erb,et al.  Audiovisual integration of emotional signals in voice and face: An event-related fMRI study , 2007, NeuroImage.

[72]  Wolfgang Grodd,et al.  It is not always tickling: Distinct cerebral responses during perception of different laughter types , 2010, NeuroImage.

[73]  Raymond J. Dolan,et al.  Selective Attention Modulates Neural Substrates of Repetition Priming and Implicit Visual Memory: Suppressions and Enhancements Revealed by fMRI , 2005, Journal of Cognitive Neuroscience.

[74]  Alan C. Evans,et al.  Searching scale space for activation in PET images , 1996, Human brain mapping.

[75]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[76]  Karl J. Friston,et al.  Modelling Geometric Deformations in Epi Time Series , 2022 .

[77]  J. Ringo,et al.  Mnemonic Responses of Single Units Recorded from Monkey Inferotemporal Cortex, Accessed via Transcommissural Versus Direct Pathways: A Dissociation between Unit Activity and Behavior , 1996, The Journal of Neuroscience.

[78]  A. Nakamura,et al.  Vocal identification of speaker and emotion activates differerent brain regions , 1997, Neuroreport.

[79]  Steven L. Small,et al.  Repetition Suppression for Spoken Sentences and the Effect of Task Demands , 2006, Journal of Cognitive Neuroscience.

[80]  S. Edelman,et al.  Differential Processing of Objects under Various Viewing Conditions in the Human Lateral Occipital Complex , 1999, Neuron.

[81]  E Tulving,et al.  Priming and human memory systems. , 1990, Science.

[82]  H. Ackermann,et al.  Cerebral processing of linguistic and emotional prosody: fMRI studies. , 2006, Progress in brain research.

[83]  J. Moake,et al.  This article has been cited by other articles , 2003 .

[84]  Wolfgang Grodd,et al.  Response and habituation of the amygdala during processing of emotional prosody , 2009, Neuroreport.

[85]  M. Erb,et al.  Dynamic Brain Activation during Processing of Emotional Intonation: Influence of Acoustic Parameters, Emotional Valence, and Sex , 2002, NeuroImage.

[86]  Karl J. Friston,et al.  Classical and Bayesian Inference in Neuroimaging: Applications , 2002, NeuroImage.

[87]  Matthew H. Davis,et al.  Neural Response Suppression Predicts Repetition Priming of Spoken Words and Pseudowords , 2006, Journal of Cognitive Neuroscience.