Investigating emotion with music: An fMRI study

The present study used pleasant and unpleasant music to evoke emotion and functional magnetic resonance imaging (fMRI) to determine neural correlates of emotion processing. Unpleasant (permanently dissonant) music contrasted with pleasant (consonant) music showed activations of amygdala, hippocampus, parahippocampal gyrus, and temporal poles. These structures have previously been implicated in the emotional processing of stimuli with (negative) emotional valence; the present data show that a cerebral network comprising these structures can be activated during the perception of auditory (musical) information. Pleasant (contrasted to unpleasant) music showed activations of the inferior frontal gyrus (IFG, inferior Brodmann's area (BA) 44, BA 45, and BA 46), the anterior superior insula, the ventral striatum, Heschl's gyrus, and the Rolandic operculum. IFG activations appear to reflect processes of music–syntactic analysis and working memory operations. Activations of Rolandic opercular areas possibly reflect the activation of mirror‐function mechanisms during the perception of the pleasant tunes. Rolandic operculum, anterior superior insula, and ventral striatum may form a motor‐related circuitry that serves the formation of (premotor) representations for vocal sound production during the perception of pleasant auditory information. In all of the mentioned structures, except the hippocampus, activations increased over time during the presentation of the musical stimuli, indicating that the effects of emotion processing have temporal dynamics; the temporal dynamics of emotion have so far mainly been neglected in the functional imaging literature. Hum Brain Mapp 2005. © 2005 Wiley‐Liss, Inc.

[1]  Consonance and Dissonance , 1913 .

[2]  R.N.Dej.,et al.  The Cerebral Cortex of Man , 1951, Neurology.

[3]  R. Plomp,et al.  The connotation of musical consonance , 1962 .

[4]  Mieczyslaw Kolinski,et al.  Consonance and Dissonance , 1962 .

[5]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[6]  L. Wedin,et al.  A multidimensional study of perceptual-emotional qualities in music. , 1972, Scandinavian journal of psychology.

[7]  J. Russell.  A circumplex model of affect. , 1980 .

[8]  D. Amaral,et al.  Amygdalo‐cortical projections in the monkey (Macaca fascicularis) , 1984, The Journal of comparative neurology.

[9]  J. Talairach,et al.  Co-Planar Stereotaxic Atlas of the Human Brain: 3-Dimensional Proportional System: An Approach to Cerebral Imaging , 1988 .

[10]  E. Schellenberg,et al.  Frequency ratios and the perception of tone patterns , 1994, Psychonomic bulletin & review.

[11]  D. Amaral,et al.  Perirhinal and parahippocampal cortices of the macaque monkey: Cortical afferents , 1994, The Journal of comparative neurology.

[12]  R. Adolphs,et al.  Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala , 1994, Nature.

[13]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[14]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[15]  D. Perrett,et al.  A differential neural response in the human amygdala to fearful and happy facial expressions , 1996, Nature.

[16]  J. R. Augustine.  Circuitry and functional aspects of the insular lobe in primates including humans , 1996, Brain Research Reviews.

[17]  S. Rauch,et al.  Response and Habituation of the Human Amygdala during Visual Processing of Facial Expression , 1996, Neuron.

[18]  N. Dronkers.  A new brain region for coordinating speech articulation , 1996, Nature.

[19]  U Klose,et al.  Functional lateralization of speech production at primary motor cortex: a fMRI study. , 1996, Neuroreport.

[20]  Karl J. Friston,et al.  A unified statistical approach for determining significant signals in images of cerebral activation , 1996, Human brain mapping.

[21]  T. Robbins,et al.  Neurobehavioural mechanisms of reward and motivation , 1996, Current Opinion in Neurobiology.

[22]  D. Perrett,et al.  A specific neural substrate for perceiving facial expressions of disgust , 1997, Nature.

[23]  J. Pardo,et al.  Emotion, olfaction, and the human amygdala: amygdala activation during aversive olfactory stimulation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[24]  M S Mega,et al.  The limbic system: an anatomic, phylogenetic, and clinical perspective. , 1997, The Journal of neuropsychiatry and clinical neurosciences.

[25]  C. Krumhansl.  An exploratory study of musical emotions and psychophysiology. , 1997, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[26]  M. Bradley,et al.  Neuroanatomical correlates of pleasant and unpleasant emotion , 1997, Neuropsychologia.

[27]  S. Watson.  Neuroendocrine and Behavioral Responses and Brain Pattern of c‐fos Induction Associated with Audiogenic Stress , 1997, Journal of neuroendocrinology.

[28]  J. Pardo,et al.  PET study of the localization and laterality of lingual somatosensory processing in humans , 1997, Neuroscience Letters.

[29]  Jeffrey L. Cummings,et al.  The neuropsychiatry of limbic and subcortical disorders , 1997 .

[30]  Sophie K. Scott,et al.  Impaired auditory recognition of fear and anger following bilateral amygdala lesions , 1997, Nature.

[31]  R. M. Siegel,et al.  Lack of selectivity for simple shapes defined by motion and luminance in STPa of the behaving macaque , 1998, Neuroreport.

[32]  S. Taylor,et al.  The Effect of Emotional Content on Visual Recognition Memory: A PET Activation Study , 1998, NeuroImage.

[33]  S. Rauch,et al.  Masked Presentations of Emotional Facial Expressions Modulate Amygdala Activity without Explicit Knowledge , 1998, The Journal of Neuroscience.

[34]  R. Adolphs,et al.  The human amygdala in social judgment , 1998, Nature.

[35]  A. Nakamura,et al.  Somatosensory Homunculus as Drawn by MEG , 1998, NeuroImage.

[36]  Karl J. Friston,et al.  A neuromodulatory role for the human amygdala in processing emotional facial expressions. , 1998, Brain : a journal of neurology.

[37]  Karl J. Friston,et al.  Generalisability, Random Effects & Population Inference , 1998, NeuroImage.

[38]  A. Young,et al.  Neural responses to facial and vocal expressions of fear and disgust , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[39]  E. Bullmore,et al.  Investigation of facial recognition memory and happy and sad facial expression perception: an fMRI study , 1998, Psychiatry Research: Neuroimaging.

[40]  A K Anderson,et al.  Intact recognition of vocal expressions of fear following bilateral lesions of the human amygdala. , 1998, Neuroreport.

[41]  J. Kagan,et al.  INFANTS' PERCEPTION OF CONSONANCE AND DISSONANCE IN MUSIC , 1998 .

[42]  L. Trainor,et al.  The development of evaluative responses to music:: Infants prefer to listen to consonance over dissonance , 1998 .

[43]  S. Scott,et al.  Saying it with feeling: neural responses to emotional vocalizations , 1999, Neuropsychologia.

[44]  Alan C. Evans,et al.  Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions , 1999, Nature Neuroscience.

[45]  J. Douglas Bremner,et al.  Does stress damage the brain? , 1999, Biological Psychiatry.

[46]  Huda Akil,et al.  Neural circuits mediating stress , 1999, Biological Psychiatry.

[47]  Karl J. Friston,et al.  Robust Smoothness Estimation in Statistical Parametric Maps Using Standardized Residuals from the General Linear Model , 1999, NeuroImage.

[48]  Lutz Jäncke,et al.  Attention modulates activity in the primary and the secondary auditory cortex: a functional magnetic resonance imaging study in human subjects , 1999, Neuroscience Letters.

[49]  A. Crawley,et al.  Cortical activation during human volitional swallowing: an event-related fMRI study. , 1999, American journal of physiology. Gastrointestinal and liver physiology.

[50]  Scott T. Grafton,et al.  Amygdala activity related to enhanced memory for pleasant and aversive stimuli , 1999, Nature Neuroscience.

[51]  A. Chiba,et al.  Cognitive functions of the basal forebrain , 1999, Current Opinion in Neurobiology.

[52]  R. Adolphs,et al.  The human amygdala in social judgement , 2000 .

[53]  W Grodd,et al.  Opposite hemispheric lateralization effects during speaking and singing at motor cortex, insula and cerebellum , 2000, Neuroreport.

[54]  J. Pardo,et al.  Cortical activation induced by intraoral stimulation with water in humans. , 2000, Chemical senses.

[55]  Stefan Koelsch,et al.  Musical syntax is processed in the area of Broca: an MEG study , 2000, NeuroImage.

[56]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[57]  Michael Davis,et al.  The amygdala: vigilance and emotion , 2001, Molecular Psychiatry.

[58]  P Hagoort,et al.  A neural correlate of syntactic encoding during speech production , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[59]  A. Friederici,et al.  Musical syntax is processed in Broca's area: an MEG study , 2001, Nature Neuroscience.

[60]  G Lohmann,et al.  LIPSIA--a new software system for the evaluation of functional magnetic resonance images of the human brain. , 2001, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[61]  Andrew W. Young,et al.  Neuropsychology of fear and loathing , 2001, Nature Reviews Neuroscience.

[62]  H Scheich,et al.  Auditory perception of laughing and crying activates human amygdala regardless of attentional state. , 2001, Brain research. Cognitive brain research.

[63]  I. Peretz,et al.  Cortical deafness to dissonance. , 2001, Brain : a journal of neurology.

[64]  R. Zatorre,et al.  Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[65]  M Steinschneider,et al.  Consonance and dissonance of musical chords: neural correlates in auditory cortex of monkeys and humans. , 2001, Journal of neurophysiology.

[66]  Stefan Koelsch,et al.  Bach Speaks: A Cortical “Language-Network” Serves the Processing of Music , 2002, NeuroImage.

[67]  Marc Leman,et al.  The Cortical Topography of Tonal Structures Underlying Western Music , 2002, Science.

[68]  P. Janata,et al.  Listening to polyphonic music recruits domain-general attention and working memory circuits , 2002, Cognitive, affective & behavioral neuroscience.

[69]  R. Dolan,et al.  Emotion, Cognition, and Behavior , 2002, Science.

[70]  B. Everitt,et al.  Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex , 2002, Neuroscience & Biobehavioral Reviews.

[71]  David H. Zald,et al.  The Neural Correlates of Aversive Auditory Stimulation , 2002, NeuroImage.

[72]  G. Rizzolatti,et al.  Hearing Sounds, Understanding Actions: Action Representation in Mirror Neurons , 2002, Science.

[73]  R. Buxton.  Introduction to Functional Magnetic Resonance Imaging: Principles and Techniques , 2002 .

[74]  S. Rossitti.  Introduction to Functional Magnetic Resonance Imaging, Principles and Techniques , 2002 .

[75]  S. Taylor,et al.  Extended Amygdala and Emotional Salience: A PET Activation Study of Positive and Negative Affect , 2003, Neuropsychopharmacology.

[76]  D. Zald.  The human amygdala and the emotional evaluation of sensory stimuli , 2003, Brain Research Reviews.

[77]  M. Greicius,et al.  Regional analysis of hippocampal activation during memory encoding and retrieval: fMRI study , 2003, Hippocampus.

[78]  A. Braun,et al.  Words in melody: an H215O PET study of brain activation during singing and speaking , 2003, Neuroreport.

[79]  P. Janata,et al.  Activation of the inferior frontal cortex in musical priming. , 2003, Annals of the New York Academy of Sciences.

[80]  S. Rauch,et al.  Neurobiology of emotion perception I: the neural basis of normal emotion perception , 2003, Biological Psychiatry.

[81]  Michael J. Martinez,et al.  Passive music listening spontaneously engages limbic and paralimbic systems , 2004, Neuroreport.

[82]  A. Friederici,et al.  Brain activity varies with modulation of dynamic pitch variance in sentence melody , 2004, Brain and Language.

[83]  Hermann Ackermann,et al.  The contribution of the insula to motor aspects of speech production: A review and a hypothesis , 2004, Brain and Language.

[84]  Turhan Canli,et al.  Individual differences in emotion processing , 2004, Current Opinion in Neurobiology.

[85]  Eric E. Nelson,et al.  Orbitofrontal cortex tracks positive mood in mothers viewing pictures of their newborn infants , 2004, NeuroImage.

[86]  E. Rolls.  The functions of the orbitofrontal cortex , 1999, Brain and Cognition.

[87]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[88]  Vittorio Gallese,et al.  Listening to Action-related Sentences Activates Fronto-parietal Motor Circuits , 2005, Journal of Cognitive Neuroscience.

[89]  S. Koelsch.  Neural substrates of processing syntax and semantics in music , 2005, Current Opinion in Neurobiology.

[90]  A. Kolodkin,et al.  Development Edging towards circuitry, behavior and disease , 2005, Current Opinion in Neurobiology.

[91]  I. Peretz,et al.  Impaired recognition of scary music following unilateral temporal lobe excision. , 2005, Brain : a journal of neurology.

[92]  Stefan Koelsch,et al.  Adults and children processing music: An fMRI study , 2005, NeuroImage.