The “Musical Emotional Bursts”: a validated set of musical affect bursts to investigate auditory affective processing

The Musical Emotional Bursts (MEB) consist of 80 brief musical executions expressing basic emotional states (happiness, sadness and fear) and neutrality. These musical bursts were designed to be the musical analog of the Montreal Affective Voices (MAV)—a set of brief non-verbal affective vocalizations portraying different basic emotions. The MEB consist of short (mean duration: 1.6 s) improvisations on a given emotion or of imitations of a given MAV stimulus, played on a violin (10 stimuli × 4 [3 emotions + neutral]), or a clarinet (10 stimuli × 4 [3 emotions + neutral]). The MEB arguably represent a primitive form of music emotional expression, just like the MAV represent a primitive form of vocal, non-linguistic emotional expression. To create the MEB, stimuli were recorded from 10 violinists and 10 clarinetists, and then evaluated by 60 participants. Participants evaluated 240 stimuli [30 stimuli × 4 (3 emotions + neutral) × 2 instruments] by performing either a forced-choice emotion categorization task, a valence rating task or an arousal rating task (20 subjects per task); 40 MAVs were also used in the same session with similar task instructions. Recognition accuracy of emotional categories expressed by the MEB (n:80) was lower than for the MAVs but still very high with an average percent correct recognition score of 80.4%. Highest recognition accuracies were obtained for happy clarinet (92.0%) and fearful or sad violin (88.0% each) MEB stimuli. The MEB can be used to compare the cerebral processing of emotional expressions in music and vocal communication, or used for testing affective perception in patients with communication problems.

[1]  São Luís Castro,et al.  Not all sounds sound the same: Parkinson's disease affects differently emotion processing in music and in speech prosody , 2013, Journal of clinical and experimental neuropsychology.

[2]  Carlos D. Castillo,et al.  Facial Action Coding , 2009, Encyclopedia of Biometrics.

[3]  K. Zilles,et al.  Recognition of emotional prosody and verbal components of spoken language: an fMRI study. , 2000, Brain research. Cognitive brain research.

[4]  Isabelle Peretz,et al.  Congenital Amusia A Disorder of Fine-Grained Pitch Discrimination , 2002, Neuron.

[5]  D. Västfjäll,et al.  Emotional responses to music: the need to consider underlying mechanisms. , 2008, The Behavioral and brain sciences.

[6]  I. Peretz,et al.  Impaired recognition of scary music following unilateral temporal lobe excision. , 2005, Brain : a journal of neurology.

[7]  Sophie K. Scott,et al.  The structural neuroanatomy of music emotion recognition: Evidence from frontotemporal lobar degeneration , 2011, NeuroImage.

[8]  P. Juslin,et al.  Emotional Expression in Music Performance: Between the Performer's Intention and the Listener's Experience , 1996 .

[9]  M. Kenward,et al.  It's not what you play, it's how you play it: Timbre affects perception of emotion in music , 2009, Quarterly journal of experimental psychology.

[10]  Thomas F Münte,et al.  Unforgettable film music: The role of emotion in episodic long-term memory for music , 2008, BMC Neuroscience.

[11]  Marc D. Pell,et al.  Cerebral mechanisms for understanding emotional prosody in speech , 2006, Brain and Language.

[12]  M. Coltheart,et al.  Modularity of music processing , 2003, Nature Neuroscience.

[13]  Barbara Tillmann,et al.  Judging familiarity and emotion from very brief musical excerpts , 2010, Psychonomic bulletin & review.

[14]  I. Peretz,et al.  Time course of melody recognition: A gating paradigm study , 2003, Perception & psychophysics.

[15]  Marc Schröder,et al.  Experimental study of affect bursts , 2003, Speech Commun..

[16]  R. Adolphs,et al.  Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala , 1994, Nature.

[17]  Sophie K. Scott,et al.  Cross-cultural recognition of basic emotions through nonverbal emotional vocalizations , 2010, Proceedings of the National Academy of Sciences.

[18]  M. Terwogt,et al.  Musical Expression of Moodstates , 1991 .

[19]  Pascal Belin,et al.  Amygdala responses to nonlinguistic emotional vocalizations , 2007, NeuroImage.

[20]  W. Thompson,et al.  Reduced sensitivity to emotional prosody in congenital amusia rekindles the musical protolanguage hypothesis , 2012, Proceedings of the National Academy of Sciences.

[21]  P. Laukka,et al.  Communication of emotions in vocal expression and music performance: different channels, same code? , 2003, Psychological bulletin.

[22]  J. Sloboda,et al.  Handbook of Music and Emotion: Theory, Research, Applications , 2011 .

[23]  R. Zatorre,et al.  Anatomically distinct dopamine release during anticipation and experience of peak emotion to music , 2011, Nature Neuroscience.

[24]  I. Peretz,et al.  Brain organization for music processing. , 2005, Annual review of psychology.

[25]  M. Frank,et al.  The forced-choice paradigm and the perception of facial expressions of emotion. , 2001, Journal of personality and social psychology.

[26]  P. Belin,et al.  Cross-Cultural Differences in the Processing of Non-Verbal Affective Vocalizations by Japanese and Canadian Listeners , 2013, Front. Psychol..

[27]  P. Juslin,et al.  Emotional expression in music. , 2003 .

[28]  D. Gentile,et al.  Infants' discrimination of happy and sad music. , 2008, Infant behavior & development.

[29]  W. Thompson,et al.  A Comparison of Acoustic Cues in Music and Speech for Three Dimensions of Affect , 2006 .

[30]  I. Peretz,et al.  Universal Recognition of Three Basic Emotions in Music , 2009, Current Biology.

[31]  K. Scherer.  Vocal affect expression: a review and a model for future research. , 1986, Psychological bulletin.

[32]  A. Friederici,et al.  On the lateralization of emotional prosody: An event-related functional MR investigation , 2003, Brain and Language.

[33]  D. Hasboun,et al.  Impaired recognition of fear in voices and reduced anxiety after unilateral temporal lobe resection , 2011, Neuropsychologia.

[34]  S. Green,et al.  The Ability to Identify Emotional Content of Solo Improvisations Performed Vocally and on Three Different Instruments , 1993 .

[35]  William Aubé,et al.  The effects of emotion on memory for music and vocalisations , 2013, Memory.

[36]  C. Bellone,et al.  ON A ROLE , 1996 .

[37]  R. Elliott,et al.  The neural response to emotional prosody, as revealed by functional magnetic resonance imaging , 2003, Neuropsychologia.

[38]  K. Scherer,et al.  Emotions evoked by the sound of music: characterization, classification, and measurement. , 2008, Emotion.

[39]  Isabelle Peretz,et al.  Towards a Neurobiology of Musical Emotions , 1993 .

[40]  W. Thompson,et al.  Recognition of emotion in Japanese, Western, and Hindustani music by Japanese listeners 1 , 2004 .

[41]  I. Peretz,et al.  Happy, sad, scary and peaceful musical excerpts for research on emotions , 2008 .

[42]  宁北芳,et al.  疟原虫var基因转换速率变化导致抗原变异[英]／Paul H, Robert P, Christodoulou Z, et al//Proc Natl Acad Sci U S A , 2005 .

[43]  São Luís Castro,et al.  Speaking to the trained ear: musical expertise enhances the recognition of emotions in speech prosody. , 2011, Emotion.

[44]  William P. Dunlap,et al.  On the questionable soundness of factoring ipsative data: A response to Saville & Willson (1991) , 1994 .

[45]  Isabelle Peretz,et al.  Modulation of the startle reflex by pleasant and unpleasant music. , 2009, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[46]  I. Peretz,et al.  A developmental study of the affective value of tempo and mode in music , 2001, Cognition.

[47]  P. Ekman.  Emotion in the human face , 1982 .

[48]  R. Adolphs,et al.  Amygdala damage impairs emotion recognition from music , 2007, Neuropsychologia.

[49]  M. Kreutzer,et al.  DARWIN and FACIAL EXPRESSION A CENTURY OF RESEARCH IN REVIEW , 2014 .

[50]  P. Belin,et al.  Auditory adaptation in vocal affect perception , 2010, Cognition.

[51]  D. Javitt,et al.  Reduction in tonal discriminations predicts receptive emotion processing deficits in schizophrenia and schizoaffective disorder. , 2013, Schizophrenia bulletin.

[52]  K. Scherer,et al.  Acoustic profiles in vocal emotion expression. , 1996, Journal of personality and social psychology.

[53]  I. Peretz,et al.  Music and emotion: perceptual determinants, immediacy, and isolation after brain damage , 1998, Cognition.

[54]  W. Thompson,et al.  A Cross-Cultural Investigation of the Perception of Emotion in Music: Psychophysical and Cultural Cues , 1999 .

[55]  Annett Schirmer,et al.  On the role of attention for the processing of emotions in speech: sex differences revisited. , 2005, Brain research. Cognitive brain research.

[56]  J. Marozeau,et al.  Multidimensional scaling of emotional responses to music: The effect of musical expertise and of the duration of the excerpts , 2005 .

[57]  F. Gosselin,et al.  The Montreal Affective Voices: A validated set of nonverbal affect bursts for research on auditory affective processing , 2008, Behavior research methods.