Universal and culture-specific factors in the recognition and performance of musical affect expressions.

We present a cross-cultural study on the performance and perception of affective expression in music. Professional bowed-string musicians from different musical traditions (Swedish folk music, Hindustani classical music, Japanese traditional music, and Western classical music) were instructed to perform short pieces of music to convey 11 emotions and related states to listeners. All musical stimuli were judged by Swedish, Indian, and Japanese participants in a balanced design, and a variety of acoustic and musical cues were extracted. Results first showed that the musicians' expressive intentions could be recognized with accuracy above chance both within and across musical cultures, but communication was, in general, more accurate for culturally familiar versus unfamiliar music, and for basic emotions versus nonbasic affective states. We further used a lens-model approach to describe the relations between the strategies that musicians use to convey various expressions and listeners' perceptions of the affective content of the music. Many acoustic and musical cues were similarly correlated with both the musicians' expressive intentions and the listeners' affective judgments across musical cultures, but the match between musicians' and listeners' uses of cues was better in within-cultural versus cross-cultural conditions. We conclude that affective expression in music may depend on a combination of universal and culture-specific factors.

[1]  Anqi Qiu,et al.  Emotional expressions in voice and music: Same code, same effect? , 2013, Human brain mapping.

[2]  Catherine J. Stevens,et al.  Music Perception and Cognition: A Review of Recent Cross-Cultural Research , 2012, Top. Cogn. Sci..

[3]  K. Scherer,et al.  Introducing the Geneva Multimodal expression corpus for experimental research on emotion perception. , 2012, Emotion.

[4]  R. Zatorre,et al.  Musical Melody and Speech Intonation: Singing a Different Tune , 2012, PLoS biology.

[5]  K. Higgins Biology and Culture in Musical Emotions , 2012 .

[6]  Zbigniew W. Ras,et al.  Advances in Music Information Retrieval , 2012, Advances in Music Information Retrieval.

[7]  D. Purves,et al.  Expression of Emotion in Eastern and Western Music Mirrors Vocalization , 2012, PloS one.

[8]  T. Eerola Are the Emotions Expressed in Music Genre-specific? An Audio-based Evaluation of Datasets Spanning Classical, Film, Pop and Mixed Genres , 2011 .

[9]  K. Scherer,et al.  In the eye of the beholder? Universality and cultural specificity in the expression and perception of emotion. , 2011, International journal of psychology : Journal international de psychologie.

[10]  Daniel J Levitin,et al.  Perception of emotional expression in musical performance. , 2011, Journal of experimental psychology. Human perception and performance.

[11]  Michael J. Lyons,et al.  Evidence and a computational explanation of cultural differences in facial expression recognition. , 2010, Emotion.

[12]  Ali C. Gedik,et al.  Pitch-frequency histogram-based music information retrieval for Turkish music , 2010, Signal Process..

[13]  D. Sauter,et al.  Cross-cultural recognition of basic emotions through nonverbal emotional vocalizations , 2010, Proceedings of the National Academy of Sciences.

[14]  B. Turetsky,et al.  “It's Not What You Say, But How You Say it”: A Reciprocal Temporo-frontal Network for Affective Prosody , 2009, Front. Hum. Neurosci..

[15]  Patrick C M Wong,et al.  Bimusicalism: The Implicit Dual Enculturation of Cognitive and Affective Systems. , 2009, Music perception.

[16]  Emiliana R. Simon-Thomas,et al.  The voice conveys specific emotions: evidence from vocal burst displays. , 2009, Emotion.

[17]  Sonja A. Kotz,et al.  Factors in the recognition of vocally expressed emotions: A comparison of four languages , 2009, J. Phonetics.

[18]  Soo-Jin Kwoun An examination of cue redundancy theory in cross-cultural decoding of emotions in music. , 2009, Journal of music therapy.

[19]  I. Peretz,et al.  Universal Recognition of Three Basic Emotions in Music , 2009, Current Biology.

[20]  Judith A. Hall,et al.  Accuracy of judging others' traits and states: Comparing mean levels across tests , 2008 .

[21]  Emilia Gómez,et al.  Comparative Analysis of Music Recordings from Western and Non-Western traditions by Automatic Tonal Feature Extraction , 2008 .

[22]  K. Scherer,et al.  Emotions evoked by the sound of music: characterization, classification, and measurement. , 2008, Emotion.

[23]  R. Case,et al.  VI. CROSS‐CULTURAL INVESTIGATIONS , 2008 .

[24]  I. Peretz,et al.  Happy, sad, scary and peaceful musical excerpts for research on emotions , 2008 .

[25]  I. Cross Musicality and the human capacity for culture , 2008 .

[26]  Aniruddh D. Patel Music, Language, and the Brain , 2007 .

[27]  Hillary Anger Elfenbein,et al.  Toward a dialect theory: cultural differences in the expression and recognition of posed facial expressions. , 2007, Emotion.

[28]  K. Higgins The Cognitive and Appreciative Import of Musical Universals , 2006, Revue internationale de philosophie.

[29]  D. Keltner,et al.  Touch communicates distinct emotions. , 2006, Emotion.

[30]  W. Thompson,et al.  Decoding speech prosody in five languages , 2006 .

[31]  S. Kotz,et al.  Beyond the right hemisphere: brain mechanisms mediating vocal emotional processing , 2006, Trends in Cognitive Sciences.

[32]  S. Trehub,et al.  Perceiving emotion in children's songs across age and culture1 , 2004 .

[33]  W. Thompson,et al.  Recognition of emotion in Japanese, Western, and Hindustani music by Japanese listeners 1 , 2004 .

[34]  P. Laukka,et al.  Expression, Perception, and Induction of Musical Emotions: A Review and a Questionnaire Study of Everyday Listening , 2004 .

[35]  P. Laukka,et al.  Instrumental music teachers' views on expressivity: a report from music conservatoires , 2004 .

[36]  George Ruckert Music in North India : experiencing music, expressing culture , 2003 .

[37]  M. Budd Music and the Emotions: The Philosophical Theories , 2002 .

[38]  Hillary Anger Elfenbein,et al.  On the universality and cultural specificity of emotion recognition: a meta-analysis. , 2002, Psychological bulletin.

[39]  Hillary Anger Elfenbein,et al.  Cross-cultural patterns in emotion recognition: highlighting design and analytical techniques. , 2002, Emotion.

[40]  Geoffrey L. Collier,et al.  Why Does Music Express Only Some Emotions? a Test of a Philosophical Theory , 2002 .

[41]  William Rothstein,et al.  Articles on Schenker and Schenkerian Theory in The New Grove Dictionary of Music and Musicians, 2nd Edition Edited by Stanley Sadie Executive Editor John Tyrrell New York: Grove's Dictionaries, 2001 Also Available Online (by Subscription) at , 2001 .

[42]  K. Scherer,et al.  Emotion Inferences from Vocal Expression Correlate Across Languages and Cultures , 2001 .

[43]  Patrik N. Juslin Cue utilization in communication of emotion in music performance: relating performance to perception. , 2000, Journal of experimental psychology. Human perception and performance.

[44]  Barbara Tillmann,et al.  Implicit learning of tonality: A self-organizing approach , 2000 .

[45]  W. Thompson,et al.  A Cross-Cultural Investigation of the Perception of Emotion in Music: Psychophysical and Cultural Cues , 1999 .

[46]  F. Tokunaga,et al.  In the eye , 1998 .

[47]  R. Walker Open Peer Commentary: Can We Understand the Music of another Culture? , 1996 .

[48]  P. Juslin,et al.  Emotional Expression in Music Performance: Between the Performer's Intention and the Listener's Experience , 1996 .

[49]  A. Gregory,et al.  Cross-Cultural Comparisons in the Affective Response to Music , 1996 .

[50]  E. Hoshino The Feeling of Musical Mode and its Emotional Character in a Melody , 1996 .

[51]  K. Scherer Expression of emotion in voice and music. , 1995, Journal of voice : official journal of the Voice Foundation.

[52]  R. Qureshi,et al.  The Voice of the Sarangi: An Illustrated History of Bowing in India , 1994 .

[53]  H. Wagner On measuring performance in category judgment studies of nonverbal behavior , 1993 .

[54]  P. Ekman An argument for basic emotions , 1992 .

[55]  A. Darrow,et al.  Descriptors and Preferences for Eastern and Western Musics by Japanese and American Nonmusic Majors , 1987 .

[56]  K. Scherer Vocal affect expression: a review and a model for future research. , 1986, Psychological bulletin.

[57]  M. Yarczower,et al.  Ethnic bias in the recognition of facial expressions , 1983 .

[58]  Charles Keil,et al.  Musical Meaning: A Preliminary Report (The Perception of Indian, Western, and Afro-American Musical Moods by American Students) , 1966 .

[59]  A. Merriam The anthropology of music , 1965 .

[60]  C. Palisca,et al.  A History of Western Music , 1960 .

[61]  E. Brunswik Perception and the Representative Design of Psychological Experiments , 1957 .

[62]  K. Hevner Experimental studies of the elements of expression in music , 1936 .

[63]  Stephen Davies,et al.  Cross‐Cultural Musical Expressiveness: Theory and the Empirical Programme , 2011 .

[64]  P. Juslin,et al.  Expression and communication of emotion in music performance. , 2010 .

[65]  Alicja Wieczorkowska,et al.  On Search for Emotion in Hindusthani Vocal Music , 2010, Advances in Music Information Retrieval.

[66]  W. Thompson,et al.  Cross-cultural similarities and differences , 2010 .

[67]  Petri Toiviainen,et al.  Prediction of Multidimensional Emotional Ratings in Music from Audio Using Multivariate Regression Models , 2009, ISMIR.

[68]  Kyriaki Zacharopoulou,et al.  A Cross-Cultural Comparative Study of the Role of Musical Structural Features in the Perception of Emotion in Greek Traditional Music , 2009 .

[69]  Steven M. Demorest,et al.  Cultural constraints on music perception and cognition. , 2009, Progress in brain research.

[70]  Petri Toiviainen,et al.  MIR in Matlab (II): A Toolbox for Musical Feature Extraction from Audio , 2007, ISMIR.

[71]  Justyna Humięcka-Jakubowska,et al.  Sweet Anticipation : Music and , 2006 .

[72]  Stephen Davies,et al.  Artistic Expression and the Hard Case of Pure Music , 2006 .

[73]  P. Juslin,et al.  Emotional expression in music. , 2003 .

[74]  M. Benamou Comparing musical affect: Java and the West , 2003 .

[75]  K. Scherer,et al.  Handbook of affective sciences. , 2003 .

[76]  P. Laukka,et al.  Communication of emotions in vocal expression and music performance: different channels, same code? , 2003, Psychological bulletin.

[77]  A. Gabrielsson,et al.  The influence of musical structure on emotional expression. , 2001 .

[78]  M. Frank,et al.  The forced-choice paradigm and the perception of facial expressions of emotion. , 2001, Journal of personality and social psychology.

[79]  William P. Malm,et al.  Traditional Japanese music and musical instruments , 2000 .

[80]  J. Russell Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. , 1994, Psychological bulletin.

[81]  B. Mesquita,et al.  Cultural variations in emotions: a review. , 1992, Psychological bulletin.

[82]  Josh H McDermott,et al.  Music Perception, Pitch, and the Auditory System This Review Comes from a Themed Issue on Sensory Systems Edited Pitch Relations across Time—relative Pitch Relative Pitch—behavioral Evidence Neural Mechanisms of Relative Pitch Representation of Simultaneous Pitches— Chords and Polyphony Summary and , 2022 .

[83]  Lisa Feldman Barrett,et al.  Emotion Words Shape Emotion Percepts , 2022 .