On the Interrelation Between Listener Characteristics and the Perception of Emotions in Classical Orchestra Music

This study deals with the strong relationship between emotions and music, investigating three main research questions: (RQ1) Are there differences in human music perception (e.g., emotions, tempo, instrumentation, and complexity), according to musical education, experience, demographics, and personality traits?; (RQ2) Do certain perceived music characteristics correlate (e.g., tension and sadness), irrespective of a particular listener's background or personality?; (RQ3) Does human perception of music characteristics, such as emotions and tempo, correlate with descriptors extracted from music audio signals? To investigate our research questions, we conducted two user studies focusing on different groups of subjects. We used web-based surveys to collect information about demographics, listening habits, musical education, personality, and perceptual ratings with respect to perceived emotions, tempo, complexity, and instrumentation for 15 segments of Beethoven's 3rd symphony, “Eroica”. Our experiments showed that all three research questions can be affirmed, at least partly. We found strong support for RQ2 and RQ3, while RQ1 could be confirmed only for some perceptual aspects and user groups.

[1]  S. Srivastava,et al.  The Big Five Trait taxonomy: History, measurement, and theoretical perspectives. , 1999 .

[2]  K. Hevner Expression in music: a discussion of experimental studies and theories. , 1935 .

[3]  J. Sloboda,et al.  Music and emotion: Theory and research , 2001 .

[4]  S. Gosling,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES The Do Re Mi’s of Everyday Life: The Structure and Personality Correlates of Music Preferences , 2003 .

[5]  Alfred Pike A Phenomenological Analysis of Emotional Experience in Music , 1972 .

[6]  Yi-Hsuan Yang,et al.  Machine Recognition of Music Emotion: A Review , 2012, TIST.

[7]  Bruce Ferwerda,et al.  Fusing Social Media Cues: Personality Prediction from Twitter and Instagram , 2016, WWW.

[8]  T. Graepel,et al.  Private traits and attributes are predictable from digital records of human behavior , 2013, Proceedings of the National Academy of Sciences.

[9]  Perfecto Herrera,et al.  Automatic Detection of Emotion in Music: Interaction with Emotionally Sensitive Machines , 2018 .

[10]  Alessandro Vinciarelli,et al.  Automatic Personality Perception: Prediction of Trait Attribution Based on Prosodic Features , 2012, IEEE Transactions on Affective Computing.

[11]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[12]  E ARTICL,et al.  The content and validity of music-genre stereotypes among college students , 2008 .

[13]  John A. Johnson,et al.  The international personality item pool and the future of public-domain personality measures ☆ , 2006 .

[14]  Xavier Serra,et al.  ESSENTIA: an open source library for audio analysis , 2014 .

[15]  T. Eerola,et al.  A comparison of the discrete and dimensional models of emotion in music , 2011 .

[16]  Bruce Ferwerda,et al.  Personality Traits Predict Music Taxonomy Preferences , 2015, CHI Extended Abstracts.

[17]  James A. Russell,et al.  In defense of a prototype approach to emotion concepts. , 1991 .

[18]  Yi-Hsuan Yang,et al.  Ranking-Based Emotion Recognition for Music Organization and Retrieval , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[19]  Petri Toiviainen,et al.  Prediction of Multidimensional Emotional Ratings in Music from Audio Using Multivariate Regression Models , 2009, ISMIR.

[20]  Sergio Canazza,et al.  Clustering Affective Qualities of Classical Music: Beyond the Valence-Arousal Plane , 2014, IEEE Transactions on Affective Computing.

[21]  Alex Pentland,et al.  The role of personality in shaping social networks and mediating behavioral change , 2016, User Modeling and User-Adapted Interaction.

[22]  P. Ekman,et al.  Emotion in the Human Face: Guidelines for Research and an Integration of Findings , 1972 .

[23]  T. Dalgleish Basic Emotions , 2004 .

[24]  Andreas F. Ehmann,et al.  Lyric Text Mining in Music Mood Classification , 2009, ISMIR.

[25]  W. Thompson,et al.  A Cross-Cultural Investigation of the Perception of Emotion in Music: Psychophysical and Cultural Cues , 1999 .

[26]  Yajie Hu,et al.  Lyric-based Song Emotion Detection with Affective Lexicon and Fuzzy Clustering Method , 2009, ISMIR.

[27]  Adrian C. North,et al.  Why do we listen to music? A uses and gratifications analysis. , 2011, British journal of psychology.

[28]  R. McCrae,et al.  An introduction to the five-factor model and its applications. , 1992, Journal of personality.

[29]  Daniele Quercia,et al.  Our Twitter Profiles, Our Selves: Predicting Personality with Twitter , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.

[30]  J. Sloboda,et al.  Psychological perspectives on music and emotion , 2001 .

[31]  J. Stephen Downie,et al.  When Lyrics Outperform Audio for Music Mood Classification: A Feature Analysis , 2010, ISMIR.

[32]  Juan Pablo Bello,et al.  Automated Music Emotion Recognition: A Systematic Evaluation , 2010 .

[33]  I. Peretz,et al.  Universal Recognition of Three Basic Emotions in Music , 2009, Current Biology.

[34]  K. Scherer,et al.  Emotions evoked by the sound of music: characterization, classification, and measurement. , 2008, Emotion.

[35]  Lie Lu,et al.  Automatic mood detection from acoustic music data , 2003, ISMIR.

[36]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[37]  Bruce Ferwerda,et al.  Personality Correlates for Digital Concert Program Notes , 2015, UMAP.

[38]  Joan Serrà,et al.  Music Mood Representations from Social Tags , 2009, ISMIR.

[39]  A. Furnham,et al.  Personality and music: can traits explain how people use music in everyday life? , 2007, British journal of psychology.

[40]  M. Zentner,et al.  Mapping Aesthetic Musical Emotions in the Brain , 2011, Cerebral cortex.

[41]  S. Gosling,et al.  A very brief measure of the Big-Five personality domains , 2003 .

[42]  Tao Li,et al.  Detecting emotion in music , 2003, ISMIR.

[43]  Yading Song,et al.  Evaluation of Musical Features for Emotion Classification , 2012, ISMIR.

[44]  Alessandro Vinciarelli,et al.  A Survey of Personality Computing , 2014, IEEE Transactions on Affective Computing.

[45]  P. Laukka,et al.  Expression, Perception, and Induction of Musical Emotions: A Review and a Questionnaire Study of Everyday Listening , 2004 .

[46]  Marie-Francine Moens,et al.  Computational personality recognition in social media , 2016, User Modeling and User-Adapted Interaction.

[47]  Daniel J Levitin,et al.  The structure of musical preferences: a five-factor model. , 2011, Journal of personality and social psychology.

[48]  Jens Grivolla,et al.  Multimodal Music Mood Classification Using Audio and Lyrics , 2008, 2008 Seventh International Conference on Machine Learning and Applications.

[49]  Bruce Ferwerda,et al.  Personality & Emotional States: Understanding Users' Music Listening Needs , 2015, UMAP Workshops.

[50]  Emery Schubert Update of the Hevner Adjective Checklist , 2003, Perceptual and motor skills.

[51]  C. Laurier Automatic Classification of musical mood by content-based analysis , 2011 .

[52]  Mert Bay,et al.  The 2007 MIREX Audio Mood Classification Task: Lessons Learned , 2008, ISMIR.

[53]  P. Wilson,et al.  The Nature of Emotions , 2012 .

[54]  Jeffrey J. Scott,et al.  MUSIC EMOTION RECOGNITION: A STATE OF THE ART REVIEW , 2010 .