Studying emotion induced by music through a crowdsourcing game

We collected ground-truth data on induced musical emotion for 400 musical excerpts.We designed an online game with a purpose to attract a big number of participants.We analyzed inter-rater agreement on emotional terms from GEMS model.We found that mood, gender and liking or disliking the music influence induced emotion.We suggested improvements to GEMS scale. One of the major reasons why people find music so enjoyable is its emotional impact. Creating emotion-based playlists is a natural way of organizing music. The usability of online music streaming services could be greatly improved by developing emotion-based access methods, and automatic music emotion recognition (MER) is the most quick and feasible way of achieving it. When resorting to music for emotional regulation purposes, users are interested in the MER method to predict their induced, or felt emotion. The progress of MER in this area is impeded by the absence of publicly accessible ground-truth data on musically induced emotion. Also, there is no consensus on the question which emotional model best fits the demands of the users and can provide an unambiguous linguistic framework to describe musical emotions. In this paper we address these problems by creating a sizeable publicly available dataset of 400 musical excerpts from four genres annotated with induced emotion. We collected the data using an online "game with a purpose" Emotify, which attracted a big and varied sample of participants. We employed a nine item domain-specific emotional model GEMS (Geneva Emotional Music Scale). In this paper we analyze the collected data and report agreement of participants on different categories of GEMS. We also analyze influence of extra-musical factors on induced emotion (gender, mood, music preferences). We suggest that modifications in GEMS model are necessary.

[1]  Remco C. Veltkamp,et al.  Designing Games with a Purpose for Data Collection in Music Research. Emotify and Hooked: Two Case Studies , 2013, GALA.

[2]  W. Thompson,et al.  A Comparison of Acoustic Cues in Music and Speech for Three Dimensions of Affect , 2006 .

[3]  Tuomas Eerola,et al.  DOMAIN-SPECIFIC OR NOT? THE APPLICABILITY OF DIFFERENT EMOTION MODELS IN THE ASSESSMENT OF MUSIC-INDUCED EMOTIONS , 2008 .

[4]  Ulrich Schimmack,et al.  Mixed affective responses to music with conflicting cues , 2008 .

[5]  D. Västfjäll,et al.  An experience sampling study of emotional reactions to music: listener, music, and situation. , 2008, Emotion.

[6]  Mircea Miclea,et al.  Emotions induced by operatic music: Psychophysiological effects of music, plot, and acting A scientist’s tribute to Maria Callas , 2011, Brain and Cognition.

[7]  P. Laukka,et al.  Expression, Perception, and Induction of Musical Emotions: A Review and a Questionnaire Study of Everyday Listening , 2004 .

[8]  A. Gabrielsson.  Emotion perceived and emotion felt: Same or different? , 2001 .

[9]  Remco C. Veltkamp,et al.  Computational Modeling of Induced Emotion Using GEMS , 2014, ISMIR.

[10]  J. Marozeau,et al.  Multidimensional scaling of emotional responses to music: The effect of musical expertise and of the duration of the excerpts , 2005 .

[11]  Towards a Brief Domain-specific Self-report Scale for the Rapid Assessment of Musically Induced Emotions , 2012 .

[12]  Alf Gabrielsson,et al.  Strong experiences with music : Music is much more than just music , 2011 .

[13]  C. Krumhansl.  An exploratory study of musical emotions and psychophysiology. , 1997, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[14]  K. Scherer.  Which Emotions Can be Induced by Music? What Are the Underlying Mechanisms? And How Can We Measure Them? , 2004 .

[15]  Didier Grandjean,et al.  Towards a Dynamic Approach to the Study of Emotions Expressed by Music , 2011, INTETAIN.

[16]  Nicola Dibben,et al.  The Role of Peripheral Feedback in Emotional Experience With Music , 2004 .

[17]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[18]  Roger B. Dannenberg,et al.  TagATune: A Game for Music and Sound Annotation , 2007, ISMIR.

[19]  Emery Schubert.  The influence of emotion, locus of emotion and familiarity upon preference in music , 2007 .

[20]  K. Scherer,et al.  Emotions evoked by the sound of music: characterization, classification, and measurement. , 2008, Emotion.

[21]  Mert Bay,et al.  The 2007 MIREX Audio Mood Classification Task: Lessons Learned , 2008, ISMIR.

[22]  J. Simons,et al.  An experience sampling study of PTSD and alcohol-related problems. , 2014, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[23]  Influence of Musical Context on the Perception of Emotional Expression of Music , 2013 .

[24]  Tuomas Eerola,et al.  A Review of Music and Emotion Studies: Approaches, Emotion Models, and Stimuli , 2013 .

[25]  N. Rickard.  Intense emotional responses to music: a test of the physiological arousal hypothesis , 2004 .

[26]  G. L. Collier.  Beyond valence and activity in the emotional connotations of music , 2007 .

[27]  Yi-Hsuan Yang,et al.  Machine Recognition of Music Emotion: A Review , 2012, TIST.

[28]  Daniel P. W. Ellis,et al.  Please Scroll down for Article Journal of New Music Research a Web-based Game for Collecting Music Metadata a Web-based Game for Collecting Music Metadata , 2022 .

[29]  K. Hevner.  Experimental studies of the elements of expression in music , 1936 .

[30]  J. Russell.  A circumplex model of affect. , 1980 .

[31]  Frank A. Russo,et al.  Seeing music performance: Visual influences on perception and experience , 2005 .

[32]  Youngmoo E. Kim,et al.  MoodSwings: A Collaborative Game for Music Mood Label Collection , 2008, ISMIR.

[33]  Javier Jaimovich,et al.  Emotion in Motion: A Study of Music and Affective Response , 2012, CMMR.

[34]  J. Sloboda,et al.  Handbook of Music and Emotion: Theory, Research, Applications , 2011 .

[35]  L. Wedin,et al.  A multidimensional study of perceptual-emotional qualities in music. , 1972, Scandinavian journal of psychology.