The PMEmo Dataset for Music Emotion Recognition

Music Emotion Recognition (MER) has recently received considerable attention. To support the MER research which requires large music content libraries, we present the PMEmo dataset containing emotion annotations of 794 songs as well as the simultaneous electrodermal activity (EDA) signals. A Music Emotion Experiment was well-designed for collecting the affective-annotated music corpus of high quality, which recruited 457 subjects. The dataset is publically available to the research community, which is foremost intended for benchmarking in music emotion retrieval and recognition. To straightforwardly evaluate the methodologies for music affective analysis, it also involves pre-computed audio feature sets. In addition to that, manually selected chorus excerpts (compressed in MP3) of songs are provided to facilitate the development of chorus-related research. In this article, We describe in detail the resource acquisition, subject selection, experiment design and annotation collection procedures, as well as the dataset content and data reliability analysis. We also illustrate its usage in some simple music emotion recognition tasks which testified the PMEmo dataset's competence for the MER work. Compared to other homogeneous datasets, PMEmo is novel in the organization and management of the recruited annotators, and it is also characterized by its large amount of music with simultaneous physiological signals.

[1]  Remco C. Veltkamp,et al.  Studying emotion induced by music through a crowdsourcing game , 2016, Inf. Process. Manag..

[2]  J. Russell,et al.  The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology , 2005, Development and Psychopathology.

[3]  Yi-Hsuan Yang,et al.  Machine Recognition of Music Emotion: A Review , 2012, TIST.

[4]  K. Scherer,et al.  On the Acoustics of Emotion in Audio: What Speech, Music, and Sound have in Common , 2013, Front. Psychol..

[5]  Emery Schubert,et al.  Reliability issues regarding the beginning, middle and end of continuous emotion ratings to music , 2013 .

[6]  Robert J. Zatorre,et al.  Familiarity mediates the relationship between emotional arousal and pleasure during music listening , 2013, Front. Hum. Neurosci..

[7]  Spyros Sioutas,et al.  The Greek Music Dataset , 2015, EANN '15.

[8]  J. Ramalho-Santos,et al.  Cronbach's alpha: a tool for assessing the reliability of scales , 1999 .

[9]  Fabio Valente,et al.  The INTERSPEECH 2013 computational paralinguistics challenge: social signals, conflict, emotion, autism , 2013, INTERSPEECH.

[10]  Björn W. Schuller,et al.  Recent developments in openSMILE, the munich open-source multimedia feature extractor , 2013, ACM Multimedia.

[11]  T. Eerola,et al.  A comparison of the discrete and dimensional models of emotion in music , 2011 .

[12]  Brandon G. Morton,et al.  A Comparative Study of Collaborative vs. Traditional Musical Mood Annotation , 2011, ISMIR.

[13]  Yi-Hsuan Yang,et al.  Developing a benchmark for emotional analysis of music , 2017, PloS one.

[14]  Steven C. Padgitt,et al.  Extension's Portfolio for the 21st Century: A Place for One-on-One Consultations , 1999 .

[15]  Yi-Hsuan Yang,et al.  1000 songs for emotional analysis of music , 2013, CrowdMM '13.

[16]  C. Dai,et al.  Effect of music on level of anxiety in patients undergoing colonoscopy without sedation , 2017, Journal of the Chinese Medical Association : JCMA.

[17]  Xinxing Li,et al.  SVR based double-scale regression for dynamic emotion prediction in music , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  Yi-Hsuan Yang,et al.  Cross-Dataset and Cross-Cultural Music Mood Prediction: A Case on Western and Chinese Pop Songs , 2017, IEEE Transactions on Affective Computing.

[19]  Yi-Hsuan Yang,et al.  Emotional Analysis of Music: A Comparison of Methods , 2014, ACM Multimedia.

[20]  Yi-Hsuan Yang,et al.  The AMG1608 dataset for music emotion recognition , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[21]  R. Weisberg A-N-D , 2011 .

[22]  K. Scherer,et al.  Emotions evoked by the sound of music: characterization, classification, and measurement. , 2008, Emotion.

[23]  Zhen Gao,et al.  Emotion Recognition from EEG Signals Enhanced by User's Profile , 2016, ICMR.

[24]  Zhen Gao,et al.  Emotion Recognition from EEG Signals using Hierarchical Bayesian Network with Privileged Information , 2015, ICMR.