Enhance popular music emotion regression by importing structure information

Emotion is a useful mean to organize music library, and automatic music emotion recognition is drawing more and more attention. Music structure information is imported to improve the result for music emotion regression. Music dataset with emotion and structure annotations is built, and features concerning lyrics, audio and midi are extracted. For each emotion dimension, regressors are built using different features on different type of segments in order to find the best segment for music emotion regression. Results show that structure information can help improve emotion regression. Verse is good for pleasure recognition, while chorus is good for arousal and dominance. The difference between verse and chorus can also help improve regressors.

[1]  Homer H. Chen,et al.  Music emotion recognition: the role of individuality , 2007, HCM '07.

[2]  Petri Toiviainen,et al.  MIR in Matlab (II): A Toolbox for Musical Feature Extraction from Audio , 2007, ISMIR.

[3]  Cory McKay,et al.  Automatic Genre Classification of MIDI Recordings , 2004 .

[4]  杨德顺,et al.  Music Emotion Regression Based on Multi-modal Features , 2012 .

[5]  Mohan S. Kankanhalli,et al.  Content-based music structure analysis with applications to music semantics understanding , 2004, MULTIMEDIA '04.

[6]  Yading Song,et al.  Evaluation of Musical Features for Emotion Classification , 2012, ISMIR.

[7]  M.D. Korhonen,et al.  Modeling emotional content of music using system identification , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Mert Bay,et al.  The 2007 MIREX Audio Mood Classification Task: Lessons Learned , 2008, ISMIR.

[9]  A. Mehrabian.  Framework for a comprehensive description and measurement of emotional states. , 1995, Genetic, social, and general psychology monographs.

[10]  Youngmoo E. Kim,et al.  Feature selection for content-based, time-varying musical emotion regression , 2010, MIR '10.

[11]  Yi-Hsuan Yang,et al.  Machine Recognition of Music Emotion: A Review , 2012, TIST.

[12]  Alessandro L. Koerich,et al.  Improving automatic music genre classification with hybrid content-based feature vectors , 2010, SAC '10.

[13]  Marc Leman,et al.  Prediction of Musical Affect Using a Combination of Acoustic Structural Cues , 2005 .

[14]  Yajie Hu,et al.  Lyric-based Song Emotion Detection with Affective Lexicon and Fuzzy Clustering Method , 2009, ISMIR.

[15]  Yi-Hsuan Yang,et al.  Cross-cultural Music Mood Classification: A Comparison on English and Chinese Songs , 2012, ISMIR.

[16]  Yi-Hsuan Yang,et al.  Multimodal structure segmentation and analysis of music using audio and textual information , 2009, 2009 IEEE International Symposium on Circuits and Systems.