Cochlea-based Features for Music Emotion Classification

Listening to music often evokes strong emotions. With the rapid growth of easily-accessible digital music libraries there is an increasing need in reliable music emotion recognition systems. Common musical features like tempo, mode, pitch, clarity, etc. which can be easily calculated from audio signal are associated with particular emotions and are often used in emotion detection systems. Based on the idea that humans don’t detect emotions from pure audio signal but from a signal that had been previously processed by the cochlea, in this work we propose new cochlear based features for music emotion recognition. Features are calculated from the gammatone filterbank model output and emotion classification is then performed using Support Vector Machine (SVM) and TreeBagger classifiers. Proposed features are evaluated on publicly available 1000 songs database and compared to other commonly used features. Results show that our approach is effective and outperforms other commonly used features. In the combined features set we achieved accuracy of 83.88% and 75.12% for arousal and valence.

[1]  O. Lartillot,et al.  A MATLAB TOOLBOX FOR MUSICAL FEATURE EXTRACTION FROM AUDIO , 2007 .

[2]  J. Russell A circumplex model of affect. , 1980 .

[3]  Junjie Bai,et al.  Dimensional music emotion recognition by valence-arousal regression , 2016, 2016 IEEE 15th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC).

[4]  Roy D. Patterson,et al.  In Auditory Physiology and Perception , 1992 .

[5]  Lie Lu,et al.  Automatic mood detection and tracking of music audio signals , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[6]  Vandana M. Ladwani,et al.  Classification of music into moods using musical features , 2016, 2016 International Conference on Inventive Computation Technologies (ICICT).

[7]  Yi-Hsuan Yang,et al.  Music emotion classification: a fuzzy approach , 2006, MM '06.

[8]  Vallabha Hampiholi A method for Music Classification Based On Perceived Mood Detection for Indian Bollywood Music , 2012 .

[9]  K. Hevner Experimental studies of the elements of expression in music , 1936 .

[10]  Jeffrey J. Scott,et al.  MUSIC EMOTION RECOGNITION: A STATE OF THE ART REVIEW , 2010 .

[11]  Brian R Glasberg,et al.  Derivation of auditory filter shapes from notched-noise data , 1990, Hearing Research.

[12]  Tanaya Guha,et al.  Novel affective features for multiscale prediction of emotion in music , 2016, 2016 IEEE 18th International Workshop on Multimedia Signal Processing (MMSP).

[13]  Pamela A. Wood,et al.  An algorithmic approach to music retrieval by emotion based on feature data , 2016, 2016 Future Technologies Conference (FTC).