Music Emotion Recognition Based on Chord Identification

As one of the most classic human inventions, music can be seen as another language, used to express the author’s thoughts and emotion. Music Emotion Recognition (MER) is an interesting research topic in artificial intelligence field for recognising emotions from music. The recognition methods and tools for music signals are growing fast recently. However the attentions are paid mainly on music signal feature extraction and machine learning methods. The theoretical knowledge of music on emotion is usually ignored. This paper propose a new method through important music units – chord to recognize emotion from music. We firstly build a new chord database with chord segments based on selected emotions. Then FFT and statistics (STAT) features are extracted from the music signals in the database. Then one-shot learning are used for chord identification and emotion recognition using Euclidean distance and correlation. The proposed method can recognise 6 emotions from music signals through chord identification with 76.6% accuracy of chord identification. This idea can be developed further using more advanced feature extraction and one-shot learning methods.

[1]  Jeffrey J. Scott,et al.  MUSIC EMOTION RECOGNITION: A STATE OF THE ART REVIEW , 2010 .

[2]  Alexander Lerch,et al.  Chord Detection Using Deep Learning , 2015, ISMIR.

[3]  Tomoko Matsui,et al.  Music Emotion Recognition using Gaussian Processes , 2013, MediaEval.

[4]  Carlos Busso,et al.  Analysis of Emotionally Salient Aspects of Fundamental Frequency for Emotion Detection , 2009, IEEE Transactions on Audio, Speech, and Language Processing.

[5]  Yi-Hsuan Yang,et al.  Automatic chord recognition for music classification and retrieval , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[6]  Nadia Bianchi-Berthouze,et al.  Naturalistic Affective Expression Classification by a Multi-stage Approach Based on Hidden Markov Models , 2011, ACII.

[7]  Li Han,et al.  Audio-based deep music emotion recognition , 2018 .

[8]  Fan Zhang,et al.  Emotion extraction and recognition from music , 2016, 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[9]  Thomas Pellegrini,et al.  Time-continuous Estimation of Emotion in Music with Recurrent Neural Networks , 2015, MediaEval.