Music emotions recognition by cognitive classification methodologies

Music emotions recognition (MER) is a challenging field of studies addressed in multiple disciplines such as musicology, cognitive science, physiology, psychology, arts and affective computing. In this paper, music emotions are classified into four types known as those of pleasing, angry, sad and relaxing. MER is formulated as a classification problem in cognitive computing where 548 dimensions of music features are extracted and modeled. A comprehensive set of classification algorithms are explored and comparatively studied for MER including Support Vector Machine (SVM), k-Nearest Neighbors (KNN), Neuro-Fuzzy Networks Classification (NFNC), Fuzzy KNN (FKNN), Bayes classifier and Linear Discriminant Analysis (LDA). Experimental results show that the SVM, FKNN and LDA algorithms are the most effective methodologies which obtain more than 80% accuracy for MER in performance.

[1]  J. Russell.  A circumplex model of affect. , 1980 .

[2]  J. Sloboda,et al.  Music and emotion: Theory and research , 2001 .

[3]  Yi-Hsuan Yang,et al.  Music emotion classification: a fuzzy approach , 2006, MM '06.

[4]  Yingxu Wang,et al.  On the cognitive processes of human perception , 2005, Fourth IEEE Conference on Cognitive Informatics, 2005. (ICCI 2005)..

[5]  Petri Toiviainen,et al.  MIR in Matlab (II): A Toolbox for Musical Feature Extraction from Audio , 2007, ISMIR.

[6]  Grigorios Tsoumakas,et al.  Multi-Label Classification of Music into Emotions , 2008, ISMIR.

[7]  Jens Grivolla,et al.  Multimodal Music Mood Classification Using Audio and Lyrics , 2008, 2008 Seventh International Conference on Machine Learning and Applications.

[8]  Yi-Hsuan Yang,et al.  A Regression Approach to Music Emotion Recognition , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[9]  Björn Schuller,et al.  ‘Mister D.J., Cheer Me Up!’: Musical and Textual Features for Automatic Mood Classification , 2010 .

[10]  Dae-Won Kim,et al.  SYMMER: A Systematic Approach to Multiple Musical Emotion Recognition , 2011, Int. J. Fuzzy Log. Intell. Syst..

[11]  Neelam Sharma,et al.  INTRUSION DETECTION USING NAIVE BAYES CLASSIFIER WITH FEATURE REDUCTION , 2012 .

[12]  Yi-Hsuan Yang,et al.  The acoustic emotion gaussians model for emotion-based music annotation and retrieval , 2012, ACM Multimedia.

[13]  Yi-Hsuan Yang,et al.  1000 songs for emotional analysis of music , 2013, CrowdMM '13.

[14]  Gang Wang,et al.  An efficient diagnosis system for detection of Parkinson's disease using fuzzy k-nearest neighbor approach , 2013, Expert Syst. Appl..

[15]  Jee-Hyong Lee,et al.  An approach of genetic programming for music emotion classification , 2013 .

[16]  Chang-Hong Lin,et al.  Music emotion classification using double-layer support vector machines , 2013, 2013 1st International Conference on Orange Technologies (ICOT).

[17]  Saidatul Rahah Hamidi,et al.  Automatic Music Emotion Classification using Artificial Neural Network based on vocal and instrumental Sound Timbres , 2014, J. Comput. Sci..

[18]  Yi-Hsuan Yang,et al.  Emotional Analysis of Music: A Comparison of Methods , 2014, ACM Multimedia.

[19]  Chang-Hong Lin,et al.  Music Emotion Detection Using Hierarchical Sparse Kernel Machines , 2014, TheScientificWorldJournal.

[20]  S. Sorooshian,et al.  Watershed rainfall forecasting using neuro-fuzzy networks with the assimilation of multi-sensor information , 2014 .

[21]  Roberto de Alencar Lotufo,et al.  A comparison between k-Optimum Path Forest and k-Nearest Neighbors supervised classifiers , 2014, Pattern Recognit. Lett..

[22]  R. Vijayalakshmi,et al.  Music emotion recognition using support vector machines and regression approach , 2015 .

[23]  Hsin-Min Wang,et al.  A histogram density modeling approach to music emotion recognition , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Yingxu Wang.  On the Mathematical Theories and Cognitive Foundations of Information , 2015, Int. J. Cogn. Informatics Nat. Intell..

[25]  Jan Larsen,et al.  Learning Combinations of Multiple Feature Representations for Music Emotion Prediction , 2015, ASM@ACM Multimedia.

[26]  Yongli Deng,et al.  A regression approach to categorical music emotion recognition , 2015, 2015 IEEE International Conference on Progress in Informatics and Computing (PIC).

[27]  Yingxu Wang,et al.  Cognitive Learning Methodologies for Brain-Inspired Cognitive Robotics , 2015, Int. J. Cogn. Informatics Nat. Intell..

[28]  Junjie Bai,et al.  Dimensional music emotion recognition by valence-arousal regression , 2016, 2016 IEEE 15th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC).

[29]  Yingxu Wang,et al.  On Cognitive Foundations and Mathematical Theories of Knowledge Science , 2016, Int. J. Cogn. Informatics Nat. Intell..

[30]  Junjie Bai,et al.  Dimensional Music Emotion Recognition by Machine Learning , 2016, Int. J. Cogn. Informatics Nat. Intell..