Interactive Musical Songs Recommendation Using 3D Coordinates Model

Listening to suitable music is important as different types of music have different impacts on the listener's mood. Similarly, color has the capability of influencing one's mood and choice of music as well. The relationship between color and music, color and mood, and mood and music can be established. However, up until now, the three items have been mostly represented as two dimensional (2D) model. In order to link all the three elements together, i.e. color-mood-music, multimodals are required to represent them. In this paper, a three dimensional (3D) model is proposed that integrates these three elements together for music recommendation. Questionnaires were developed and posted onto social media such as Facebook and Whatsapp. Analysis of results revealed that the relationship between color-mood and mood-color, color-music and music-color, and mood-music and music-mood were inconsistent, interestingly, it was found that there was association between specific color to specific mood and specific musical genres. This is useful as it helps to retrieve musical genre using a single model rather than multimodal.

[1]  Kai R Fricke,et al.  Personality and self-reported preference for music genres and attributes in a German-speaking sample , 2017 .

[2]  Robert L. Mason,et al.  Statistical Principles in Experimental Design , 2003 .

[3]  Sevinc Kurt,et al.  The Effects of Color on the Moods of College Students , 2014 .

[4]  Karen B. Schloss,et al.  Music–color associations are mediated by emotion , 2013, Proceedings of the National Academy of Sciences.

[5]  Nawaz Ahmad,et al.  Impact of Music on Mood: Empirical Investigation , 2015 .

[6]  Yi Hu,et al.  An Improved Three-Dimensional Model for Emotion Based on Fuzzy Theory , 2018 .

[7]  B. J. Winer.  Statistical Principles in Experimental Design , 1992 .

[8]  Maurizio Morisio,et al.  MoodyLyrics: A Sentiment Annotated Lyrics Dataset , 2017, ISMSI '17.

[9]  N. Tarrier,et al.  The Manchester Color Wheel: development of a novel way of identifying color choice and its validation in healthy, anxious and depressed individuals , 2010, BMC medical research methodology.

[10]  G. Jiang,et al.  Probe into Color Preference in Inpatients with Depressive Disorders , 2017 .

[11]  J. Russell.  A circumplex model of affect. , 1980 .

[12]  Mario De Bortoli,et al.  Colours Across Cultures : Translating Colours in Interactive Marketing Communications , 2008 .

[13]  J. Russell,et al.  Evidence for a three-factor theory of emotions , 1977 .

[14]  John O'Donovan,et al.  Moodplay: Interactive music recommendation based on Artists' mood similarity , 2019, Int. J. Hum. Comput. Stud..

[15]  M. Marolt,et al.  The Moodo dataset: Integrating user context with emotional and color perception of music for affective music information retrieval , 2017 .

[16]  Chang Bae Moon,et al.  Analysis of relationships between mood and color for different musical preferences , 2014 .

[17]  Asir Ajmal,et al.  Effect of Classical and Pop Music on Mood and Performance , 2017 .

[18]  J. Russell,et al.  The Basic Emotional Impact of Environments , 1974, Perceptual and motor skills.

[19]  Karen B. Schloss,et al.  Music-to-Color Associations of Single-Line Piano Melodies in Non-synesthetes. , 2016, Multisensory research.

[20]  Erin S. Isbilen,et al.  The Color of Music: Emotion-Mediated Associations to Bach's Well-Tempered Clavier , 2016 .

[21]  A. B. Eckerson,et al.  Studies In Synesthetic Thinking: I. Musical and Verbal Associations of Color and Mood , 1942 .

[22]  Xavier Serra,et al.  Multimodal Deep Learning for Music Genre Classification , 2018, Trans. Int. Soc. Music. Inf. Retr..

[23]  Wang Kai,et al.  A Robot Emotion Generation Mechanism Based on PAD Emotion Space , 2008, Intelligent Information Processing.

[24]  Thomas F. Liu,et al.  Learning Design Semantics for Mobile Apps , 2018, UIST.