Music subject classification based on lyrics and user interpretations

That music seekers consider song subject metadata to be helpful in their searching/browsing experience has been noted in prior published research. In an effort to develop a subject‐based tagging system, we explored the creation of automatically generated song subject classifications. Our classifications were derived from two different sources of song‐related text: 1) lyrics; and 2) user interpretations of lyrics collected from songmeanings.com. While both sources contain subject‐related information, we found that user‐generated interpretations always outperformed lyrics in terms of classification accuracy. This suggests that user interpretations are more useful in the subject classification task than lyrics because the semantically ambiguous poetic nature of lyrics tends to confuse classifiers. An examination of top‐ranked terms and confusion matrices supported our contention that users' interpretations work better for detecting the meaning of songs than what is conveyed through lyrics.

[1]  J. Stephen Downie,et al.  What is this song about anyway?: Automatic classification of subject using user interpretations and lyrics , 2014, IEEE/ACM Joint Conference on Digital Libraries.

[2]  Peter Knees,et al.  Oh Oh Oh Whoah! Towards Automatic Topic Detection In Song Lyrics , 2008, ISMIR.

[3]  Daniel G. Brown,et al.  Are Poetry and Lyrics All That Different? , 2014, ISMIR.

[4]  Charu C. Aggarwal,et al.  A Survey of Text Classification Algorithms , 2012, Mining Text Data.

[5]  Mohan S. Kankanhalli,et al.  Multimodal fusion for multimedia analysis: a survey , 2010, Multimedia Systems.

[6]  Yi-Hsuan Yang,et al.  Machine Recognition of Music Emotion: A Review , 2012, TIST.

[7]  Jeffrey J. Scott,et al.  MUSIC EMOTION RECOGNITION: A STATE OF THE ART REVIEW , 2010 .

[8]  Andreas Rauber,et al.  Rhyme and Style Features for Musical Genre Classification by Song Lyrics , 2008, ISMIR.

[9]  Andreas F. Ehmann,et al.  Mining Music Reviews: Promising Preliminary Results , 2005, ISMIR.

[10]  Wolfgang Nejdl,et al.  Can all tags be used for search? , 2008, CIKM '08.

[11]  Mihai Surdeanu,et al.  The Stanford CoreNLP Natural Language Processing Toolkit , 2014, ACL.

[12]  Nicholas J. Belkin,et al.  Categories of Music Description and Search Terms and Phrases Used by Non-Music Experts , 2002, ISMIR.

[13]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[14]  Paris Smaragdis,et al.  Combining Musical and Cultural Features for Intelligent Style Detection , 2002, ISMIR.

[15]  Donald Byrd,et al.  Problems of music information retrieval in the real world , 2002, Inf. Process. Manag..

[16]  J. Stephen Downie,et al.  How People Describe Their Music Information Needs: A Grounded Theory Analysis Of Music Queries , 2003 .

[17]  Thierry Bertin-Mahieux,et al.  The Million Song Dataset , 2011, ISMIR.

[18]  Carole L. Palmer,et al.  Assessing Descriptive Substance in Free-Text Collection-Level Metadata , 2008, Dublin Core Conference.

[19]  J. Stephen Downie,et al.  A framework for evaluating multimodal music mood classification , 2017, J. Assoc. Inf. Sci. Technol..

[20]  Leonard B. Meyer Meaning in music and information theory. , 1957 .

[21]  György Fazekas,et al.  Music Emotion Recognition: From Content- to Context-Based Models , 2012, CMMR.

[22]  Wolfgang Nejdl,et al.  How do you feel about "dancing queen"?: deriving mood & theme annotations from user tags , 2009, JCDL '09.

[23]  Carole L. Palmer,et al.  Evaluating Descriptive Richness in Collection-Level Metadata , 2009 .

[24]  Jens Grivolla,et al.  Multimodal Music Mood Classification Using Audio and Lyrics , 2008, 2008 Seventh International Conference on Machine Learning and Applications.

[25]  J. Stephen Downie,et al.  Survey Of Music Information Needs, Uses, And Seeking Behaviours: Preliminary Findings , 2004, ISMIR.

[26]  J. Stephen Downie,et al.  Improving mood classification in music digital libraries by combining lyrics and audio , 2010, JCDL '10.

[27]  Markus Koppenberger,et al.  Natural language processing of lyrics , 2005, ACM Multimedia.