Harvesting and Structuring Social Data in Music Information Retrieval

An exponentially growing amount of music and sound resources are being shared by communities of users on the Internet. Social media content can be found with different levels of structuring, and the contributing users might be experts or non-experts of the domain. Harvesting and structuring this information semantically would be very useful in context-aware Music Information Retrieval (MIR). Until now, scant research in this field has taken advantage of the use of formal knowledge representations in the process of structuring information. We propose a methodology that combines Social Media Mining, Knowledge Extraction and Natural Language Processing techniques, to extract meaningful context information from social data. By using the extracted information we aim to improve retrieval, discovery and annotation of music and sound resources. We define three different scenarios to test and develop our methodology.

[1]  Daniel P. W. Ellis,et al.  The Quest for Ground Truth in Musical Artist Similarity , 2002, ISMIR.

[2]  Xavier Serra,et al.  Exploiting Domain Knowledge in Music Information Research , 2013 .

[3]  Markus Schedl,et al.  Harvesting microblogs for contextual music similarity estimation: a co-occurrence-based framework , 2014, Multimedia Systems.

[4]  Peter Knees,et al.  A music information system automatically generated via Web content mining techniques , 2011, Inf. Process. Manag..

[5]  Peter Knees,et al.  A WEB-BASED APPROACH TO ASSESSING ARTIST SIMILARITY USING CO-OCCURRENCES , 2005 .

[6]  Xavier Serra,et al.  ANALYSIS OF THE FOLKSONOMY OF FREESOUND , 2012 .

[7]  Xavier Serra,et al.  Audio Clip Classification Using Social Tags and the Effect of Tag Expansion , 2014, Semantic Audio.

[8]  Enrico Motta,et al.  Bridging the gap between folksonomies and the semantic web: an experience report , 2007 .

[9]  Markus Schedl,et al.  Exploiting Social Media for Music Information Retrieval , 2013, Social Media Retrieval.

[10]  Alberto Córdoba,et al.  Ontology of Folksonomy: A New Modelling Method , 2007, SAAKM.

[11]  Xavier Serra,et al.  Folksonomy-based Tag Recommendation for Online Audio Clip Sharing , 2012, ISMIR.

[12]  David E. Millard,et al.  Automatic Ontology-Based Knowledge Extraction from Web Documents , 2003, IEEE Intell. Syst..

[13]  Xavier Serra,et al.  Characterization of the Freesound online community , 2012, 2012 3rd International Workshop on Cognitive Information Processing (CIP).

[14]  Atefeh Sharif Combining ontology and folksonomy: An Integrated Approach to Knowledge Representation , 2009 .

[15]  William W. Cohen,et al.  Web-collaborative filtering: recommending music by crawling the Web , 2000, Comput. Networks.

[16]  Mohamed Sordo Semantic annotation of music collections: A computational approach , 2012 .

[17]  Xavier Serra,et al.  Inferring Semantic Facets of a Music Folksonomy with Wikipedia , 2013 .

[18]  Markus Schedl,et al.  Location-Aware Music Artist Recommendation , 2014, MMM.

[19]  Xavier Serra,et al.  A METHOD FOR EXTRACTING SEMANTIC INFORMATION FROM ON-LINE ART MUSIC DISCUSSION FORUMS , 2012 .

[20]  Aldo Gangemi,et al.  A Comparison of Knowledge Extraction Tools for the Semantic Web , 2013, ESWC.

[21]  Peter Knees,et al.  Towards Semantic Music Information Extraction from the Web Using Rule Patterns and Supervised Learning , 2011 .

[22]  Steffen Lohmann,et al.  MUTO: the modular unified tagging ontology , 2011, I-Semantics '11.

[23]  György Fazekas,et al.  Automatic Ontology Generation for Musical Instruments Based on Audio Analysis , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[24]  Peter Mika Ontologies Are Us: A Unified Model of Social Networks and Semantics , 2005, International Semantic Web Conference.

[25]  Steve Lawrence,et al.  Inferring Descriptions and Similarity for Music from Community Metadata , 2002, ICMC.