Music Retrieval and Recommendation: A Tutorial Overview

In this tutorial, we give an introduction to the field of and state of the art in music information retrieval (MIR). The tutorial particularly spotlights the question of music similarity, which is an essential aspect in music retrieval and recommendation. Three factors play a central role in MIR research: (1) the music content, i.e., the audio signal itself, (2) the music context, i.e., metadata in the widest sense, and (3) the listeners and their contexts, manifested in user-music interaction traces. We review approaches that extract features from all three data sources and combinations thereof and show how these features can be used for (large-scale) music indexing, music description, music similarity measurement, and recommendation. These methods are further showcased in a number of popular music applications, such as automatic playlist generation and personalized radio stationing, location-aware music recommendation, music search engines, and intelligent browsing interfaces. Additionally, related topics such as music identification, automatic music accompaniment and score following, and search and retrieval in the music production domain are discussed.

[1]  Markus Schedl,et al.  Local and global scaling reduce hubs in space , 2012, J. Mach. Learn. Res..

[2]  Yuval Shavitt,et al.  Mining Music from Large-Scale, Peer-to-Peer Networks , 2011, IEEE MultiMedia.

[3]  Gert R. G. Lanckriet,et al.  Combining audio content and social context for semantic music discovery , 2009, SIGIR.

[4]  Andreas Rauber,et al.  Rhyme and Style Features for Musical Genre Classification by Song Lyrics , 2008, ISMIR.

[5]  Roger B. Dannenberg,et al.  TagATune: A Game for Music and Sound Annotation , 2007, ISMIR.

[6]  Daniel P. W. Ellis,et al.  Speech and Audio Signal Processing - Processing and Perception of Speech and Music, Second Edition , 1999 .

[7]  Steve Lawrence,et al.  Inferring Descriptions and Similarity for Music from Community Metadata , 2002, ICMC.

[8]  EN,et al.  DO YOU SOUND LIKE YOUR FRIENDS? EXPLORING ARTIST SIMILARITY VIA ARTIST SOCIAL NETWORK RELATIONSHIPS AND AUDIO SIGNAL PROCESSING , 2008 .

[9]  Peter Knees,et al.  A music search engine built upon audio-based and web-based similarity measures , 2007, SIGIR.

[10]  Gerhard Widmer,et al.  Towards Effective 'Any-Time' Music Tracking , 2010, STAIRS.

[11]  Markus Schedl,et al.  #nowplaying Madonna: a large-scale evaluation on estimating similarities between music artists and between movies from microblogs , 2012, Information Retrieval.

[12]  Beth Logan,et al.  Mel Frequency Cepstral Coefficients for Music Modeling , 2000, ISMIR.

[13]  Emilia Gómez,et al.  Melody Extraction From Polyphonic Music Signals Using Pitch Contour Characteristics , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[14]  Peter Knees,et al.  Towards Semantic Music Information Extraction from the Web Using Rule Patterns and Supervised Learning , 2011 .

[15]  Peter Knees,et al.  Automatic Music Tag Classification Based On Block-Level Features , 2010 .

[16]  Yehuda Koren,et al.  Yahoo! music recommendations: modeling music ratings with temporal dynamics and item taxonomy , 2011, RecSys '11.

[17]  Markus Schedl Leveraging Microblogs for Spatiotemporal Music Information Retrieval , 2013, ECIR.

[18]  Hendrik Purwins,et al.  Profiles of Pitch Classes - Circularity of Relative Pitch and Key: Experiments, Models, Music Analysis, and Perspectives , 2005 .

[19]  Paul Lamere,et al.  Social Tagging and Music Information Retrieval , 2008 .

[20]  Yuval Shavitt,et al.  Spotting out emerging artists using geo-aware analysis of P2P query strings , 2008, KDD.

[21]  Xavier Serra,et al.  Evaluation in Music Information Retrieval , 2013, Journal of Intelligent Information Systems.

[22]  Gerhard Widmer,et al.  Towards Characterisation of Music via Rhythmic Patterns , 2004, ISMIR.

[23]  J. Stephen Downie,et al.  The International Music Information Retrieval Systems Evaluation Laboratory: Governance, Access and Security , 2004, ISMIR.

[24]  Mark B. Sandler,et al.  A Semantic Space for Music Derived from Social Tags , 2007, ISMIR.

[25]  Markus Schedl,et al.  Music Information Retrieval: Recent Developments and Applications , 2014, Found. Trends Inf. Retr..

[26]  Nicola Orio,et al.  User-Aware Music Retrieval , 2012, Multimodal Music Processing.

[27]  Daniele Quercia,et al.  Auralist: introducing serendipity into music recommendation , 2012, WSDM '12.

[28]  Gert R. G. Lanckriet,et al.  Hypergraph Models of Playlist Dialects , 2012, ISMIR.

[29]  Markus Schedl,et al.  Iron Maiden While Jogging, Debussy for Dinner? - An Analysis of Music Listening Behavior in Context , 2015, MMM.

[30]  Òscar Celma,et al.  A new approach to evaluating novel recommendations , 2008, RecSys '08.

[31]  Markus Schedl,et al.  Minimal test collections for low-cost evaluation of Audio Music Similarity and Retrieval systems , 2012, International Journal of Multimedia Information Retrieval.

[32]  Peter Knees,et al.  Artist Classification with Web-Based Data , 2004, ISMIR.