On Effective Personalized Music Retrieval by Exploring Online User Behaviors

In this paper, we study the problem of personalized text based music retrieval which takes users' music preferences on songs into account via the analysis of online listening behaviours and social tags. Towards the goal, a novel Dual-Layer Music Preference Topic Model (DL-MPTM) is proposed to construct latent music interest space and characterize the correlations among (user, song, term). Based on the DL-MPTM, we further develop an effective personalized music retrieval system. To evaluate the system's performance, extensive experimental studies have been conducted over two test collections to compare the proposed method with the state-of-the-art music retrieval methods. The results demonstrate that our proposed method significantly outperforms those approaches in terms of personalized search accuracy.

[1]  Vladimir Batagelj,et al.  Generalized Cores , 2002, ArXiv.

[2]  Lawrence K. Saul,et al.  A Variational Approximation for Topic Modeling of Hierarchical Corpora , 2013, ICML.

[3]  M. de Rijke,et al.  Personalized document re-ranking based on Bayesian probabilistic matrix factorization , 2014, SIGIR.

[4]  Trevor Darrell,et al.  Learning cross-modality similarity for multinomial data , 2011, 2011 International Conference on Computer Vision.

[5]  Peter Knees,et al.  Augmenting Text-based Music Retrieval with Audio Similarity: Advantages and Limitations , 2009, ISMIR.

[6]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[7]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[8]  Avery Wang,et al.  The Shazam music recognition service , 2006, CACM.

[9]  Keiichiro Hoashi,et al.  Personalization of user profiles for content-based music retrieval based on relevance feedback , 2003, ACM Multimedia.

[10]  Ryen W. White,et al.  Enhancing personalization via search activity attribution , 2014, SIGIR.

[11]  Jialie Shen,et al.  On Effective Location-Aware Music Recommendation , 2016, ACM Trans. Inf. Syst..

[12]  Òscar Celma,et al.  Music recommendation and discovery in the long tail , 2008 .

[13]  Thomas L. Griffiths,et al.  Hierarchical Topic Models and the Nested Chinese Restaurant Process , 2003, NIPS.

[14]  Mark Steyvers,et al.  Finding scientific topics , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[15]  Riccardo Miotto,et al.  A Probabilistic Model to Combine Tags and Acoustic Similarity for Music Retrieval , 2012, TOIS.

[16]  Robin Burke,et al.  Personalized Text-Based Music Retrieval , 2013 .

[17]  Beth Logan,et al.  Mel Frequency Cepstral Coefficients for Music Modeling , 2000, ISMIR.

[18]  Riccardo Miotto,et al.  A Generative Context Model for Semantic Music Annotation and Retrieval , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[19]  Michael I. Jordan,et al.  Modeling annotated data , 2003, SIGIR.

[20]  Nisheeth Shrivastava,et al.  Know your personalization: learning topic level personalization in online services , 2012, WWW.

[21]  Tao Mei,et al.  Just-for-Me: An Adaptive Personalization System for Location-Aware Social Music Recommendation , 2014, ICMR.

[22]  Joydeep Ghosh,et al.  A text retrieval approach to content-based audio retrieval , 2008 .

[23]  Panagiotis Symeonidis,et al.  Ternary Semantic Analysis of Social Tags for Personalized Music Recommendation , 2008, ISMIR.

[24]  Chong Wang,et al.  Nested Hierarchical Dirichlet Processes , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Meng Wang,et al.  Modeling concept dynamics for large scale music search , 2012, SIGIR '12.

[26]  Feng Niu,et al.  Million Song Dataset Challenge ! , 2012 .

[27]  Gert R. G. Lanckriet,et al.  Towards musical query-by-semantic-description using the CAL500 data set , 2007, SIGIR.

[28]  Òscar Celma,et al.  Music Recommendation and Discovery - The Long Tail, Long Fail, and Long Play in the Digital Music Space , 2010 .

[29]  Hsin-Min Wang,et al.  Colorizing tags in tag cloud: a novel query-by-tag music search system , 2011, ACM Multimedia.

[30]  Trevor Darrell,et al.  Factorized Multi-Modal Topic Model , 2012, UAI.

[31]  Gerard Salton,et al.  A vector space model for automatic indexing , 1975, CACM.

[32]  Mark B. Sandler,et al.  Music Information Retrieval Using Social Tags and Audio , 2009, IEEE Transactions on Multimedia.

[33]  Markus Schedl,et al.  Putting the User in the Center of Music Information Retrieval , 2012, ISMIR.

[34]  Hagai Attias,et al.  Topic regression multi-modal Latent Dirichlet Allocation for image annotation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[35]  David A. Forsyth,et al.  Matching Words and Pictures , 2003, J. Mach. Learn. Res..