User models for multi-context-aware music recommendation

In the last decade, music consumption has changed dramatically as humans have increasingly started to use music streaming platforms. While such platforms provide access to millions of songs, the sheer volume of choices available renders it hard for users to find songs they like. Consequently, the task of finding music the user likes is often mitigated by music recommender systems, which aim to provide recommendations that match the user’s current context. Particularly in the field of music recommendation, adapting recommendations to the user’s current context is critical as, throughout the day, users listen to different music in numerous different contexts and situations. Therefore, we propose a multi-context-aware user model and track recommender system that jointly exploit information about the current situation and musical preferences of users. Our proposed system clusters users based on their situational context features and similarly, clusters music tracks based on their content features. By conducting a series of offline experiments, we show that by relying on Factorization Machines for the computation of recommendations, the proposed multi-context-aware user model successfully leverages interaction effects between user listening histories, situational, and track content information, substantially outperforming a set of baseline recommender systems.

[1]  Shuang-Hong Yang,et al.  Dimensionality Reduction and Topic Modeling: From Latent Semantic Indexing to Latent Dirichlet Allocation and Beyond , 2012, Mining Text Data.

[2]  Sally Jo Cunningham,et al.  'More of an Art than a Science': Supporting the Creation of Playlists and Mixes , 2006, ISMIR.

[3]  Dietmar Jannach,et al.  Analyzing the Characteristics of Shared Playlists for Music Recommendation , 2014, RSWeb@RecSys.

[4]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[5]  Chih-Jen Lin,et al.  Field-aware Factorization Machines for CTR Prediction , 2016, RecSys.

[6]  Benjamin Schrauwen,et al.  Deep content-based music recommendation , 2013, NIPS.

[7]  Eva Zangerle,et al.  Improving Context-Aware Music Recommender Systems: Beyond the Pre-filtering Approach , 2017, ICMR.

[8]  Gang Wu,et al.  Digital content recommendation system using implicit feedback data , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[9]  Jin Ha Lee,et al.  A Look at the Cloud from Both Sides Now: An Analysis of Cloud Music Service Usage , 2016, ISMIR.

[10]  Francesco Ricci,et al.  Location-aware music recommendation using auto-tagging and hybrid matching , 2013, RecSys.

[11]  Gert R. G. Lanckriet,et al.  Learning Content Similarity for Music Recommendation , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[12]  Christophe Ley,et al.  Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median , 2013 .

[13]  Chong Wang,et al.  MusicSense: contextual music recommendation using emotional allocation modeling , 2007, ACM Multimedia.

[14]  Eva Zangerle,et al.  Culture-Aware Music Recommendation , 2018, UMAP.

[15]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[16]  Nicholas J. Belkin,et al.  Categories of Music Description and Search Terms and Phrases Used by Non-Music Experts , 2002, ISMIR.

[17]  Bernd Ludwig,et al.  InCarMusic: Context-Aware Music Recommendations in a Car , 2011, EC-Web.

[18]  Yi-Hsuan Yang,et al.  Music Recommendation Based on Multiple Contextual Similarity Information , 2013, 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT).

[19]  Robin Burke,et al.  Context-aware music recommendation based on latenttopic sequential patterns , 2012, RecSys.

[20]  Jesper Steen Andersen,et al.  Using the Echo Nest's automatically extracted music features for a musicological purpose , 2014, 2014 4th International Workshop on Cognitive Information Processing (CIP).

[21]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[22]  Gert R. G. Lanckriet,et al.  Hypergraph Models of Playlist Dialects , 2012, ISMIR.

[23]  Francesco Ricci,et al.  Contextual music information retrieval and recommendation: State of the art and challenges , 2012, Comput. Sci. Rev..

[24]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[25]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[26]  Torsten Möller,et al.  A Survey on Music Listening and Management Behaviours , 2012, ISMIR.

[27]  Alejandro Bellogín,et al.  Precision-oriented evaluation of recommender systems: an algorithmic comparison , 2011, RecSys '11.

[28]  Bernd Ludwig,et al.  Matrix factorization techniques for context aware recommendation , 2011, RecSys '11.

[29]  Dietmar Jannach,et al.  Beyond "Hitting the Hits": Generating Coherent Music Playlist Continuations with the Right Tracks , 2015, RecSys.

[30]  Markus Schedl,et al.  Feature-combination hybrid recommender systems for automated music playlist continuation , 2019, User Modeling and User-Adapted Interaction.

[31]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[32]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[33]  Lars Schmidt-Thieme,et al.  Pairwise interaction tensor factorization for personalized tag recommendation , 2010, WSDM '10.

[34]  Steffen Rendle,et al.  Factorization Machines with libFM , 2012, TIST.

[35]  Eva Zangerle,et al.  Understanding Playlist Creation on Music Streaming Platforms , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[36]  Yi-Hsuan Yang,et al.  Leveraging Affective Hashtags for Ranking Music Recommendations , 2018, IEEE Transactions on Affective Computing.

[37]  Mark P. Graus,et al.  Understanding choice overload in recommender systems , 2010, RecSys '10.

[38]  Derek Bridge,et al.  Diversity, Serendipity, Novelty, and Coverage , 2016, ACM Trans. Interact. Intell. Syst..

[39]  Kheir M. Al-Kodmany Preliminary Findings , 2020, The Urban Book Series.

[40]  J. Stephen Downie,et al.  Survey Of Music Information Needs, Uses, And Seeking Behaviours: Preliminary Findings , 2004, ISMIR.

[41]  Martijn Millecamp,et al.  Controlling Spotify Recommendations: Effects of Personal Characteristics on Music Recommender User Interfaces , 2018, UMAP.

[42]  Eva Zangerle,et al.  CONTENT-BASED USER MODELS: MODELING THE MANY FACES OF MUSICAL PREFERENCE , 2018 .

[43]  Tao Mei,et al.  Just-for-Me: An Adaptive Personalization System for Location-Aware Social Music Recommendation , 2014, ICMR.

[44]  Yehuda Koren,et al.  Collaborative filtering with temporal dynamics , 2009, KDD.

[45]  Katayoun Farrahi,et al.  User geospatial context for music recommendation in microblogs , 2014, SIGIR.

[46]  Ian T. Jolliffe,et al.  Principal Component Analysis , 1986, Springer Series in Statistics.

[47]  Eva Zangerle,et al.  Exploiting Twitter's Collective Knowledge for Music Recommendations , 2012, #MSM.

[48]  Gediminas Adomavicius,et al.  Context-aware recommender systems , 2008, ACM Conference on Recommender Systems.

[49]  Christoph Freudenthaler,et al.  Bayesian Factorization Machines , 2011 .

[50]  Eva Zangerle,et al.  Towards a Context-Aware Music Recommendation Approach: What is Hidden in the Playlist Name? , 2015, 2015 IEEE International Conference on Data Mining Workshop (ICDMW).

[51]  Eva Zangerle,et al.  Understanding User-Curated Playlists on Spotify: A Machine Learning Approach , 2017, Int. J. Multim. Data Eng. Manag..

[52]  Tijl De Bie,et al.  Mining the Correlation between Lyrical and Audio Features and the Emergence of Mood , 2011, ISMIR.

[53]  Naonori Ueda,et al.  Higher-Order Factorization Machines , 2016, NIPS.

[54]  Seungmin Rho,et al.  Music emotion classification and context-based music recommendation , 2010, Multimedia Tools and Applications.

[55]  M. Hitt The Long Tail: Why the Future of Business Is Selling Less of More , 2007 .

[56]  Jialie Shen,et al.  Just-for-Me: An Adaptive Personalization System for Location-Aware Social Music Recommendation , 2014, ICMR.

[57]  Chris Anderson,et al.  The Long Tail: Why the Future of Business is Selling Less of More , 2006 .

[58]  Gerhard Widmer,et al.  Playlist Generation using Start and End Songs , 2008, ISMIR.

[59]  Eva Zangerle,et al.  Latent Feature Combination for Multi-Context Music Recommendation , 2018, 2018 International Conference on Content-Based Multimedia Indexing (CBMI).