Heterogeneous Knowledge-Based Attentive Neural Networks for Short-Term Music Recommendations

The current existing data in online music service platforms are heterogeneous, extensive, and disorganized. Finding an effective method to use these data in recommending appropriate music to users during a short-term session is a significant challenge. Another serious problem is that most of the data, in reality, obey the long-tailed distribution, which consequently leads to traditional music recommendation systems recommending a lot of popular music that users do not like on a specific occasion. To solve these problems, we propose a heterogeneous knowledge-based attentive neural network model for short-term music recommendations. First, we collect three types of data for modeling entities in user–music interaction network, i.e., graphic, textual, and visual data, and then embed them into high-dimensional spaces using the TransR, distributed memory version of paragraph vector, and variational autoencoder methods, respectively. The concatenation of these embedding results is an abstract representation of the entity. Based on this, a recurrent neural network with an attention mechanism is built, which is capable of obtaining users’ preferences in the current session and consequently making recommendations. The experimental results show that our proposed approach outperforms the current state-of-the-art short-term music recommendation systems on one real-world dataset. In addition, it can also recommend more relatively unpopular songs compared with classic models.

[1]  Xiaozhong Liu,et al.  Automatic Feature Generation on Heterogeneous Graph for Music Recommendation , 2015, SIGIR.

[2]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[3]  Tsvi Kuflik,et al.  Incorporating Dwell Time in Session-Based Recommendations with Recurrent Neural Networks , 2017, RecTemp@RecSys.

[4]  David S. Rosenblum,et al.  Context-aware mobile music recommendation for daily activities , 2012, ACM Multimedia.

[5]  Benjamin Schrauwen,et al.  Deep content-based music recommendation , 2013, NIPS.

[6]  Ye Wang,et al.  Improving Content-based and Hybrid Music Recommendation using Deep Learning , 2014, ACM Multimedia.

[7]  HeJing,et al.  A Graph-based model for context-aware recommendation using implicit feedback data , 2015 .

[8]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[9]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[10]  Zhiyuan Liu,et al.  Learning Entity and Relation Embeddings for Knowledge Graph Completion , 2015, AAAI.

[11]  Guandong Xu,et al.  Sequence-based context-aware music recommendation , 2018, Information Retrieval Journal.

[12]  Alexandros Karatzoglou,et al.  Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networks , 2017, RecSys.

[13]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[14]  Dongfeng Yuan,et al.  Music recommendation based on embedding model with user preference and context , 2017, 2017 IEEE 2nd International Conference on Big Data Analysis (ICBDA)(.

[15]  Jinpeng Chen,et al.  Improving music recommendation by incorporating social influence , 2018, Multimedia Tools and Applications.

[16]  Ayush Singhal,et al.  Use of Deep Learning in Modern Recommendation System: A Summary of Recent Works , 2017, ArXiv.

[17]  Xiaozhong Liu,et al.  Dynamic feature generation and selection on heterogeneous graph for music recommendation , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[18]  Zhendong Niu,et al.  A hybrid knowledge-based recommender system for e-learning based on ontology and sequential pattern mining , 2017, Future Gener. Comput. Syst..

[19]  Yong Liu,et al.  Improved Recurrent Neural Networks for Session-based Recommendations , 2016, DLRS@RecSys.

[20]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[21]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[22]  Quoc V. Le,et al.  Distributed Representations of Sentences and Documents , 2014, ICML.

[23]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[24]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[25]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[26]  Qiuxia Li,et al.  Research of Music Recommendation System Based on User Behavior Analysis and Word2vec User Emotion Extraction , 2017 .

[27]  Guorui Zhou,et al.  Deep Interest Network for Click-Through Rate Prediction , 2017, KDD.

[28]  Francesco Ricci,et al.  Contextual music information retrieval and recommendation: State of the art and challenges , 2012, Comput. Sci. Rev..

[29]  Ricardo Dias,et al.  Improving Music Recommendation in Session-Based Collaborative Filtering by Using Temporal Context , 2013, 2013 IEEE 25th International Conference on Tools with Artificial Intelligence.

[30]  J. Stephen Downie,et al.  Survey Of Music Information Needs, Uses, And Seeking Behaviours: Preliminary Findings , 2004, ISMIR.

[31]  Zhendong Niu,et al.  A learner oriented learning recommendation approach based on mixed concept mapping and immune algorithm , 2016, Knowl. Based Syst..

[32]  Daan Wierstra,et al.  Stochastic Backpropagation and Approximate Inference in Deep Generative Models , 2014, ICML.

[33]  Vikram Pudi,et al.  Explicit Modelling of the Implicit Short Term User Preferences for Music Recommendation , 2018, ECIR.

[34]  Francesco Ricci,et al.  Location-aware music recommendation using auto-tagging and hybrid matching , 2013, RecSys.

[35]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[36]  Alexandros Karatzoglou,et al.  Parallel Recurrent Neural Network Architectures for Feature-rich Session-based Recommendations , 2016, RecSys.

[37]  Gert R. G. Lanckriet,et al.  Learning Content Similarity for Music Recommendation , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[38]  Jürgen Schmidhuber,et al.  Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction , 2011, ICANN.

[39]  Nicholas Jing Yuan,et al.  Collaborative Knowledge Base Embedding for Recommender Systems , 2016, KDD.

[40]  Thorsten Joachims,et al.  Playlist prediction via metric embedding , 2012, KDD.

[41]  Francesco Ricci,et al.  Recommending music for places of interest in a mobile travel guide , 2011, RecSys '11.

[42]  Xin Zhang,et al.  Learning to embed music and metadata for context-aware music recommendation , 2018, World Wide Web.

[43]  Derek Bridge,et al.  Diversity, Serendipity, Novelty, and Coverage , 2016, ACM Trans. Interact. Intell. Syst..

[44]  Yanchun Zhang,et al.  A Graph-based model for context-aware recommendation using implicit feedback data , 2015, World Wide Web.

[45]  Sung-Bae Cho,et al.  A Context-Aware Music Recommendation System Using Fuzzy Bayesian Networks with Utility Theory , 2006, FSKD.

[46]  Jia-Hao Wu,et al.  A personalized music recommendation system based on electroencephalography feedback , 2017, Multimedia Tools and Applications.

[47]  Yehuda Koren,et al.  Build your own music recommender by modeling internet radio streams , 2012, WWW.

[48]  Bernd Ludwig,et al.  InCarMusic: Context-Aware Music Recommendations in a Car , 2011, EC-Web.

[49]  Tao Mei,et al.  Just-for-Me: An Adaptive Personalization System for Location-Aware Social Music Recommendation , 2014, ICMR.

[50]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[51]  Guandong Xu,et al.  Music recommendation via heterogeneous information graph embedding , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[52]  Erik Duval,et al.  Context-Aware Recommender Systems for Learning: A Survey and Future Challenges , 2012, IEEE Transactions on Learning Technologies.