LSTM Networks for Online Cross-Network Recommendations

Cross-network recommender systems use auxiliary information from multiple source networks to create holistic user profiles and improve recommendations in a target network. However, we find two major limitations in existing cross-network solutions that reduce overall recommender performance. Existing models (1) fail to capture complex non-linear relationships in user interactions, and (2) are designed for offline settings hence, not updated online with incoming interactions to capture the dynamics in the recommender environment. We propose a novel multi-layered Long Short-Term Memory (LSTM) network based online solution to mitigate these issues. The proposed model contains three main extensions to the standard LSTM: First, an attention gated mechanism to capture long-term user preference changes. Second, a higher order interaction layer to alleviate data sparsity. Third, time aware LSTM cell gates to capture irregular time intervals between user interactions. We illustrate our solution using auxiliary information from Twitter and Google Plus to improve recommendations on YouTube. Extensive experiments show that the proposed model consistently outperforms state-of-the-art in terms of accuracy, diversity and novelty.

[1]  Jia Li,et al.  Approximating Graph Pattern Queries Using Views , 2016, CIKM.

[2]  Mark Sanderson,et al.  Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval , 2012, SIGIR 2012.

[3]  Geoffrey E. Hinton,et al.  Restricted Boltzmann machines for collaborative filtering , 2007, ICML '07.

[4]  Tat-Seng Chua,et al.  Neural Factorization Machines for Sparse Predictive Analytics , 2017, SIGIR.

[5]  Stan Matwin,et al.  Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , 2017, KDD.

[6]  Tao Chen,et al.  #mytweet via Instagram: Exploring user behaviour across multiple social networks , 2015, 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[7]  Charu C. Aggarwal,et al.  Proceedings of the 24th ACM International on Conference on Information and Knowledge Management , 2015 .

[8]  Hervé Jégou,et al.  A Group Testing Framework for Similarity Search in High-dimensional Spaces , 2014, ACM Multimedia.

[9]  Kyung-Yong Chung,et al.  Item recommendation based on context-aware model for personalized u-healthcare service , 2011, Multimedia Tools and Applications.

[10]  Hongfei Yan,et al.  Comparing Twitter and Traditional Media Using Topic Models , 2011, ECIR.

[11]  Olha Buchel,et al.  Big Data: A Revolution That Will Transform How We Live, Work, and Think , 2015 .

[12]  Sheetal A. Takale,et al.  YouTube Video Recommendation via Cross-Network Collaboration , 2016 .

[13]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[14]  Hugues Bersini,et al.  Long and Short-Term Recommendations with Recurrent Neural Networks , 2017, UMAP.

[15]  Phil Blunsom,et al.  Reasoning about Entailment with Neural Attention , 2015, ICLR.

[16]  Proceedings of the 5th ACM on International Conference on Multimedia Retrieval , 2015, ICMR.

[17]  Xiaodong He,et al.  A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems , 2015, WWW.

[18]  Tat-Seng Chua,et al.  Fast Matrix Factorization for Online Recommendation with Implicit Feedback , 2016, SIGIR.

[19]  Yiannis Kompatsiaris,et al.  Proceedings of the 2016 ACM on Multimedia Conference , 2016, MM 2016.

[20]  Saint John Walker Big Data: A Revolution That Will Transform How We Live, Work, and Think , 2014 .

[21]  Chong-Wah Ngo,et al.  Proceedings of the 2017 ACM on International Conference on Multimedia Retrieval , 2017, ICMR.

[22]  Chengqi Zhang,et al.  Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , 2015, KDD.

[23]  Shujian Huang,et al.  Deep Matrix Factorization Models for Recommender Systems , 2017, IJCAI.

[24]  Dilruk Perera,et al.  Exploring the use of Time-Dependent Cross-Network Information for Personalized Recommendations , 2017, ACM Multimedia.

[25]  Zoubin Ghahramani,et al.  Proceedings of the 24th international conference on Machine learning , 2007, ICML 2007.

[26]  Lior Rokach,et al.  Proceedings of the 3rd Workshop on Deep Learning for Recommender Systems , 2016, DLRS.

[27]  Nicolas Kourtellis,et al.  Dynamic Matrix Factorization with Priors on Unknown Values , 2015, KDD.

[28]  Naonori Ueda,et al.  Polynomial Networks and Factorization Machines: New Insights and Efficient Training Algorithms , 2016, ICML.

[29]  Alan F. Smeaton,et al.  Proceedings of the 23rd ACM international conference on Multimedia , 2015, MM 2015.

[30]  Sheng Li,et al.  Deep Collaborative Filtering via Marginalized Denoising Auto-encoder , 2015, CIKM.

[31]  Marek R. Ogiela,et al.  Multimedia tools and applications , 2005, Multimedia Tools and Applications.

[32]  Noriko Kando,et al.  Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval , 2017, SIGIR.

[33]  Lars Grunske,et al.  Dimensions and Metrics for Evaluating Recommendation Systems , 2014, Recommendation Systems in Software Engineering.

[34]  Yong Liu,et al.  Improved Recurrent Neural Networks for Session-based Recommendations , 2016, DLRS@RecSys.

[35]  Marco Furini,et al.  International Journal of Computer and Applications , 2010 .

[36]  Fei Wang,et al.  Patient Subtyping via Time-Aware LSTM Networks , 2017, KDD.

[37]  Changsheng Xu,et al.  Unified YouTube Video Recommendation via Cross-network Collaboration , 2015, ICMR.

[38]  Deng Cai,et al.  What to Do Next: Modeling User Behaviors by Time-LSTM , 2017, IJCAI.

[39]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[40]  Gang Chen,et al.  Personal recommendation using deep recurrent neural networks in NetEase , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[41]  Tao Chen,et al.  TriRank: Review-aware Explainable Recommendation by Modeling Aspects , 2015, CIKM.

[42]  David Carmel,et al.  Query Expansion for Email Search , 2017, SIGIR.

[43]  Liang Zhang,et al.  The Definition of Novelty in Recommendation System , 2013 .