Multi-Layer Graph Generative Model Using AutoEncoder for Recommendation Systems

Given the glut of information on the web, it is crucially important to have a system, which will parse the information appropriately and recommend users with relevant information, this class of systems is known as Recommendation Systems (RS)-it is one of the most extensively used systems on the web today. Recently, Deep Learning (DL) models are being used to generate recommendations, as it has shown state-of-the-art (SoTA) results in the field of Speech Recognition and Computer Vision in the last decade. However, the RS is a much harder problem, as the central variable in the recommendation system’s environment is the chaotic nature of the human’s purchasing/consuming behaviors and their interest. These user-item interactions cannot be fully represented in the EuclideanSpace, as it will trivialize the interaction and undermine the implicit interactions patterns. So to preserve the implicit as well as explicit interactions of user and items, we propose a new graph based recommendation framework. The fundamental idea behind this framework is not only to generate the recommendations in the unsupervised fashion but to learn the dynamics of the graph and predict the short and long term interest of the users. In this paper, we propose the first step, a heuristic multi-layer high-dimensional graph which preserves the implicit and explicit interactions between users and items using SoTA Deep Learning models such as AutoEncoders. To generate recommendation from this generated graph a new class of neural network architecture-Graph Neural Network-can be used.

[1]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[2]  Hsinchun Chen,et al.  Recommendation as link prediction in bipartite graphs: A graph kernel-based machine learning approach , 2013, Decis. Support Syst..

[3]  Wolfram Wöß,et al.  Towards a Definition of Knowledge Graphs , 2016, SEMANTiCS.

[4]  Lingling Zhang,et al.  Heterogeneous Network Linkage-weight Based Link Prediction in Bipartite Graph for Personalized Recommendation , 2016 .

[5]  CARLOS A. GOMEZ-URIBE,et al.  The Netflix Recommender System , 2015, ACM Trans. Manag. Inf. Syst..

[6]  Florian Strub,et al.  Collaborative Filtering with Stacked Denoising AutoEncoders and Sparse Inputs , 2015, NIPS 2015.

[7]  Masaru Kitsuregawa,et al.  A Graph Based Approach to Extract a Neighborhood Customer Community for Collaborative Filtering , 2002, DNIS.

[8]  Scott Sanner,et al.  AutoRec: Autoencoders Meet Collaborative Filtering , 2015, WWW.

[9]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[10]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[11]  Lina Yao,et al.  Next Item Recommendation with Self-Attention , 2018, ArXiv.

[12]  Yu He,et al.  The YouTube video recommendation system , 2010, RecSys '10.

[13]  Xiaodong Liu,et al.  SMK-means: An Improved Mini Batch K-means Algorithm Based on Mapreduce with Big Data , 2018 .

[14]  Jure Leskovec,et al.  Pixie: A System for Recommending 3+ Billion Items to 200+ Million Users in Real-Time , 2017, WWW.

[15]  Lina Yao,et al.  Deep Learning Based Recommender System , 2017, ACM Comput. Surv..

[16]  Jure Leskovec,et al.  Modeling polypharmacy side effects with graph convolutional networks , 2018, bioRxiv.

[17]  Xin Dong,et al.  Challenges and Innovations in Building a Product Knowledge Graph , 2018, KDD.

[18]  Martin Ester,et al.  Collaborative Denoising Auto-Encoders for Top-N Recommender Systems , 2016, WSDM.

[19]  Florian Strub,et al.  Hybrid Recommender System based on Autoencoders , 2018 .

[20]  Yehuda Koren,et al.  Collaborative filtering with temporal dynamics , 2009, KDD.

[21]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[22]  Xiangnan He,et al.  NAIS: Neural Attentive Item Similarity Model for Recommendation , 2018, IEEE Transactions on Knowledge and Data Engineering.