Dual-regularized matrix factorization with deep neural networks for recommender systems

Abstract In recommender systems, many efforts have been made on utilizing textual information in matrix factorization to alleviate the problem of data sparsity. Recently, some of the works have explored neural networks to do an in-depth understanding of textual item content and achieved impressive effectiveness by generating more accurate item latent models. Nevertheless, there remains an open issue as how to effectively exploit description documents of both users and items in matrix factorization. In this paper, we proposed dual-regularized matrix factorization with deep neural networks (DRMF) to deal with this issue. DRMF adopts a multilayered neural network model by stacking convolutional neural network and gated recurrent neural network, to generate independent distributed representations of contents of users and items. Then, representations serve to regularize the generation of latent models both for users and items in matrix factorization. We propose the corresponding algorithm for learning all parameters in DRMF. Experimental results proved that the dual-way regularization strategy significantly improves the matrix factorization methods on the accuracy of rating prediction and the recall of top-n recommendations. Also, as the components of DRMF, the new neural network model works better than the single convolutional neural network model.

[1]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[2]  Ting Liu,et al.  Deep learning for sentiment analysis: successful approaches and future challenges , 2015, WIREs Data Mining Knowl. Discov..

[3]  Yi-Cheng Zhang,et al.  Solving the apparent diversity-accuracy dilemma of recommender systems , 2008, Proceedings of the National Academy of Sciences.

[4]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[5]  Lei Zheng,et al.  Joint Deep Modeling of Users and Items Using Reviews for Recommendation , 2017, WSDM.

[6]  Tara N. Sainath,et al.  Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[7]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[8]  Shunxiang Wu,et al.  Version-sensitive mobile App recommendation , 2017, Inf. Sci..

[9]  Wei Wang,et al.  Recommender system application developments: A survey , 2015, Decis. Support Syst..

[10]  Yi Zhang,et al.  Mixed Similarity Diffusion for Recommendation on Bipartite Networks , 2017, IEEE Access.

[11]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[12]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[13]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[14]  Ting Liu,et al.  Document Modeling with Gated Recurrent Neural Network for Sentiment Classification , 2015, EMNLP.

[15]  Sophie Ahrens,et al.  Recommender Systems , 2012 .

[16]  Quoc V. Le,et al.  Distributed Representations of Sentences and Documents , 2014, ICML.

[17]  Qian Zhang,et al.  A cross-domain recommender system with consistent information transfer , 2017, Decis. Support Syst..

[18]  Hao Wu,et al.  Content Embedding Regularized Matrix Factorization for Recommender Systems , 2017, 2017 IEEE International Congress on Big Data (BigData Congress).

[19]  Scott Sanner,et al.  AutoRec: Autoencoders Meet Collaborative Filtering , 2015, WWW.

[20]  Jian Gao,et al.  A vertex similarity index for better personalized recommendation , 2015, 1510.02348.

[21]  Roberto Turrin,et al.  Performance of recommender algorithms on top-n recommendation tasks , 2010, RecSys '10.

[22]  An Zeng,et al.  Long-Term Effects of Recommendation on the Evolution of Online Systems , 2013 .

[23]  Geoffrey E. Hinton,et al.  Restricted Boltzmann machines for collaborative filtering , 2007, ICML '07.

[24]  Julian J. McAuley,et al.  Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering , 2016, WWW.

[25]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[26]  Tao Zhou,et al.  Evaluating user reputation in online rating systems via an iterative group-based ranking method , 2015, ArXiv.

[27]  Jaana Kekäläinen,et al.  IR evaluation methods for retrieving highly relevant documents , 2000, SIGIR Forum.

[28]  Ximeng Wang,et al.  Diffusion-based recommendation with trust relations on tripartite graphs , 2017 .

[29]  Shunzhi Zhu,et al.  Embedding Factorization Models for Jointly Recommending Items and User Generated Lists , 2017, SIGIR.

[30]  Mingsheng Shang,et al.  Group-based ranking method for online rating systems with spamming attacks , 2015, ArXiv.

[31]  Jie Lu,et al.  Multirelational Social Recommendations via Multigraph Ranking , 2017, IEEE Transactions on Cybernetics.

[32]  Wei Wang,et al.  Member contribution-based group recommender system , 2016, Decis. Support Syst..

[33]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[34]  Shunxiang Wu,et al.  Cross-Platform App Recommendation by Jointly Modeling Ratings and Texts , 2017, ACM Trans. Inf. Syst..

[35]  Donghyun Kim,et al.  Convolutional Matrix Factorization for Document Context-Aware Recommendation , 2016, RecSys.

[36]  Chong Wang,et al.  Collaborative topic modeling for recommending scientific articles , 2011, KDD.

[37]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[38]  Li Chen,et al.  Evaluating recommender systems from the user’s perspective: survey of the state of the art , 2012, User Modeling and User-Adapted Interaction.

[39]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[40]  Hao Wu,et al.  Item recommendation in collaborative tagging systems via heuristic data fusion , 2015, Knowl. Based Syst..

[41]  Martin Ester,et al.  Collaborative Denoising Auto-Encoders for Top-N Recommender Systems , 2016, WSDM.

[42]  Xiaodong He,et al.  A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems , 2015, WWW.

[43]  Nicholas Jing Yuan,et al.  Collaborative Knowledge Base Embedding for Recommender Systems , 2016, KDD.

[44]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[45]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[46]  Li Chen,et al.  Recommender systems based on user reviews: the state of the art , 2015, User Modeling and User-Adapted Interaction.