Memory-aware gated factorization machine for top-N recommendation

Abstract Factorization machine (FM) has recently become one of the most popular methods in collaborative filtering due to its flexibility of incorporating auxiliary information, e.g., user demographics and item genres. However, standard FM method and its deep variants (e.g., NFM and DeepFM) suffer from two key issues: (1) failing to effectively leverage user historical records, i.e., all historical records are treated equally without considering the relevance to the targeted user–item pair and (2) failing to adaptively weigh the importance of auxiliary information, i.e., auxiliary information may have negative effects on the accuracy in certain cases but existing methods cannot effectively detect and eliminate the negative effects. To this end, this paper proposes a memory-aware gated factorization machine (MAGFM), which improves the FM method by introducing two new components: (1) an external user memory matrix is introduced to each user, which can enrich the representation capacity by leveraging user historical items and the auxiliary information associated with the historical items and (2) gated filtering units are applied on top of the embedding of user/item auxiliary information, which can adaptively filter out the features with negative effects to achieve higher accuracy. Experimental studies on real-world datasets demonstrate that MAGFM can substantially outperform FM, NFM and DeepFM methods by 0.31% – 12.77% relatively in top-N recommendation.

[1]  William W. Cohen,et al.  TransNets: Learning to Transform for Recommendation , 2017, RecSys.

[2]  Alexandros Karatzoglou,et al.  Recurrent Neural Networks with Top-k Gains for Session-based Recommendations , 2017, CIKM.

[3]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[4]  Sang-Wook Kim,et al.  Autoencoder-based personalized ranking framework unifying explicit and implicit feedback for accurate top-N recommendation , 2019, Knowl. Based Syst..

[5]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[6]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[7]  Matthew D. Hoffman,et al.  Variational Autoencoders for Collaborative Filtering , 2018, WWW.

[8]  Hamido Fujita,et al.  Low-rank local tangent space embedding for subspace clustering , 2020, Inf. Sci..

[9]  Yongfeng Zhang,et al.  Sequential Recommendation with User Memory Networks , 2018, WSDM.

[10]  Alex Beutel,et al.  Recurrent Recommender Networks , 2017, WSDM.

[11]  Jie Lu,et al.  Multirelational Social Recommendations via Multigraph Ranking , 2017, IEEE Transactions on Cybernetics.

[12]  Weinan Zhang,et al.  LambdaFM: Learning Optimal Ranking with Factorization Machines Using Lambda Surrogates , 2016, CIKM.

[13]  Harald Steck,et al.  Embarrassingly Shallow Autoencoders for Sparse Data , 2019, WWW.

[14]  Brian D. Davison,et al.  Co-factorization machines: modeling user interests and predicting individual decisions in Twitter , 2013, WSDM.

[15]  Bin Jiang,et al.  Gated and attentive neural collaborative filtering for user generated list recommendation , 2020, Knowl. Based Syst..

[16]  Naonori Ueda,et al.  Higher-Order Factorization Machines , 2016, NIPS.

[17]  Lars Schmidt-Thieme,et al.  Fast context-aware recommendations with factorization machines , 2011, SIGIR.

[18]  Giuseppe De Pietro,et al.  Hybrid query expansion using lexical resources and word embeddings for sentence retrieval in question answering , 2020, Inf. Sci..

[19]  Tat-Seng Chua,et al.  Neural Factorization Machines for Sparse Predictive Analytics , 2017, SIGIR.

[20]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[21]  Guangquan Zhang,et al.  A Cross-Domain Recommender System With Kernel-Induced Knowledge Transfer for Overlapping Entities , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Xin Wang,et al.  Compressed knowledge transfer via factorization machine for heterogeneous collaborative recommendation , 2015, Knowl. Based Syst..

[23]  Yoram Singer,et al.  Train faster, generalize better: Stability of stochastic gradient descent , 2015, ICML.

[24]  Chris Eliasmith,et al.  Hyperopt: a Python library for model selection and hyperparameter optimization , 2015 .

[25]  Yang Gao,et al.  Attributes coupling based matrix factorization for item recommendation , 2017, Applied Intelligence.

[26]  Bin Song,et al.  Adaptive graph regularized nonnegative matrix factorization for data representation , 2019, Applied Intelligence.

[27]  Siu Cheung Hui,et al.  Multi-Pointer Co-Attention Networks for Recommendation , 2018, KDD.

[28]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[29]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[30]  Jason Weston,et al.  Memory Networks , 2014, ICLR.

[31]  Lei Zheng,et al.  Joint Deep Modeling of Users and Items Using Reviews for Recommendation , 2017, WSDM.

[32]  Xu Chen,et al.  Joint Representation Learning for Top-N Recommendation with Heterogeneous Information Sources , 2017, CIKM.

[33]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[34]  Hui Xiong,et al.  Sequential Recommender System based on Hierarchical Attention Networks , 2018, IJCAI.

[35]  Lina Yao,et al.  Deep Learning Based Recommender System , 2017, ACM Comput. Surv..

[36]  Parham Moradi,et al.  A scalable and robust trust-based nonnegative matrix factorization recommender using the alternating direction method , 2019, Knowl. Based Syst..

[37]  Ling Chen,et al.  Weighted multi-information constrained matrix factorization for personalized travel location recommendation based on geo-tagged photos , 2020, Applied Intelligence.

[38]  Bin Shen,et al.  Collaborative Memory Network for Recommendation Systems , 2018, SIGIR.

[39]  Meng Wang,et al.  Adaptive local learning regularized nonnegative matrix factorization for data clustering , 2018, Applied Intelligence.

[40]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[42]  Yehuda Koren,et al.  Collaborative filtering with temporal dynamics , 2009, KDD.

[43]  Xiaoshuang Chen,et al.  RaFM: Rank-Aware Factorization Machines , 2019, ICML.

[44]  Chih-Jen Lin,et al.  Field-aware Factorization Machines for CTR Prediction , 2016, RecSys.

[45]  Tong Zhang,et al.  Gradient boosting factorization machines , 2014, RecSys '14.

[46]  Wei Liu,et al.  Mixture-Rank Matrix Approximation for Collaborative Filtering , 2017, NIPS.

[47]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[48]  Martha Larson,et al.  Cross-Domain Collaborative Filtering with Factorization Machines , 2014, ECIR.

[49]  Li Shang,et al.  AdaError: An Adaptive Learning Rate Method for Matrix Approximation-based Collaborative Filtering , 2018, WWW.

[50]  Martha Larson,et al.  Top-N Recommendation with Multi-Channel Positive Feedback using Factorization Machines , 2019, ACM Trans. Inf. Syst..

[51]  Shujian Huang,et al.  Deep Matrix Factorization Models for Recommender Systems , 2017, IJCAI.