Sequential Recommendation Based on Long-Term and Short-Term User Behavior with Self-attention

Product recommenders based on users’ interests are becoming increasingly essential in e-commerce. With the continuous development of the recommendation system, the available information is further enriched. In the case, user’s click or purchase behavior could be a visual representation of his or her interest. Due to the rapid update of products, users’ interests are not static, but change over time. In order to cope with the users’ interest changes, we propose a desirable work on the basis of representative recommendation algorithm. The sequence of user interaction behavior is thoroughly utilized, and the items that users interact at different times have different significance for the reflect of users’ interests. By considering the user’s sequential behaviors, this paper focuses on the recent ones to obtains the real interest of user. In this process, user behavior is divided into long-term and short-term, modeled by LSTM and Attention-based model respectively for user’s next click recommendation. We refer this model as LANCR and analyze the model in experiment. The experiment demonstrates that the proposed model has superior improvement compared with standard approaches. We deploy our model on two real datasets to verify the superior performance made in predicting user preferences.

[1]  Julian J. McAuley,et al.  Self-Attentive Sequential Recommendation , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[2]  Jürgen Ziegler,et al.  Sequential User-based Recurrent Neural Network Recommendations , 2017, RecSys.

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  Jiajun Zhang,et al.  Learning Sentence Representation with Guidance of Human Attention , 2016, IJCAI.

[5]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[6]  Xing Xie,et al.  Session-based Recommendation with Graph Neural Networks , 2018, AAAI.

[7]  Philippe Preux,et al.  Recurrent Neural Networks for Long and Short-Term Sequential Recommendation , 2018, ArXiv.

[8]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[9]  David Heckerman,et al.  Empirical Analysis of Predictive Algorithms for Collaborative Filtering , 1998, UAI.

[10]  Alexandros Karatzoglou,et al.  Recurrent Neural Networks with Top-k Gains for Session-based Recommendations , 2017, CIKM.

[11]  Yong Liu,et al.  Improved Recurrent Neural Networks for Session-based Recommendations , 2016, DLRS@RecSys.

[12]  Duen-Ren Liu,et al.  A hybrid of sequential rules and collaborative filtering for product recommendation , 2009, Inf. Sci..

[13]  Enhong Chen,et al.  Learning from History and Present: Next-item Recommendation via Discriminatively Exploiting User Behaviors , 2018, KDD.

[14]  Chang Zhou,et al.  ATRank: An Attention-Based User Behavior Modeling Framework for Recommendation , 2017, AAAI.

[15]  Xiang Li,et al.  Perceive Your Users in Depth: Learning Universal User Representations from Multiple E-commerce Tasks , 2018, KDD.

[16]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[17]  Alexander J. Smola,et al.  Stacked Attention Networks for Image Question Answering , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Hui Chen,et al.  A Sequential Recommendation for Mobile Apps: What Will User Click Next App? , 2018, 2018 IEEE International Conference on Web Services (ICWS).

[19]  Sylvia Richardson,et al.  Markov Chain Monte Carlo in Practice , 1997 .

[20]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[21]  Ke Wang,et al.  Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding , 2018, WSDM.

[22]  Longbing Cao,et al.  Attention-Based Transactional Context Embedding for Next-Item Recommendation , 2018, AAAI.

[23]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.