Nonindependent Session Recommendation Based on Ordinary Differential Equation

The recommendation method based on user sessions is mainly to model sessions as sequences in the assumption that user behaviors are independent and identically distributed, and then to use deep semantic information mining through Deep Neural Networks. Nevertheless, user behaviors may be a nonindependent intention at irregular points in time. For example, users may buy painkillers, books, or clothes for different reasons at different times. However, this has not been taken seriously in previous studies. Therefore, we propose a session recommendation method based on Neural Differential Equations in an attempt to predict user behavior forward or backward from any point in time. We used Ordinary Differential Equations to train the Graph Neural Network and could predict forward or backward at any point in time to model the user's nonindependent sessions. We tested for four real datasets and found that our model achieved the expected results and was superior to the existing session-based recommendations.

[1]  Andrew McCallum,et al.  Ask the GRU: Multi-task Learning for Deep Text Recommendations , 2016, RecSys.

[2]  Anders Nielsen,et al.  TMB: Automatic Differentiation and Laplace Approximation , 2015, 1509.00660.

[3]  Xavier Serra,et al.  Class-based tag recommendation and user-based evaluation in online audio clip sharing , 2014, Knowl. Based Syst..

[4]  Elena Smirnova,et al.  Contextual Sequence Modeling for Recommendation with Recurrent Neural Networks , 2017, DLRS@RecSys.

[5]  Yixin Cao,et al.  KGAT: Knowledge Graph Attention Network for Recommendation , 2019, KDD.

[6]  Zhaochun Ren,et al.  Neural Attentive Session-based Recommendation , 2017, CIKM.

[7]  Haibin Cheng,et al.  Real-time Personalization using Embeddings for Search Ranking at Airbnb , 2018, KDD.

[8]  Xianfa Song,et al.  The relationships between some types of partial differential equations and ordinary differential equations as well as their applications , 2018 .

[9]  Priyank Thakkar,et al.  Outcome Fusion-Based Approaches for User-Based and Item-Based Collaborative Filtering , 2017 .

[10]  Iryna Gurevych,et al.  Modeling Semantics with Gated Graph Neural Networks for Knowledge Base Question Answering , 2018, COLING.

[11]  Marcelo Lobosco,et al.  Mathematical modeling based on ordinary differential equations: A promising approach to vaccinology , 2017, Human vaccines & immunotherapeutics.

[12]  E. Blum,et al.  The Mathematical Theory of Optimal Processes. , 1963 .

[13]  Syed Tanveer Jishan,et al.  Audience Activity Recommendation Using Stacked-LSTM Based Sequence Learning , 2017, ICMLC.

[14]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[15]  Liang Wang,et al.  A Hierarchical Contextual Attention-based GRU Network for Sequential Recommendation , 2017, ArXiv.

[16]  Shalini Gupta,et al.  A Propound Hybrid Approach for Personalized Online Product Recommendations , 2018, Appl. Artif. Intell..

[17]  Boi Faltings,et al.  Context Tree for Adaptive Session-based Recommendation , 2018, ArXiv.

[18]  Gang Chen,et al.  Personal recommendation using deep recurrent neural networks in NetEase , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[19]  François Fouss,et al.  An experimental investigation of kernels on graphs for collaborative recommendation and semisupervised classification , 2012, Neural Networks.

[20]  Helge Langseth,et al.  Inter-Session Modeling for Session-Based Recommendation , 2017, DLRS@RecSys.

[21]  Surya Kant,et al.  Merging user and item based collaborative filtering to alleviate data sparsity , 2018, Int. J. Syst. Assur. Eng. Manag..

[22]  Dietmar Jannach,et al.  When Recurrent Neural Networks meet the Neighborhood for Session-Based Recommendation , 2017, RecSys.

[23]  Vladimir P. Gerdt,et al.  Algorithmic Verification of Linearizability for Ordinary Differential Equations , 2017, ISSAC.

[24]  Hasan Dag,et al.  Improving item-based recommendation accuracy with user's preferences on Apache Mahout , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[25]  A. Griewank,et al.  Verifying Jacobian sparsity , 2000 .

[26]  T. Coleman,et al.  The Efficient Application of Automatic Differentiation for Computing Gradients in Financial Applications , 2016 .

[27]  Andreas Griewank,et al.  Achieving logarithmic growth of temporal and spatial complexity in reverse automatic differentiation , 1992 .

[28]  Dik Lun Lee,et al.  Meta-Graph Based Recommendation Fusion over Heterogeneous Information Networks , 2017, KDD.

[29]  Yuan He,et al.  Graph Neural Networks for Social Recommendation , 2019, WWW.

[30]  Oren Barkan,et al.  ITEM2VEC: Neural item embedding for collaborative filtering , 2016, 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP).

[31]  Andreas S. Andreou,et al.  A Variational Latent Variable Model with Recurrent Temporal Dependencies for Session-Based Recommendation (VLaReT) , 2018 .

[32]  Xing Xie,et al.  Session-based Recommendation with Graph Neural Networks , 2018, AAAI.

[33]  Gholamreza Haffari,et al.  Graph-to-Sequence Learning using Gated Graph Neural Networks , 2018, ACL.

[34]  David Duvenaud,et al.  Neural Ordinary Differential Equations , 2018, NeurIPS.

[35]  Zhenglu Yang,et al.  Topic-STG: extending the session-based temporal graph approach for personalized tweet recommendation , 2014, WWW '14 Companion.

[36]  Fabio Stella,et al.  Towards a deep learning model for hybrid recommendation , 2017, WI.

[37]  Wei Xu,et al.  Solving nonlinear equations with the Newton–Krylov method based on automatic differentiation , 2014, Optim. Methods Softw..

[38]  Qian Qian,et al.  An recommendation algorithm based on weighted Slope one algorithm and user-based collaborative filtering , 2016, 2016 Chinese Control and Decision Conference (CCDC).

[39]  Dustin Tran,et al.  Automatic Differentiation Variational Inference , 2016, J. Mach. Learn. Res..

[40]  Yee Whye Teh,et al.  Augmented Neural ODEs , 2019, NeurIPS.

[41]  Joan Serrà,et al.  An empirical evaluation of similarity measures for time series classification , 2014, Knowl. Based Syst..