Recommender Systems Based on Generative Adversarial Networks: A Problem-Driven Perspective

Recommender systems (RSs) now play a very important role in the online lives of people as they serve as personalized filters for users to find relevant items from an array of options. Owing to their effectiveness, RSs have been widely employed in consumer-oriented e-commerce platforms. However, despite their empirical successes, these systems still suffer from two limitations: data noise and data sparsity. In recent years, generative adversarial networks (GANs) have garnered increased interest in many fields, owing to their strong capacity to learn complex real data distributions; their abilities to enhance RSs by tackling the challenges these systems exhibit have also been demonstrated in numerous studies. In general, two lines of research have been conducted, and their common ideas can be summarized as follows: (1) for the data noise issue, adversarial perturbations and adversarial sampling-based training often serve as a solution; (2) for the data sparsity issue, data augmentation--implemented by capturing the distribution of real data under the minimax framework--is the primary coping strategy. To gain a comprehensive understanding of these research efforts, we review the corresponding studies and models, organizing them from a problem-driven perspective. More specifically, we propose a taxonomy of these models, along with their detailed descriptions and advantages. Finally, we elaborate on several open issues and current trends in GAN-based RSs.

[1]  Minyi Guo,et al.  GraphGAN: Graph Representation Learning with Generative Adversarial Nets , 2017, AAAI.

[2]  Xiangnan He,et al.  Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention , 2017, SIGIR.

[3]  Huan Liu,et al.  Exploiting Multilabel Information for Noise-Resilient Feature Selection , 2018, ACM Trans. Intell. Syst. Technol..

[4]  Cheng Wang,et al.  RecSys-DAN: Discriminative Adversarial Networks for Cross-Domain Recommender Systems , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Julian J. McAuley,et al.  VBPR: Visual Bayesian Personalized Ranking from Implicit Feedback , 2015, AAAI.

[6]  Lei Zheng,et al.  Joint Deep Modeling of Users and Items Using Reviews for Recommendation , 2017, WSDM.

[7]  Léon Bottou,et al.  Towards Principled Methods for Training Generative Adversarial Networks , 2017, ICLR.

[8]  Jiancheng Lv,et al.  BFGAN: Backward and Forward Generative Adversarial Networks for Lexically Constrained Sentence Generation , 2018, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[9]  Tyler Baldwin,et al.  Autonomous Self-Assessment of Autocorrections: Exploring Text Message Dialogues , 2012, NAACL.

[10]  Peng Zhang,et al.  UD-HMM: An unsupervised method for shilling attack detection based on hidden Markov model and hierarchical clustering , 2018, Knowl. Based Syst..

[11]  Quoc Viet Hung Nguyen,et al.  Enhancing Collaborative Filtering with Generative Augmentation , 2019, KDD.

[12]  Jie Nie,et al.  HGAN: Holistic Generative Adversarial Networks for Two-dimensional Image-based Three-dimensional Object Retrieval , 2020, ACM Trans. Multim. Comput. Commun. Appl..

[13]  Léon Bottou,et al.  Wasserstein Generative Adversarial Networks , 2017, ICML.

[14]  Wei Wang,et al.  A Knowledge-Enhanced Deep Recommendation Framework Incorporating GAN-Based Models , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[15]  Rob Fergus,et al.  Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks , 2015, NIPS.

[16]  Tat-Seng Chua,et al.  Item Silk Road: Recommending Items from Information Domains to Social Users , 2017, SIGIR.

[17]  Yizhou Sun,et al.  On Sampling Strategies for Neural Network-based Collaborative Filtering , 2017, KDD.

[18]  Luis Martínez,et al.  Natural Noise Management in Recommender Systems Using Fuzzy Tools , 2020, Computational Intelligence for Semantic Knowledge Management.

[19]  Jung-Woo Ha,et al.  Energy-Based Sequence GANs for Recommendation and Their Connection to Imitation Learning , 2017, ArXiv.

[20]  Peng Cui,et al.  Collaborative Generative Adversarial Network for Recommendation Systems , 2019, 2019 IEEE 35th International Conference on Data Engineering Workshops (ICDEW).

[21]  Bin Wu,et al.  APL: Adversarial Pairwise Learning for Recommender Systems , 2019, Expert Syst. Appl..

[22]  Tat-Seng Chua,et al.  Neural Factorization Machines for Sparse Predictive Analytics , 2017, SIGIR.

[23]  Xianwen Yu,et al.  VAEGAN: A Collaborative Filtering Framework based on Adversarial Variational Autoencoders , 2019, IJCAI.

[24]  Kunpeng Zhang,et al.  Adversarial Point-of-Interest Recommendation , 2019, WWW.

[25]  Xiaomei Yu,et al.  Attention-based context-aware sequential recommendation model , 2020, Inf. Sci..

[26]  Luis Martínez,et al.  Managing Natural Noise in Recommender Systems , 2016, TPNC.

[27]  Lars Schmidt-Thieme,et al.  Real-time top-n recommendation in social streams , 2012, RecSys.

[28]  Alex Beutel,et al.  Recurrent Recommender Networks , 2017, WSDM.

[29]  Kiran Rama,et al.  Deep Learning to Address Candidate Generation and Cold Start Challenges in Recommender Systems: A Research Survey , 2019, ArXiv.

[30]  Jian Yin,et al.  Geo-ALM: POI Recommendation by Fusing Geographical Information and Adversarial Learning Mechanism , 2019, IJCAI.

[31]  Min Yang,et al.  PLASTIC: Prioritize Long and Short-term Information in Top-n Recommendation using Adversarial Training , 2018, IJCAI.

[32]  Zhong Ming,et al.  CoFiGAN: Collaborative filtering by generative and discriminative training for one-class recommendation , 2020, Knowl. Based Syst..

[33]  Ling Liu,et al.  Effective Facial Obstructions Removal with Enhanced Cycle-Consistent Generative Adversarial Networks , 2018, AIMS.

[34]  Dilruk Perera,et al.  CnGAN: Generative Adversarial Networks for Cross-network user preference generation for non-overlapped users , 2019, WWW.

[35]  Huan Liu,et al.  Personalized Privacy-Preserving Social Recommendation , 2018, AAAI.

[36]  Jiliang Tang,et al.  Deep Adversarial Social Recommendation , 2019, IJCAI.

[37]  Jung-Tae Lee,et al.  CFGAN: A Generic Collaborative Filtering Framework based on Generative Adversarial Networks , 2018, CIKM.

[38]  Jonathon Shlens,et al.  Explaining and Harnessing Adversarial Examples , 2014, ICLR.

[39]  Avishek Anand,et al.  EXS: Explainable Search Using Local Model Agnostic Interpretability , 2018, WSDM.

[40]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[41]  Tong Zhao,et al.  Leveraging Social Connections to Improve Personalized Ranking for Collaborative Filtering , 2014, CIKM.

[42]  Zhang Xiong,et al.  Autoencoder-Based Collaborative Filtering , 2014, ICONIP.

[43]  Qi Tian,et al.  Adversarial Training Towards Robust Multimedia Recommender System , 2018, IEEE Transactions on Knowledge and Data Engineering.

[44]  Min Gao,et al.  Generating Reliable Friends via Adversarial Training to Improve Social Recommendation , 2019, 2019 IEEE International Conference on Data Mining (ICDM).

[45]  Yixin Cao,et al.  Explainable Reasoning over Knowledge Graphs for Recommendation , 2018, AAAI.

[46]  Cheng Soon Ong,et al.  Cold-start playlist recommendation with multitask learning , 2018, PeerJ Prepr..

[47]  Jure Leskovec,et al.  Hidden factors and hidden topics: understanding rating dimensions with review text , 2013, RecSys.

[48]  Brian Y. Lim,et al.  RecGAN: recurrent generative adversarial networks for recommendation systems , 2018, RecSys.

[49]  Xi Xiong,et al.  Where to go: An effective point-of-interest recommendation framework for heterogeneous social networks , 2020, Neurocomputing.

[50]  Junwei Han,et al.  Generative Adversarial Network Based Heterogeneous Bibliographic Network Representation for Personalized Citation Recommendation , 2018, AAAI.

[51]  Martin Ester,et al.  Collaborative Denoising Auto-Encoders for Top-N Recommender Systems , 2016, WSDM.

[52]  Mohan Kankanhalli,et al.  Adversarial Learning for Personalized Tag Recommendation , 2020, IEEE Transactions on Multimedia.

[53]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[54]  William Yang Wang,et al.  KBGAN: Adversarial Learning for Knowledge Graph Embeddings , 2017, NAACL.

[55]  Fabio Crestani,et al.  Adversarial Training for Review-Based Recommendations , 2019, SIGIR.

[56]  Raymond Y. K. Lau,et al.  Least Squares Generative Adversarial Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[57]  Huan Liu,et al.  Recommendation with Social Dimensions , 2016, AAAI.

[58]  Haoxiang Wang,et al.  A deep variational matrix factorization method for recommendation on large scale sparse dataset , 2019, Neurocomputing.

[59]  Tommaso Di Noia,et al.  Assessing the Impact of a User-Item Collaborative Attack on Class of Users , 2019, ImpactRS@RecSys.

[60]  Ben Poole,et al.  Categorical Reparameterization with Gumbel-Softmax , 2016, ICLR.

[61]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[62]  Jung-Woo Ha,et al.  StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[63]  Xu Chen,et al.  Adversarial Distillation for Efficient Recommendation with External Knowledge , 2018, ACM Trans. Inf. Syst..

[64]  Yun He,et al.  Pseudo-Implicit Feedback for Alleviating Data Sparsity in Top-K Recommendation , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[65]  Maoguo Gong,et al.  Multi-objective optimization for location-based and preferences-aware recommendation , 2020, Inf. Sci..

[66]  Mohan S. Kankanhalli,et al.  Aspect-Aware Latent Factor Model: Rating Prediction with Ratings and Reviews , 2018, WWW.

[67]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[68]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[69]  Luis Martínez,et al.  A fuzzy approach for natural noise management in group recommender systems , 2018, Expert Syst. Appl..

[70]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[71]  Wang Chen,et al.  Utilizing Generative Adversarial Networks for Recommendation based on Ratings and Reviews , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[72]  Wei Wang,et al.  Click Feedback-Aware Query Recommendation Using Adversarial Examples , 2019, WWW.

[73]  Ronald J. Williams,et al.  Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning , 2004, Machine Learning.

[74]  Sang-Wook Kim,et al.  Rating Augmentation with Generative Adversarial Networks towards Accurate Collaborative Filtering , 2019, WWW.

[75]  Computational Intelligence for Semantic Knowledge Management - New Perspectives for Designing and Organizing Information Systems , 2020, Computational Intelligence for Semantic Knowledge Management.

[76]  Zi Huang,et al.  Neural Memory Streaming Recommender Networks with Adversarial Training , 2018, KDD.

[77]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[78]  Manoj Kumar Tiwari,et al.  A noise correction-based approach to support a recommender system in a highly sparse rating environment , 2019, Decis. Support Syst..

[79]  Pieter Abbeel,et al.  InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets , 2016, NIPS.

[80]  Weinan Zhang,et al.  Generative Adversarial Nets for Information Retrieval: Fundamentals and Advances , 2018, SIGIR.

[81]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[82]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[83]  Yann LeCun,et al.  Deep multi-scale video prediction beyond mean square error , 2015, ICLR.

[84]  Haoyu Wang,et al.  Adversarial Binary Collaborative Filtering for Implicit Feedback , 2019, AAAI.

[85]  Peng Zhang,et al.  IRGAN: A Minimax Game for Unifying Generative and Discriminative Information Retrieval Models , 2017, SIGIR.

[86]  Xiaoyu Du,et al.  Adversarial Personalized Ranking for Recommendation , 2018, SIGIR.

[87]  Jinfeng Yi,et al.  Enhancing the Robustness of Neural Collaborative Filtering Systems Under Malicious Attacks , 2019, IEEE Transactions on Multimedia.

[88]  Lantao Yu,et al.  SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient , 2016, AAAI.

[89]  Lars Schmidt-Thieme,et al.  Online-updating regularized kernel matrix factorization models for large-scale recommender systems , 2008, RecSys '08.

[90]  Yehuda Koren,et al.  Collaborative filtering with temporal dynamics , 2009, KDD.

[91]  Feng Liang,et al.  Exploiting ranking factorization machines for microblog retrieval , 2013, CIKM.

[92]  Kyumin Lee,et al.  Adversarial Mahalanobis Distance-based Attentive Song Recommender for Automatic Playlist Continuation , 2019, SIGIR.

[93]  Chunyan Miao,et al.  PD-GAN: Adversarial Learning for Personalized Diversity-Promoting Recommendation , 2019, IJCAI.

[94]  Huan Liu,et al.  mTrust: discerning multi-faceted trust in a connected world , 2012, WSDM '12.

[95]  Huan Liu,et al.  Adaptive Implicit Friends Identification over Heterogeneous Network for Social Recommendation , 2018, CIKM.

[96]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[97]  Yixin Cao,et al.  KGAT: Knowledge Graph Attention Network for Recommendation , 2019, KDD.

[98]  Linmei Hu,et al.  Virtually Trying on New Clothing with Arbitrary Poses , 2019, ACM Multimedia.

[99]  Fangzhao Wu,et al.  Hybrid neural recommendation with joint deep representation learning of ratings and reviews , 2020, Neurocomputing.

[100]  Huan Liu,et al.  Exploiting Emotion on Reviews for Recommender Systems , 2018, AAAI.

[101]  James Caverlee,et al.  Fairness-Aware Tensor-Based Recommendation , 2018, CIKM.

[102]  Xinfeng Zhang,et al.  Multiple Cycle-in-Cycle Generative Adversarial Networks for Unsupervised Image Super-Resolution , 2020, IEEE Transactions on Image Processing.

[103]  Tie-Yan Liu,et al.  Adversarial Neural Machine Translation , 2017, ACML.

[104]  Chen Fang,et al.  Visually-Aware Fashion Recommendation and Design with Generative Image Models , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[105]  Lina Yao,et al.  Adversarial Collaborative Auto-encoder for Top-N Recommendation , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[106]  Idris Rabiu,et al.  Recommendation system exploiting aspect-based opinion mining with deep learning method , 2020, Inf. Sci..

[107]  Antonio Torralba,et al.  Generating Videos with Scene Dynamics , 2016, NIPS.

[108]  Qing Li,et al.  Deep Modeling of Social Relations for Recommendation , 2018, AAAI.

[109]  Lina Yao,et al.  Adversarial Collaborative Neural Network for Robust Recommendation , 2019, SIGIR.

[110]  Jing Li,et al.  Adversarial tensor factorization for context-aware recommendation , 2019, RecSys.

[111]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.