Recommender Systems Based on Generative Adversarial Networks: A Problem-Driven Perspective

Recommender systems (RSs) now play a very important role in the online lives of people as they serve as personalized filters for users to find relevant items from an array of options. Owing to their effectiveness, RSs have been widely employed in consumer-oriented e-commerce platforms. However, despite their empirical successes, these systems still suffer from two limitations: data noise and data sparsity. In recent years, generative adversarial networks (GANs) have garnered increased interest in many fields, owing to their strong capacity to learn complex real data distributions; their abilities to enhance RSs by tackling the challenges these systems exhibit have also been demonstrated in numerous studies. In general, two lines of research have been conducted, and their common ideas can be summarized as follows: (1) for the data noise issue, adversarial perturbations and adversarial sampling-based training often serve as a solution; (2) for the data sparsity issue, data augmentation--implemented by capturing the distribution of real data under the minimax framework--is the primary coping strategy. To gain a comprehensive understanding of these research efforts, we review the corresponding studies and models, organizing them from a problem-driven perspective. More specifically, we propose a taxonomy of these models, along with their detailed descriptions and advantages. Finally, we elaborate on several open issues and current trends in GAN-based RSs.

[1]  Xianwen Yu,et al.  VAEGAN: A Collaborative Filtering Framework based on Adversarial Variational Autoencoders , 2019, IJCAI.

[2]  James Caverlee,et al.  Fairness-Aware Tensor-Based Recommendation , 2018, CIKM.

[3]  Junwei Han,et al.  Generative Adversarial Network Based Heterogeneous Bibliographic Network Representation for Personalized Citation Recommendation , 2018, AAAI.

[4]  Chen Fang,et al.  Visually-Aware Fashion Recommendation and Design with Generative Image Models , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[5]  Ben Poole,et al.  Categorical Reparameterization with Gumbel-Softmax , 2016, ICLR.

[6]  Huan Liu,et al.  Personalized Privacy-Preserving Social Recommendation , 2018, AAAI.

[7]  Lei Zheng,et al.  Joint Deep Modeling of Users and Items Using Reviews for Recommendation , 2017, WSDM.

[8]  Luis Martínez,et al.  Natural Noise Management in Recommender Systems Using Fuzzy Tools , 2020, Computational Intelligence for Semantic Knowledge Management.

[9]  Zhong Ming,et al.  CoFiGAN: Collaborative filtering by generative and discriminative training for one-class recommendation , 2020, Knowl. Based Syst..

[10]  Yann LeCun,et al.  Deep multi-scale video prediction beyond mean square error , 2015, ICLR.

[11]  Xi Xiong,et al.  Where to go: An effective point-of-interest recommendation framework for heterogeneous social networks , 2020, Neurocomputing.

[12]  Haoxiang Wang,et al.  A deep variational matrix factorization method for recommendation on large scale sparse dataset , 2019, Neurocomputing.

[13]  Jing Li,et al.  Adversarial tensor factorization for context-aware recommendation , 2019, RecSys.

[14]  Lars Schmidt-Thieme,et al.  Real-time top-n recommendation in social streams , 2012, RecSys.

[15]  Yun He,et al.  Pseudo-Implicit Feedback for Alleviating Data Sparsity in Top-K Recommendation , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[16]  Tyler Baldwin,et al.  Autonomous Self-Assessment of Autocorrections: Exploring Text Message Dialogues , 2012, NAACL.

[17]  Tat-Seng Chua,et al.  Neural Factorization Machines for Sparse Predictive Analytics , 2017, SIGIR.

[18]  Léon Bottou,et al.  Wasserstein Generative Adversarial Networks , 2017, ICML.

[19]  Minyi Guo,et al.  GraphGAN: Graph Representation Learning with Generative Adversarial Nets , 2017, AAAI.

[20]  Xiaomei Yu,et al.  Attention-based context-aware sequential recommendation model , 2020, Inf. Sci..

[21]  Lantao Yu,et al.  SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient , 2016, AAAI.

[22]  Idris Rabiu,et al.  Recommendation system exploiting aspect-based opinion mining with deep learning method , 2020, Inf. Sci..

[23]  Wei Wang,et al.  A Knowledge-Enhanced Deep Recommendation Framework Incorporating GAN-Based Models , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[24]  Maoguo Gong,et al.  Multi-objective optimization for location-based and preferences-aware recommendation , 2020, Inf. Sci..

[25]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[26]  Tong Zhao,et al.  Leveraging Social Connections to Improve Personalized Ranking for Collaborative Filtering , 2014, CIKM.

[27]  Lars Schmidt-Thieme,et al.  Online-updating regularized kernel matrix factorization models for large-scale recommender systems , 2008, RecSys '08.

[28]  Qi Tian,et al.  Adversarial Training Towards Robust Multimedia Recommender System , 2018, IEEE Transactions on Knowledge and Data Engineering.

[29]  Raymond Y. K. Lau,et al.  Least Squares Generative Adversarial Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[30]  Feng Liang,et al.  Exploiting ranking factorization machines for microblog retrieval , 2013, CIKM.

[31]  Tat-Seng Chua,et al.  Item Silk Road: Recommending Items from Information Domains to Social Users , 2017, SIGIR.

[32]  Qing Li,et al.  Deep Modeling of Social Relations for Recommendation , 2018, AAAI.

[33]  Luis Martínez,et al.  Managing Natural Noise in Recommender Systems , 2016, TPNC.

[34]  Yixin Cao,et al.  KGAT: Knowledge Graph Attention Network for Recommendation , 2019, KDD.

[35]  Linmei Hu,et al.  Virtually Trying on New Clothing with Arbitrary Poses , 2019, ACM Multimedia.

[36]  Fangzhao Wu,et al.  Hybrid neural recommendation with joint deep representation learning of ratings and reviews , 2020, Neurocomputing.

[37]  Computational Intelligence for Semantic Knowledge Management - New Perspectives for Designing and Organizing Information Systems , 2020, Computational Intelligence for Semantic Knowledge Management.

[38]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[39]  Cheng Wang,et al.  RecSys-DAN: Discriminative Adversarial Networks for Cross-Domain Recommender Systems , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[40]  Martin Ester,et al.  Collaborative Denoising Auto-Encoders for Top-N Recommender Systems , 2016, WSDM.

[41]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[42]  Zhang Xiong,et al.  Autoencoder-Based Collaborative Filtering , 2014, ICONIP.

[43]  Jian Yin,et al.  Geo-ALM: POI Recommendation by Fusing Geographical Information and Adversarial Learning Mechanism , 2019, IJCAI.

[44]  Jure Leskovec,et al.  Hidden factors and hidden topics: understanding rating dimensions with review text , 2013, RecSys.

[45]  Huan Liu,et al.  Recommendation with Social Dimensions , 2016, AAAI.

[46]  Julian J. McAuley,et al.  VBPR: Visual Bayesian Personalized Ranking from Implicit Feedback , 2015, AAAI.

[47]  Tie-Yan Liu,et al.  Adversarial Neural Machine Translation , 2017, ACML.

[48]  Xinfeng Zhang,et al.  Multiple Cycle-in-Cycle Generative Adversarial Networks for Unsupervised Image Super-Resolution , 2020, IEEE Transactions on Image Processing.

[49]  Zi Huang,et al.  Neural Memory Streaming Recommender Networks with Adversarial Training , 2018, KDD.

[50]  Kunpeng Zhang,et al.  Adversarial Point-of-Interest Recommendation , 2019, WWW.

[51]  Xu Chen,et al.  Adversarial Distillation for Efficient Recommendation with External Knowledge , 2018, ACM Trans. Inf. Syst..

[52]  Yixin Cao,et al.  Explainable Reasoning over Knowledge Graphs for Recommendation , 2018, AAAI.

[53]  Léon Bottou,et al.  Towards Principled Methods for Training Generative Adversarial Networks , 2017, ICLR.

[54]  Peng Zhang,et al.  IRGAN: A Minimax Game for Unifying Generative and Discriminative Information Retrieval Models , 2017, SIGIR.

[55]  Chunyan Miao,et al.  PD-GAN: Adversarial Learning for Personalized Diversity-Promoting Recommendation , 2019, IJCAI.

[56]  Huan Liu,et al.  mTrust: discerning multi-faceted trust in a connected world , 2012, WSDM '12.

[57]  Min Gao,et al.  Generating Reliable Friends via Adversarial Training to Improve Social Recommendation , 2019, 2019 IEEE International Conference on Data Mining (ICDM).

[58]  Jung-Woo Ha,et al.  Energy-Based Sequence GANs for Recommendation and Their Connection to Imitation Learning , 2017, ArXiv.

[59]  Wei Wang,et al.  Click Feedback-Aware Query Recommendation Using Adversarial Examples , 2019, WWW.

[60]  Tommaso Di Noia,et al.  Assessing the Impact of a User-Item Collaborative Attack on Class of Users , 2019, ImpactRS@RecSys.

[61]  Quoc Viet Hung Nguyen,et al.  Enhancing Collaborative Filtering with Generative Augmentation , 2019, KDD.

[62]  Antonio Torralba,et al.  Generating Videos with Scene Dynamics , 2016, NIPS.

[63]  Jonathon Shlens,et al.  Explaining and Harnessing Adversarial Examples , 2014, ICLR.

[64]  Huan Liu,et al.  Adaptive Implicit Friends Identification over Heterogeneous Network for Social Recommendation , 2018, CIKM.

[65]  Jinfeng Yi,et al.  Enhancing the Robustness of Neural Collaborative Filtering Systems Under Malicious Attacks , 2019, IEEE Transactions on Multimedia.

[66]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[67]  Pieter Abbeel,et al.  InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets , 2016, NIPS.

[68]  Weinan Zhang,et al.  Generative Adversarial Nets for Information Retrieval: Fundamentals and Advances , 2018, SIGIR.

[69]  Jung-Tae Lee,et al.  CFGAN: A Generic Collaborative Filtering Framework based on Generative Adversarial Networks , 2018, CIKM.

[70]  Bin Wu,et al.  APL: Adversarial Pairwise Learning for Recommender Systems , 2019, Expert Syst. Appl..

[71]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[72]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[73]  Yehuda Koren,et al.  Collaborative filtering with temporal dynamics , 2009, KDD.

[74]  Avishek Anand,et al.  EXS: Explainable Search Using Local Model Agnostic Interpretability , 2018, WSDM.

[75]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[76]  Xiangnan He,et al.  Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention , 2017, SIGIR.

[77]  William Yang Wang,et al.  KBGAN: Adversarial Learning for Knowledge Graph Embeddings , 2017, NAACL.

[78]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[79]  Fabio Crestani,et al.  Adversarial Training for Review-Based Recommendations , 2019, SIGIR.

[80]  Ling Liu,et al.  Effective Facial Obstructions Removal with Enhanced Cycle-Consistent Generative Adversarial Networks , 2018, AIMS.

[81]  Huan Liu,et al.  Exploiting Emotion on Reviews for Recommender Systems , 2018, AAAI.

[82]  Mohan S. Kankanhalli,et al.  Aspect-Aware Latent Factor Model: Rating Prediction with Ratings and Reviews , 2018, WWW.

[83]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[84]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[85]  Sang-Wook Kim,et al.  Rating Augmentation with Generative Adversarial Networks towards Accurate Collaborative Filtering , 2019, WWW.

[86]  Peng Zhang,et al.  UD-HMM: An unsupervised method for shilling attack detection based on hidden Markov model and hierarchical clustering , 2018, Knowl. Based Syst..

[87]  Min Yang,et al.  PLASTIC: Prioritize Long and Short-term Information in Top-n Recommendation using Adversarial Training , 2018, IJCAI.

[88]  Jiancheng Lv,et al.  BFGAN: Backward and Forward Generative Adversarial Networks for Lexically Constrained Sentence Generation , 2018, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[89]  Kiran Rama,et al.  Deep Learning to Address Candidate Generation and Cold Start Challenges in Recommender Systems: A Research Survey , 2019, ArXiv.

[90]  Alex Beutel,et al.  Recurrent Recommender Networks , 2017, WSDM.

[91]  Lina Yao,et al.  Adversarial Collaborative Auto-encoder for Top-N Recommendation , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[92]  Lina Yao,et al.  Adversarial Collaborative Neural Network for Robust Recommendation , 2019, SIGIR.

[93]  Huan Liu,et al.  Exploiting Multilabel Information for Noise-Resilient Feature Selection , 2018, ACM Trans. Intell. Syst. Technol..

[94]  Dilruk Perera,et al.  CnGAN: Generative Adversarial Networks for Cross-network user preference generation for non-overlapped users , 2019, WWW.

[95]  Brian Y. Lim,et al.  RecGAN: recurrent generative adversarial networks for recommendation systems , 2018, RecSys.

[96]  Jiliang Tang,et al.  Deep Adversarial Social Recommendation , 2019, IJCAI.

[97]  Jung-Woo Ha,et al.  StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[98]  Haoyu Wang,et al.  Adversarial Binary Collaborative Filtering for Implicit Feedback , 2019, AAAI.

[99]  Xiaoyu Du,et al.  Adversarial Personalized Ranking for Recommendation , 2018, SIGIR.

[100]  Ronald J. Williams,et al.  Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning , 2004, Machine Learning.

[101]  Yizhou Sun,et al.  On Sampling Strategies for Neural Network-based Collaborative Filtering , 2017, KDD.

[102]  Cheng Soon Ong,et al.  Cold-start playlist recommendation with multitask learning , 2018, PeerJ Prepr..

[103]  Manoj Kumar Tiwari,et al.  A noise correction-based approach to support a recommender system in a highly sparse rating environment , 2019, Decis. Support Syst..

[104]  Kyumin Lee,et al.  Adversarial Mahalanobis Distance-based Attentive Song Recommender for Automatic Playlist Continuation , 2019, SIGIR.

[105]  Wang Chen,et al.  Utilizing Generative Adversarial Networks for Recommendation based on Ratings and Reviews , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[106]  Peng Cui,et al.  Collaborative Generative Adversarial Network for Recommendation Systems , 2019, 2019 IEEE 35th International Conference on Data Engineering Workshops (ICDEW).

[107]  Luis Martínez,et al.  A fuzzy approach for natural noise management in group recommender systems , 2018, Expert Syst. Appl..

[108]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[109]  Rob Fergus,et al.  Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks , 2015, NIPS.

[110]  Mohan Kankanhalli,et al.  Adversarial Learning for Personalized Tag Recommendation , 2020, IEEE Transactions on Multimedia.