Leave No User Behind: Towards Improving the Utility of Recommender Systems for Non-mainstream Users

In a collaborative-filtering recommendation scenario, biases in the data will likely propagate in the learned recommendations. In this paper we focus on the so-called mainstream bias: the tendency of a recommender system to provide better recommendations to users who have a mainstream taste, as opposed to non-mainstream users. We propose NAECF, a conceptually simple but effective idea to address this bias. The idea consists of adding an autoencoder (AE) layer when learning user and item representations with text-based Convolutional Neural Networks. The AEs, one for the users and one for the items, serve as adversaries to the process of minimizing the rating prediction error when learning how to recommend. They enforce that the specific unique properties of all users and items are sufficiently well incorporated and preserved in the learned representations. These representations, extracted as the bottlenecks of the corresponding AEs, are expected to be less biased towards mainstream users, and to provide more balanced recommendation utility across all users. Our experimental results confirm these expectations, significantly improving the recommendations for nonmainstream users while maintaining the recommendation quality for mainstream users. Our results emphasize the importance of deploying extensive content-based features, such as online reviews, in order to better represent users and items to maximize the debiasing effect.

[1]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[2]  Casper Hansen,et al.  Content-aware Neural Hashing for Cold-start Recommendation , 2020, SIGIR.

[3]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[4]  C. Miao,et al.  Learning Hierarchical Review Graph Representations for Recommendation , 2020, IEEE Transactions on Knowledge and Data Engineering.

[5]  Scott Sanner,et al.  AutoRec: Autoencoders Meet Collaborative Filtering , 2015, WWW.

[6]  Krishna P. Gummadi,et al.  Fighting Fire with Fire: Using Antidote Data to Improve Polarization and Fairness of Recommender Systems , 2018, WSDM.

[7]  Dominik Kowald,et al.  The Unfairness of Popularity Bias in Music Recommendation: A Reproducibility Study , 2019, ECIR.

[8]  Dana H. Ballard,et al.  Modular Learning in Neural Networks , 1987, AAAI.

[9]  Anton van den Hengel,et al.  Image-Based Recommendations on Styles and Substitutes , 2015, SIGIR.

[10]  Xing Xie,et al.  NPA: Neural News Recommendation with Personalized Attention , 2019, KDD.

[11]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[12]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[13]  Mohan S. Kankanhalli,et al.  A^3NCF: An Adaptive Aspect Attention Model for Rating Prediction , 2018, IJCAI.

[14]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[15]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[16]  Fernando Diaz,et al.  Towards a Fair Marketplace: Counterfactual Evaluation of the trade-off between Relevance, Fairness & Satisfaction in Recommendation Systems , 2018, CIKM.

[17]  Robin Burke,et al.  The Unfairness of Popularity Bias in Recommendation , 2019, RMSE@RecSys.

[18]  Yue Yin,et al.  Explainable Recommendation via Multi-Task Learning in Opinionated Text Data , 2018, SIGIR.

[19]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[20]  Shawn P. Curley,et al.  De-biasing user preference ratings in recommender systems completed research paper , 2014, RecSys 2014.

[21]  Harald Steck,et al.  Item popularity and recommendation accuracy , 2011, RecSys '11.

[22]  Bamshad Mobasher,et al.  Investigating Potential Factors Associated with Gender Discrimination in Collaborative Recommender Systems , 2020, FLAIRS.

[23]  Yiqun Liu,et al.  Neural Attentional Rating Regression with Review-level Explanations , 2018, WWW.

[24]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[25]  Dominik Kowald,et al.  Utilizing Human Memory Processes to Model Genre Preferences for Personalized Music Recommendations , 2020, ArXiv.

[26]  Robin Burke,et al.  Popularity-Aware Item Weighting for Long-Tail Recommendation. , 2018 .

[27]  Steffen Rendle,et al.  Factorization Machines with libFM , 2012, TIST.

[28]  Ilya Sutskever,et al.  Language Models are Unsupervised Multitask Learners , 2019 .

[29]  Christine Bauer,et al.  An Analysis of Global and Regional Mainstreaminess for Personalized Music Recommender Systems , 2018 .

[30]  Jure Leskovec,et al.  Learning Attitudes and Attributes from Multi-aspect Reviews , 2012, 2012 IEEE 12th International Conference on Data Mining.

[31]  Markus Schedl,et al.  Online Music Listening Culture of Kids and Adolescents: Listening Analysis and Music Recommendation Tailored to the Young , 2019, ArXiv.

[32]  Lei Zheng,et al.  Joint Deep Modeling of Users and Items Using Reviews for Recommendation , 2017, WSDM.

[33]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[34]  Yukihiro Tagami,et al.  Embedding-based News Recommendation for Millions of Users , 2017, KDD.

[35]  Quoc Viet Hung Nguyen,et al.  Enhancing Collaborative Filtering with Generative Augmentation , 2019, KDD.

[36]  Alan Hanjalic,et al.  Statistical Significance Testing in Information Retrieval: An Empirical Analysis of Type I, Type II and Type III Errors , 2019, SIGIR.

[37]  Siu Cheung Hui,et al.  Multi-Pointer Co-Attention Networks for Recommendation , 2018, KDD.

[38]  Yong Zheng,et al.  Identification of Grey Sheep Users by Histogram Intersection in Recommender Systems , 2017, ADMA.

[39]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[40]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[41]  Alexander J. Smola,et al.  Joint Training of Ratings and Reviews with Recurrent Recommender Networks , 2016, ICLR.

[42]  Xin Li,et al.  Explainable Recommendation via Interpretable Feature Mapping and Evaluation of Explainability , 2020, IJCAI.

[43]  Xue Liu,et al.  Gated Attentive-Autoencoder for Content-Aware Recommendation , 2018, WSDM.