Leave No User Behind: Towards Improving the Utility of Recommender Systems for Non-mainstream Users

In a collaborative-filtering recommendation scenario, biases in the data will likely propagate in the learned recommendations. In this paper we focus on the so-called mainstream bias: the tendency of a recommender system to provide better recommendations to users who have a mainstream taste, as opposed to non-mainstream users. We propose NAECF, a conceptually simple but effective idea to address this bias. The idea consists of adding an autoencoder (AE) layer when learning user and item representations with text-based Convolutional Neural Networks. The AEs, one for the users and one for the items, serve as adversaries to the process of minimizing the rating prediction error when learning how to recommend. They enforce that the specific unique properties of all users and items are sufficiently well incorporated and preserved in the learned representations. These representations, extracted as the bottlenecks of the corresponding AEs, are expected to be less biased towards mainstream users, and to provide more balanced recommendation utility across all users. Our experimental results confirm these expectations, significantly improving the recommendations for non-mainstream users while maintaining the recommendation quality for mainstream users. Our results emphasize the importance of deploying extensive content-based features, such as online reviews, in order to better represent users and items to maximize the de-biasing effect.

[1]  Bamshad Mobasher,et al.  Investigating Potential Factors Associated with Gender Discrimination in Collaborative Recommender Systems , 2020, FLAIRS.

[2]  Xue Liu,et al.  Gated Attentive-Autoencoder for Content-Aware Recommendation , 2018, WSDM.

[3]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[4]  Dominik Kowald,et al.  Utilizing Human Memory Processes to Model Genre Preferences for Personalized Music Recommendations , 2020, ArXiv.

[5]  Robin Burke,et al.  Popularity-Aware Item Weighting for Long-Tail Recommendation. , 2018 .

[6]  Steffen Rendle,et al.  Factorization Machines with libFM , 2012, TIST.

[7]  Harald Steck,et al.  Item popularity and recommendation accuracy , 2011, RecSys '11.

[8]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[9]  Yong Zheng,et al.  Identification of Grey Sheep Users by Histogram Intersection in Recommender Systems , 2017, ADMA.

[10]  Casper Hansen,et al.  Content-aware Neural Hashing for Cold-start Recommendation , 2020, SIGIR.

[11]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[12]  Yue Yin,et al.  Explainable Recommendation via Multi-Task Learning in Opinionated Text Data , 2018, SIGIR.

[13]  Robin Burke,et al.  The Unfairness of Popularity Bias in Recommendation , 2019, RMSE@RecSys.

[14]  Ilya Sutskever,et al.  Language Models are Unsupervised Multitask Learners , 2019 .

[15]  Scott Sanner,et al.  AutoRec: Autoencoders Meet Collaborative Filtering , 2015, WWW.

[16]  Lei Zheng,et al.  Joint Deep Modeling of Users and Items Using Reviews for Recommendation , 2017, WSDM.

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  Yukihiro Tagami,et al.  Embedding-based News Recommendation for Millions of Users , 2017, KDD.

[19]  Quoc Viet Hung Nguyen,et al.  Enhancing Collaborative Filtering with Generative Augmentation , 2019, KDD.

[20]  Alan Hanjalic,et al.  Statistical Significance Testing in Information Retrieval: An Empirical Analysis of Type I, Type II and Type III Errors , 2019, SIGIR.

[21]  Christine Bauer,et al.  An Analysis of Global and Regional Mainstreaminess for Personalized Music Recommender Systems , 2018 .

[22]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[23]  Jure Leskovec,et al.  Learning Attitudes and Attributes from Multi-aspect Reviews , 2012, 2012 IEEE 12th International Conference on Data Mining.

[24]  Yiqun Liu,et al.  Neural Attentional Rating Regression with Review-level Explanations , 2018, WWW.

[25]  Markus Schedl,et al.  Online Music Listening Culture of Kids and Adolescents: Listening Analysis and Music Recommendation Tailored to the Young , 2019, ArXiv.

[26]  Mohan S. Kankanhalli,et al.  A^3NCF: An Adaptive Aspect Attention Model for Rating Prediction , 2018, IJCAI.

[27]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[28]  Fernando Diaz,et al.  Towards a Fair Marketplace: Counterfactual Evaluation of the trade-off between Relevance, Fairness & Satisfaction in Recommendation Systems , 2018, CIKM.

[29]  Krishna P. Gummadi,et al.  Fighting Fire with Fire: Using Antidote Data to Improve Polarization and Fairness of Recommender Systems , 2018, WSDM.

[30]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[31]  Alexander J. Smola,et al.  Joint Training of Ratings and Reviews with Recurrent Recommender Networks , 2016, ICLR.

[32]  Xin Li,et al.  Explainable Recommendation via Interpretable Feature Mapping and Evaluation of Explainability , 2020, IJCAI.

[33]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[34]  C. Miao,et al.  Learning Hierarchical Review Graph Representations for Recommendation , 2020, IEEE Transactions on Knowledge and Data Engineering.

[35]  Anton van den Hengel,et al.  Image-Based Recommendations on Styles and Substitutes , 2015, SIGIR.

[36]  Xing Xie,et al.  NPA: Neural News Recommendation with Personalized Attention , 2019, KDD.

[37]  Shawn P. Curley,et al.  De-biasing user preference ratings in recommender systems completed research paper , 2014, RecSys 2014.

[38]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[39]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[40]  Dominik Kowald,et al.  The Unfairness of Popularity Bias in Music Recommendation: A Reproducibility Study , 2019, ECIR.

[41]  Dana H. Ballard,et al.  Modular Learning in Neural Networks , 1987, AAAI.

[42]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[43]  Siu Cheung Hui,et al.  Multi-Pointer Co-Attention Networks for Recommendation , 2018, KDD.