Fairness-aware News Recommendation with Decomposed Adversarial Learning

News recommendation is important for online news services. Most news recommendation methods model users' interests from their news click behaviors. Usually the behaviors of users with the same sensitive attributes have similar patterns, and existing news recommendation models can inherit these biases and encode them into news ranking results. Thus, their recommendation results may be heavily influenced by the biases related to sensitive user attributes, which is unfair since users cannot receive sufficient news information that they are interested in. In this paper, we propose a fairness-aware news recommendation approach with decomposed adversarial learning and orthogonality regularization, which can alleviate unfairness in news recommendation brought by the biases of sensitive user attributes. For model training, we propose to learn a bias-aware user embedding that captures the bias information on user attributes from click behaviors, and learn a bias-free user embedding that only encodes attribute-independent user interest information for fairness-aware news recommendation. In addition, we propose to apply an attribute prediction task to the bias-aware user embedding to enhance its ability on bias modeling, and we apply adversarial learning to the bias-free user embedding to remove the bias information from it. Moreover, we propose an orthogonality regularization method to encourage the bias-free user embeddings to be orthogonal to the bias-aware one to further purify the bias-free user embedding. For fairness-aware news ranking, we only use the bias-free user embedding. Extensive experiments on benchmark dataset show that our approach can effectively improve fairness in news recommendation with acceptable performance loss.

[1]  Steffen Rendle,et al.  Factorization Machines with libFM , 2012, TIST.

[2]  Larry P. Heck,et al.  Learning deep structured semantic models for web search using clickthrough data , 2013, CIKM.

[3]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[4]  Shou-De Lin,et al.  Fairness-Aware Loan Recommendation for Microfinance Services , 2014, SocialCom '14.

[5]  Jun Sakuma,et al.  Correcting Popularity Bias by Enhancing Recommendation Neutrality , 2014, RecSys Posters.

[6]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[7]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[8]  Yukihiro Tagami,et al.  Embedding-based News Recommendation for Millions of Users , 2017, KDD.

[9]  Bert Huang,et al.  Beyond Parity: Fairness Objectives for Collaborative Filtering , 2017, NIPS.

[10]  Yiqun Liu,et al.  Fairness-Aware Group Recommendation with Pareto-Efficiency , 2017, RecSys.

[11]  Minyi Guo,et al.  DKN: Deep Knowledge-Aware Network for News Recommendation , 2018, WWW.

[12]  Lise Getoor,et al.  A Fairness-aware Hybrid Recommender System , 2018, ArXiv.

[13]  Nasim Sonboli,et al.  Balanced Neighborhoods for Multi-sided Fairness in Recommendation , 2018, FAT.

[14]  James Caverlee,et al.  Fairness-Aware Tensor-Based Recommendation , 2018, CIKM.

[15]  Chris Piech,et al.  Achieving Fairness through Adversarial Learning: an Application to Recidivism Prediction , 2018, ArXiv.

[16]  Toniann Pitassi,et al.  Learning Adversarially Fair and Transferable Representations , 2018, ICML.

[17]  Blake Lemoine,et al.  Mitigating Unwanted Biases with Adversarial Learning , 2018, AIES.

[18]  Yoav Goldberg,et al.  Adversarial Removal of Demographic Attributes from Text Data , 2018, EMNLP.

[19]  Tao Qi,et al.  Neural Gender Prediction from News Browsing Data , 2019, CCL.

[20]  Jun Guo,et al.  Personalized fairness-aware re-ranking for microlending , 2019, RecSys.

[21]  Suyu Ge,et al.  Neural News Recommendation with Multi-Head Self-Attention , 2019, EMNLP.

[22]  Robin D. Burke,et al.  Fairness and Discrimination in Retrieval and Recommendation , 2019, SIGIR.

[23]  Xing Xie,et al.  NPA: Neural News Recommendation with Personalized Attention , 2019, KDD.

[24]  Ed H. Chi,et al.  Fairness in Recommendation Ranking through Pairwise Comparisons , 2019, KDD.

[25]  Xing Xie,et al.  Neural News Recommendation with Long- and Short-term User Representations , 2019, ACL.

[26]  Xing Xie,et al.  Neural News Recommendation with Attentive Multi-View Learning , 2019, IJCAI.

[27]  Xiaofei Zhou,et al.  DAN: Deep Attention Neural Network for News Recommendation , 2019, AAAI.

[28]  Sahin Cem Geyik,et al.  Fairness-Aware Ranking in Search & Recommendation Systems with Application to LinkedIn Talent Search , 2019, KDD.

[29]  Krishna P. Gummadi,et al.  FairRec: Two-Sided Fairness for Personalized Recommendations in Two-Sided Platforms , 2020, WWW.

[30]  Chuhan Wu,et al.  Privacy-Preserving News Recommendation Model Learning , 2020, FINDINGS.

[31]  Shuyuan Xu,et al.  Fairness-Aware Explainable Recommendation over Knowledge Graphs , 2020, SIGIR.

[32]  Kristina Lerman,et al.  A Geometric Solution to Fair Representations , 2020, AIES.

[33]  C. Shi,et al.  Graph Neural News Recommendation with Long-term and Short-term Interest Modeling , 2019, Inf. Process. Manag..

[34]  Xing Xie,et al.  Fine-grained Interest Matching for Neural News Recommendation , 2020, ACL.

[35]  Xia Hu,et al.  Fairness in Deep Learning: A Computational Perspective , 2019, IEEE Intelligent Systems.