Fairness in Rankings and Recommenders: Models, Methods and Research Directions

We increasingly depend on a variety of data-driven algorithmic systems to assist us in many aspects of life. Search engines and recommendation systems amongst others are used as sources of information and to help us in making all sort of decisions from selecting restaurants and books, to choosing friends and careers. This has given rise to important concerns regarding the fairness of such systems. This tutorial aims at presenting a toolkit of definitions, models and methods used for ensuring fairness in rankings and recommendations. Our objectives are three-fold: (a) to provide a solid framework on a novel, quickly evolving, and impactful domain, (b) to present related methods and put them into perspective, and (c) to highlight challenges and research paths for researchers and practitioners that work in data management and applications.

[1]  Cong Yu,et al.  Group Recommendation: Semantics and Efficiency , 2009, Proc. VLDB Endow..

[2]  Aws Albarghouthi,et al.  Fairness as a Program Property , 2016, ArXiv.

[3]  Bert Huang,et al.  Beyond Parity: Fairness Objectives for Collaborative Filtering , 2017, NIPS.

[4]  Abolfazl Asudeh,et al.  Designing Fair Ranking Schemes , 2017, SIGMOD Conference.

[5]  Yiqun Liu,et al.  Fairness-Aware Group Recommendation with Pareto-Efficiency , 2017, RecSys.

[6]  Bert Huang,et al.  New Fairness Metrics for Recommendation that Embrace Differences , 2017, ArXiv.

[7]  Sean A. Munson,et al.  Unequal Representation and Gender Stereotypes in Image Search Results for Occupations , 2015, CHI.

[8]  Kristina Lerman,et al.  A Survey on Bias and Fairness in Machine Learning , 2019, ACM Comput. Surv..

[9]  Jon M. Kleinberg,et al.  On Fairness and Calibration , 2017, NIPS.

[10]  Nikos Mamoulis,et al.  Fairness in Package-to-Group Recommendations , 2017, WWW.

[11]  Evaggelia Pitoura,et al.  Fair sequential group recommendations , 2020, SAC.

[12]  Thorsten Joachims,et al.  Fairness of Exposure in Rankings , 2018, KDD.

[13]  Toniann Pitassi,et al.  Learning Fair Representations , 2013, ICML.

[14]  Yang Liu,et al.  Calibrated Fairness in Bandits , 2017, ArXiv.

[15]  Hans-Peter Kriegel,et al.  Fast Group Recommendations by Applying User Clustering , 2012, ER.

[16]  Nisheeth K. Vishnoi,et al.  Ranking with Fairness Constraints , 2017, ICALP.

[17]  Julia Stoyanovich,et al.  Measuring Fairness in Ranked Outputs , 2016, SSDBM.

[18]  Krishna P. Gummadi,et al.  Incremental Fairness in Two-Sided Market Platforms: On Smoothly Updating Recommendations , 2019, AAAI 2020.

[19]  Aaron Roth,et al.  Fairness in Learning: Classic and Contextual Bandits , 2016, NIPS.

[20]  Xiaojie Mao,et al.  Assessing algorithmic fairness with unobserved protected class using data combination , 2019, FAT*.

[21]  Krishna P. Gummadi,et al.  Equity of Attention: Amortizing Individual Fairness in Rankings , 2018, SIGIR.

[22]  Jun Sakuma,et al.  Recommendation Independence , 2018, FAT.

[23]  Matt J. Kusner,et al.  Counterfactual Fairness , 2017, NIPS.

[24]  Latanya Sweeney,et al.  Discrimination in online ad delivery , 2013, CACM.

[25]  David C. Parkes,et al.  How Do Fairness Definitions Fare?: Examining Public Attitudes Towards Algorithmic Definitions of Fairness , 2018, AIES.

[26]  Kostas Stefanidis,et al.  FairGRecs: Fair Group Recommendations by Exploiting Personal Health Information , 2018, DEXA.

[27]  Dimitris Sacharidis.  Top-N group recommendations with fairness , 2019, SAC.

[28]  Georgia Koutrika,et al.  Fairness in Rankings and Recommenders , 2020, EDBT.

[29]  Aws Albarghouthi,et al.  Fairness-Aware Programming , 2019, FAT.

[30]  Krishna P. Gummadi,et al.  Human Perceptions of Fairness in Algorithmic Decision Making: A Case Study of Criminal Risk Prediction , 2018, WWW.

[31]  Evaggelia Pitoura,et al.  Bias Disparity in Recommendation Systems , 2018, RMSE@RecSys.

[32]  Megha Khosla,et al.  User Fairness in Recommender Systems , 2018, WWW.

[33]  Robin D. Burke,et al.  Multisided Fairness for Recommendation , 2017, ArXiv.

[34]  Kostas Stefanidis,et al.  Enhancing Long Term Fairness in Recommendations with Variational Autoencoders , 2019, MEDES.

[35]  Julia Rubin,et al.  Fairness Definitions Explained , 2018, 2018 IEEE/ACM International Workshop on Software Fairness (FairWare).

[36]  Ricardo Baeza-Yates,et al.  FA*IR: A Fair Top-k Ranking Algorithm , 2017, CIKM.

[37]  Toniann Pitassi,et al.  Fairness through awareness , 2011, ITCS '12.

[38]  James Caverlee,et al.  Fairness-Aware Tensor-Based Recommendation , 2018, CIKM.

[39]  Dan Suciu,et al.  Interventional Fairness: Causal Database Repair for Algorithmic Fairness , 2019, SIGMOD Conference.

[40]  Nisheeth K. Vishnoi,et al.  How to be Fair and Diverse? , 2016, ArXiv.

[41]  Michael Carl Tschantz,et al.  Exploring User Perceptions of Discrimination in Online Targeted Advertising , 2017, USENIX Security Symposium.

[42]  Kostas Stefanidis,et al.  On mitigating popularity bias in recommendations via variational autoencoders , 2021, SAC.

[43]  Evaggelia Pitoura,et al.  Social-minded Measures of Data Quality , 2020, ACM J. Data Inf. Qual..

[44]  Harald Steck,et al.  Calibrated recommendations , 2018, RecSys.

[45]  Debashis Ghosh,et al.  An Invitation to System-wide Algorithmic Fairness , 2020, AIES.

[46]  Nikos Mamoulis,et al.  Fairness-Aware PageRank , 2020, WWW.

[47]  Carlos Castillo,et al.  Reducing Disparate Exposure in Ranking: A Learning To Rank Approach , 2018, WWW.

[48]  Ed H. Chi,et al.  Fairness in Recommendation Ranking through Pairwise Comparisons , 2019, KDD.