Facets of Fairness in Search and Recommendation

Several recent works have highlighted how search and recommender systems exhibit bias along different dimensions. Counteracting this bias and bringing a certain amount of fairness in search is crucial to not only creating a more balanced environment that considers relevance and diversity but also providing a more sustainable way forward for both content consumers and content producers. This short paper examines some of the recent works to define relevance, diversity, and related concepts. Then, it focuses on explaining the emerging concept of fairness in various recommendation settings. In doing so, this paper presents comparisons and highlights contracts among various measures, and gaps in our conceptual and evaluative frameworks.

[1]  Ricardo Baeza-Yates,et al.  FA*IR: A Fair Top-k Ranking Algorithm , 2017, CIKM.

[2]  Elke A. Rundensteiner,et al.  FARE: Diagnostics for Fair Ranking using Pairwise Error Metrics , 2019, WWW.

[3]  Robin Burke,et al.  Multi-stakeholder Recommendation and its Connection to Multi-sided Fairness , 2019, RMSE@RecSys.

[4]  Ruoyuan Gao,et al.  Toward creating a fairer ranking in search engine results , 2020, Inf. Process. Manag..

[5]  Fernando Diaz,et al.  Towards a Fair Marketplace: Counterfactual Evaluation of the trade-off between Relevance, Fairness & Satisfaction in Recommendation Systems , 2018, CIKM.

[6]  Julia Rubin,et al.  Fairness Definitions Explained , 2018, 2018 IEEE/ACM International Workshop on Software Fairness (FairWare).

[7]  Sahin Cem Geyik,et al.  Fairness-Aware Ranking in Search & Recommendation Systems with Application to LinkedIn Talent Search , 2019, KDD.

[8]  Lu Zhang,et al.  On Discrimination Discovery and Removal in Ranked Data using Causal Graph , 2018, KDD.

[9]  Robin D. Burke,et al.  Multisided Fairness for Recommendation , 2017, ArXiv.

[10]  Stephen E. Robertson,et al.  Simple Evaluation Metrics for Diversified Search Results , 2010, EVIA@NTCIR.

[11]  Matthew Richardson,et al.  Predicting clicks: estimating the click-through rate for new ads , 2007, WWW '07.

[12]  Ed H. Chi,et al.  Fairness in Recommendation Ranking through Pairwise Comparisons , 2019, KDD.

[13]  Bamshad Mobasher,et al.  Recommender Systems as Multistakeholder Environments , 2017, UMAP.

[14]  James Grimmelmann.  Some Skepticism About Search Neutrality , 2011 .

[15]  Meena Jagadeesan,et al.  Multi-category fairness in sponsored search auctions , 2019, FAT*.

[16]  Julia Stoyanovich,et al.  Measuring Fairness in Ranked Outputs , 2016, SSDBM.

[17]  Dmitry Bogdanov,et al.  Artist and style exposure bias in collaborative filtering based music recommendations , 2019, ArXiv.

[18]  Andreas Krause,et al.  Preventing Disparate Treatment in Sequential Decision Making , 2018, IJCAI.

[19]  Krishna P. Gummadi,et al.  Equality of Voice: Towards Fair Representation in Crowdsourced Top-K Recommendations , 2018, FAT.

[20]  Nikos Mamoulis,et al.  Fairness in Package-to-Group Recommendations , 2017, WWW.

[21]  Michael Carl Tschantz,et al.  Automated Experiments on Ad Privacy Settings: A Tale of Opacity, Choice, and Discrimination , 2014, ArXiv.

[22]  Thorsten Joachims,et al.  Fairness of Exposure in Rankings , 2018, KDD.

[23]  Mengting Wan,et al.  Addressing Marketing Bias in Product Recommendations , 2019, WSDM.

[24]  Enrique Amigó,et al.  An Axiomatic Analysis of Diversity Evaluation Metrics: Introducing the Rank-Biased Utility Metric , 2018, SIGIR.