Addressing Bias and Fairness in Search Systems

Search systems have unprecedented influence on how and what information people access. These gateways to information on the one hand create an easy and universal access to online information, and on the other hand create biases that have shown to cause knowledge disparity and ill-decisions for information seekers. Most of the algorithms for indexing, retrieval, and ranking are heavily driven by the underlying data that itself is biased. In addition, orderings of the search results create position bias and exposure bias due to their considerable focus on relevance and user satisfaction. These and other forms of biases that are implicitly and sometimes explicitly woven in search systems are becoming increasing threats to information seeking and sense-making processes. In this tutorial, we will introduce the issues of biases in data, in algorithms, and overall in search processes and show how we could think about and create systems that are fairer, with increasing diversity and transparency. Specifically, the tutorial will present several fundamental concepts such as relevance, novelty, diversity, bias, and fairness using socio-technical terminologies taken from various communities, and dive deeper into metrics and frameworks that allow us to understand, extract, and materialize them. The tutorial will cover some of the most recent works in this area and show how this interdisciplinary research has opened up new challenges and opportunities for communities such as SIGIR.

[1]  Chirag Shah,et al.  How Fair Can We Go: Detecting the Boundaries of Fairness Optimization in Information Retrieval , 2019, ICTIR.

[2]  Piotr Sapiezynski,et al.  Quantifying the Impact of User Attentionon Fair Group Representation in Ranked Lists , 2019, WWW.

[3]  Bert Huang,et al.  New Fairness Metrics for Recommendation that Embrace Differences , 2017, ArXiv.

[4]  Ed H. Chi,et al.  Fairness in Recommendation Ranking through Pairwise Comparisons , 2019, KDD.

[5]  Shuyuan Xu,et al.  Fairness-Aware Explainable Recommendation over Knowledge Graphs , 2020, SIGIR.

[6]  Nisheeth K. Vishnoi,et al.  Controlling Polarization in Personalization: An Algorithmic Framework , 2019, FAT.

[7]  Chirag Shah,et al.  Counteracting Bias and Increasing Fairness in Search and Recommender Systems , 2020, RecSys.

[8]  Masoud Mansoury,et al.  Fairness-Aware Recommendation in Multi-Sided Platforms , 2021, WSDM.

[9]  Alexandra Chouldechova,et al.  Fair prediction with disparate impact: A study of bias in recidivism prediction instruments , 2016, Big Data.

[10]  Sahin Cem Geyik,et al.  Fairness-Aware Ranking in Search & Recommendation Systems with Application to LinkedIn Talent Search , 2019, KDD.

[11]  Julia Stoyanovich,et al.  Measuring Fairness in Ranked Outputs , 2016, SSDBM.

[12]  Krishna P. Gummadi,et al.  iFair: Learning Individually Fair Data Representations for Algorithmic Decision Making , 2018, 2019 IEEE 35th International Conference on Data Engineering (ICDE).

[13]  Chirag Shah,et al.  Towards Fairness-Aware Ranking by Defining Latent Groups Using Inferred Features , 2021, BIAS.

[14]  Thorsten Joachims,et al.  Policy Learning for Fairness in Ranking , 2019, NeurIPS.

[15]  Thorsten Joachims,et al.  Controlling Fairness and Bias in Dynamic Learning-to-Rank , 2020, SIGIR.

[16]  Michael D. Ekstrand,et al.  Comparing Fair Ranking Metrics , 2020, ArXiv.

[17]  Andrew D. Selbst,et al.  Big Data's Disparate Impact , 2016 .

[18]  Chirag Shah,et al.  Users' Perception of Search Engine Biases and Satisfaction , 2021, BIAS.

[19]  Yongfeng Zhang,et al.  Towards Long-term Fairness in Recommendation , 2021, WSDM.

[20]  Krishna P. Gummadi,et al.  Equity of Attention: Amortizing Individual Fairness in Rankings , 2018, SIGIR.

[21]  Ruoyuan Gao,et al.  Toward a fairer information retrieval system , 2021, SIGIR Forum.

[22]  Yunqi Li,et al.  User-oriented Fairness in Recommendation , 2021, WWW.

[23]  Ruoyuan Gao,et al.  Toward creating a fairer ranking in search engine results , 2020, Inf. Process. Manag..

[24]  Bhaskar Mitra,et al.  Evaluating Stochastic Rankings with Expected Exposure , 2020, CIKM.

[25]  Matt J. Kusner,et al.  Counterfactual Fairness , 2017, NIPS.

[26]  Thorsten Joachims,et al.  Fairness of Exposure in Rankings , 2018, KDD.

[27]  Fernando Diaz,et al.  Auditing Search Engines for Differential Satisfaction Across Demographics , 2017, WWW.

[28]  Thorsten Joachims,et al.  Fair Learning-to-Rank from Implicit Feedback , 2019, ArXiv.

[29]  Pratyush Garg,et al.  Fairness Metrics: A Comparative Analysis , 2020, 2020 IEEE International Conference on Big Data (Big Data).

[30]  Krishna P. Gummadi,et al.  FairRec: Two-Sided Fairness for Personalized Recommendations in Two-Sided Platforms , 2020, WWW.

[31]  Elke A. Rundensteiner,et al.  FARE: Diagnostics for Fair Ranking using Pairwise Error Metrics , 2019, WWW.

[32]  Stefan Kramer,et al.  Fair pairwise learning to rank , 2020, 2020 IEEE 7th International Conference on Data Science and Advanced Analytics (DSAA).

[33]  Krishna P. Gummadi,et al.  Quantifying Search Bias: Investigating Sources of Bias for Political Searches in Social Media , 2017, CSCW.

[34]  Sahil Verma,et al.  Facets of Fairness in Search and Recommendation , 2020, BIAS.

[35]  Fernando Diaz,et al.  Towards a Fair Marketplace: Counterfactual Evaluation of the trade-off between Relevance, Fairness & Satisfaction in Recommendation Systems , 2018, CIKM.