Ranking and scoring are ubiquitous. We consider the setting in which an institution, called a ranker, evaluates a set of individuals based on demographic, behavioral or other characteristics. The final output is a ranking that represents the relative quality of the individuals. While automatic and therefore seemingly objective, rankers can, and often do, discriminate against individuals and systematically disadvantage members of protected groups. This warrants a careful study of the fairness of a ranking scheme, to enable data science for social good applications, among others. In this paper we propose fairness measures for ranked outputs. We develop a data generation procedure that allows us to systematically control the degree of unfairness in the output, and study the behavior of our measures on these datasets. We then apply our proposed measures to several real datasets, and detect cases of bias. Finally, we show preliminary results of incorporating our ranked fairness measures into an optimization framework, and show potential for improving fairness of ranked outputs while maintaining accuracy. The code implementing all parts of this work is publicly available at https://github.com/DataResponsibly/FairRank.
[1]
Roxana Geambasu,et al.
Discovering Unwarranted Associations in Data-Driven Applications with the FairTest Testing Toolkit
,
2015,
ArXiv.
[2]
Indre Zliobaite,et al.
A survey on measuring indirect discrimination in machine learning
,
2015,
ArXiv.
[3]
Suresh Venkatasubramanian,et al.
On the (im)possibility of fairness
,
2016,
ArXiv.
[4]
Sihem Amer-Yahia,et al.
Making interval-based clustering rank-aware
,
2011,
EDBT/ICDT '11.
[5]
Jaana Kekäläinen,et al.
Cumulated gain-based evaluation of IR techniques
,
2002,
TOIS.
[6]
Frank A. Pasquale,et al.
[89WashLRev0001] The Scored Society: Due Process for Automated Predictions
,
2014
.
[7]
J. Reidenberg,et al.
Accountable Algorithms
,
2016
.
[8]
Toniann Pitassi,et al.
Fairness through awareness
,
2011,
ITCS '12.
[9]
Toniann Pitassi,et al.
Learning Fair Representations
,
2013,
ICML.