Learning Optimal Fair Policies

Systematic discriminatory biases present in our society influence the way data is collected and stored, the way variables are defined, and the way scientific findings are put into practice as policy. Automated decision procedures and learning algorithms applied to such data may serve to perpetuate existing injustice or unfairness in our society. In this paper, we consider how to make optimal but fair decisions, which "break the cycle of injustice" by correcting for the unfair dependence of both decisions and outcomes on sensitive features (e.g., variables that correspond to gender, race, disability, or other protected attributes). We use methods from causal inference and constrained optimization to learn optimal policies in a way that addresses multiple potential biases which afflict data analysis in sensitive contexts, extending the approach of Nabi & Shpitser (2018). Our proposal comes equipped with the theoretical guarantee that the chosen fair policy will induce a joint distribution for new instances that satisfies given fairness constraints. We illustrate our approach with both synthetic data and real criminal justice data.

[1]  Elias Bareinboim,et al.  Fairness in Decision-Making - The Causal Explanation Formula , 2018, AAAI.

[2]  I. Shpitser,et al.  Estimation of a Semiparametric Natural Direct Effect Model Incorporating Baseline Covariates. , 2014, Biometrika.

[3]  Aaron Roth,et al.  Fairness in Reinforcement Learning , 2016, ICML.

[4]  Alexandra Chouldechova,et al.  A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions , 2018, FAT.

[5]  Ilya Shpitser,et al.  Counterfactual Graphical Models for Longitudinal Mediation Analysis With Unobserved Confounding , 2012, Cogn. Sci..

[6]  Lu Zhang,et al.  A Causal Framework for Discovering and Removing Direct and Indirect Discrimination , 2016, IJCAI.

[7]  T. Richardson.  Single World Intervention Graphs ( SWIGs ) : A Unification of the Counterfactual and Graphical Approaches to Causality , 2013 .

[8]  Faisal Kamiran,et al.  Quantifying explainable discrimination and removing illegal discrimination in automated decision making , 2012, Knowledge and Information Systems.

[9]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[10]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[11]  J. Pearl.  Causality: Models, Reasoning and Inference , 2000 .

[12]  Nathan Srebro,et al.  Equality of Opportunity in Supervised Learning , 2016, NIPS.

[13]  Carlos Eduardo Scheidegger,et al.  Certifying and Removing Disparate Impact , 2014, KDD.

[14]  Avi Feller,et al.  Algorithmic Decision Making and the Cost of Fairness , 2017, KDD.

[15]  Silvia Chiappa,et al.  Path-Specific Counterfactual Fairness , 2018, AAAI.

[16]  J. Robins,et al.  Doubly Robust Estimation in Missing Data and Causal Inference Models , 2005, Biometrics.

[17]  Tom Burr,et al.  Causation, Prediction, and Search , 2003, Technometrics.

[18]  Judea Pearl,et al.  Complete Identification Methods for the Causal Hierarchy , 2008, J. Mach. Learn. Res..

[19]  Franco Turini,et al.  Discrimination-aware data mining , 2008, KDD.

[20]  Ilya Shpitser,et al.  Fair Inference on Outcomes , 2017, AAAI.

[21]  Erica E. M. Moodie,et al.  Statistical Methods for Dynamic Treatment Regimes: Reinforcement Learning, Causal Inference, and Personalized Medicine , 2013 .

[22]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[23]  Martin Wainwright,et al.  Identification in Graphical Causal Models , 2018 .

[24]  Ilya Shpitser,et al.  Semiparametric Theory for Causal Mediation Analysis: efficiency bounds, multiple robustness, and sensitivity analysis. , 2012, Annals of statistics.

[25]  James M. Robins,et al.  Optimal Structural Nested Models for Optimal Sequential Decisions , 2004 .

[26]  Judea Pearl,et al.  Equivalence and Synthesis of Causal Models , 1990, UAI.

[27]  Matt J. Kusner,et al.  Counterfactual Fairness , 2017, NIPS.

[29]  Christopher T. Lowenkamp,et al.  False Positives, False Negatives, and False Analyses: A Rejoinder to "Machine Bias: There's Software Used across the Country to Predict Future Criminals. and It's Biased against Blacks" , 2016 .

[30]  Judea Pearl,et al.  Direct and Indirect Effects , 2001, UAI.

[31]  I. Shpitser,et al.  CAUSAL INFERENCE WITH A GRAPHICAL HIERARCHY OF INTERVENTIONS. , 2014, Annals of statistics.

[32]  Eric J. Tchetgen Tchetgen,et al.  Semiparametric Estimation of Models for Natural Direct and Indirect Effects , 2011 .