A review of predictive policing from the perspective of fairness

Machine Learning has become a popular tool in a variety of applications in criminal justice, including sentencing and policing. Media has brought attention to the possibility of predictive policing systems causing disparate impacts and exacerbating social injustices. However, there is little academic research on the importance of fairness in machine learning applications in policing. Although prior research has shown that machine learning models can handle some tasks efficiently, they are susceptible to replicating systemic bias of previous human decision-makers. While there is much research on fair machine learning in general, there is a need to investigate fair machine learning techniques as they pertain to the predictive policing. Therefore, we evaluate the existing publications in the field of fairness in machine learning and predictive policing to arrive at a set of standards for fair predictive policing. We also review the evaluations of ML applications in the area of criminal justice and potential techniques to improve these technologies going forward. We urge that the growing literature on fairness in ML be brought into conversation with the legal and social science concerns being raised about predictive policing. Lastly, in any area, including predictive policing, the pros and cons of the technology need to be evaluated holistically to determine whether and how the technology should be used in policing.

[1]  K. Crawford,et al.  Dirty Data, Bad Predictions: How Civil Rights Violations Impact Police Data, Predictive Policing Systems, and Justice , 2019 .

[2]  Suresh Venkatasubramanian,et al.  Runaway Feedback Loops in Predictive Policing , 2017, FAT.

[3]  N. Cristianini,et al.  Machine Decisions and Human Consequences , 2018, Algorithmic Regulation.

[4]  Guillermo Sapiro,et al.  Fairness With Minimal Harm: A Pareto-Optimal Approach For Healthcare , 2019, ArXiv.

[5]  Julia Rubin,et al.  Fairness Definitions Explained , 2018, 2018 IEEE/ACM International Workshop on Software Fairness (FairWare).

[6]  Toniann Pitassi,et al.  Fairness through awareness , 2011, ITCS '12.

[7]  Vidushi Marda,et al.  Data in New Delhi's predictive policing system , 2020, FAT*.

[8]  Kush R. Varshney,et al.  Bias Mitigation Post-processing for Individual and Group Fairness , 2018, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Martin Wattenberg,et al.  The What-If Tool: Interactive Probing of Machine Learning Models , 2019, IEEE Transactions on Visualization and Computer Graphics.

[10]  Micah Altman,et al.  A Harm-Reduction Framework for Algorithmic Fairness , 2018, IEEE Security & Privacy.

[11]  Kristina Lerman,et al.  A Survey on Bias and Fairness in Machine Learning , 2019, ACM Comput. Surv..

[12]  Andrea L. Bertozzi,et al.  Randomized Controlled Field Trials of Predictive Policing , 2015 .

[13]  Ephraim Nissan,et al.  Digital technologies and artificial intelligence’s present and foreseeable impact on lawyering, judging, policing and law enforcement , 2015, AI & SOCIETY.

[14]  Sebastian Benthall,et al.  Racial categories in machine learning , 2018, FAT.

[15]  J. Chan,et al.  Algorithmic prediction in policing: assumptions, evaluation, and accountability , 2016 .

[16]  Andrew Guthrie Ferguson,et al.  Policing Predictive Policing , 2016 .

[17]  Gian Maria Campedelli,et al.  Where are we? Using Scopus to map the literature at the intersection between artificial intelligence and research on crime , 2019, Journal of Computational Social Science.

[18]  Suresh Venkatasubramanian,et al.  A comparative study of fairness-enhancing interventions in machine learning , 2018, FAT.

[19]  K. Lum,et al.  To predict and serve? , 2016 .

[20]  Peter M. Asaro,et al.  AI Ethics in Predictive Policing: From Models of Threat to an Ethics of Care , 2019, IEEE Technology and Society Magazine.

[21]  Krishna P. Gummadi,et al.  An Empirical Study on Learning Fairness Metrics for COMPAS Data with Human Supervision , 2019, ArXiv.

[22]  P. Jeffrey Brantingham,et al.  Does Predictive Policing Lead to Biased Arrests? Results From a Randomized Controlled Trial , 2018 .

[23]  Hanna M. Wallach,et al.  Fairlearn: A toolkit for assessing and improving fairness in AI , 2020 .

[24]  Reuben Binns,et al.  What Can Political Philosophy Teach Us about Algorithmic Fairness? , 2018, IEEE Security & Privacy.

[25]  Annette Vestby,et al.  Machine Learning and the Police: Asking the Right Questions , 2019, Policing: A Journal of Policy and Practice.

[26]  Patrick Perrot.  What about AI in criminal intelligence? From predictive policing to AI perspectives , 2017 .

[27]  Rachel K. E. Bellamy,et al.  AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Bias , 2018, ArXiv.

[28]  Inioluwa Deborah Raji,et al.  On the Legal Compatibility of Fairness Definitions , 2019, ArXiv.

[29]  Krishna P. Gummadi,et al.  A Unified Approach to Quantifying Algorithmic Unfairness: Measuring Individual &Group Unfairness via Inequality Indices , 2018, KDD.

[30]  Vasant Honavar,et al.  Algorithmic Bias in Recidivism Prediction: A Causal Perspective , 2019, AAAI.

[31]  Kush R. Varshney,et al.  Optimized Data Pre-Processing for Discrimination Prevention , 2017, ArXiv.

[32]  R. B. Santos.  Critic: Predictive Policing: Where’s the Evidence? , 2019 .

[33]  A. Persson,et al.  How to make decisions with algorithms , 2017 .

[34]  Krishna P. Gummadi,et al.  A Moral Framework for Understanding of Fair ML through Economic Models of Equality of Opportunity , 2018, ArXiv.

[35]  Alexandra Chouldechova,et al.  Fair prediction with disparate impact: A study of bias in recidivism prediction instruments , 2016, Big Data.

[36]  Sharad Goel,et al.  The Measure and Mismeasure of Fairness: A Critical Review of Fair Machine Learning , 2018, ArXiv.

[37]  M. Kearns,et al.  Fairness in Criminal Justice Risk Assessments: The State of the Art , 2017, Sociological Methods & Research.

[38]  Andrew D. Selbst.  Disparate Impact in Big Data Policing , 2017 .

[39]  Carter C. Price,et al.  Predictive Policing: The Role of Crime Forecasting in Law Enforcement Operations , 2013 .

[40]  Yongjie Yang,et al.  Fairness in Algorithmic Decision-Making: Applications in Multi-Winner Voting, Machine Learning, and Recommender Systems , 2019, Algorithms.

[41]  Rayid Ghani,et al.  Aequitas: A Bias and Fairness Audit Toolkit , 2018, ArXiv.

[42]  Olfa Nasraoui,et al.  Transparency in Fair Machine Learning: the Case of Explainable Recommender Systems , 2018, Human and Machine Learning.

[43]  Elizabeth E. Joh.  Artificial Intelligence and Policing: First Questions , 2018 .

[44]  Bettina Berendt,et al.  What is wrong about Robocops as consultants? A technology-centric critique of predictive policing , 2018, AI & SOCIETY.

[45]  Avi Feller,et al.  Algorithmic Decision Making and the Cost of Fairness , 2017, KDD.

[46]  Iordanis Kavathatzopoulos,et al.  How to make decisions with algorithms: ethical decision-making using algorithms within predictive analytics , 2018, CSOC.