Gender, risk assessment, and sanctioning: The cost of treating women like men.

Increasingly, jurisdictions across the United States are using risk assessment instruments to scaffold efforts to unwind mass incarceration without compromising public safety. Despite promising results, critics oppose the use of these instruments to inform sentencing and correctional decisions. One argument is that the use of instruments that include gender as a risk factor will discriminate against men in sanctioning. On the basis of a sample of 14,310 federal offenders, we empirically test the predictive fairness of an instrument that omits gender, the Post Conviction Risk Assessment (PCRA). We found that the PCRA strongly predicts arrests for both genders, but overestimates women's likelihood of recidivism. For a given PCRA score, the predicted probability of arrest, which is based on combining both genders, is too high for women. Although gender neutrality is an obviously appealing concept, it may translate into instrument bias and overly harsh sanctions for women. With respect to the moral question of disparate impact, we found that women obtain slightly lower mean scores on the PCRA than men (d = .32, 99% CI = .29-.35, or 87% overlap in scores); this difference is wholly attributable to men's greater criminal history, a factor already embedded in sentencing guidelines. (PsycINFO Database Record

[1]  T. Cleary TEST BIAS: PREDICTION OF GRADES OF NEGRO AND WHITE STUDENTS IN INTEGRATED COLLEGES , 1968 .

[2]  Sarah L Desmarais,et al.  Performance of recidivism risk assessment instruments in U.S. correctional settings. , 2016, Psychological services.

[3]  Wendy Wood,et al.  Provided for Non-commercial Research and Educational Use Only. Not for Reproduction, Distribution or Commercial Use. Biosocial Construction of Sex Differences and Similarities in Behavior , 2022 .

[4]  Galit Shmueli,et al.  Research Commentary - Too Big to Fail: Large Samples and the p-Value Problem , 2013, Inf. Syst. Res..

[5]  P. Sackett,et al.  Principles for the Validation and Use of Personnel Selection Procedures , 2018, Industrial and Organizational Psychology.

[6]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[7]  Richard S. Frase Recurring Policy Issues of Guidelines (and non-Guidelines) Sentencing: Risk Assessments, Criminal History Enhancements, and the Enforcement of Release Conditions , 2014 .

[8]  Grant T. Harris,et al.  Comparing Effect Sizes in Follow-Up Studies: ROC Area, Cohen's d, and r , 2005, Law and human behavior.

[9]  Robert J. Sampson,et al.  Violent victimization and offending: Individual-, situational-, and community-level risk factors. , 1994 .

[10]  Herman Aguinis,et al.  Revival of test bias research in preemployment testing. , 2010, The Journal of applied psychology.

[11]  C. Reynolds Methods for Detecting and Evaluating Cultural Bias in Neuropsychological Tests , 2000 .

[12]  Nina L. Colwill,et al.  The psychology of sex differences , 1978 .

[13]  Christopher T. Lowenkamp,et al.  Does Change in Risk Matter , 2016 .

[14]  Kathleen Daly,et al.  Gender, Race, and Sentencing , 1997, Crime and Justice.

[15]  Jennifer L. Skeem,et al.  Risk Redux: The Resurgence of Risk Assessment in Criminal Sanctioning , 2014 .

[16]  B. Western,et al.  The growth of incarceration in the United States: exploring causes and consequences , 2014 .

[17]  Christopher T. Lowenkamp,et al.  Predicting recidivism with the Psychological Inventory of Criminal Thinking Styles (PICTS) in community-supervised male and female federal offenders. , 2016, Psychological assessment.

[18]  Christopher T. Lowenkamp,et al.  The Construction and Validation of the Federal Post Conviction Risk Assessment ( PCRA ) , 2015 .

[19]  Sonja B. Starr Evidence-Based Sentencing and the Scientific Rationalization of Discrimination , 2013 .

[20]  J. Given Society and Homicide in Thirteenth-Century England , 1978 .

[21]  Shana Hertz Hattis Crime in the United States , 2013 .

[22]  Christopher T. Lowenkamp,et al.  The federal Post Conviction Risk Assessment (PCRA): a construction and validation study. , 2013, Psychological services.

[23]  H. J. Arnold Moderator variables: A clarification of conceptual, analytic, and psychometric issues , 1982 .

[24]  D. Hemenway The city that became safe: New York's lessons for urban crime and its control , 2012, Injury Prevention.

[25]  K. Babchishin,et al.  The influence of base rates on correlations: An evaluation of proposed alternative effect sizes with real-world data , 2016, Behavior research methods.

[26]  Jennifer L. Skeem,et al.  Risk, Race, & Recidivism: Predictive Bias and Disparate Impact , 2016 .

[27]  Eric Silver,et al.  Constructing Actuarial Devices for Predicting Recidivism , 2000 .

[28]  Christopher T. Lowenkamp,et al.  PCRA revisited: Testing the validity of the Federal Post Conviction Risk Assessment (PCRA). , 2015, Psychological services.

[29]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[30]  J. Simon Rise of the Carceral State , 2014 .

[31]  J. Monahan The Inclusion of Biological Risk Factors in Violence Risk Assessments , 2013 .

[32]  Emily J. Salisbury,et al.  Women’s Risk Factors and Their Contributions to Existing Risk/Needs Assessment , 2010 .

[33]  P. Gendreau,et al.  A META‐ANALYSIS OF THE PREDICTORS OF ADULT OFFENDER RECIDIVISM: WHAT WORKS!* , 1996 .

[34]  M. Tonry Legal and Ethical Issues in the Prediction of Recidivism , 2014 .

[35]  D. Eignor The standards for educational and psychological testing. , 2013 .

[36]  Matthew J Borneman,et al.  High stakes testing in higher education and employment: appraising the evidence for validity and fairness. , 2008, The American psychologist.

[37]  Daniel S. Nagin,et al.  Prisons Do Not Reduce Recidivism , 2011 .

[38]  Yvonne Neudorf,et al.  A General Theory Of Crime , 2016 .

[39]  K. Douglas,et al.  Using social science to reduce violent offending , 2011 .

[40]  J. Monahan,et al.  Evidence-based sentencing: Public openness and opposition to using gender, age, and race as risk factors for recidivism. , 2016, Law and human behavior.

[41]  A. Blumstein Criminal careers and "career criminals" , 1986 .

[42]  Richard S. Frase,et al.  Criminal History Enhancements Sourcebook , 2015 .

[43]  P. Bobko,et al.  Conceptual and Technical Issues in Conducting and Interpreting Differential Prediction Analyses , 2010, Industrial and Organizational Psychology.

[44]  Jennifer L. Skeem,et al.  Science Current Directions in Psychological Current Directions in Violence Risk Assessment on Behalf Of: Association for Psychological Science , 2022 .

[45]  Christopher T. Lowenkamp,et al.  The Risk Principle in Action: What Have We Learned From 13,676 Offenders and 97 Correctional Programs? , 2006 .

[46]  Kristy Holtfreter,et al.  Gender and Risk Assessment , 2007 .

[47]  Francis T. Cullen,et al.  Can 14,737 women be wrong? A meta‐analysis of the LSI‐R and recidivism for female offenders* , 2009 .

[48]  C. Reynolds,et al.  Bias in Psychological Assessment: An Empirical Review and Recommendations , 2003 .

[49]  Jennifer L. Skeem,et al.  Risk Assessment in Criminal Sentencing. , 2016, Annual review of clinical psychology.

[50]  C. Kruttschnitt Gender and Crime , 2013 .