How Algorithms Discriminate Based on Data They Lack: Challenges, Solutions, and Policy Implications

[1]  E. Bonilla-Silva,et al.  White Logic, White Methods: Racism and Methodology , 2008 .

[2]  Sean F. Reardon,et al.  Recent Trends in Income, Racial, and Ethnic School Readiness Gaps at Kindergarten Entry , 2016 .

[3]  Kush R. Varshney,et al.  Decision Making With Quantized Priors Leads to Discrimination , 2017, Proceedings of the IEEE.

[4]  Ange-Marie Hancock,et al.  Empirical Intersectionality: A Tale of Two Approaches , 2013, The Palgrave Handbook of Intersectionality in Public Policy.

[5]  Tamara Shepherd,et al.  Datafication and discrimination , 2017 .

[6]  Devin G. Pope,et al.  Implementing Anti-discrimination Policies in Statistical Profiling Models , 2011 .

[7]  Melissa R. Gilbert.  THEORIZING DIGITAL AND URBAN INEQUALITIES , 2010 .

[8]  Arvind Narayanan,et al.  Semantics derived automatically from language corpora contain human-like biases , 2016, Science.

[9]  Lisa Nakamura.  Cybertypes: Race, Ethnicity, and Identity on the Internet , 2002 .

[10]  Christopher Harris.  The Capitalization of School Quality: , 2002 .

[11]  Susan Bibler Coutin,et al.  Deferred action and the discretionary state: migration, precarity and resistance* , 2017 .

[12]  Shaun R. Harper,et al.  Disproportionate Impact of K-12 School Suspension and Expulsion on Black Students in Southern States , 2016 .

[13]  S. Michael Gaddis,et al.  How Black Are Lakisha and Jamal? Racial Perceptions from Names Used in Correspondence Audit Studies , 2017 .

[14]  C. Steele,et al.  Stereotype threat and the intellectual test performance of African Americans. , 1995, Journal of personality and social psychology.

[15]  O. Gandy.  Engaging rational discrimination: exploring reasons for placing regulatory constraints on decision support systems , 2010, Ethics and Information Technology.

[16]  Latanya Sweeney,et al.  Discrimination in online ad delivery , 2013, CACM.

[17]  D. Karlen.  The Supreme Court of the United States , 1962 .

[18]  J. Stiglitz.  Information and the Change in the Paradigm in Economics , 2002 .

[19]  Jon M. Kleinberg,et al.  Inherent Trade-Offs in the Fair Determination of Risk Scores , 2016, ITCS.

[20]  Bettina Berendt,et al.  Better decision support through exploratory discrimination-aware data mining: foundations and empirical evidence , 2014, Artificial Intelligence and Law.

[21]  Danielle K. Citron.  Big Data Should Be Regulated by ‘Technological Due Process’ , 2016 .

[22]  Brooke Foucault Welles,et al.  On minorities and outliers: The case for making Big Data small , 2014, Big Data Soc..

[23]  Karrie Karahalios,et al.  Auditing Algorithms : Research Methods for Detecting Discrimination on Internet Platforms , 2014 .

[24]  Ann Phoenix,et al.  Intersectionality , 2006, The futures of feminism.

[25]  Myra Marx Ferree,et al.  Practicing Intersectionality in Sociological Research: A Critical Analysis of Inclusions, Interactions, and Institutions in the Study of Inequalities* , 2010 .

[26]  M. Spence.  Job Market Signaling , 1973 .

[27]  C. Goldin,et al.  Orchestrating Impartiality: The Impact of "Blind" Auditions on Female Musicians , 1997 .

[28]  Paul Warmington,et al.  QuantCrit: education, policy, ‘Big Data’ and principles for a critical race theory of statistics , 2018 .

[29]  Sebastian Ehrlichmann,et al.  The Economics of Discrimination , 2009 .

[30]  Scott R. Peppet.  Unraveling Privacy: The Personal Prospectus & the Threat of a Full Disclosure Future , 2010 .

[31]  Rachel E. Kranton,et al.  Identity Economics: How Our Identities Shape Our Work, Wages, and Well-Being , 2010 .

[32]  Martha A. Poon.  What lenders see -- : a history of the Fair Isaac scorecard , 2012 .

[33]  Amanda Y. Agan.  Increasing Employment of People with Records , 2017 .

[34]  Jennifer L. Glanville,et al.  BIRDS OF A FEATHER : Homophily in Social Networks , 2014 .

[35]  Jacob S. Rugh,et al.  SEGREGATION IN POST-CIVIL RIGHTS AMERICA , 2013, Du Bois Review: Social Science Research on Race.

[36]  Yu Xie,et al.  Population heterogeneity and causal inference , 2013, Proceedings of the National Academy of Sciences.

[37]  E. Phelps.  The Statistical Theory of Racism and Sexism , 1972 .

[38]  Toniann Pitassi,et al.  Fairness through awareness , 2011, ITCS '12.

[39]  William Seltzer,et al.  Federal Statistical Confidentiality and Business Data: Twentieth Century Challenges and Continuing Issues , 2009, J. Priv. Confidentiality.

[40]  Stephen L. Ross,et al.  The Color of Credit: Mortgage Discrimination, Research Methodology, and Fair-Lending Enforcement , 2002 .

[41]  Bill Fitzgerald,et al.  Algorithms and Bias: Q. and A. With Cynthia Dwork , 2015 .

[42]  Roland G. Fryer,et al.  Racial Disparities in Job Finding and Offered Wages , 2011, The Journal of Law and Economics.

[43]  Sheri Sheppard,et al.  Studying the career pathways of engineers: An illustration with two data sets , 2014 .

[44]  Jessie Daniels,et al.  Race and racism in Internet Studies: A review and critique , 2013, New Media Soc..

[45]  Wendy Hulko,et al.  The Time- and Context-Contingent Nature of Intersectionality and Interlocking Oppressions , 2009 .

[46]  L. McCall.  The Complexity of Intersectionality , 2005, Signs: Journal of Women in Culture and Society.

[47]  K. Crenshaw.  Demarginalizing the Intersection of Race and Sex: A Black Feminist Critique of Antidiscrimination Doctrine, Feminist Theory and Antiracist Politics , 1989 .

[48]  M. Spence.  Signaling in Retrospect and the Informational Structure of Markets , 2002 .

[49]  M. Goldberg.  Discrimination, Nepotism, and Long-Run Wage Differentials , 1982 .

[50]  J. Kleinberg,et al.  Prediction Policy Problems. , 2015, The American economic review.

[51]  Suresh Venkatasubramanian,et al.  On the (im)possibility of fairness , 2016, ArXiv.

[52]  Indre Zliobaite,et al.  Using sensitive personal data may be necessary for avoiding discrimination in data-driven decision models , 2016, Artificial Intelligence and Law.

[53]  Salvatore Ruggieri,et al.  A multidisciplinary survey on discrimination analysis , 2013, The Knowledge Engineering Review.

[54]  Matthias Leese,et al.  The new profiling: Algorithms, black boxes, and the failure of anti-discriminatory safeguards in the European Union , 2014 .

[55]  Sean F. Reardon,et al.  Income Inequality and Income Segregation1 , 2011, American Journal of Sociology.

[56]  M. McPherson,et al.  Birds of a Feather: Homophily in Social Networks , 2001 .

[57]  Karl A. Smith,et al.  Cambridge Handbook of Engineering Education Research: Retention and Persistence of Women and Minorities Along the Engineering Pathway in the United States , 2014 .

[58]  Phuong Nguyen-Hoang,et al.  The capitalization of school quality into house values: A review , 2011 .

[59]  Jake M. Hofman,et al.  Prediction and explanation in social systems , 2017, Science.

[60]  Jennifer L. Doleac,et al.  Does “Ban the Box” Help or Hurt Low-Skilled Workers? Statistical Discrimination and Employment Outcomes When Criminal Histories are Hidden , 2016 .

[61]  Kenneth J Arrow,et al.  Some Models of Racial Discrimination in the Labor Market , 1971 .

[62]  Susan Athey,et al.  Beyond prediction: Using big data for policy problems , 2017, Science.

[63]  Andrew D. Selbst,et al.  Big Data's Disparate Impact , 2016 .

[64]  Geoffrey Heeren.  The Status of Nonstatus , 2015 .

[65]  Jonas Lerman,et al.  Big Data and Its Exclusions , 2013 .

[66]  Jacob S. Rugh,et al.  Race, Space, and Cumulative Disadvantage: A Case Study of the Subprime Lending Collapse. , 2015, Social problems.

[67]  Andrew Dean Ho,et al.  Discreteness Causes Bias in Percentage-Based Comparisons: A Case Study From Educational Testing , 2015 .

[68]  L. Strahilevitz.  Privacy versus Antidiscrimination , 2007 .

[69]  Douglas D. Ready,et al.  Accuracy and Inaccuracy in Teachers’ Perceptions of Young Children’s Cognitive Abilities , 2011 .

[70]  Frances McCall Rosenbluth,et al.  Explaining Occupational Gender Inequality: Hours Regulation and Statistical Discrimination , 2011 .

[71]  S. Lundberg,et al.  The Enforcement of Equal Opportunity Laws Under Imperfect Information: Affirmative Action and Alternatives , 1991 .

[72]  P. Kim.  Data-Driven Discrimination at Work , 2017 .

[73]  Gustavo S. Mesch,et al.  Digital inequalities and why they matter , 2015 .

[74]  Jonathan Guryan,et al.  Prejudice and Wages: An Empirical Assessment of Becker’s The Economics of Discrimination , 2008, Journal of Political Economy.