The Use of Field Experiments to Study Mechanisms of Discrimination

Abstract This paper discusses social mechanisms of discrimination and reviews existing field experimental designs for their identification. We first explicate two social mechanisms proposed in the literature, animus-driven and statistical discrimination, to explain differential treatment based on ascriptive characteristics. We then present common approaches to study discrimination based on observational data and laboratory experiments, discuss their strengths and weaknesses, and elaborate why unobtrusive field experiments are a promising complement. However, apart from specific methodological challenges, well-established experimental designs fail to identify the mechanisms of discrimination. Consequently, we introduce a rapidly growing strand of research which actively intervenes in market activities varying costs and information for potential perpetrators to identify causal pathways of discrimination. We end with a summary of lessons learned and a discussion of challenges that lie ahead.

[1]  James J. Heckman,et al.  1. The Scientific Model of Causality , 2005 .

[2]  A. K. Geddes,et al.  The Child in America: Behavior Problems and Programs. , 1929 .

[3]  Axel Franzen,et al.  The external validity of giving in the dictator game , 2012 .

[4]  M. Sobel Discussion: ‘The Scientific Model of Causality’ , 2005 .

[5]  Raymond J. Struyk,et al.  Clear and Convincing Evidence: Measurement of Discrimination in America. , 1994 .

[6]  C. Ridgeway,et al.  The Social Construction of Status Value: Gender and Other Nominal Characteristics , 1991 .

[7]  George A. Akerlof,et al.  Economics and Identity , 2000 .

[8]  P. Hedström,et al.  Social Mechanisms: Social mechanisms: An introductory essay , 1998 .

[9]  D. Rubin Randomization Analysis of Experimental Data: The Fisher Randomization Test Comment , 1980 .

[10]  Andrea Moro,et al.  Theories of Statistical Discrimination and Affirmative Action: A Survey , 2010 .

[11]  Jeffrey M. Wooldridge,et al.  Estimating average partial effects under conditional moment independence assumptions , 2004 .

[12]  Jennifer L. Doleac,et al.  The Visible Hand: Race and Online Market Outcomes , 2010 .

[13]  Scott A. Golder,et al.  Digital Footprints: Opportunities and Challenges for Online Social Research , 2014 .

[14]  H. Seibert,et al.  Auf der Suche nach einer Erklärung für die spezifischen Arbeitsmarktnachteile von Jugendlichen türkischer Herkunft , 2006 .

[15]  R. Oaxaca Male-Female Wage Differentials in Urban Labor Markets , 1973 .

[16]  Bruce Western,et al.  Discrimination in a Low-Wage Labor Market , 2009, American sociological review.

[17]  S. Gaertner,et al.  Effects of Race on the Elicitation of Helping Behavior: The Wrong Number Technique. , 1971 .

[18]  Richard A. Posner,et al.  Aging and old age , 1996 .

[19]  L. Cronbach,et al.  Designing evaluations of educational and social programs , 1983 .

[20]  J. Heckman,et al.  Lab Experiments Are a Major Source of Knowledge in the Social Sciences , 2009, Science.

[21]  L. Blommaert,et al.  Discrimination of Arabic-Named Applicants in the Netherlands: An Internet-Based Field Experiment Examining Different Phases in Online Recruitment Procedures , 2014 .

[22]  T. Hinz,et al.  The Factorial Survey as a Method for Measuring Sensitive Issues , 2015 .

[23]  Michael Biggs Self-fulfilling prophecies , 2011 .

[24]  T. Good,et al.  The Self-Fulfilling Prophecy. , 1971 .

[25]  E. Goffman Stigma; Notes On The Management Of Spoiled Identity , 1964 .

[26]  G. Jasso,et al.  Assessing the gender gap in just earnings and its underlying mechanisms , 1999 .

[27]  E. Phelps The Statistical Theory of Racism and Sexism , 1972 .

[28]  A. Farmer,et al.  DISCRIMINATION, BAYESIAN UPDATING OF EMPLOYER BELIEFS, AND HUMAN CAPITAL ACCUMULATION , 1996 .

[29]  Colleen Glavinspiens,et al.  Walking the talk. , 2006, Imprint.

[30]  P. Hedström,et al.  Causal Mechanisms in the Social Sciences , 2010 .

[31]  Jeffrey T. Hancock,et al.  Experimental evidence of massive-scale emotional contagion through social networks , 2014, Proceedings of the National Academy of Sciences.

[32]  Y. Paradies A systematic review of empirical research on self-reported racism and health. , 2006, International journal of epidemiology.

[33]  Jonathan Guryan,et al.  Taste�?Based or Statistical Discrimination: The Economics of Discrimination Returns to its Roots , 2013 .

[34]  M. Redman The economic approach to human behavior : . Chicago, Illinois: The University of Chicago Press, 1977. Pp. 314, $17.00 , 1978 .

[35]  D. Basu Randomization Analysis of Experimental Data: The Fisher Randomization Test , 1980 .

[36]  Jeffrey R. Kling,et al.  Mechanism Experiments and Policy Evaluations , 2011 .

[37]  J. List The nature and extent of discrimination in the marketplace: Evidence from the field , 2004 .

[38]  Kosuke Imai,et al.  Unpacking the Black Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies , 2011, American Political Science Review.

[39]  Patricia Prescott-Clarke,et al.  Racial Discrimination and White-collar Workers in Britain , 1970 .

[40]  P. Bourdieu Distinction: A Social Critique of the Judgement of Taste* , 2018, Food and Culture.

[41]  D. Rubin,et al.  Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction , 2016 .

[42]  Arnfinn H. Midtbøen,et al.  DISCRIMINATION. Methodological controversies and sociological perspectives on future research , 2012 .

[43]  H. Tajfel Differentiation between social groups: Studies in the social psychology of intergroup relations. , 1978 .

[44]  J. Tyran,et al.  The Price of Prejudice , 2014 .

[45]  D. Pager,et al.  Bayesian Bigot? Statistical Discrimination, Stereotypes, and Employer Decision Making , 2009, The Annals of the American Academy of Political and Social Science.

[46]  J. Neyman,et al.  Statistical Problems in Agricultural Experimentation , 1935 .

[47]  Kenneth C. Williams,et al.  Experimental Political Science and the Study of Causality: The Advent of Experimental Political Science , 2010 .

[48]  D. Pager,et al.  The Sociology of Discrimination: Racial Discrimination in Employment, Housing, Credit, and Consumer Markets. , 2008, Annual review of sociology.

[49]  Kenneth C. Williams,et al.  Experimental Political Science and the Study of Causality: From Nature to the Lab , 2010 .

[50]  J. Heckman Detecting Discrimination , 1998 .

[51]  Angus Deaton Instruments, Randomization, and Learning about Development , 2010 .

[52]  S. Ceci,et al.  National hiring experiments reveal 2:1 faculty preference for women on STEM tenure track , 2015, Proceedings of the National Academy of Sciences.

[53]  C. Pierret,et al.  Employer Learning and Statistical Discrimination , 1997 .

[54]  Asaf Zussman Ethnic Discrimination: Lessons from the Israeli Online Market for Used Cars , 2013 .

[55]  R. LaPiere Attitudes vs Actions. 1934. , 1934, International journal of epidemiology.

[56]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[57]  Thomas Faist,et al.  From Heterogeneities to Inequalities : Looking at Social Mechanisms as an Explanatory Approach to the Generation of Social Inequalities , 2011 .

[58]  Grant Whitehorn,et al.  ARE EMILY AND GREG MORE EMPLOYABLE THAN LAKISHA AND JAMAL ? , 2012 .

[59]  Christopher Winship,et al.  Counterfactuals and Causal Inference: Methods and Principles for Social Research , 2007 .

[60]  Leon Mann,et al.  THE LOST-LETTER TECHNIQUE: A TOOL OF SOCIAL RESEARCH , 1965 .

[61]  A. Young Mostly Harmless Econometrics , 2012 .

[62]  D. Pager,et al.  Walking the Talk? What Employers Say Versus What They Do , 2005 .

[63]  B. Reskin Including Mechanisms in Our Models of Ascriptive Inequality , 2003, American Sociological Review.

[64]  Brian F. Bowdle,et al.  Insult, aggression, and the southern culture of honor: an "experimental ethnography". , 1996, Journal of personality and social psychology.

[65]  Christopher Winship,et al.  Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable. , 2014, Annual review of sociology.

[66]  D. Aigner,et al.  Statistical Theories of Discrimination in Labor Markets , 1977 .

[67]  A. Blinder Wage Discrimination: Reduced Form and Structural Estimates , 1973 .

[68]  J. Mincer Schooling, Experience, and Earnings , 1976 .

[69]  M. Jackson,et al.  The Principles of Experimental Design and Their Application in Sociology , 2013 .

[70]  Stanley Lieberson,et al.  Making It Count: The Improvement of Social Research and Theory. , 1987 .

[71]  K. Arrow The Theory of Discrimination , 1971 .

[72]  Gijs van de Kuilen,et al.  Belief Elicitation: A Horse Race Among Truth Serums , 2011 .

[73]  Kosuke Imai,et al.  Experimental designs for identifying causal mechanisms , 2013 .

[74]  Barbara F. Reskin,et al.  Including Mechanisms in Our Models of Ascriptive Inequality , 2003, American Sociological Review.

[75]  D. Rubin Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[76]  F. Kalter,et al.  Between Mechanism Talk And Mechanism Cult: New Emphases in Explanatory Sociology And Empirical Research , 2014 .

[77]  P. Riach,et al.  Field Experiments of Discrimination in the Market Place , 2002 .

[78]  N. Krieger Discrimination and Health Inequities , 2014, International journal of health services : planning, administration, evaluation.

[79]  H. Tajfel,et al.  The Social Identity Theory of Intergroup Behavior. , 2004 .

[80]  Lee Jussim,et al.  Teacher Expectations and Self-Fulfilling Prophecies: Knowns and Unknowns, Resolved and Unresolved Controversies , 2005, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[81]  Sebastian Ehrlichmann,et al.  The Economics of Discrimination , 2009 .

[82]  M. Sherif Superordinate Goals in the Reduction of Intergroup Conflict , 1958, American Journal of Sociology.

[83]  Ben Jann,et al.  Reputation Formation and the Evolution of Cooperation in Anonymous Online Markets , 2014 .

[84]  Jonathan Guryan,et al.  Studying Discrimination: Fundamental Challenges and Recent Progress , 2011 .

[85]  F. Squazzoni,et al.  Employer Networks, Priming, and Discrimination in Hiring: An Experiment , 2014 .

[86]  D. Rubin For objective causal inference, design trumps analysis , 2008, 0811.1640.

[87]  Diego Gambetta,et al.  Codes of the Underworld: How Criminals Communicate , 2009 .

[88]  Jens Hainmueller,et al.  Validating vignette and conjoint survey experiments against real-world behavior , 2015, Proceedings of the National Academy of Sciences.

[89]  Steven D. Levitt,et al.  FIELD EXPERIMENTS IN ECONOMICS : THE PAST , THE PRESENT , AND THE FUTURE , 2008 .

[90]  Heike Solga,et al.  Gleiche Chancen dank einer abgeschlossenen Ausbildung? Zum Signalwert von Ausbildungsabschlüssen bei ausländischen und deutschen jungen Erwachsenen , 2005 .

[91]  P. Hedström Dissecting the Social: On the Principles of Analytical Sociology , 2005 .

[92]  F. Kalter Auf der Suche nach einer Erklärung für die spezifischen Arbeitsmarktnachteile Jugendlicher türkischer Herkunft. Zugleich eine Replik auf den Beitrag von Holger Seibert und Heike Solga: "Gleiche Chancen dank einer abgeschlossenen Ausbildung?" (ZfS 5/2005) , 2006 .

[93]  Linda Steg,et al.  The Spreading of Disorder , 2008, Science.

[94]  D. Campbell Factors relevant to the validity of experiments in social settings. , 1957, Psychological bulletin.

[95]  Colin F. Camerer,et al.  The Promise and Success of Lab-Field Generalizability in Experimental Economics: A Critical Reply to Levitt and List , 2011 .

[96]  Kenneth J. Arrow,et al.  What Has Economics to Say about Racial Discrimination , 1998 .

[97]  Robert S Gibbons,et al.  Learning and Wage Dynamics , 1991 .

[98]  Bárbara C. Cruz Walking the Talk , 1997 .

[99]  C. Blumberg Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction , 2016 .

[100]  Steven D. Levitt,et al.  Viewpoint: On the Generalizability of Lab Behaviour to the Field , 2007 .

[101]  Lincoln Quillian,et al.  NEW APPROACHES TO UNDERSTANDING RACIAL PREJUDICE AND DISCRIMINATION , 2006 .

[102]  James J. Heckman,et al.  The Urban Institute Audit Studies: Their Methods and Findings , 1993 .

[103]  P. Riach,et al.  Deceptive Field Experiments of Discrimination: Are They Ethical? , 2004 .

[104]  F. Rosenbluth,et al.  Women, Work, and Politics: The Political Economy of Gender Inequality , 2010 .

[105]  Maria Krysan,et al.  Prejudice, politics, and public opinion : Understanding the sources of racial policy attitudes , 2000 .

[106]  David Neumark,et al.  Detecting Discrimination in Audit and Correspondence Studies , 2010, The Journal of Human Resources.

[107]  T. Hinz,et al.  Factorial Survey Experiments , 2014 .

[108]  G. Becker,et al.  The Economic Approach to Human Behavior , 1978 .