Field Experiments on Discrimination

This article reviews the existing field experimentation literature on the prevalence of discrimination, the consequences of such discrimination, and possible approaches to undermine it. We highlight key gaps in the literature and ripe opportunities for future field work. Section 1 reviews the various experimental methods that have been employed to measure the prevalence of discrimination, most notably audit and correspondence studies; it also describes several other measurement tools commonly used in lab-based work that deserve greater consideration in field research. Section 2 provides an overview of the literature on the costs of being stereotyped or discriminated against, with a focus on self-expectancy effects and self-fulfilling prophecies; section 2 also discusses the thin field-based literature on the consequences of limited diversity in organizations and groups. The final section of the paper, Section 3, reviews the evidence for policies and interventions aimed at weakening discrimination, covering role model and intergroup contact effects, as well as socio-cognitive and technological de-biasing strategies.

[1]  Bertram Gawronski,et al.  When “Just Say No” is not enough: Affirmation versus negation training and the reduction of automatic stereotype activation☆ , 2008 .

[2]  Bradley Wright,et al.  Are Gay Men and Lesbians Discriminated Against When Applying for Jobs? A Four-City, Internet-Based Field Experiment , 2013, Journal of homosexuality.

[3]  Mark Levine,et al.  Deindividuation, power relations between groups and the expression of social identity: The effects of visibility to the out‐group , 1994 .

[4]  Joshua Aronson,et al.  Improving adolescents' standardized test performance: An intervention to reduce the effects of stereotype threat , 2003 .

[5]  Emir Kamenica,et al.  Racial Preferences in Dating , 2008 .

[6]  Patrick S. Forscher,et al.  Long-term reduction in implicit race bias: A prejudice habit-breaking intervention. , 2012, Journal of experimental social psychology.

[7]  David Ong,et al.  Income Attraction: An Online Dating Field Experiment , 2015 .

[8]  C. Chabris,et al.  Reading the Mind in the Eyes or Reading between the Lines? Theory of Mind Predicts Collective Intelligence Equally Well Online and Face-To-Face , 2014, PloS one.

[9]  Jonas Hjort Ethnic Divisions and Production in Firms , 2013, SSRN Electronic Journal.

[10]  S. Eriksson,et al.  Do Employers Use Unemployment as a Sorting Criterion When Hiring? Evidence from a Field Experiment , 2014, SSRN Electronic Journal.

[11]  Antoinette Schoar,et al.  Managing with Style: The Effect of Managers on Firm Policies , 2003 .

[12]  Justine Burns,et al.  Interaction , prejudice and performance . Evidence from South Africa , 2015 .

[13]  M. Rokeach,et al.  Long-range experimental modification of values, attitudes, and behavior. , 1971 .

[14]  Raymond J. Struyk,et al.  Clear and Convincing Evidence: Measurement of Discrimination in America. , 1994 .

[15]  Dennis Reynolds,et al.  Restraining Golem and Harnessing Pygmalion in the Classroom: A Laboratory Study of Managerial Expectations and Task Design , 2007 .

[16]  Sapna Cheryan,et al.  Do Female and Male Role Models Who Embody STEM Stereotypes Hinder Women’s Anticipated Success in STEM? , 2011 .

[17]  Francesca Gino,et al.  Correspondence Bias in Performance Evaluation: Why Grade Inflation Works , 2010, Personality & social psychology bulletin.

[18]  James J. Heckman,et al.  Randomization and Social Policy Evaluation , 1991 .

[19]  Enrico Santarelli,et al.  Beauty and the Labour Market , 2011 .

[20]  Ali Ahmed,et al.  Are gay men and lesbians discriminated against in the hiring process , 2013 .

[21]  J. Dovidio,et al.  The Impact of Counterstereotypic Training and Related Correction Processes on the Application of Stereotypes , 2007 .

[22]  Matthew J. Notowidigdo,et al.  Duration Dependence and Labor Market Conditions: Evidence from a Field Experiment* , 2013 .

[23]  K. Stanovich,et al.  Advancing the rationality debate , 2000, Behavioral and Brain Sciences.

[24]  Amy K. Dittmar,et al.  The Changing of the Boards: The Impact on Firm Valuation of Mandated Female Board Representation , 2011 .

[25]  J. Heckman Detecting Discrimination , 1998 .

[26]  Michael D. Martinez,et al.  Race and 2008 Presidential Politics in Florida: A List Experiment , 2010 .

[27]  Manuel Bagues,et al.  Can Gender Parity Break the Glass Ceiling?: Evidence from a Repeated Randomized Experiment , 2010 .

[28]  David W. Johnson,et al.  Cooperation and Competition: Theory and Research , 1989 .

[29]  Matthew Hunsinger,et al.  Fanning the flames of prejudice: the influence of specific incidental emotions on implicit prejudice. , 2009, Emotion.

[30]  T. Dee,et al.  Stereotype Threat and the Student‐Athlete , 2009 .

[31]  J. Dovidio,et al.  Reducing intergroup bias: elements of intergroup cooperation. , 1999, Journal of personality and social psychology.

[32]  N. Zinovyeva,et al.  The Role of Connections in Academic Promotions , 2014 .

[33]  Madeline E. Heilman,et al.  Exposure to successful women: Antidote to sex discrimination in applicant screening decisions? , 1986 .

[34]  Esther Duflo,et al.  Political Reservation and Substantive Representation: Evidence from Indian Village Councils , 2011 .

[35]  M. Angeles Carnero,et al.  Information and discrimination in the rental housing market: Evidence from a field experiment , 2010 .

[36]  John Dixon,et al.  Beyond prejudice: are negative evaluations the problem and is getting us to like one another more the solution? , 2012, The Behavioral and brain sciences.

[37]  R. Dawes A case study of graduate admissions: Application of three principles of human decision making. , 1971 .

[38]  S. Spencer,et al.  Prejudice as self-image maintenance: Affirming the self through derogating others , 1997 .

[39]  G. Keinan Decision making under stress: scanning of alternatives under controllable and uncontrollable threats. , 1987, Journal of personality and social psychology.

[40]  Z. Kunda,et al.  Superstars and me : Predicting the impact of role models on the self , 1997 .

[41]  Francisco B. Galarza,et al.  Labor market discrimination in Lima, Peru: evidence from a field experiment , 2012 .

[42]  H. Tajfel,et al.  Experiments in intergroup discrimination. , 1970, Scientific American.

[43]  Kenneth F. Scheve,et al.  Social Identity, Political Speech, and Electoral Competition , 2006 .

[44]  S. Karau,et al.  Role congruity theory of prejudice toward female leaders. , 2002, Psychological review.

[45]  Asaf Zussman Ethnic Discrimination: Lessons from the Israeli Online Market for Used Cars , 2013 .

[46]  Thomas S. Dee Stereotype Threat and the Student-Athlete. NBER Working Paper No. 14705. , 2009 .

[47]  Jim Hubbuck,et al.  Half a chance?: A report on job discrimination against young blacks in Nottingham , 1980 .

[48]  Takahiro Tsuchiya,et al.  A Study of the Properties of the Item Count Technique , 2007 .

[49]  Greg J. Duncan,et al.  Empathy or Antipathy ? The Impact of Diversity , 2007 .

[50]  Dov Eden,et al.  Restraining the Golem: Boosting performance by changing the interpretation of low scores. , 1994 .

[51]  Amalia R. Miller,et al.  A Female Style in Corporate Leadership? Evidence from Quotas , 2012 .

[52]  Dov Eden,et al.  Pygmalion versus self-expectancy: Effects of instructor- and self-expectancy on trainee performance. , 1982 .

[53]  Norbert Schwarz,et al.  Implicit measures of attitudes , 2007 .

[54]  Ulf Rinne,et al.  Anonymous job applications in Europe , 2012, SSRN Electronic Journal.

[55]  Barry Z. Posner,et al.  Preferential Treatment in Preselection Decisions According to Sex and Race , 1980 .

[56]  Rikhil R Bhavnani,et al.  Do Electoral Quotas 'Work' After They Are Withdrawn? Evidence from a Natural Experiment in India , 2008 .

[57]  James J. Heckman,et al.  The Urban Institute Audit Studies: Their Methods and Findings , 1993 .

[58]  A. Dijksterhuis,et al.  Judgement and memory of a criminal act: the effects of stereotypes and cognitive load , 1999 .

[59]  Michael Ewens,et al.  Statistical Discrimination or Prejudice? A Large Sample Field Experiment , 2012, Review of Economics and Statistics.

[60]  Christian Manger,et al.  Ethnic Discrimination in Germany’s Labour Market: A Field Experiment , 2012 .

[61]  Felicia Pratto,et al.  The Irony of Harmony , 2009, Psychological science.

[62]  T. K. Srull,et al.  A Dual process model of impression formation , 1988 .

[63]  Dilip Mookherjee,et al.  Journal of Globalization and Development Impact of Political Reservations in West Bengal Local Governments on Anti-Poverty Targeting , 2011 .

[64]  Margaret Shih,et al.  Perspective Taking: Reducing Prejudice Towards General Outgroups and Specific Individuals , 2009 .

[65]  Stijn Baert,et al.  Do Employers Discriminate Less If Vacancies are Difficult to Fill? Evidence from a Field Experiment , 2013, SSRN Electronic Journal.

[66]  Kurt Hugenberg,et al.  Ambiguity in Social Categorization , 2004, Psychological science.

[67]  Amanda Pallais,et al.  Discrimination as a Self-Fulfilling Prophecy: Evidence from French Grocery Stores , 2017 .

[68]  Stephen Coate,et al.  An Economic Model of Representative Democracy , 1997 .

[69]  James D. Johnson,et al.  Justice is Still Not Colorblind: Differential Racial Effects of Exposure to Inadmissible Evidence , 1995 .

[70]  Mats Hammarstedt,et al.  Discrimination in the rental housing market: A field experiment on the Internet , 2008 .

[71]  R. Rosenthal,et al.  Pygmalion in the classroom , 1968 .

[72]  Esther Duflo,et al.  WOMEN AS POLICY MAKERS: EVIDENCE FROM A RANDOMIZED POLICY EXPERIMENT IN INDIA , 2004 .

[73]  James Jaccard,et al.  Journal of Personality and Social Psychology Predicting Ethnic and Racial Discrimination : A Meta-Analysis of IAT Criterion Studies , 2013 .

[74]  James W. Tanaka,et al.  Perceptual Other-Race Training Reduces Implicit Racial Bias , 2009, PloS one.

[75]  Yves Zenou,et al.  Unexplored dimensions of discrimination in Europe: homosexuality and physical appearance , 2015 .

[76]  Kevin Lang,et al.  A Language Theory of Discrimination , 1986 .

[77]  Magnus Carlsson,et al.  Does Hiring Discrimination Cause Gender Segregation in the Swedish Labor Market? , 2011 .

[78]  Irma Clots Figueras,et al.  Are female leaders good for education? evidence from India , 2007 .

[79]  Laurie A. Rudman,et al.  Prescriptive Gender Stereotypes and Backlash Toward Agentic Women , 2001 .

[80]  Jonathan Guryan,et al.  Prejudice and Wages: An Empirical Assessment of Becker’s The Economics of Discrimination , 2008, Journal of Political Economy.

[81]  Anthony G. Greenwald,et al.  No Place for Nostalgia in Science: A Response to Arkes and Tetlock , 2004 .

[83]  Alison L. Booth,et al.  Do Employers Discriminate by Gender? A Field Experiment in Female-Dominated Occupations , 2010 .

[84]  Lisa S. Blackwell,et al.  Implicit theories of intelligence predict achievement across an adolescent transition: a longitudinal study and an intervention. , 2007, Child development.

[85]  Esther Duflo,et al.  Entry, Exit and Candidate Selection: Evidence from India , 2016 .

[86]  Esther Duflo,et al.  Women as Policy Makers: Evidence from a Randomized Experiment , 2010 .

[87]  Herbert J. Gans,et al.  Report of the center for urban archaeology , 1968 .

[88]  B. Hamilton,et al.  Team Incentives and Worker Heterogeneity: An Empirical Analysis of the Impact of Teams on Productivity and Participation , 2001, Journal of Political Economy.

[89]  Sendhil Mullainathan,et al.  Labor market discrimination in Delhi: Evidence from a field experiment , 2009 .

[90]  James H. Kuklinski,et al.  Racial Attitudes and the "New South" , 1997, The Journal of Politics.

[91]  Canice Prendergast,et al.  Favoritism in Organizations , 1993, Journal of Political Economy.

[92]  A. Isen,et al.  Positive affect, cognition, and the reduction of intergroup bias. , 1998 .

[93]  Robert E. Slavin,et al.  Effects of biracial learning teams on cross-racial friendships. , 1979 .

[94]  Justin R. Sydnor,et al.  What's in a Picture?: Evidence of Discrimination from Prosper.com , 2012 .

[95]  Tanya Rosenblat,et al.  Why Beauty Matters ∗ , 2005 .

[96]  Age Diffsrences MODIFICATION OF CHILDREN'S RACIAL ATTITUDES , 2011 .

[97]  Luc Behaghel,et al.  Unintended Effects of Anonymous Resumes , 2014, SSRN Electronic Journal.

[98]  A. Y. Lee,et al.  Stereotype efficiency reconsidered: encoding flexibility under cognitive load? , 1998, Journal of personality and social psychology.

[99]  Manuel Bagues,et al.  Do Gender Quotas Pass the Test? Evidence from Academic Evaluations in Italy , 2014 .

[100]  C. Steele,et al.  Stereotype threat and the intellectual test performance of African Americans. , 1995, Journal of personality and social psychology.

[101]  David Neumark,et al.  Sex Discrimination in Restaurant Hiring: An Audit Study , 1995 .

[102]  Eileen M. Oickle,et al.  Effects of Cooperative Learning Teams on Student Achievement and Race Relations: Treatment by Race Interactions. , 1981 .

[103]  William E. Loges,et al.  Rental Discrimination and Ethnicity in Names 1 , 2006 .

[104]  Daniel S. Hamermesh,et al.  Charity and Favoritism in the Field: Are Female Economists Nicer (To Each Other)? , 2010, Review of Economics and Statistics.

[105]  Linda R. Tropp,et al.  Does intergroup contact reduce prejudice: Recent meta-analytic findings. , 2000 .

[106]  Torsten Persson,et al.  Gender Quotas and the Crisis of the Mediocre Man: Theory and Evidence from Sweden , 2013 .

[107]  James H. Kuklinski,et al.  Racial prejudice and attitudes toward affirmative action , 1997 .

[108]  M. R. Leippe,et al.  Generalization of dissonance reduction: Decreasing prejudice through induced compliance. , 1994 .

[109]  P. Riach,et al.  Field Experiments of Discrimination in the Market Place , 2002 .

[110]  K. A. Finlay,et al.  The role of empathy in improving intergroup relations. , 1999 .

[111]  Eric Luis Uhlmann,et al.  Constructed Criteria , 2005, Psychological science.

[112]  J. Yinger,et al.  Evidence on Discrimination in Consumer Markets , 1998 .

[113]  Denise Sekaquaptewa,et al.  My Fair Physicist? Feminine Math and Science Role Models Demotivate Young Girls , 2012 .

[114]  Carrie B. Fried,et al.  Reducing the Effects of Stereotype Threat on African American College Students by Shaping Theories of Intelligence , 2002 .

[115]  Olof Åslund,et al.  Do Anonymous Job Application Procedures Level the Playing Field? , 2012 .

[116]  Michael E. Wallace,et al.  Religious affiliation and hiring discrimination in New England: A field experiment , 2013 .

[117]  Nils Gottfries,et al.  The Beveridge Curve and Labour Market Flows - a Reinterpretation , 2016 .

[118]  Steven D. Levitt,et al.  The Causes and Consequences of Distinctively Black Names , 2003 .

[119]  Katharina Schmid,et al.  The Social Psychology of intergroup relations , 2009 .

[120]  A. Banerjee,et al.  Parochial Politics: Ethnic Preferences and Politician Corruption , 2007 .

[121]  R. Rosenthal,et al.  On the social psychology of the psychological experiment: the experimenter's hypothesis as unintended determinant of experimental results. , 1963, American scientist.

[122]  Nicolas Jacquemet,et al.  Indiscriminate Discrimination: A Correspondence Test for Ethnic Homophily in the Chicago Labor Market , 2011 .

[123]  Michael A. Genovese,et al.  Social Desirability Effects and Support for a Female American President , 2008 .

[124]  Patricia G. Devine,et al.  The Role of Discrepancy-Associated Affect in Prejudice Reduction , 1993 .

[125]  Jonathan Zinman,et al.  List Randomization for Sensitive Behavior: An Application for Measuring Use of Loan Proceeds , 2011 .

[126]  L. Blommaert,et al.  Discrimination of Arabic-Named Applicants in the Netherlands: An Internet-Based Field Experiment Examining Different Phases in Online Recruitment Procedures , 2014 .

[127]  Richard E. Snow,et al.  Pygmalion and Intelligence? , 1995 .

[128]  Abhijit Banerjee,et al.  Can Voters be Primed to Choose Better Legislators? Experimental Evidence from Rural India , 2010 .

[129]  Valerie Purdie-Vaughns,et al.  Journal of Experimental Psychology : General Breaking the Cycle of Mistrust : Wise Interventions to Provide Critical Feedback Across the Racial Divide , 2013 .

[130]  Laurie A. Rudman,et al.  Implicit and Explicit Consequences of Exposure to Violent and Misogynous Rap Music , 2002 .

[131]  Rebecca M. Blank,et al.  Chapter 48 Race and gender in the labor market , 1999 .

[132]  Sander Hoogendoorn,et al.  Ethnic Diversity and Team Performance: A Field Experiment , 2012, SSRN Electronic Journal.

[133]  David DeSteno,et al.  Prejudice From Thin Air , 2004, Psychological science.

[134]  M. Rehavi,et al.  Sex and Politics: Do Female Legislators Aect State Spending? , 2007 .

[135]  Priyanka Pandey,et al.  Discrimination, Social Identity, and Durable Inequalities , 2006 .

[136]  S. Craig,et al.  Religion and Presidential Politics in Florida: A List Experiment* , 2004 .

[137]  R. Slavin Cooperative Learning: Theory, Research and Practice , 1990 .

[138]  Toni Schmader,et al.  Retraining attitudes and stereotypes to affect motivation and cognitive capacity under stereotype threat. , 2010, Journal of personality and social psychology.

[139]  Robert E. Slavin,et al.  Improving Intergroup Relations: Lessons Learned From Cooperative Learning Programs , 1999 .

[140]  C. Dweck,et al.  Stereotype formation and endorsement: The role of implicit theories. , 1998 .

[141]  Lee Jussim,et al.  Teacher Expectations and Self-Fulfilling Prophecies: Knowns and Unknowns, Resolved and Unresolved Controversies , 2005, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[142]  Joshua Aronson,et al.  Problems in the pipeline: Stereotype threat and women's achievement in high-level math courses ☆ ☆☆ , 2008 .

[143]  Robert Rosenthal,et al.  Interpersonal Expectancy Effects: A 30-Year Perspective: , 1994 .

[144]  D. Eden Leadership and expectations: Pygmalion effects and other self-fulfilling prophecies in organizations , 1992 .

[145]  Philip Oreopoulos,et al.  Why Do Skilled Immigrants Struggle in the Labor Market? a Field Experiment with Six Thousand Resumes , 2011 .

[146]  Sebastian Ehrlichmann,et al.  The Economics of Discrimination , 2009 .

[147]  J. Dovidio,et al.  On the Nature of Contemporary Prejudice: The Third Wave , 2001 .

[148]  Anthony G. Greenwald,et al.  Implicit Bias in the Courtroom , 2012 .

[149]  Dan-Olof Rooth,et al.  Automatic associations and discrimination in hiring: : Real world evidence , 2010 .

[150]  Conrad Miller,et al.  The Persistent Effect of Temporary Affirmative Action , 2017 .

[151]  Victor Lavy,et al.  On the Origins of Gender Human Capital Gaps: Short and Long Term Consequences of Teachers’ Stereotypical Biases , 2015 .

[152]  D. E. Glasford,et al.  The conflict of harmony: Intergroup contact, commonality and political solidarity between minority groups , 2012 .

[153]  Moa Bursell,et al.  What's in a name? A field experiment test for the existence of ethnic discrimination in the hiring process , 2007 .

[154]  Steven L. Neuberg,et al.  A Continuum of Impression Formation, from Category-Based to Individuating Processes: Influences of Information and Motivation on Attention and Interpretation , 1990 .

[155]  Manuel Bagues,et al.  Does Gender Matter for Academic Promotion? Evidence from a Randomized Natural Experiment , 2010, SSRN Electronic Journal.

[156]  L R Hartley,et al.  Effect of noise on the Stroop Test. , 1974, Journal of experimental psychology.

[157]  A. Galinsky,et al.  Perspective-taking: decreasing stereotype expression, stereotype accessibility, and in-group favoritism. , 2000, Journal of personality and social psychology.

[158]  Prachi Mishra,et al.  The Power of Political Voice: Women’s Political Representation and Crime in India , 2011 .

[159]  M. Banaji,et al.  PREDICTIVE VALIDITY OF THE IAT 1 RUNNING HEAD : PREDICTIVE VALIDITY OF THE IAT Understanding and Using the Implicit Association Test : III . Meta-analysis of Predictive Validity , 2006 .

[160]  P. Devine,et al.  The active control of prejudice: unpacking the intentions guiding control efforts. , 2009, Journal of personality and social psychology.

[161]  Yves Zenou,et al.  Unexplored Dimensions of Discrimination in Europe: Religion, Homosexuality and Physical Appearance , 2012 .

[162]  B. Payne,et al.  CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE Weapon Bias Split-Second Decisions and Unintended Stereotyping , 2022 .

[163]  H. Tajfel,et al.  An integrative theory of intergroup conflict. , 1979 .

[164]  Valerie Purdie-Vaughns,et al.  Recursive Processes in Self-Affirmation: Intervening to Close the Minority Achievement Gap , 2009, Science.

[165]  B. Golub,et al.  How Homophily Affects the Speed of Learning and Best Response Dynamics , 2012 .

[166]  J. Yinger,et al.  Measuring racial discrimination with fair housing audits: caught in the Act. , 1986 .

[167]  George Galster,et al.  Racial Discrimination in Housing Markets during the 1980s: A Review of the Audit Evidence , 1990 .

[168]  J. Dovidio,et al.  Distance Makes the Heart Grow Fonder : Improving Implicit Racial Attitudes and Interracial Interactions Through Approach Behaviors , 2007 .

[169]  T. Sepora,et al.  Language and Culture , 2012 .

[170]  R. Pande,et al.  Can Mandated Political Representation Increase Policy Influence for Disadvantaged Minorities? Theory and Evidence from India , 2003 .

[171]  Günter J. Hitsch,et al.  Matching and Sorting in Online Dating , 2008 .

[172]  Esther Duflo,et al.  Female Leadership Raises Aspirations and Educational Attainment for Girls: A Policy Experiment in India , 2012, Science.

[173]  Harry E. Cross,et al.  Employer Hiring Practices: Differential Treatment of Hispanic and Anglo Job Seekers , 1990 .

[174]  C. Goldin,et al.  Orchestrating Impartiality: The Impact of "Blind" Auditions on Female Musicians , 1997 .

[175]  Jeff Biddle,et al.  Business Success and Businesses&Apos; Beauty Capital , 1997 .

[176]  Marvin A. Jolson,et al.  Employment Barriers in Marketing , 1974 .

[177]  Margaret Maurer-Fazio,et al.  Ethnic discrimination in China's internet job board labor market , 2012, SSRN Electronic Journal.

[178]  Don W. Stacks,et al.  Implicit Measures of Attitudes , 2007 .

[179]  Mats Hammarstedt,et al.  Detecting Discrimination Against Homosexuals: Evidence from a Field Experiment on the Internet , 2009 .

[180]  J. M. Nunley,et al.  An Examination of Racial Discrimination in the Labor Market for Recent College Graduates: Estimates from the Field , 2014 .

[181]  Katherine L. Milkman,et al.  Temporal Distance and Discrimination , 2012, Psychological science.

[182]  N. Dasgupta,et al.  Seeing is believing: Exposure to counterstereotypic women leaders and its effect on the malleability of automatic gender stereotyping , 2004 .

[183]  Astri Muren,et al.  Constructing Gender in the Economics Lab , 2009 .

[184]  Lina Andersson,et al.  Does age matter for employability? A field experiment on ageism in the Swedish labour market , 2012 .

[185]  M. Baldini,et al.  Ethnic discrimination in the Italian rental housing market , 2011 .

[186]  M. Banaji,et al.  Implicit social cognition: attitudes, self-esteem, and stereotypes. , 1995, Psychological review.

[187]  D. Gilbert,et al.  The trouble of thinking: Activation and application of stereotypic beliefs. , 1991 .

[188]  Alex Madva,et al.  Biased against Debiasing: On the Role of (Institutionally Sponsored) Self-Transformation in the Struggle against Prejuice , 2017 .

[189]  Lucas C. Coffman,et al.  The Size of the Lgbt Population and the Magnitude of Anti-Gay Sentiment are Substantially Underestimated , 2013, Manag. Sci..

[190]  D. Hamermesh,et al.  Beauty and the Labor Market , 1993 .

[191]  J. Dovidio,et al.  Approaching math increases math=me and math=pleasant. , 2008 .

[192]  P. Riach,et al.  An Experimental Investigation of Age Discrimination in the English Labor Market , 2007 .

[193]  P. Riach,et al.  Testing for racial discrimination in the labour market , 1991 .

[194]  David Neumark,et al.  Detecting Discrimination in Audit and Correspondence Studies , 2010, The Journal of Human Resources.

[195]  Philip E. Tetlock,et al.  TARGET ARTICLE: Attributions of Implicit Prejudice, or "Would Jesse Jackson 'Fail' the Implicit Association Test?" , 2004 .

[196]  Mahzarin R. Banaji,et al.  Implicit Bias among Physicians and its Prediction of Thrombolysis Decisions for Black and White Patients , 2007, Journal of General Internal Medicine.

[197]  M. Rokeach The Nature Of Human Values , 1974 .

[198]  D. McNatt,et al.  Ancient Pygmalion joins contemporary management: a meta-analysis of the result. , 2000, The Journal of applied psychology.

[199]  P. Devine Stereotypes and prejudice: Their automatic and controlled components. , 1989 .

[200]  J. Dovidio,et al.  Aversive Racism and Selection Decisions: 1989 and 1999 , 2000, Psychological science.

[201]  Donald B. Rubin,et al.  Interpersonal expectancy effects: the first 345 studies , 1978, Behavioral and Brain Sciences.

[202]  Philip Goldberg,et al.  Are women prejudiced against women? , 1968 .

[203]  Benjamin F. Jones,et al.  Do Leaders Matter? National Leadership and Growth Since World War Ii , 2004 .

[204]  Patricia Prescott-Clarke,et al.  Racial Discrimination and White-collar Workers in Britain , 1970 .

[205]  Esther Duflo,et al.  Powerful Women: Does Exposure Reduce Bias? , 2008 .

[206]  G. Bodenhausen,et al.  Social stereotypes and information-processing strategies: the impact of task complexity. , 1987, Journal of personality and social psychology.

[207]  A G Greenwald,et al.  Implicit gender stereotyping in judgments of fame. , 1995, Journal of personality and social psychology.

[208]  D. Pager The Mark of a Criminal Record1 , 2003, American Journal of Sociology.

[209]  Andrew Leigh,et al.  Does Ethnic Discrimination Vary Across Minority Groups? Evidence from a Field Experiment , 2012 .

[210]  R. Deshpandé,et al.  Identity salience and the influence of differential activation of the social self-schema on advertising response. , 2002, The Journal of applied psychology.

[211]  C. Judd,et al.  The police officer's dilemma: using ethnicity to disambiguate potentially threatening individuals. , 2002, Journal of personality and social psychology.

[212]  Wendy Visscher,et al.  The Item Count Technique as a Method of Indirect Questioning: A Review of Its Development and a Case Study Application , 2011 .

[213]  Cecilia Elena Rouse,et al.  Orchestrating Impartiality: The Impact of , 1997 .

[214]  Dan-Olof Rooth,et al.  Obesity, Attractiveness, and Differential Treatment in Hiring: A Field Experiment , 2009 .

[215]  Guido Imbens,et al.  Site Selection Bias in Program Evaluation , 2014 .

[216]  Michal Bauer,et al.  Attention Discrimination: Theory and Field Experiments , 2013 .

[217]  J. Dovidio,et al.  Just say no (to stereotyping): effects of training in the negation of stereotypic associations on stereotype activation. , 2000, Journal of personality and social psychology.

[218]  R. Fazio,et al.  Roommate Relationships: A Comparison of Interracial and Same-Race Living Situations , 2008 .

[219]  J. Dovidio,et al.  Intergroup bias: status, differentiation, and a common in-group identity. , 1998, Journal of personality and social psychology.

[220]  Martin Bøg,et al.  Labor market discrimination of minorities? yes, but not in job offers , 2011 .

[221]  Lina Andersson,et al.  Can Discrimination in the Housing Market Be Reduced by Increasing the Information about the Applicants? , 2010, Land Economics.

[222]  Jon A. Krosnick,et al.  Social desirability bias in voter turnout reports Tests using the item count technique , 2010 .

[223]  Larry L. Jacoby,et al.  Mental control and visual illusions : Toward explaining race-biased weapon misidentifications q , 2004 .

[224]  A. Alesina,et al.  Ethnic Diversity and Economic Performance , 2004 .

[225]  Ulf Rinne,et al.  Anonymous Job Applications of Fresh Ph.D. Economists , 2012, SSRN Electronic Journal.

[226]  S. Danziger,et al.  Extraneous factors in judicial decisions , 2011, Proceedings of the National Academy of Sciences.

[227]  P. Petit,et al.  Are Young French Jobseekers of Ethnic Immigrant Origin Discriminated Against? A Controlled Experiment in the Paris Area , 2008 .

[228]  T. Eells,et al.  Work-related stress in American trial judges. , 1994, The Bulletin of the American Academy of Psychiatry and the Law.

[229]  D. Meyer,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S6 References Evidence for a Collective Intelligence Factor in the Performance of Human Groups , 2022 .

[230]  A. Galinsky,et al.  Perspective taking combats automatic expressions of racial bias. , 2011, Journal of personality and social psychology.

[231]  Margery Austin Turner,et al.  Opportunities denied, opportunities diminished : racial discrimination in hiring , 1991 .

[232]  Abraham B. Shani,et al.  Pygmalion goes to boot camp: Expectancy, leadership, and trainee performance. , 1982 .

[233]  C. Judd,et al.  Evidence for racial prejudice at the implicit level and its relationship with questionnaire measures. , 1997, Journal of personality and social psychology.

[234]  T. Dunning,et al.  Ethnic Quotas and Political Mobilization: Caste, Parties, and Distribution in Indian Village Councils , 2013, American Political Science Review.

[235]  Pierre Couture,et al.  Informed Consent in Social Science , 2008, Science.

[236]  J. List The nature and extent of discrimination in the marketplace: Evidence from the field , 2004 .

[237]  Manuel Bagues,et al.  Do Recruiters Prefer Applicants with Similar Skills? Evidence from a Randomized Natural Experiment , 2009 .

[238]  A. Greenwald,et al.  On the malleability of automatic attitudes: combating automatic prejudice with images of admired and disliked individuals. , 2001, Journal of personality and social psychology.

[239]  A. Greenwald,et al.  Measuring individual differences in implicit cognition: the implicit association test. , 1998, Journal of personality and social psychology.

[240]  Claire J. Kramsch Language and Culture , 1998 .

[241]  Andrew Hanson,et al.  Do landlords discriminate in the rental housing market? Evidence from an internet field experiment in US cities , 2010 .

[242]  Colin Brown,et al.  Racial discrimination : 17 years after the act , 1985 .

[243]  D. Green,et al.  Prejudice reduction: what works? A review and assessment of research and practice. , 2009, Annual review of psychology.

[244]  A. McConnell,et al.  Relations among the Implicit Association Test, Discriminatory Behavior, and Explicit Measures of Racial Attitudes , 2001 .

[245]  E. Phelps The Statistical Theory of Racism and Sexism , 1972 .

[246]  Jeff E. Biddle,et al.  Beauty, Productivity, and Discrimination: Lawyers' Looks and Lucre , 1998, Journal of Labor Economics.

[247]  Brian A. Nosek,et al.  Harvesting implicit group attitudes and beliefs from a demonstration web site , 2002 .

[248]  G. Bodenhausen,et al.  Happiness and stereotypic thinking in social judgment. , 1994 .

[249]  R. Rosenthal,et al.  Pygmalion, Galatea, and the Golem: Investigations of biased and unbiased teachers. , 1982 .

[250]  Jonathan Guryan,et al.  Taste�?Based or Statistical Discrimination: The Economics of Discrimination Returns to its Roots , 2013 .

[251]  Amanda Pallais,et al.  Discrimination as a Self-Fulfilling Prophecy: Evidence from French Grocery Stores , 2016 .

[252]  Sander Hoogendoorn,et al.  The Impact of Gender Diversity on the Performance of Business Teams: Evidence from a Field Experiment , 2011, Manag. Sci..

[253]  Magnus Carlsson,et al.  Discrimination in the rental market for apartments , 2014 .

[254]  Jennifer K. Elek,et al.  Can Explicit Instructions Reduce Expressions of Implicit Bias? New Questions Following a Test of a Specialized Jury Instruction , 2014 .

[255]  A. Eagly,et al.  Gender and the evaluation of leaders: A meta-analysis. , 1992 .

[256]  P. Petit,et al.  Hiring discrimination: a field experiment in the French financial sector , 2004 .

[257]  Jerry M. Newman Discrimination in Recruitment: An Empirical Analysis , 1978 .

[258]  J. Dovidio,et al.  Commonality and the Complexity of “We”: Social Attitudes and Social Change , 2009, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[259]  Brian A. Nosek,et al.  When Fatigue Turns Deadly: The Association Between Fatigue and Racial Bias in the Decision to Shoot , 2013 .

[260]  Stephen Coate,et al.  Antidiscrimination enforcement and the problem of patronization , 1993 .

[261]  Michael Dobbs,et al.  Outgroup Accountability in the Minimal Group Paradigm: Implications for Aversive Discrimination and Social Identity Theory , 2001 .

[262]  Ivy E. Broder,et al.  Review of NSF Economics Proposals: Gender and Institutional Patterns , 1993 .

[263]  Robert E. Slavin,et al.  How Student Learning Teams Can Integrate the Desegregated Classroom. , 1977 .

[264]  V. O. Key,et al.  Southern Politics In State and Nation , 1984 .

[265]  Eldar Shafir,et al.  The Conflicting Choices of Alternating Selves , 2010 .

[266]  Stefanie Gosen,et al.  Social desirability in survey research: Can the list experiment provide the truth? , 2014 .

[267]  I. Ayres,et al.  Race and Gender Discrimination in Bargaining for a New Car , 1995 .

[268]  D. Aigner,et al.  Statistical Theories of Discrimination in Labor Markets , 1977 .

[269]  K. Arrow The Theory of Discrimination , 1971 .

[270]  Geoffrey L. Cohen,et al.  Reducing the Racial Achievement Gap: A Social-Psychological Intervention , 2006, Science.

[271]  Brian A. Nosek,et al.  of Experimental Psychology : General Reducing Implicit Racial Preferences : I . A Comparative Investigation of 17 Interventions , 2014 .

[272]  J Tudor-Hart,et al.  On the nature of prejudice. , 1961, The Eugenics review.

[273]  Irma Clots-Figueras,et al.  Women in Politics. Evidence from the Indian States , 2005 .

[274]  Jennifer L. Doleac,et al.  The Visible Hand: Race and Online Market Outcomes , 2010 .

[275]  J. Dovidio,et al.  Developing a More Inclusive Social Identity: An Elementary School Intervention , 2004 .

[276]  Brian A. Nosek,et al.  Understanding and using the implicit association test: I. An improved scoring algorithm. , 2003, Journal of personality and social psychology.