The BIAT and the AMP as measures of racial prejudice in political science: A methodological assessment

Political scientists often use measures such as the Brief Implicit Association Test (BIAT) and the Affect Misattribution Procedure (AMP) to gauge hidden or subconscious racial prejudice. However, the validity of these measures has been contested. Using data from the 2008–2009 ANES panel study—the only study we are aware of in which a high-quality, nationally representative sample of respondents took both implicit tests—we show that: (1) although political scientists use the BIAT and the AMP to measure the same thing, the relationship between them is substantively indistinguishable from zero; (2) both measures classify an unlikely proportion of whites as more favorable toward Black Americans than white Americans; and (3) substantial numbers of whites that either measure classifies as free of prejudice openly endorse anti-Black stereotypes. These results have important implications for the use of implicit measures to study racial prejudice in political science.

[1]  A. Engelhardt.  Observational Equivalence in Explaining Attitude Change: Have White Racial Attitudes Genuinely Changed? , 2021, American Journal of Political Science.

[2]  T. Ryan,et al.  Split Feelings: Understanding Implicit and Explicit Political Persuasion , 2021, American Political Science Review.

[3]  Jennifer Chudy.  Racial Sympathy and Its Political Consequences , 2020, The Journal of Politics.

[4]  O. Corneille,et al.  Implicit? What Do You Mean? A Comprehensive Review of the Delusive Implicitness Construct in Attitude Research , 2020, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[5]  A. Greenwald,et al.  Implicit Social Cognition. , 2020, Annual review of psychology.

[6]  M. Banaji,et al.  The implicit revolution: Reconceiving the relation between conscious and unconscious. , 2017, The American psychologist.

[7]  Nicholas A. Valentino,et al.  The Changing Norms of Racial Political Rhetoric and the End of Racial Priming , 2017, The Journal of Politics.

[8]  Heidi A. Vuletich,et al.  The Bias of Crowds: How Implicit Bias Bridges Personal and Systemic Prejudice , 2017 .

[9]  T. Ryan.  How Do Indifferent Voters Decide? The Political Importance of Implicit Attitudes , 2017 .

[10]  Silvia Galdi,et al.  Temporal Stability of Implicit and Explicit Measures , 2017, Personality & social psychology bulletin.

[11]  Malte Friese,et al.  Implicit measures of attitudes and political voting behavior , 2016 .

[12]  Efrén O. Pérez.  Unspoken Politics: Implicit Attitudes and Political Thinking , 2016 .

[13]  D. Kinder,et al.  Prejudice and Politics Re-Examined The Political Significance of Implicit Racial Bias* , 2015, Political Science Research and Methods.

[14]  S. Iyengar,et al.  Fear and Loathing across Party Lines: New Evidence on Group Polarization , 2015 .

[15]  C. Mo.  The Consequences of Explicit and Implicit Gender Attitudes and Candidate Quality in the Calculations of Voters , 2015 .

[16]  Brian A. Nosek,et al.  Statistically small effects of the Implicit Association Test can have societally large effects. , 2015, Journal of personality and social psychology.

[17]  A. Miyake,et al.  Toward a comprehensive understanding of executive cognitive function in implicit racial bias. , 2015, Journal of personality and social psychology.

[18]  Brian A. Nosek,et al.  A comparative investigation of seven indirect attitude measures , 2014, Behavior research methods.

[19]  B. Payne,et al.  Decisions among the Undecided: Implicit Attitudes Predict Future Voting Behavior of Undecided Voters , 2014, PloS one.

[20]  D. O. Sears,et al.  AMPing Racial Attitudes: Comparing the Power of Explicit and Implicit Racism Measures in 2008 , 2013 .

[21]  James Jaccard,et al.  Journal of Personality and Social Psychology Predicting Ethnic and Racial Discrimination : A Meta-Analysis of IAT Criterion Studies , 2013 .

[22]  Neil Malhotra,et al.  Economic Explanations for Opposition to Immigration: Distinguishing between Prevalence and Conditional Impact , 2013 .

[23]  J. Glaser,et al.  Voter Affect and the 2008 U.S. Presidential Election: Hope and Race Mattered , 2010 .

[24]  Gary M. Segura,et al.  Hope, Tropes, and Dopes: Hispanic and White Racial Animus in the 2008 Election , 2010 .

[25]  Efrén O. Pérez.  Explicit Evidence on the Import of Implicit Attitudes: The IAT and Immigration Policy Judgments , 2010 .

[26]  J. Krosnick,et al.  Implicit and explicit prejudice in the 2008 American presidential election , 2010 .

[27]  Anthony G. Greenwald,et al.  Implicit Race Attitudes Predicted Vote in the 2008 U.S. Presidential Election , 2009 .

[28]  A. Greenwald,et al.  The Brief Implicit Association Test. , 2009, Experimental psychology.

[29]  S. Feldman,et al.  On Assessing the Political Effects of Racial Prejudice , 2009 .

[30]  M. Banaji,et al.  PREDICTIVE VALIDITY OF THE IAT 1 RUNNING HEAD : PREDICTIVE VALIDITY OF THE IAT Understanding and Using the Implicit Association Test : III . Meta-analysis of Predictive Validity , 2006 .

[31]  Olesya Govorun,et al.  Automatic attitudes and alcohol: Does implicit liking predict drinking? , 2008 .

[32]  T. Beckers,et al.  Novel attitudes can be faked on the Implicit Association Test , 2007 .

[33]  Cindy D. Kam.  Implicit Attitudes, Explicit Choices: When Subliminal Priming Predicts Candidate Preference , 2007 .

[34]  G. Bodenhausen,et al.  Associative and propositional processes in evaluation: an integrative review of implicit and explicit attitude change. , 2006, Psychological bulletin.

[35]  Brian A. Nosek,et al.  Consequential validity of the implicit association test: comment on Blanton and Jaccard (2006). , 2006, The American psychologist.

[36]  Olesya Govorun,et al.  An inkblot for attitudes: affect misattribution as implicit measurement. , 2005, Journal of personality and social psychology.

[37]  Philip E. Tetlock,et al.  TARGET ARTICLE: Attributions of Implicit Prejudice, or "Would Jesse Jackson 'Fail' the Implicit Association Test?" , 2004 .

[38]  Michael A. Olson,et al.  Implicit measures in social cognition. research: their meaning and use. , 2003, Annual review of psychology.

[39]  A. Greenwald,et al.  Measuring individual differences in implicit cognition: the implicit association test. , 1998, Journal of personality and social psychology.

[40]  Maria E. Jabon,et al.  Bias in the Flesh: Skin Complexion and Stereotype Consistency in Political Campaigns. , 2016, Public opinion quarterly.

[41]  Nathan P. Kalmoe,et al.  Is Implicit Prejudice against Blacks Politically Consequential? Evidence from the AMP , 2013 .

[42]  Jon A. Krosnick,et al.  Determinants of Turnout and Candidate Choice in the 2008 U.S. Presidential Election Illuminating the Impact of Racial Prejudice and Other Considerations , 2009 .

[43]  M. Banaji,et al.  Easier done than undone: asymmetry in the malleability of implicit preferences. , 2006, Journal of personality and social psychology.

[44]  H. Arkes,et al.  ""Attributions of Implicit Prejudice, or" Would Jesse Jackson 'Fail'the Implicit Association Test?", 15 Psychol , 2004 .

[45]  J. Dovidio,et al.  Implicit and explicit prejudice and interracial interaction. , 2002, Journal of personality and social psychology.