Can the Implicit Association Test Serve as a Valid Measure of Automatic Cognition? A Response to Schimmack (2021)

Much of human thought, feeling, and behavior unfolds automatically. Indirect measures of cognition capture such processes by observing responding under corresponding conditions (e.g., lack of intention or control). The Implicit Association Test (IAT) is one such measure. The IAT indexes the strength of association between categories such as “planes” and “trains” and attributes such as “fast” and “slow” by comparing response latencies across two sorting tasks (planes–fast/trains–slow vs. trains–fast/planes–slow). Relying on a reanalysis of multitrait–multimethod (MTMM) studies, Schimmack (this issue, p. 396) argues that the IAT and direct measures of cognition, for example, Likert scales, can serve as indicators of the same latent construct, thereby purportedly undermining the validity of the IAT as a measure of individual differences in automatic cognition. Here we note the compatibility of Schimmack’s empirical findings with a range of existing theoretical perspectives and the importance of considering evidence beyond MTMM approaches to establishing construct validity. Depending on the nature of the study, different standards of validity may apply to each use of the IAT; however, the evidence presented by Schimmack is easily reconcilable with the potential of the IAT to serve as a valid measure of automatic processes in human cognition, including in individual-difference contexts.

[1]  Michelangelo Vianello,et al.  Can the Implicit Association Test Measure Automatic Judgment? The Validation Continues , 2020, Perspectives on psychological science : a journal of the Association for Psychological Science.

[2]  U. Schimmack The Implicit Association Test: A Method in Search of a Construct , 2019, Perspectives on psychological science : a journal of the Association for Psychological Science.

[3]  C. Smith,et al.  Measure what you are trying to predict: Applying the correspondence principle to the Implicit Association Test , 2019, Journal of Experimental Social Psychology.

[4]  J. de Houwer Implicit Bias Is Behavior: A Functional-Cognitive Perspective on Implicit Bias , 2019, Perspectives on psychological science : a journal of the Association for Psychological Science.

[5]  J. de Houwer,et al.  Implicit Bias Is Behavior: A Functional-Cognitive Perspective on Implicit Bias , 2019, Perspectives on psychological science : a journal of the Association for Psychological Science.

[6]  M. Banaji,et al.  Relationship between the Implicit Association Test and intergroup behavior: A meta-analysis. , 2018, The American psychologist.

[7]  Bertram Gawronski Six Lessons for a Cogent Science of Implicit Bias and Its Criticism , 2019, Perspectives on psychological science : a journal of the Association for Psychological Science.

[8]  Jordan B. Leitner,et al.  Establishing construct validity evidence for regional measures of explicit and implicit racial bias. , 2019, Journal of experimental psychology. General.

[9]  J. de Houwer,et al.  Does Explaining Social Behavior Require Multiple Memory Systems? , 2019, Trends in Cognitive Sciences.

[10]  Andrew C. Porter,et al.  Implicit Identification with Death Predicts Suicidal Thoughts and Behaviors in Adolescents , 2019, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[11]  Jordan R. Axt The Best Way to Measure Explicit Racial Attitudes Is to Ask About Them , 2018 .

[12]  W. Hofmann,et al.  Speech Is Silver, Nonverbal Behavior Is Gold: How Implicit Partner Evaluations Affect Dyadic Interactions in Close Relationships , 2018, Psychological science.

[13]  Bertram Gawronski,et al.  Facing One’s Implicit Biases: From Awareness to Acknowledgment , 2018, Journal of personality and social psychology.

[14]  Yoav Bar-Anan,et al.  A Multi-Method Multi-Trait Test of the Dual-Attitude Perspective , 2018, Journal of experimental psychology. General.

[15]  M. Banaji,et al.  The implicit revolution: Reconceiving the relation between conscious and unconscious. , 2017, The American psychologist.

[16]  Heidi A. Vuletich,et al.  Flipping the Script on Implicit Bias Research with the Bias of Crowds , 2017 .

[17]  James R. Rae,et al.  Persons or Situations? Individual Differences Explain Variance in Aggregated Implicit Race Attitudes , 2017 .

[18]  G. Bodenhausen,et al.  Beyond Persons and Situations: An Interactionist Approach to Understanding Implicit Bias , 2017 .

[19]  Heidi A. Vuletich,et al.  The Bias of Crowds: How Implicit Bias Bridges Personal and Systemic Prejudice , 2017 .

[20]  Annchen R. Knodt,et al.  The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences , 2017, Behavior research methods.

[21]  M. Banaji,et al.  Reports of the Death of the Individual Difference Approach to Implicit Social Cognition May Be Greatly Exaggerated: A Commentary on Payne, Vuletich, and Lundberg , 2017 .

[22]  Jeffrey J. Glenn,et al.  Suicide and Self-Injury-Related Implicit Cognition: A Large-Scale Examination and Replication , 2017, Journal of abnormal psychology.

[23]  M. Nock,et al.  Moving Beyond Self‐Report: Implicit Associations about Death/Life Prospectively Predict Suicidal Behavior among Veterans , 2017, Suicide & life-threatening behavior.

[24]  R. Wiers,et al.  Implicit alcohol associations, especially drinking identity, predict drinking over time. , 2016, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[25]  Kosuke Takemura,et al.  Are implicit self-esteem measures valid for assessing individual and cultural differences? , 2015, Journal of personality.

[26]  J. Houwer A propositional model of implicit evaluation , 2014 .

[27]  Calvin K. Lai,et al.  Attitudinal and Non-Attitudinal Components of IAT Performance , 2014, Personality & social psychology bulletin.

[28]  Adam Hahn,et al.  Awareness of implicit attitudes. , 2014, Journal of experimental psychology. General.

[29]  James Jaccard,et al.  Journal of Personality and Social Psychology Predicting Ethnic and Racial Discrimination : A Meta-Analysis of IAT Criterion Studies , 2013 .

[30]  Erin C. Westgate,et al.  Pick your poison: stimuli selection in alcohol-related implicit measures. , 2012, Addictive behaviors.

[31]  William A. Cunningham,et al.  Evaluation is a dynamic process: Moving beyond dual system models. , 2012 .

[32]  J. Houwer,et al.  The Dominance of Associative Theorizing in Implicit Attitude Research: Propositional and Behavioral Alternatives , 2011 .

[33]  B. Penninx,et al.  Child abuse and negative explicit and automatic self-associations: the cognitive scars of emotional maltreatment. , 2010, Behaviour research and therapy.

[34]  Y. Trope,et al.  Construal-level theory of psychological distance. , 2010, Psychological review.

[35]  Anthony G. Greenwald,et al.  Implicit Race Attitudes Predicted Vote in the 2008 U.S. Presidential Election , 2009 .

[36]  I. Stewart,et al.  Testing the Validity of the Implicit Relational Assessment Procedure and the Implicit Association Test: Measuring Attitudes Toward Dublin and Country Life in Ireland , 2009 .

[37]  James Jaccard,et al.  Strong claims and weak evidence: reassessing the predictive validity of the IAT. , 2009, The Journal of applied psychology.

[38]  N. Schwarz ATTITUDE CONSTRUCTION: EVALUATION IN CONTEXT , 2007 .

[39]  William A. Cunningham,et al.  The iterative reprocessing model: A multilevel framework for attitudes and evaluation. , 2007 .

[40]  R. Fazio Attitudes as Object-Evaluation Associations of Varying Strength. , 2007, Social cognition.

[41]  Karl Christoph Klauer,et al.  Process components of the Implicit Association Test: a diffusion-model analysis. , 2007, Journal of personality and social psychology.

[42]  Brian A. Nosek CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE Implicit–Explicit Relations , 2022 .

[43]  William A. Cunningham,et al.  Opinion TRENDS in Cognitive Sciences Vol.11 No.3 Attitudes and evaluations: a social cognitive neuroscience perspective , 2022 .

[44]  Robert J. Rydell,et al.  Understanding implicit and explicit attitude change: a systems of reasoning analysis. , 2006, Journal of personality and social psychology.

[45]  G. Bodenhausen,et al.  Associative and propositional processes in evaluation: an integrative review of implicit and explicit attitude change. , 2006, Psychological bulletin.

[46]  Brian A. Nosek,et al.  Moderators of the relationship between implicit and explicit evaluation. , 2005, Journal of experimental psychology. General.

[47]  Carla J. Groom,et al.  Separating multiple processes in implicit social cognition: the quad model of implicit task performance. , 2005, Journal of personality and social psychology.

[48]  Philip E. Tetlock,et al.  TARGET ARTICLE: Attributions of Implicit Prejudice, or "Would Jesse Jackson 'Fail' the Implicit Association Test?" , 2004 .

[49]  F. Strack,et al.  Reflective and Impulsive Determinants of Social Behavior , 2004, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[50]  Brian A. Nosek,et al.  Understanding and using the implicit association test: I. An improved scoring algorithm. , 2003, Journal of personality and social psychology.

[51]  William A. Cunningham,et al.  Implicit Attitude Measures: Consistency, Stability, and Convergent Validity , 2001, Psychological science.

[52]  Eliot R. Smith,et al.  Dual-Process Models in Social and Cognitive Psychology: Conceptual Integration and Links to Underlying Memory Systems , 2000 .

[53]  S. Embretson A cognitive design system approach to generating valid tests : Application to abstract reasoning , 1998 .

[54]  A. Greenwald,et al.  Measuring individual differences in implicit cognition: the implicit association test. , 1998, Journal of personality and social psychology.

[55]  S. Messick Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[56]  John J. Skowronski,et al.  Savings in the relearning of trait information as evidence for spontaneous inference generation. , 1994 .

[57]  David M. Sanbonmatsu,et al.  On the automatic activation of attitudes. , 1986, Journal of personality and social psychology.

[58]  J. M. Nuttin Narcissism beyond Gestalt and awareness: The name letter effect , 1985 .

[59]  Robert J. Sternberg,et al.  Testing and cognitive psychology. , 1981 .

[60]  J. H. Neely Semantic priming and retrieval from lexical memory: Evidence for facilitatory and inhibitory processes , 1976, Memory & cognition.

[61]  R. Schvaneveldt,et al.  Facilitation in recognizing pairs of words: evidence of a dependence between retrieval operations. , 1971, Journal of experimental psychology.

[62]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[63]  L. Cronbach The two disciplines of scientific psychology. , 1957 .

[64]  J. Loevinger Objective Tests as Instruments of Psychological Theory , 1957 .

[65]  Pieter Van Dessel,et al.  Attitudes beyond associations: On the role of propositional representations in stimulus evaluation , 2020 .

[66]  Thomas C. Mann,et al.  Changing Our Implicit Minds: How, When, and Why Implicit Evaluations Can Be Rapidly Revised , 2017 .

[67]  Allen R. McConnell,et al.  The Systems of Evaluation Model A Dual-Systems Approach to Attitudes , 2014 .

[68]  K. Rothermund,et al.  Estimating the contributions of associations and recoding in the Implicit Association Test: the ReAL model for the IAT. , 2013, Journal of personality and social psychology.

[69]  G. Gigerenzer,et al.  Intuitive and Deliberate Judgments Are Based on Common Principles This Article Has Been Corrected. See Last Page , 2022 .

[70]  Bertram Gawronski,et al.  The Associative–Propositional Evaluation Model: Theory, Evidence, and Open Questions , 2011 .

[71]  J. de Houwer,et al.  Implicit measures: A normative analysis and review. , 2009, Psychological bulletin.

[72]  D. Borsboom,et al.  The concept of validity. , 2004, Psychological review.

[73]  W. Mischel Personality and Assessment , 1996 .

[74]  M. Banaji,et al.  Implicit social cognition: attitudes, self-esteem, and stereotypes. , 1995, Psychological review.

[75]  J. Bargh The four horsemen of automaticity: Awareness, intention, efficiency, and control in social cognition. , 1994 .

[76]  J. Stroop Studies of interference in serial verbal reactions. , 1992 .

[77]  R. Fazio Multiple Processes by which Attitudes Guide Behavior: The Mode Model as an Integrative Framework , 1990 .

[78]  S. Whitely Construct validity: Construct representation versus nomothetic span. , 1983 .

[79]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[80]  M. Sherif,et al.  The psychology of attitudes. , 1946, Psychological review.