Weak Criticisms and Selective Evidence: Reply to Blanton et al. (2009)

We respond to a critique by H. Blanton et al. (2009), challenging our previous work demonstrating that an Implicit Association Test designed to assess implicit prejudice reliably predicts intergroup discrimination (A. R. McConnell & J. M. Leibold, 2001). We outline 3 flawed aspects of the critique. First, we note that claims that an outlier should be eliminated from the original data set are unfounded, and even with the elimination of this outlier, the conclusions of our original work are still strongly supported by the data. Second, we explain that concerns about interjudge reliability are specious and that considerable data support the validity of the judges' observations reported in our original study. Third, we note that claims of a disconnect between Implicit Association Test scores (argued to show negative bias against Blacks) and behavioral measures (argued to show pro-Black bias) are inappropriate because they neglect the relativistic nature of the key measures. Implications for the relation between implicit attitudes and behavior, for the law, and for future work on implicit attitudes are discussed.

[1]  James Jaccard,et al.  Strong claims and weak evidence: reassessing the predictive validity of the IAT. , 2009, The Journal of applied psychology.

[2]  M. Banaji,et al.  PREDICTIVE VALIDITY OF THE IAT 1 RUNNING HEAD : PREDICTIVE VALIDITY OF THE IAT Understanding and Using the Implicit Association Test : III . Meta-analysis of Predictive Validity , 2006 .

[3]  D. Mackie,et al.  Consequences of discrepant explicit and implicit attitudes: Cognitive dissonance and increased information processing , 2008 .

[4]  Allen R McConnell,et al.  Forming implicit and explicit attitudes toward individuals: social group association cues. , 2008, Journal of personality and social psychology.

[5]  H. Chambers Civil Rights Act of 1964 , 2008 .

[6]  Brian A. Nosek,et al.  Pervasiveness and correlates of implicit attitudes and stereotypes , 2007 .

[7]  S. Bagenstos Implicit Bias, 'Science,' and Antidiscrimination Law , 2007 .

[8]  P. Tetlock,et al.  Antidiscrimination Law and the Perils of Mindreading , 2007 .

[9]  Jana L. Raver,et al.  Discrimination In Organizations: An Organizational-Level Systems Perspective , 2007 .

[10]  Brian A. Nosek,et al.  The Implicit Association Test at Age 7: A Methodological and Conceptual Review , 2007 .

[11]  Robert J. Rydell,et al.  Understanding implicit and explicit attitude change: a systems of reasoning analysis. , 2006, Journal of personality and social psychology.

[12]  D. Mackie,et al.  Of Two Minds , 2006, Psychological science.

[13]  A. Greenwald,et al.  Implicit Bias: Scientific Foundations , 2006 .

[14]  M. Banaji,et al.  Fair Measures: A Behavioral Realist Revision of 'Affirmative Action' , 2006 .

[15]  Brian A. Nosek,et al.  Consequential validity of the implicit association test: comment on Blanton and Jaccard (2006). , 2006, The American psychologist.

[16]  James Jaccard,et al.  Arbitrary metrics in psychology. , 2006, The American psychologist.

[17]  J. Ziegert,et al.  Employment discrimination: the role of implicit attitudes, motivation, and a climate for racial bias. , 2005, The Journal of applied psychology.

[18]  E. Ziegel Introduction to Robust Estimation and Hypothesis Testing (2nd ed.) , 2005 .

[19]  R. Wilcox Some results on extensions and modifications of the Theil-Sen regression estimator. , 2004, The British journal of mathematical and statistical psychology.

[20]  H. Keselman,et al.  Robust Regression Methods: Achieving Small Standard Errors When There Is Heteroscedasticity , 2004 .

[21]  J Richard Eiser,et al.  Attitude formation through exploration: valence asymmetries. , 2004, Journal of personality and social psychology.

[22]  A. McConnell,et al.  Implicit and Explicit Measures of Sexual Orientation Attitudes: In Group Preferences and Related Behaviors and Beliefs among Gay and Straight Men , 2004, Personality & social psychology bulletin.

[23]  T. Salthouse,et al.  Age-related effects on cognition between 20 and 50 years of age , 2004 .

[24]  H. Arkes,et al.  ""Attributions of Implicit Prejudice, or" Would Jesse Jackson 'Fail'the Implicit Association Test?", 15 Psychol , 2004 .

[25]  Anthony G. Greenwald,et al.  No Place for Nostalgia in Science: A Response to Arkes and Tetlock , 2004 .

[26]  T. Salthouse,et al.  Executive functioning as a potential mediator of age-related cognitive decline in normal adults. , 2003, Journal of experimental psychology. General.

[27]  Brian A. Nosek,et al.  Understanding and using the implicit association test: I. An improved scoring algorithm. , 2003, Journal of personality and social psychology.

[28]  Mark F. Zimbelman,et al.  A cognitive footprint in archival data: Generalizing the dilution effect from laboratory to field settings , 2003 .

[29]  T. Salthouse,et al.  What needs to be explained to account for age-related effects on multiple cognitive variables? , 2003, Psychology and aging.

[30]  S. McFarland,et al.  A COGNITIVE SKILL CONFOUND ON THE IMPLICIT ASSOCIATION TEST , 2002 .

[31]  T. Wilson Strangers to Ourselves: Discovering the Adaptive Unconscious , 2002 .

[32]  A. Greenwald,et al.  Using the implicit association test to measure age differences in implicit social cognitions. , 2002, Psychology and aging.

[33]  J. Payne,et al.  Punitive Damages: How Juries Decide , 2002 .

[34]  J. Dovidio,et al.  Implicit and Explicit Prejudice and Interracial Interaction , 2002 .

[35]  A. McConnell,et al.  Relations among the Implicit Association Test, Discriminatory Behavior, and Explicit Measures of Racial Attitudes , 2001 .

[36]  Eliot R. Smith,et al.  Dual-Process Models in Social and Cognitive Psychology: Conceptual Integration and Links to Underlying Memory Systems , 2000 .

[37]  P. Hanges,et al.  Bounding the Concept of Test Banding: Reaffirming the Traditional Approach , 2000 .

[38]  Cohen,et al.  Just Doing Business: Modern Racism and Obedience to Authority as Explanations for Employment Discrimination. , 2000, Organizational behavior and human decision processes.

[39]  R. Fazio,et al.  The MODE model of attitude-behavior processes. , 1999 .

[40]  S. Chaiken,et al.  Dual-process theories in social psychology , 1999 .

[41]  Herman Aguinis,et al.  A New Procedure for Computing Equivalence Bands in Personnel Selection , 1998 .

[42]  Arthur P. Brief,et al.  Attitudes in and around organizations , 1998 .

[43]  A. Greenwald,et al.  Measuring individual differences in implicit cognition: the implicit association test. , 1998, Journal of personality and social psychology.

[44]  S. Fiske Stereotyping, prejudice, and discrimination. , 1998 .

[45]  J. Dovidio,et al.  On the nature of prejudice: Automatic and controlled processes , 1997 .

[46]  R. Wilcox Introduction to Robust Estimation and Hypothesis Testing , 1997 .

[47]  Duane T. Wegener,et al.  The Flexible Correction Model: The Role of Naive Theories of Bias in Bias Correction , 1997 .

[48]  R. Fazio,et al.  Variability in automatic activation as an unobtrusive measure of racial attitudes: a bona fide pipeline? , 1995, Journal of personality and social psychology.

[49]  C. N. Macrae,et al.  Out of mind but back in sight: Stereotypes on the rebound , 1994 .

[50]  M. Biernat,et al.  Shifting standards and stereotype-based judgments. , 1994, Journal of personality and social psychology.

[51]  J. Brigham,et al.  College Students’ Racial Attitudes , 1993 .

[52]  Teri A. Crosby,et al.  How to Detect and Handle Outliers , 1993 .

[53]  B. Mellers,et al.  Judgments of Social Justice: Compromises Between Equality and Efficiency , 1993 .

[54]  Frank L. Schmidt,et al.  Why All Banding Procedures in Personnel Selection Are Logically Flawed , 1991 .

[55]  Wayne F. Cascio,et al.  Statistical Implications of Six Methods of Test Score Use in Personnel Selection , 1991 .

[56]  L Hasher,et al.  Age and inhibition. , 1991, Journal of experimental psychology. Learning, memory, and cognition.

[57]  Daniel M. Wegner,et al.  White Bears and Other Unwanted Thoughts: Suppression, Obsession, and the Psychology of Mental Control , 1989 .

[58]  Lynn Hasher,et al.  Working Memory, Comprehension, and Aging: A Review and a New View , 1988 .

[59]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[60]  E. A. Locke,et al.  Generalizing From Laboratory to Field Settings. , 1987 .

[61]  D. Mook,et al.  In defense of external invalidity. , 1983 .

[62]  J. B. Mcconahay,et al.  Has Racism Declined in America? , 1981 .

[63]  Norman R. Draper,et al.  Applied regression analysis (2. ed.) , 1981, Wiley series in probability and mathematical statistics.

[64]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[65]  Benjamin Schneider,et al.  Organizational climate: Individual preferences and organizational realities. , 1972 .

[66]  G. H. Litwin,et al.  Motivation and Organizational Climate , 1968 .

[67]  D. M. Ellis,et al.  Applied Regression Analysis , 1968 .

[68]  Carl I. Hovland,et al.  Reconciling conflicting results derived from experimental and survey studies of attitude change. , 1959 .

[69]  L. Cronbach,et al.  Psychological tests and personnel decisions , 1958 .

[70]  Hubert E. Brogden,et al.  When Testing Pays Off , 1949 .

[71]  H. E. Brogden,et al.  On the interpretation of the correlation coefficient as a measure of predictive efficiency. , 1946, Journal of educational psychology.

[72]  Ronald Lippitt,et al.  Patterns of Aggressive Behavior in Experimentally Created “Social Climates” , 1939 .

[73]  S. Fiske,et al.  The Handbook of Social Psychology , 1935 .

[74]  G. A. Taylor,et al.  The applicability of mental tests to persons over fifty years of age. , 1920 .