Bias Blind Spot: Structure, Measurement, and Consequences

People exhibit a bias blind spot: they are less likely to detect bias in themselves than in others. We report the development and validation of an instrument to measure individual differences in the propensity to exhibit the bias blind spot that is unidimensional, internally consistent, has high test-retest reliability, and is discriminated from measures of intelligence, decision-making ability, and personality traits related to self-esteem, self-enhancement, and self-presentation. The scale is predictive of the extent to which people judge their abilities to be better than average for easy tasks and worse than average for difficult tasks, ignore the advice of others, and are responsive to an intervention designed to mitigate a different judgmental bias. These results suggest that the bias blind spot is a distinct metabias resulting from naive realism rather than other forms of egocentric cognition, and has unique effects on judgment and behavior. This paper was accepted by Yuval Rottenstreich, judgment and decision making.

[1]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[2]  D. Marlowe,et al.  A new scale of social desirability independent of psychopathology. , 1960, Journal of consulting psychology.

[3]  J. Horn.  A rationale and test for the number of factors in factor analysis , 1965, Psychometrika.

[4]  M. Rosenberg.  Society and the adolescent self-image , 1966 .

[5]  V. A. Harris,et al.  The Attribution of Attitudes , 1967 .

[6]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[7]  D. J. Lee.  Society and the Adolescent Self-Image , 1969 .

[8]  M. Snyder.  Self-monitoring of expressive behavior. , 1974 .

[9]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[10]  M. Scheier,et al.  Public and private self-consciousness: Assessment and theory. , 1975 .

[11]  K. Mehrotra,et al.  Tests for Univariate and Multivariate Normality. , 1976 .

[12]  M. L. Snyder,et al.  Observer bias: A stringent test of behavior engulfing the field. , 1976 .

[13]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[14]  C. R. Snyder,et al.  Abnormality as a positive characteristic: The development and validation of a scale measuring need for uniqueness. , 1977 .

[15]  J. Nunnally.  Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[16]  L. Ross,et al.  Human Inference: Strategies and Shortcomings of Social Judgment. , 1981 .

[17]  K. Mardia.  9 Tests of unvariate and multivariate normality , 1980 .

[18]  J. Cacioppo,et al.  The need for cognition. , 1982 .

[19]  B. Fischhoff,et al.  Judgment under uncertainty: Debiasing , 1982 .

[20]  G. A. Miller,et al.  Book Review Nisbett, R. , & Ross, L.Human inference: Strategies and shortcomings of social judgment.Englewood Cliffs, N.J.: Prentice-Hall, 1980. , 1982 .

[21]  C. F. Kao,et al.  The efficient assessment of need for cognition. , 1984, Journal of personality assessment.

[22]  管原健介.  自意識尺度(self‐consciousness scale)日本語版作成の試み , 1984 .

[23]  S. Robbins,et al.  Self-psychology and career development: Construction of the Superiority and Goal Instability scales. , 1985 .

[24]  P. Costa,et al.  Validation of the five-factor model of personality across instruments and observers. , 1987, Journal of personality and social psychology.

[25]  Shelley E. Taylor,et al.  Illusion and well-being: a social psychological perspective on mental health. , 1988, Psychological bulletin.

[26]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[27]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[28]  S. West,et al.  Multiple Regression: Testing and Interpreting Interactions. , 1994 .

[29]  Rex V. Brown,et al.  Teaching Decision Making To Adolescents , 1991 .

[30]  R. Lennox,et al.  Conventional wisdom on measurement: A structural equation perspective. , 1991 .

[31]  Richard P. Larrick,et al.  Who uses the cost-benefit rules of choice? implications for the normative status of microeconomic theory , 1993 .

[32]  J. Sinacore.  Multiple regression: Testing and interpreting interactions , 1993 .

[33]  Timothy D. Wilson,et al.  Mental contamination and mental correction: unwanted influences on judgments and evaluations. , 1994, Psychological bulletin.

[34]  L. Ross,et al.  Psychological Barriers to Dispute Resolution , 1995 .

[35]  L. Ross,et al.  Actual versus assumed differences in construal: 'naive realism' in intergroup perception and conflict , 1995 .

[36]  R. J. Brodnick,et al.  A Structural Model of Academic Performance, Socioeconomic Status, and Spearman's g , 1995 .

[37]  L. Ross,et al.  Naive realism in everyday life: Implications for social conflict and misunderstanding. , 1996 .

[38]  J. Cacioppo,et al.  DISPOSITIONAL DIFFERENCES IN COGNITIVE MOTIVATION : THE LIFE AND TIMES OF INDIVIDUALS VARYING IN NEED FOR COGNITION , 1996 .

[39]  L. Stankov,et al.  Confidence judgments in studies of individual differences , 1996 .

[40]  Timothy D. Wilson,et al.  A new look at anchoring effects: basic anchoring and its antecedents. , 1996, Journal of experimental psychology. General.

[41]  N. Harvey,et al.  Taking Advice: Accepting Help, Improving Judgment, and Sharing Responsibility☆☆☆ , 1997 .

[42]  L. Stankov,et al.  Self-confidence and performance on tests of cognitive abilities , 1997 .

[43]  K. Stanovich,et al.  The domain specificity and generality of overconfidence: Individual differences in performance estimation bias , 1997 .

[44]  D. Paulhus.  Interpersonal and intrapsychic adaptiveness of trait self-enhancement: a mixed blessing? , 1998, Journal of personality and social psychology.

[45]  Jack B. Soll,et al.  Overconfidence: It Depends on How, What, and Whom You Ask. , 1999, Organizational behavior and human decision processes.

[46]  S. Srivastava,et al.  The Big Five Trait taxonomy: History, measurement, and theoretical perspectives. , 1999 .

[47]  B. Bornstein,et al.  " I know I know it, I know I saw it": The stability of the confidence–accuracy relationship across domains , 1999 .

[48]  J. Kruger.  Lake Wobegon be gone! The "below-average effect" and the egocentric nature of comparative ability judgments. , 1999, Journal of personality and social psychology.

[49]  J. Kruger,et al.  Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments. , 1999, Journal of personality and social psychology.

[50]  R. Bagozzi,et al.  On the nature and direction of relationships between constructs and measures. , 2000, Psychological methods.

[51]  N. Epley,et al.  Feeling "holier than thou": are self-serving assessments produced by errors in self- or social prediction? , 2000, Journal of personality and social psychology.

[52]  K. Stanovich,et al.  Heuristics and Biases: Individual Differences in Reasoning: Implications for the Rationality Debate? , 2002 .

[53]  Adrian K. Rantilla,et al.  Confidence in aggregation of expert opinions. , 2000, Acta psychologica.

[54]  Yaniv,et al.  Advice Taking in Decision Making: Egocentric Discounting and Reputation Formation. , 2000, Organizational behavior and human decision processes.

[55]  G. Loewenstein,et al.  Egocentric Empathy Gaps between Owners and Buyers: Misperceptions of the Endowment Effect , 2000, Journal of personality and social psychology.

[56]  D. Budescu,et al.  Averaging probability judgments: Monte Carlo analyses of asymptotic diagnostic value , 2001 .

[57]  C. Morf,et al.  Unraveling the Paradoxes of Narcissism: A Dynamic Self-Regulatory Processing Model , 2001 .

[58]  J. Cacioppo,et al.  DISPOSITIONAL DIFFERENCES IN COGNITIVE MOTIVATION : THE LIFE AND TIMES OF INDIVIDUALS VARYING IN NEED FOR COGNITION , 1996 .

[59]  I. Levin,et al.  A New Look at Framing Effects: Distribution of Effect Sizes, Individual Differences, and Independence of Types of Effects , 2002 .

[60]  L. Ross,et al.  The Bias Blind Spot: Perceptions of Bias in Self Versus Others , 2002 .

[61]  J. Krueger.  Return of the ego--self-referent information as a filter for social prediction: comment on Karniol (2003). , 2003, Psychological review.

[62]  D. Paulhus,et al.  The over-claiming technique: measuring self-enhancement independent of ability. , 2003, Journal of personality and social psychology.

[63]  L. Ross,et al.  Objectivity in the eye of the beholder: divergent perceptions of bias in self versus others. , 2004, Psychological review.

[64]  Timothy D. Wilson,et al.  Self-knowledge: its limits, value, and potential for improvement. , 2004, Annual review of psychology.

[65]  Ilan Yaniv,et al.  Receiving Other People's Advice: Influence and Benefit , 2004 .

[66]  Nigel Harvey,et al.  Blackwell Handbook of Judgment and Decision Making , 2004 .

[67]  D. Detterman,et al.  Scholastic Assessment or g? , 2004, Psychological science.

[68]  J. Baranski,et al.  Individual differences in decision processing and confidence judgments in comparative judgment tasks: The role of cognitive styles , 2005 .

[69]  S. Frederick.  Journal of Economic Perspectives—Volume 19, Number 4—Fall 2005—Pages 25–42 Cognitive Reflection and Decision Making , 2022 .

[70]  D. Ames,et al.  The NPI-16 as a short measure of narcissism , 2006 .

[71]  Richard P. Larrick,et al.  Intuitions About Combining Opinions: Misappreciation of the Averaging Principle , 2006, Manag. Sci..

[72]  S. Bonaccio,et al.  Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences , 2006 .

[73]  E. Pronin,et al.  Bombing Versus Negotiating: How Preferences for Combating Terrorism Are Affected by Perceived Terrorist Rationality , 2006 .

[74]  D. Moore,et al.  Effects of Task Difficulty on Use of Advice , 2007 .

[75]  Andrew M. Parker,et al.  Individual differences in adult decision-making competence. , 2007, Journal of personality and social psychology.

[76]  K. Stanovich,et al.  Natural myside bias is independent of cognitive ability , 2007 .

[77]  Matthew B. Kugler,et al.  Valuing thoughts, ignoring behavior: The introspection illusion as a source of the bias blind spot , 2007 .

[78]  E. Pronin,et al.  Perception and misperception of bias in human judgment , 2007, Trends in Cognitive Sciences.

[79]  R. Engle,et al.  The nature of individual differences in working memory capacity: active maintenance in primary memory and controlled search from secondary memory. , 2007, Psychological review.

[80]  K. Stanovich,et al.  On the relative independence of thinking biases and cognitive ability. , 2008, Journal of personality and social psychology.

[81]  K. Stanovich,et al.  Heuristics and Biases as Measures of Critical Thinking: Associations with Cognitive Ability and Thinking Dispositions , 2008 .

[82]  E. Pronin.  How We See Ourselves and How We See Others , 2008, Science.

[83]  F. Gino.  Do we listen to advice just because we paid for it? The impact of advice cost on its use , 2008 .

[84]  R. Keen.  Why People Fail to Recognize Their Own Incompetence , 2010 .

[85]  David G. Rand,et al.  The online laboratory: conducting experiments in a real labor market , 2010, ArXiv.

[86]  Panagiotis G. Ipeirotis,et al.  Running Experiments on Amazon Mechanical Turk , 2010, Judgment and Decision Making.

[87]  Carey K. Morewedge,et al.  Associative processes in intuitive judgment , 2010, Trends in Cognitive Sciences.

[88]  L. Ross,et al.  Naïve realism and capturing the “wisdom of dyads” , 2012 .

[89]  K. Stanovich,et al.  Cognitive sophistication does not attenuate the bias blind spot. , 2012, Journal of personality and social psychology.

[90]  John G. Lynch,et al.  Spotlights, Floodlights, and the Magic Number Zero: Simple Effects Tests in Moderated Regression , 2012 .

[91]  Adam J. Berinsky,et al.  Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk , 2012, Political Analysis.

[92]  Carey K. Morewedge,et al.  Missing: A Serious Game for the Mitigation of Cognitive Biases , 2014 .