A Meta-Analysis of Research on Hindsight Bias

We conducted a meta-analysis of research on hindsight bias to gain an up-to-date summary of the overall strength of hindsight effects and to test hypotheses about potential moderators of hindsight distortion. A total of 95 studies (83 published and 12 unpublished) were included, and 252 independent effect sizes were coded for moderator variables in 3 broad categories involving characteristics of the study, of measurement, and of the experimental manipulation. When excluding missing effect sizes, the overall mean effect size was Md = .39 with a 95% confidence interval of .36 to .42. Five main findings emerged: (a) effect sizes calculated from objective probability estimates were larger than effect sizes calculated from subjective probability estimates; (b) effect sizes of studies that used almanac questions were larger than effect sizes of studies that used real-world events or case histories; (c) studies that included neutral outcomes resulted in larger effect sizes than studies that used positive or negative outcomes; (d) studies that included manipulations to increase hindsight bias resulted in significantly larger effect sizes than studies in which there were no manipulations to reduce or increase hindsight bias; and (e) studies that included manipulations to reduce hindsight bias did not produce lower effect sizes. These findings contribute to our understanding of hindsight bias by updating the state of knowledge, widening the range of known moderator variables, identifying factors that may activate different mediating processes, and highlighting critical gaps in the research literature.

[1]  D. Pennington.  The British firemen's strike of 1977/78: An investigation of judgements in foresight and hindsight , 1981 .

[2]  Rami Zwick,et al.  On the Practical Significance of Hindsight Bias: The Case of the Expectancy-Disconfirmation Model of Consumer Satisfaction , 1995 .

[3]  Reversibility of the Hindsight Bias: Manipulation of Experimental Demands , 1993 .

[4]  Ralph B. Taylor,et al.  Hindsight bias and third-party consentors to warrantless police searches , 1991 .

[5]  N. J. Butterworth.  Expert Assessment of Examination Grades , 1988 .

[6]  Matthew H. Olson,et al.  A Study of Hindsight Bias: The Rodney King Case in Retrospect , 1994 .

[7]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[8]  E. Aronson,et al.  Performance expectancy as a determinant of actual performance. , 1962, Journal of abnormal and social psychology.

[9]  Stephen J. Hoch,et al.  Outcome feedback: hindsight and information , 1989 .

[10]  R. Agans,et al.  The Hindsight Bias: The Role of the Availability Heuristic and Perceived Risk , 1994 .

[11]  Terry Connolly,et al.  Hindsight Bias and Strategic Choice: Some Problems in Learning From Experience , 1988 .

[12]  Jonathan D. Casper,et al.  Juror decision making, attitudes, and the hindsight bias , 1989 .

[13]  Terry Connolly,et al.  Hindsight bias: Self-flattery or cognitive error? , 1990 .

[14]  Linda L. Carli.  Cognitive Reconstruction, Hindsight, and Reactions to Victims and Perpetrators , 1999 .

[15]  Therese D. Pigott,et al.  Methods for handling missing data in research synthesis. , 1994 .

[16]  Reid Hastie,et al.  Hindsight and Causality , 1991 .

[17]  S. Fiske,et al.  Social Psychology , 2019, Definitions.

[18]  Gary L. Wells,et al.  Measuring Psychological Uncertainty : Verbal Versus Numeric Methods , 2004 .

[19]  R. Hastie,et al.  Hindsight: Biased judgments of past events after the outcomes are known. , 1990 .

[20]  Jay J.J. Christensen-Szalanski,et al.  The hindsight bias: A meta-analysis , 1991 .

[21]  David B. Pillemer,et al.  Summing Up: The Science of Reviewing Research , 1984 .

[22]  B. Guerin.  Salience and Hindsight Biases in Judgements of World Events , 1982 .

[23]  Rüdiger F. Pohl,et al.  No Reduction in Hindsight Bias after Complete Information and Repeated Testing , 1996 .

[24]  M. Leary.  The Distorted Nature of Hindsight , 1981 .

[25]  G Gigerenzer,et al.  Hindsight bias: An interaction of automatic and motivational factors? , 1988, Memory & cognition.

[26]  David Faust,et al.  Eliminating the hindsight bias. , 1988 .

[27]  T. Mitchell,et al.  Effects of outcome knowledge and outcome valence on supervisors' evaluations. , 1981 .

[28]  F. Bryant,et al.  Hindsight Bias in Reaction to the Verdict in the O.J. Simpson Criminal Trial , 1997 .

[29]  R. Rosenthal.  Parametric measures of effect size. , 1994 .

[30]  B. Fischhoff,et al.  I knew it would happen: Remembered probabilities of once—future things , 1975 .

[31]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[32]  Betsy Jane Becker,et al.  Statistical methods in the meta-analysis of research on gender differences , 1986 .

[33]  O. Tykocinski,et al.  I Never Had a Chance: Using Hindsight Tactics to Mitigate Disappointments , 2001 .

[34]  T. Louie.  Decision makers' hindsight bias after receiving favorable and unfavorable feedback. , 1999 .

[35]  Field-Dependence and Hindsight Bias: Output Interference in the Generation of Reasons , 1993 .

[36]  Joel B. Greenhouse,et al.  Sensitivity analysis and diagnostics. , 1994 .

[37]  A. Tenbrunsel,et al.  Organizational Behavior and Human Decision Processes , 2013 .

[38]  D. Pennington.  Being wise after the event: an investigation of hindsight bias , 1981 .

[39]  J. Robbennolt,et al.  An Integration of Hindsight Bias and Counterfactual Thinking: Decision-Making and Drug Courier Profiles , 1997, Law and human behavior.

[40]  A. Tesser,et al.  Motivational interpretations of hindsight bias: An individual difference analysis , 1983 .

[41]  F. Bryant,et al.  "I Knew It All Along" Eventually: The Development of Hindsight Bias in Reaction to the Clinton Impeachment Verdict , 2002 .

[42]  Matthew H. Olson,et al.  A Demonstration of Hindsight Bias Using the Thomas Confirmation Vote , 1993 .

[43]  W. Goggin,et al.  The Disadvantages of Hindsight in the Perception of Suicide , 1985 .

[44]  R. Pohl,et al.  Hindsight bias and the misinformation effect: separating blended recollections from other recollection types. , 1995, Memory.

[45]  B. Fischhoff,et al.  Perceived Informativeness of Facts. , 1977 .

[46]  G. Glass,et al.  Meta-analysis in social research , 1981 .

[47]  David Mazursky,et al.  Does a surprising outcome reinforce or reverse the hindsight bias , 1997 .

[48]  V. Barnett,et al.  Applied Linear Statistical Models , 1975 .

[49]  E. Walster.  'Second Guessing' Important Events , 1967 .

[50]  Nicolaos E. Synodinos.  Hindsight Distortion: “I knew‐it‐all along and I was sure about it”1 , 1986 .

[51]  Baruch Fischhoff,et al.  On the Psychology of Experimental Surprises , 1977 .

[52]  I. Morley,et al.  Estimating the outcome of a pregnancy test: women's judgements in foresight and hindsight. , 1980, The British journal of social and clinical psychology.

[53]  D E Detmer,et al.  Heuristics and biases in medical decision-making. , 1978, Journal of medical education.

[54]  J. Payne,et al.  Juror Judgments in Civil Cases: Hindsight Effects on Judgments of Liability for Punitive Damages , 1999 .

[55]  G. Bodenhausen.  Second-guessing the jury: Stereotypic and hindsight biases in perceptions of court cases , 1990 .

[56]  Philip M.J. Reckers,et al.  Evaluation of auditor decisions: Hindsight bias effects and the expectation gap , 1993 .

[57]  G. Demakis.  Hindsight Bias and the Simpson Trial: Use in Introductory Psychology , 1997 .

[58]  N. Branscombe,et al.  Comparison Processes in Hindsight and Causal Attribution , 1995 .

[59]  T. Buchman.  An effect of hindsight on predicting bankruptcy with accounting information , 1985 .

[60]  Martin F. Davies,et al.  Field dependence and hindsight bias: Cognitive restructuring and the generation of reasons , 1992 .

[61]  R. Janoff-Bulman,et al.  Cognitive biases in blaming the victim , 1985 .

[62]  P. R. Jones,et al.  Hindsight bias in reflective practice: an empirical investigation. , 1995, Journal of advanced nursing.

[63]  L. Anderson.  Is Hindsight a Fair Judge of Foresight?: An Experimental Investigation of Second-Guessing , 1986 .

[64]  J. Neter,et al.  Applied Linear Statistical Models (3rd ed.). , 1992 .

[65]  Bernard Goitein,et al.  Protestantism and Retrospective Labeling: A Cross-Cultural Study in Person Perception , 1977 .

[66]  Linda L. Carli,et al.  The Effect of Hindsight on Victim Derogation , 1989 .

[67]  J. Brigham,et al.  The Impact of Race, Racial Attitude, and Gender on Reactions to the Criminal Trial of O. J. Simpson1 , 1999 .

[68]  M. F. Davies,et al.  Reduction of hindsight bias by restoration of foresight perspective: Effectiveness of foresight-encoding and hindsight-retrieval strategies. , 1987 .

[69]  Anders Winman,et al.  The importance of item selection in ''knew-it-all-along'' studies of general knowledge , 1997 .

[70]  Susan J. LaBine,et al.  Determinations of negligence and the hindsight bias , 1996 .

[71]  James E. Campion,et al.  Hindsight bias in an application of the Angoff method for setting cutoff scores , 1994 .

[72]  B. Fischhoff,et al.  Hindsight ≠ foresight: the effect of outcome knowledge on judgment under uncertainty* , 2003 .

[73]  D. Schkade,et al.  Expectation-outcome consistency and hindsight bias , 1991 .

[74]  H. Arkes,et al.  Hindsight bias among physicians weighing the likelihood of diagnoses. , 1981, The Journal of applied psychology.

[75]  D. R. Lehman,et al.  Hindsight Bias: A Cross-Cultural Analysis , 1996 .

[76]  Baruch Fischhoff,et al.  The effect of temporal setting on likelihood estimates , 1976 .

[77]  Daniel Kahneman,et al.  Availability: A heuristic for judging frequency and probability , 1973 .

[78]  Debra L. Worthington,et al.  Reducing the Hindsight Bias Utilizing Attorney Closing Arguments , 1999, Law and human behavior.

[79]  Lynn Hasher,et al.  I knew it all along: or, did I? , 1981 .

[80]  N. Haslam,et al.  NEGATIVE AFFECT AND HINDSIGHT BIAS , 1995 .

[81]  Vernon L. Quinsey,et al.  The Likelihood of Violent Behaviour: Predictions, Postdictions, and Hindsight Bias , 1995 .

[82]  Gordon Wood,et al.  The knew-it-all-along effect. , 1978 .

[83]  A. Winman.  Cognitive processes operating in hindsight , 1999 .

[84]  Dale T. Miller,et al.  Counterfactuals , Causal Attributions , and the Hindsight Bias : A Conceptual Integration , 1996 .

[85]  N. Roese,et al.  Perceptions of Purple: Counterfactual and Hindsight Judgments at Northwestern Wildcats Football Games , 1997 .

[86]  Hal R. Arkes,et al.  Hindsight Bias: An Impediment to Accurate Probability Estimation in Clinicopathologic Conferences , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[87]  E. Erdfelder,et al.  What kind of bias is hindsight bias? , 1998 .

[88]  R. Pieters,et al.  Individual differences in reverse Hindsight bias: I never thought something like chernobyl would happen. Did I? , 1988 .

[89]  P. Juslin,et al.  The Confidence-Hindsight Mirror Effect in Judgment: An Accuracy-Assessment Model for the Knew-It-All-Along Phenomenon , 1998 .

[90]  Mark R. Lepper,et al.  Social explanation and social expectation: Effects of real and hypothetical explanations on subjective likelihood. , 1977 .

[91]  Richard S. Brown,et al.  The Effect of Hindsight Bias on Fear of Future Illness , 1993 .

[92]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[93]  Jonathan D. Casper,et al.  Cognitions, Attitudes and Decision‐Making in Search and Seizure Cases 1 , 1988 .

[94]  E. Erdfelder,et al.  Decomposing the Hindsight Bias : A Multinomial Processing Tree Model for Separating Recollection and Reconstruction in Hindsight , 2004 .

[95]  R. Pohl.  The Effects of Feedback Source and Plausibility of Hindsight Bias , 1998 .

[96]  Richard S. Brown,et al.  The Effects of Hindsight Bias and Causal Attribution on Human Response to Environmental Events1 , 1994 .

[97]  S. Edgell,et al.  Hindsight bias in a very sparse environment , 1991 .

[98]  B. Fischhoff,et al.  Hindsight is not equal to foresight: The effect of outcome knowledge on judgment under uncertainty. , 1975 .

[99]  Mark R. Leary,et al.  Hindsight Distortion and the 1980 Presidential Election , 1982 .

[100]  Dieter Frey,et al.  We Knew It All Along: Hindsight Bias in Groups , 1995 .

[101]  O. Tykocinski,et al.  Retroactive pessimism: a different kind of hindsight bias , 2002 .

[102]  David Mazursky,et al.  “I could never have expected it to happen”: The reversal of the hindsight bias , 1990 .

[103]  L. Hedges,et al.  The power of statistical tests in meta-analysis. , 2001, Psychological methods.

[104]  J. L. Powell.  A Test of the Knew-It-All-Along Effect in the 1984 Presidential and Statewide Elections1 , 1988 .

[105]  William T. Ross,et al.  Hindsight bias and inferences in choice: the mediating effect of cognitive effort , 1993 .