When good evidence goes bad: The weak evidence effect in judgment and decision-making

An indispensable principle of rational thought is that positive evidence should increase belief. In this paper, we demonstrate that people routinely violate this principle when predicting an outcome from a weak cause. In Experiment 1 participants given weak positive evidence judged outcomes of public policy initiatives to be less likely than participants given no evidence, even though the evidence was separately judged to be supportive. Experiment 2 ruled out a pragmatic explanation of the result, that the weak evidence implies the absence of stronger evidence. In Experiment 3, weak positive evidence made people less likely to gamble on the outcome of the 2010 United States mid-term Congressional election. Experiments 4 and 5 replicated these findings with everyday causal scenarios. We argue that this "weak evidence effect" arises because people focus disproportionately on the mentioned weak cause and fail to think about alternative causes.

[1]  D. Barr,et al.  Limits on theory of mind use in adults , 2003, Cognition.

[2]  Robyn M. Dawes,et al.  Everyday Irrationality: How Pseudo- Scientists, Lunatics, And The Rest Of Us Systematically Fail To Think Rationally , 2001 .

[3]  Philip M. Fernbach,et al.  Asymmetries in predictive and diagnostic reasoning. , 2011, Journal of experimental psychology. General.

[4]  C. Gettys,et al.  MINERVA-DM: A memory processes model for judgments of likelihood. , 1999 .

[5]  Panagiotis G. Ipeirotis,et al.  Running Experiments on Amazon Mechanical Turk , 2010, Judgment and Decision Making.

[6]  R. Nisbett,et al.  The dilution effect: Nondiagnostic information weakens the implications of diagnostic information , 1981, Cognitive Psychology.

[7]  B. Ross,et al.  Category-based predictions: influence of uncertainty and feature associations. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[8]  B. Fischhoff,et al.  Fault Trees: Sensitivity of Estimated Failure Probabilities to Problem Representation , 2005 .

[9]  Lola L. Lopes Averaging rules and adjustment processes in Bayesian inference , 1985 .

[10]  Philip M. Fernbach,et al.  Neglect of Alternative Causes in Predictive but Not Diagnostic Reasoning , 2010, Psychological science.

[11]  A. Tversky,et al.  Unpacking, repacking, and anchoring: advances in support theory. , 1997 .

[12]  A. Tversky,et al.  Extensional versus intuitive reasoning: the conjunction fallacy in probability judgment , 1983 .

[13]  Craig R. M. McKenzie,et al.  When negative evidence increases confidence: change in belief after hearing two sides of a dispute , 2002 .

[14]  James Shanteau,et al.  Averaging versus multiplying combination rules of inference judgment. , 1975 .

[15]  H Garavan,et al.  On people’s understanding of the diagnostic implications of probabilistic data , 1996, Memory & cognition.

[16]  A. Tversky,et al.  The simulation heuristic , 1982 .

[17]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[18]  A. Tversky,et al.  Extensional versus intuitive reasoning: the conjunction fallacy in probability judgment , 1983 .

[19]  W. Ahn,et al.  Causal Attribution as a Search for Underlying Mechanisms: An Explanation of the Conjunction Fallacy and the Discounting Principle , 1996, Cognitive Psychology.

[20]  P. Cheng From covariation to causation: A causal power theory. , 1997 .

[21]  Henry Markovits,et al.  Conditional reasoning, causality, and the structure of semantic memory: strength of association as a predictive factor for content effects , 1998, Cognition.

[22]  Siobhan Chapman Logic and Conversation , 2005 .

[23]  Yuval Rottenstreich,et al.  Typical versus atypical unpacking and superadditive probability judgment. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[24]  Jonathan Evans,et al.  A Theory of Hypothetical Thinking , 2005 .

[25]  D. Krantz,et al.  The Dilution Effect : Nondiagnostic Information Weakens the Implications of Diagnostic Information , 2003 .

[26]  A. Tversky,et al.  Support theory: A nonextensional representation of subjective probability. , 1994 .

[27]  Amos Tversky,et al.  Causal versus diagnostic contingencies: On self-deception and on the voter's illusion. , 1984 .

[28]  I. Simonson,et al.  Experimental Evidence on the Negative Effect of Product Features and Sales Promotions on Brand Choice , 1994 .