Judging the strength of designated evidence

Judgments of evidence strength were obtained in a series of vignettes, each containing one or two items of evidence for each of two logically independent hypotheses. Each judgment concerned a designated subset of the presented evidence. Different groups of subjects encountered different but overlapping sets of evidence. We compared groups that judged the same designated evidence for the same hypothesis, but differed in exposure to surrounding (nondesignated) evidence. Results showed clear separation of relevant from irrelevant evidence and of designated from surrounding relevant evidence. This was particularly clear in the second experiment, where judgments of designated evidence remained invariant whether the surrounding evidence supported or contradicted the specified hypothesis. The conjunction fallacy was observed for judgments of evidence strength, but was substantially reduced by a simple instruction. Because subjects can separate evidence, it becomes possible to construct cardinally scaled standards of evidence strength using conjoint-measurement methods.