Explaining computation of predictive values: 2 × 2 table versus frequency tree. A randomized controlled trial [ISRCTN74278823]

BackgroundInvolving patients in decision making on diagnostic procedures requires a basic level of statistical thinking. However, innumeracy is prevalent even among physicians. In medical teaching the 2 × 2 table is widely used as a visual help for computations whereas in psychology the frequency tree is favoured. We assumed that the 2 × 2 table is more suitable to support computations of predictive values.Methods184 students without prior statistical training were randomised either to a step-by-step self-learning tutorial using the 2 × 2 table (n = 94) or the frequency tree (n = 90). During the training session students were instructed by two sample tasks and a total of five positive predictive values had to be computed. During a follow-up session 4 weeks later participants had to compute 5 different tasks of comparable degree of difficulty without having the tutorial instructions at their disposal. The primary outcome was the correct solution of the tasks.ResultsThere were no statistically significant differences between the two groups. About 58% achieved correct solutions in 4–5 tasks following the training session and 26% in the follow-up examination.ConclusionsThese findings do not support the hypothesis that the 2 × 2 table is more valuable to facilitate the calculation of positive predictive values than the frequency tree.

[1]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[2]  D. Humphries,et al.  Reckoning with risk: learning to live with uncertainty , 2003, British Journal of Sports Medicine.

[3]  Gerd Gigerenzer,et al.  Communicating Statistical Information , 2000, Science.

[4]  K. Johnson The two by two diagram: a graphical truth table. , 1999, Journal of clinical epidemiology.

[5]  Lucas M Bachmann,et al.  Communicating accuracy of tests to general practitioners: a controlled study , 2002, BMJ : British Medical Journal.

[6]  G Gigerenzer,et al.  Using natural frequencies to improve diagnostic inferences , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[7]  Ulrich Hoffrage,et al.  Teaching Bayesian reasoning: an evaluation of a classroom tutorial for medical students , 2002, Medical teacher.

[8]  Gerd Gigerenzer,et al.  How to Improve Bayesian Reasoning Without Instruction: Frequency Formats , 1995 .

[9]  G. Gigerenzer,et al.  Teaching Bayesian reasoning in less than two hours. , 2001, Journal of experimental psychology. General.

[10]  D. Sackett Evidence-Based Medicine: How to Practice and Teach EBM , 2018 .

[11]  D. Eddy Judgment under uncertainty: Probabilistic reasoning in clinical medicine: Problems and opportunities , 1982 .

[12]  G. Gigerenzer Ecological intelligence: An adaptation for frequencies , 1997 .

[13]  G. Gigerenzer Reckoning with Risk : Learning to Live with Uncertainty , 2002 .

[14]  G. Gigerenzer,et al.  AIDS counselling for low-risk clients. , 1998, AIDS care.