Using Tree Diagrams without Numerical Values in Addition to Relative Numbers Improves Students’ Numeracy Skills

Background. Physicians and medical students may lack sufficient numeracy skills to make treatment decisions, interpret test results, and practice evidence-based medicine. We evaluated whether the use of a tree diagram without numerical values as an aid for numerical processing might improve students’ test results when dealing with percentages. Methods. A prospective randomized study was carried out with 102 third-year students. Participants received 3 diagnostic test problems and were asked to determine positive predictive values. The information in these tests was expressed either in (1) natural frequencies, (2) conditional probabilities, or (3) conditional probabilities with a tree diagram without numbers. Results. Ninety-eight (96.1%) complete data sets could be obtained. The group working with natural frequencies achieved significantly higher test results (n = 29, mean score: 1.1, P = 0.045) than the group working with conditional probabilities (n = 34, mean score: 0.56). The students who were given a tree diagram in addition to conditional probabilities (n = 35, mean score: 1.26) also achieved significantly better scores than the group with conditional probabilities alone (P = 0.008). The difference between the group who had received natural frequencies and the group working with conditional probabilities and the tree diagram was not significant. Conclusions. We suggest the use of a tree diagram as a visual aid when dealing with diagnostic tests expressed in conditional probabilities.

[1]  Larry Culpepper,et al.  Numeracy and medicine: key family physician attitudes about communicating probability with patients. , 2004, The Journal of the American Board of Family Practice.

[2]  L. Moore,et al.  Medical students' perspective on the teaching of medical statistics in the undergraduate medical curriculum , 2002, Statistics in medicine.

[3]  G Gigerenzer,et al.  Using natural frequencies to improve diagnostic inferences , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[4]  D. Eddy Judgment under uncertainty: Probabilistic reasoning in clinical medicine: Problems and opportunities , 1982 .

[5]  H. Fineberg,et al.  When doctors meet numbers. , 1981, The American journal of medicine.

[6]  Emmanuel Simons,et al.  Physical examination for lumbar radiculopathy due to disc herniation in patients with low-back pain. , 2010, The Cochrane database of systematic reviews.

[7]  G. Elwyn,et al.  One hundred years ago: Should milk be boiled? , 2002, BMJ : British Medical Journal.

[8]  S. Kanter,et al.  Physician numeracy as the basis for an evidence-based medicine curriculum. , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[9]  C. Estrada,et al.  Health literacy and numeracy. , 1999, JAMA.

[10]  David Staniforth,et al.  Innovations in curriculum design: A multi-disciplinary approach to teaching statistics to undergraduate medical students , 2008, BMC medical education.

[11]  H. Wulff,et al.  What do doctors know about statistics? , 1987, Statistics in medicine.

[12]  G Gigerenzer,et al.  [How can one improve the understanding and communication of the importance of medical test results?]. , 2000, Zeitschrift fur arztliche Fortbildung und Qualitatssicherung.

[13]  B. Thiers Medicine Residents' Understanding of the Biostatistics and Results in the Medical Literature , 2008 .

[14]  Michael Pignone,et al.  Numeracy and the medical student's ability to interpret data. , 2002, Effective clinical practice : ECP.

[15]  Gerd Gigerenzer,et al.  How to Improve Bayesian Reasoning Without Instruction: Frequency Formats , 1995 .

[16]  Ulrich Hoffrage,et al.  Teaching Bayesian reasoning: an evaluation of a classroom tutorial for medical students , 2002, Medical teacher.

[17]  K. Matsui,et al.  Quantitative evaluation of the diagnostic thinking process in medical students , 2002, Journal of General Internal Medicine.

[18]  M. Galesic,et al.  Who profits from visual aids: overcoming challenges in people's understanding of risks [corrected]. , 2010, Social science & medicine.

[19]  T. Fukui,et al.  A traditionally administered short course failed to improve medical students’ diagnostic performance , 2004, Journal of General Internal Medicine.

[20]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.