Incorporating Uncertainty Into Medical Decision Making: An Approach to Unexpected Test Results

The utility of diagnostic tests derives from the ability to translate the population concepts of sensitivity and specificity into information that will be useful for the individual patient: the predictive value of the result. As the array of available diagnostic testing broadens, there is a temptation to de-emphasize history and physical findings and defer to the objective rigor of technology. However, diagnostic test interpretation is not always straightforward. One significant barrier to routine use of probability-based test interpretation is the uncertainty inherent in pretest probability estimation, the critical first step of Bayesian reasoning. The context in which this uncertainty presents the greatest challenge is when test results oppose clinical judgment. It is this situation when decision support would be most helpful. The authors propose a simple graphical approach that incorporates uncertainty in pretest probability and has specific application to the interpretation of unexpected results. This method quantitatively demonstrates how uncertainty in disease probability may be amplified when test results are unexpected (opposing clinical judgment), even for tests with high sensitivity and specificity. The authors provide a simple nomogram for determining whether an unexpected test result suggests that one should ``switch diagnostic sides.'' This graphical framework overcomes the limitation of pretest probability uncertainty in Bayesian analysis and guides decision making when it is most challenging: interpretation of unexpected test results.

[1]  J. Attia,et al.  Generating pre‐test probabilities: a neglected area in clinical decision making , 2004, The Medical journal of Australia.

[2]  J. Baron Uncertainty in Bayes , 1994, Medical decision making : an international journal of the Society for Medical Decision Making.

[3]  M. Levitt,et al.  Pretest probability estimates: a pitfall to the clinical utility of evidence-based medicine? , 2004, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[4]  Matthias Egger,et al.  Ruling a diagnosis in or out with “SpPIn” and “SnNOut”: a note of caution , 2004, BMJ : British Medical Journal.

[5]  E. Boyko,et al.  Ruling Out or Ruling In Disease with the Most sensitiue or Specific Diagnostic Test , 1994, Medical decision making : an international journal of the Society for Medical Decision Making.

[6]  G. Lyman,et al.  Overestimation of test effects in clinical judgment. , 1993, Journal of cancer education : the official journal of the American Association for Cancer Education.

[7]  G. Diamond,et al.  Analysis of probability as an aid in the clinical diagnosis of coronary-artery disease. , 1979, The New England journal of medicine.

[8]  A. Halkin,et al.  Likelihood ratios: getting diagnostic testing into perspective. , 1998, QJM : monthly journal of the Association of Physicians.

[9]  J. Kassirer,et al.  The threshold approach to clinical decision making. , 1980, The New England journal of medicine.

[10]  W. Benish The use of information graphs to evaluate and compare diagnostic tests. , 2002, Methods of information in medicine.

[11]  A. Weissler A perspective on standardizing the predictive power of noninvasive cardiovascular tests by likelihood ratio computation: 2. Clinical applications. , 1999, Mayo Clinic proceedings.

[12]  Evidence based diagnosis: does the language reflect the theory? , 2006, BMJ : British Medical Journal.

[13]  M. Parker Whither our art? Clinical wisdom and evidence-based medicine , 2002, Medicine, health care, and philosophy.

[14]  G. Lyman,et al.  The effect of changing disease risk on clinical reasoning , 1994, Journal of General Internal Medicine.

[15]  A. Weissler A perspective on standardizing the predictive power of noninvasive cardiovascular tests by likelihood ratio computation: 1. Mathematical principles. , 1999, Mayo Clinic proceedings.

[16]  K. Ghosh,et al.  Do medical students and physicians understand probability? , 2004, QJM : monthly journal of the Association of Physicians.

[17]  Diana Nicoll Pocket Guide to Diagnostic Tests , 1992 .

[18]  O Manor,et al.  Probabilistic reasoning and clinical decision-making: do doctors overestimate diagnostic probabilities? , 2003, QJM : monthly journal of the Association of Physicians.

[19]  D. Sackett,et al.  The Ends of Human Life: Medical Ethics in a Liberal Polity , 1992, Annals of Internal Medicine.

[20]  M. Green,et al.  Evidence-based medicine training in graduate medical education: past, present and future. , 2000, Journal of evaluation in clinical practice.

[21]  Allen F. Shaughnessy,et al.  Clinical Epidemiology: A Basic Science for Clinical Medicine , 2007, BMJ : British Medical Journal.

[22]  J. Sandars,et al.  GPs' and physicians' interpretation of risks, benefits and diagnostic test results. , 2004, Family practice.

[23]  W. Richardson Five uneasy pieces about pre-test probability , 2002, Journal of General Internal Medicine.

[24]  E. Gallagher,et al.  Clinical utility of likelihood ratios. , 1998, Annals of emergency medicine.

[25]  Brian M Alexander,et al.  Evidence based diagnosis: does the language reflect the theory? , 2006, BMJ : British Medical Journal.