You Can Lead a Horse to Water-Improving Physicians' Knowledge of Probabilities May Not Affect Their Decisions

Objectives. To determine whether improving physicians' judgments of the probability of streptococcal pharyngitis for patients with sore throats would affect their use of antibiotics and affect the variation in such use. Design. Post-hoc retrospective analysis of data previously collected as part of a controlled trial. Settings. University student health services in Penn sylvania and Nebraska. Patients. Sequential patients with pharyngitis seen before and after the time clinicians received either an experimental educational intervention designed to improve probabilistic diagnostic judgments (at the Pennsylvania site) or a control intervention, a standard lecture (at the Nebraska site). The clinician-subjects were the primary case physicians practicing at either site. Measurements. Clinical variables prospectively recorded by the clinicians, probability assessments, and treatment decisions. Results. At the experi mental site, despite marked decreases in clinicians' overestimations of disease probability after the intervention, the proportion of patients prescribed antibiotics showed a trend toward increasing: 100/290 (34.5%) pre-intervention, 90/225 (40%) post-intervention. The interven tion did not decrease practice variation between individual doctors. Univariable and multi variable analyses showed no major change in the relationships between clinical variables and treatment decisions after the intervention. At the control site there was no major change in probability judgments or treatment decisions after the intervention. Conclusions. Teaching physicians to make better judgments of disease probability may not alter their treatment decisions. Key words: knowledge; probability; decision making; pharyngitis diagnosis. (Med Decis Making 1995;15:65-75)

[1]  H C Sox,et al.  Probability theory in the use of diagnostic tests. An introduction to critical study of the literature. , 1986, Annals of internal medicine.

[2]  D. Ott,et al.  Methodologic considerations in comparing imaging methods. , 1985, AJR. American journal of roentgenology.

[3]  J. Wasson,et al.  Physician variation in anticoagulating patients with atrial fibrillation. Dartmouth Primary Care COOP Project. , 1990, Archives of internal medicine.

[4]  William R. Ferrell,et al.  A model of calibration for subjective probabilities , 1980 .

[5]  R. Centor,et al.  What a Difference a Day Makes: A Decision Analysis of Adult Streptococcal Pharyngitis , 2022 .

[6]  R S Wigton,et al.  Transportability of a decision rule for the diagnosis of streptococcal pharyngitis. , 1986, Archives of internal medicine.

[7]  J. Newhouse,et al.  Hospital spending in the United States and Canada: a comparison. , 1988, Health affairs.

[8]  R M Centor,et al.  The Diagnosis of Strep Throat in Adults in the Emergency Room , 1981, Medical decision making : an international journal of the Society for Medical Decision Making.

[9]  K. Skadhauge,et al.  Penicillin therapy in acute tonsillitis, phlegmonous tonsillitis and ulcerative tonsillitis. , 2009, Acta medica Scandinavica.

[10]  T. Jersild.  Penicillin therapy in scarlet fever and complicating otitis. , 1948, The Lancet.

[11]  R. Cebul,et al.  The comparative cost-effectiveness of statistical decision rules and experienced physicians in pharyngitis management. , 1986, JAMA.

[12]  R. Plackett,et al.  THE DESIGN OF OPTIMUM MULTIFACTORIAL EXPERIMENTS , 1946 .

[13]  R S Wigton,et al.  Controlled trial using computerized feedback to improve physicians' diagnostic judgments , 1992, Academic medicine : journal of the Association of American Medical Colleges.

[14]  M. Young,et al.  Comparing aggregate estimates of derived thresholds for clinical decisions. , 1986, Health services research.

[15]  Colin Camerer.  Judgment and decision making, J. Frank Yates. Englewood Cliffs, New Jersey, Prentice-Hall inc. 1990 , 1991 .

[16]  D A Bergman,et al.  The impact of reading a clinical study on treatment decisions of physicians and residents. , 1986, Journal of medical education.

[17]  R S Wigton,et al.  Practice Variation in the Management of Pharyngitis , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[18]  J.W. Payne,et al.  Understanding contingent choice: a computer simulation approach , 1990, IEEE Trans. Syst. Man Cybern..

[19]  P. Greenland,et al.  Selection and interpretation of diagnostic tests and procedures. Principles and applications. , 1981, Annals of internal medicine.

[20]  L. Beach,et al.  “… Do i love thee? Let me count …” toward an understanding of intuitive and automatic decision making , 1990 .

[21]  A. Detsky,et al.  When was a "negative" clinical trial big enough? How many patients you needed depends on what you found. , 1985, Archives of internal medicine.

[22]  R D Cebul,et al.  The importance of disease prevalence in transporting clinical prediction rules. The case of streptococcal pharyngitis. , 1986, Annals of internal medicine.

[23]  D. Spiegelhalter,et al.  Doctors' attitudes to risk in difficult clinical decisions: application of decision analysis in hepatobiliary disease. , 1984, British medical journal.

[24]  J. Eisenberg,et al.  Usefulness of synovial fluid analysis in the evaluation of joint effusions. Use of threshold analysis and likelihood ratios to assess a diagnostic test. , 1984, Archives of internal medicine.

[25]  W M Tierney,et al.  Physicians' Estimates of the Probability of Myocardial Infarction in Emergency Boom Patients with chest Pain , 1986, Medical decision making : an international journal of the Society for Medical Decision Making.

[26]  J. Wennberg.  Improving the Medical Decisionmaking Process , 1988 .

[27]  Sore throat management--decision analysis using pleasant hour equivalents. , 1979, Computers and biomedical research, an international journal.

[28]  D. Simel.  PLAYING THE ODDS , 1985, The Lancet.

[29]  F. W. Denny,et al.  Prevention of rheumatic fever; treatment of the preceding streptococcic infection. , 1950 .

[30]  J. Sammons.  Reviews: Organized Medicine , 1984 .

[31]  R. Tompkins,et al.  An analysis of the cost-effectiveness of pharyngitis management and acute rheumatic fever prevention. , 1977, Annals of internal medicine.

[32]  P. A. R. Koopman,et al.  Confidence intervals for the ratio of two binomial proportions , 1984 .

[33]  R S Wigton,et al.  Teaching old dogs new tricks: using cognitive feedback to improve physicians' diagnostic judgments on simulated cases , 1990, Academic medicine : journal of the Association of American Medical Colleges.

[34]  N. Roos,et al.  Hospitalization style of physicians in Manitoba: the disturbing lack of logic in medical practice. , 1992, Health services research.

[35]  V. Clark,et al.  Computer-aided multivariate analysis , 1991 .

[36]  Stochastic thresholds. , 1986, Medical decision making : an international journal of the Society for Medical Decision Making.

[37]  R. Fletcher,et al.  Clinical Epidemiology: The Essentials , 1982 .

[38]  J. Bell,et al.  Physician Variation in Anticoagulating Patients With Atrial Fibrillation , 1990 .

[39]  R M Allman,et al.  Physician tolerance for uncertainty. Use of liver-spleen scans to detect metastases. , 1985, JAMA.

[40]  R D Cebul,et al.  The accuracy of experienced physicians' probability estimates for patients with sore throats. Implications for decision making. , 1985, JAMA.

[41]  R S Wigton,et al.  Use of Linear Models to Analyze Physicians' Decisions , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[42]  A. Bisno.  Group A streptococcal infections and acute rheumatic fever. , 1991, The New England journal of medicine.

[43]  A S Elstein,et al.  Comparison of physicians' decisions regarding estrogen replacement therapy for menopausal women and decisions derived from a decision analytic model. , 1986, The American journal of medicine.

[44]  K. Rogers,et al.  Streptococcal pharyngitis. Early treatment and management by nurse practitioners. , 1974, JAMA.