Physician judgment in clinical settings: methodological influences and cognitive performance.

Understanding the quality of physicians' intuitive judgments is essential in determining the appropriate use of their judgments in medical decision-making (vis-a-vis analytical or actuarial approaches). As part of this process, the quality of physicians' predictions must be assessed because prediction is fundamental to common clinical tasks: determining diagnosis, prognosis, and therapy; establishing monitoring intervals; performing screening and preventive maneuvers. Critical evaluation of predictive capabilities requires an assessment of the components of the prediction process: the data available for prediction, the method used for prediction, and the accuracy of prediction. Although variation in and uncertainty about the underlying data elements are often acknowledged as a source of inaccurate predictions, prediction also can be confounded by both methodological and cognitive limitations. During the past two decades, numerous factors have been recognized that may bias test characteristics (sensitivity and specificity). These same factors may also produce bias in intuitive judgments. The use of cognitive processes to simplify judgment tasks (e.g., the availability and representativeness heuristics) and the presence of certain biases in the judgment process (e.g., ego, regret) may present obstacles to accurate estimation of probabilities by physicians. Limitations on the intuitive use of information (cognitive biases) have been demonstrated in both medical and nonmedical decision-making settings. Recent studies have led to a deepening understanding of the advantages and disadvantages of intuitive and analytical approaches to decision making. Here, many aspects of the basis for this understanding are reviewed.

[1]  N V Dawson,et al.  Systematic errors in medical decision making: judgment limitations. , 1987, Journal of general internal medicine.

[2]  Jay J.J. Christensen-Szalanski,et al.  Physicians' use of probabilistic information in a real clinical setting. , 1981 .

[3]  A. D. Pearman,et al.  Judgment and Decision Making: An Interdisciplinary Reader , 1999 .

[4]  C. Metz Basic principles of ROC analysis. , 1978, Seminars in nuclear medicine.

[5]  SUPPORT: Study to understand prognoses and preferences for outcomes and risks of treatments. Study design. , 1990, Journal of clinical epidemiology.

[6]  T. Wallsten Physician and Medical Student Bias in Evaluating Diagnostic Information , 1981, Medical decision making : an international journal of the Society for Medical Decision Making.

[7]  R. L. Winkler,et al.  Are two (inexperienced) heads better than one (experienced) head? Averaging house officers' prognostic judgments for critically ill patients. , 1990, Archives of internal medicine.

[8]  H. Arkes,et al.  Hindsight bias among physicians weighing the likelihood of diagnoses. , 1981, The Journal of applied psychology.

[9]  W M Tierney,et al.  Physicians' Estimates of the Probability of Myocardial Infarction in Emergency Boom Patients with chest Pain , 1986, Medical decision making : an international journal of the Society for Medical Decision Making.

[10]  G. Brier,et al.  External correspondence: Decompositions of the mean probability score , 1982 .

[11]  A. Feinstein,et al.  Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. , 1978, The New England journal of medicine.

[12]  A. Tversky,et al.  On the elicitation of preferences for alternative therapies. , 1982, The New England journal of medicine.

[13]  Hal R. Arkes,et al.  Hindsight Bias: An Impediment to Accurate Probability Estimation in Clinicopathologic Conferences , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[14]  J. H. Mitchell,et al.  Information and medicine. The nature of medical descriptions , 1985 .

[15]  R. Hogarth,et al.  Confidence in judgment: Persistence of the illusion of validity. , 1978 .

[16]  J J Christensen-Szalanski,et al.  Physicians' Misunderstanding of Normal Findings , 1983, Medical decision making : an international journal of the Society for Medical Decision Making.

[17]  K. R. Hammond,et al.  SOME METHODOLOGICAL CONSIDERATIONS IN MULTIPLE-CUE PROBABILITY STUDIES. , 1964, Psychological review.

[18]  M. Weinstein,et al.  Clinical Decision Analysis , 1980 .

[19]  A. Baum,et al.  Assessment of Preferences for self-treatment and information in health care. , 1980, Journal of personality and social psychology.

[20]  J. Knottnerus The Effects of Disease Verification and Referral on the Relationship Between Symptoms and Diseases , 1987, Medical decision making : an international journal of the Society for Medical Decision Making.

[21]  N V Dawson,et al.  Hemodynamic assessment in managing the critically ill: is physician confidence warranted? , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[22]  F. Harrell,et al.  Factors affecting sensitivity and specificity of exercise electrocardiography. Multivariable analysis. , 1984, The American journal of medicine.

[23]  T. Speroff,et al.  Lens Model Analysis of Hemodynamic status in the critically III , 1989, Medical decision making : an international journal of the Society for Medical Decision Making.

[24]  R Roberts,et al.  Early diagnosis of acute myocardial infarction based on assay for subforms of creatine kinase-MB. , 1990, Circulation.

[25]  Steven Schwartz,et al.  Medical Thinking: The Psychology of Medical Judgment and Decision Making , 1986 .

[26]  L D Fisher,et al.  Exercise stress testing: Correlations among history of angina, ST-segment response and prevalence of coronary-artery disease in the coronary artery surgery study , 1980 .

[27]  J. Wennberg,et al.  Which rate is right? , 1986, The New England journal of medicine.

[28]  Baruch Fischhoff,et al.  Calibration of Probabilities: The State of the Art , 1977 .

[29]  D. Sackett,et al.  The Ends of Human Life: Medical Ethics in a Liberal Polity , 1992, Annals of Internal Medicine.

[30]  C B Begg,et al.  Biases in the assessment of diagnostic tests. , 1987, Statistics in medicine.

[31]  J. Kassirer,et al.  The threshold approach to clinical decision making. , 1980, The New England journal of medicine.

[32]  R. Dawes,et al.  Heuristics and Biases: Clinical versus Actuarial Judgment , 2002 .

[33]  D. McClish,et al.  How Well Can Physicians Estimate Mortality in a Medical Intensive Care Unit? , 1989, Medical decision making : an international journal of the Society for Medical Decision Making.

[34]  K. R. Hammond,et al.  ANALYZING THE COMPONENTS OF CLINICAL INFERENCE. , 1964, Psychological review.

[35]  A R Feinstein,et al.  The 'chagrin factor' and qualitative decision analysis. , 1985, Archives of internal medicine.

[36]  J. Swets The Relative Operating Characteristic in Psychology , 1973, Science.

[37]  D E Detmer,et al.  Heuristics and biases in medical decision-making. , 1978, Journal of medical education.

[38]  L D Gruppen,et al.  Differential diagnosis and the competing-hypotheses heuristic. A practical approach to judgment under uncertainty and Bayesian probability. , 1985, JAMA.

[39]  R M Poses,et al.  The answer to “What are my chances, Doctor?” depends on whom is asked: Prognostic disagreement and inaccuracy for critically ill patients , 1989, Critical care medicine.

[40]  G. Somes,et al.  Beyond Normality: The Predictive Value and Efficiency of Medical Diagnoses R. S. Galen and S. R. Gambino. New York, Wiley, 1975, 237 pp, $14.95 , 1976 .

[41]  J E McEachern,et al.  How to start a direct patient care team. , 1992, QRB. Quality review bulletin.

[42]  William A. Knaus,et al.  The SUPPORT Prognostic Model , 1995 .

[43]  J J Christensen-Szalanski,et al.  Feedback and the Illusion of Validity in a Medical Clinic , 1981, Medical decision making : an international journal of the Society for Medical Decision Making.

[44]  T. K. Natarajan,et al.  A test for patency of the cystic duct in acute cholecystitis. , 1975, Annals of internal medicine.

[45]  A. Stewart,et al.  The MOS short-form general health survey. Reliability and validity in a patient population. , 1988, Medical care.

[46]  R S Wigton,et al.  Use of Linear Models to Analyze Physicians' Decisions , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[47]  S. French Professional Judgment: A Reader in Clinical Decision Making , 1988 .

[48]  A. Elstein Clinical judgment: psychological research and medical practice. , 1976, Science.

[49]  Margaret R. Spitz,et al.  Research methodology: Strengthening causal interpretations of nonexperimental data , 2004, Cancer Causes & Control.

[50]  A L Brannen,et al.  Prediction of outcome from critical illness. A comparison of clinical judgment with a prediction rule. , 1989, Archives of internal medicine.

[51]  D. Eddy Judgment under uncertainty: Probabilistic reasoning in clinical medicine: Problems and opportunities , 1982 .

[52]  J. Frank Yates,et al.  Judgment and Decision Making , 1990 .

[53]  R D Cebul,et al.  The accuracy of experienced physicians' probability estimates for patients with sore throats. Implications for decision making. , 1985, JAMA.

[54]  G. Chapman,et al.  [Medical decision making]. , 1976, Lakartidningen.

[55]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.