Estimating hospital deaths due to medical errors: preventability is in the eye of the reviewer.

CONTEXT Studies using physician implicit review have suggested that the number of deaths due to medical errors in US hospitals is extremely high. However, some have questioned the validity of these estimates. OBJECTIVE To examine the reliability of reviewer ratings of medical error and the implications of a death described as "preventable by better care" in terms of the probability of immediate and short-term survival if care had been optimal. DESIGN Retrospective implicit review of medical records from 1995-1996. SETTING AND PARTICIPANTS Fourteen board-certified, trained internists used a previously tested structured implicit review instrument to conduct 383 reviews of 111 hospital deaths at 7 Department of Veterans Affairs medical centers, oversampling for markers previously found to be associated with high rates of preventable deaths. Patients considered terminally ill who received comfort care only were excluded. MAIN OUTCOME MEASURES Reviewer estimates of whether deaths could have been prevented by optimal care (rated on a 5-point scale) and of the probability that patients would have lived to discharge or for 3 months or more if care had been optimal (rated from 0%-100%). RESULTS Similar to previous studies, almost a quarter (22.7%) of active-care patient deaths were rated as at least possibly preventable by optimal care, with 6.0% rated as probably or definitely preventable. Interrater reliability for these ratings was also similar to previous studies (0.34 for 2 reviewers). The reviewers' estimates of the percentage of patients who would have left the hospital alive had optimal care been provided was 6.0% (95% confidence interval [CI], 3.4%-8.6%). However, after considering 3-month prognosis and adjusting for the variability and skewness of reviewers' ratings, clinicians estimated that only 0.5% (95% CI, 0.3%-0.7%) of patients who died would have lived 3 months or more in good cognitive health if care had been optimal, representing roughly 1 patient per 10 000 admissions to the study hospitals. CONCLUSIONS Medical errors are a major concern regardless of patients' life expectancies, but our study suggests that previous interpretations of medical error statistics are probably misleading. Our data place the estimates of preventable deaths in context, pointing out the limitations of this means of identifying medical errors and assessing their potential implications for patient outcomes.

[1]  Charles Perrow,et al.  Normal accidents : living with high-risk technologies : with a new afterword and a postscript on the Y2K problem , 1999 .

[2]  T. Brennan,et al.  INCIDENCE OF ADVERSE EVENTS AND NEGLIGENCE IN HOSPITALIZED PATIENTS , 2008 .

[3]  K L Posner,et al.  Effect of outcome on physician judgments of appropriateness of care. , 1991, JAMA.

[4]  A. Wall,et al.  Book ReviewTo Err is Human: building a safer health system Kohn L T Corrigan J M Donaldson M S Washington DC USA: Institute of Medicine/National Academy Press ISBN 0 309 06837 1 $34.95 , 2000 .

[5]  T A Brennan,et al.  The Institute of Medicine report on medical errors--could it do harm? , 2000, The New England journal of medicine.

[6]  J. Lynn,et al.  Predicting life span for applicants to inpatient hospice. , 1988, Archives of internal medicine.

[7]  L L Leape,et al.  Institute of Medicine medical error figures are not exaggerated. , 2000, JAMA.

[8]  R. Hayward,et al.  What is an error? , 2000, Effective clinical practice : ECP.

[9]  D Draper,et al.  Changes in quality of care for five diseases measured by implicit review, 1981 to 1986. , 1990, JAMA.

[10]  C G Cayten,et al.  Determining the Generalizability of Rating Scales in Clinical Settings , 1981, Medical care.

[11]  N. Christakis,et al.  Predicting patient survival before and after hospice enrollment. , 1998, The Hospice journal.

[12]  R H Brook,et al.  Preventable deaths: who, how often, and why? , 1988, Annals of internal medicine.

[13]  M. Mccarthy,et al.  PROGNOSTIC UNCERTAINTY IN TERMINAL CARE: CAN THE KARNOFSKY INDEX HELP? , 1985, The Lancet.

[14]  H. R. Anderson,et al.  Can the Spitzer Quality of Life Index help to reduce prognostic uncertainty in terminal care? , 1990, British Journal of Cancer.

[15]  C J McDonald,et al.  Deaths due to medical errors are exaggerated in Institute of Medicine report. , 2000, JAMA.

[16]  R H Brook,et al.  Watching the doctor-watchers. How well do peer review organization methods detect hospital care quality problems? , 1992, JAMA.

[17]  R. Hayward,et al.  Validating quality indicators for hospital care. , 1997, The Joint Commission journal on quality improvement.

[18]  R. Hayward,et al.  Identifying poor-quality hospitals. Can hospital mortality rates detect quality problems for medical diagnoses? , 1996, Medical care.

[19]  N. Laird,et al.  Incidence of Adverse Drug Events and Potential Adverse Drug Events: Implications for Prevention , 1995 .

[20]  N. Christakis,et al.  Extent and determinants of error in doctors' prognoses in terminally ill patients: prospective cohort study , 2000, BMJ : British Medical Journal.

[21]  L. McMahon,et al.  An Evaluation of Generic Screens for Poor Quality of Hospital Care on a General Medicine Service , 1993, Medical care.

[22]  A M Bernard,et al.  Evaluating the Care of General Medicine Inpatients: How Good Is Implicit Review? , 1993, Annals of Internal Medicine.

[23]  S. Thompson,et al.  Illusions of control, underestimations, and accuracy: a control heuristic explanation. , 1998, Psychological bulletin.

[24]  G Bravo,et al.  Estimating the reliability of continuous measures with Cronbach's alpha or the intraclass correlation coefficient: toward the integration of two traditions. , 1991, Journal of clinical epidemiology.

[25]  J. Butler,et al.  Internal audit in the department of medicine of a community hospital; two years' experience. , 1958, Journal of the American Medical Association.

[26]  K. Kahn,et al.  Structured Implicit Review for Physician Implicit Measurement of Quality of Care , 1989 .

[27]  A. Gawande,et al.  The incidence and nature of surgical adverse events in Colorado and Utah in 1992. , 1999, Surgery.

[28]  R. Goldman,et al.  The reliability of peer assessments of quality of care. , 1992, JAMA.

[29]  H. Sox,et al.  How many deaths are due to medical error? Getting the number right. , 2000, Effective clinical practice : ECP.

[30]  T A Brennan,et al.  Reliability and Validity of Judgments Concerning Adverse Events Suffered by Hospitalized Patients , 1989, Medical care.

[31]  R. Hayward,et al.  Discussion between reviewers does not improve reliability of peer review of hospital quality. , 2000, Medical care.

[32]  L. Kohn,et al.  To Err Is Human : Building a Safer Health System , 2007 .

[33]  L. Andrews,et al.  An alternative strategy for studying adverse events in medical care , 1997, The Lancet.