Safe but sound: patient safety meets evidence-based medicine.

THE INSTITUTE OF MEDICINE’S SEMINAL REPORT TO ERR Is Human highlighted the risks of medical care in the United States and shocked the sensibilities of many Americans. As one element of a multipronged response, the Agency for Healthcare Research and Quality (AHRQ) commissioned the University of California, San Francisco– Stanford University Evidence-Based Practice Center to develop a compendium of evidence-based patient safety practices, a resource summarizing the literature supporting practices relevant to improving patient safety. Making Health Care Safer: A Critical Analysis of Patient Safety Practices contains the complete results of this collaborative effort. Production of the report involved a commissioned group of 40 researchers across the country, including experts in patient safety, evidence-based medicine, and various areas of clinical medicine, nursing, and pharmacy. The report, which contains concise summaries of the evidence supporting more than 80 safety practices and a detailed description of its methods, has generated a substantial amount of attention (more than 50000 copies have been ordered or downloaded) and some controversy. The latter, elegantly articulated in the accompanying article of this issue of THE JOURNAL by 3 of the dominant figures in the fields of patient safety and quality improvement, largely concerns the tension inherent in applying principles of evidencebased medicine to patient safety practices. The paradigm of evidence-based medicine arose from the realization that health care interventions, no matter how commonsense or physiologically sound, often lack benefit and sometimes even cause harm. Since safety practices also may prove ineffective, wasteful, or even harmful, there is no reason to exempt most safety practices from the scrutiny of an evidence-based approach. Moreover, in the face of limited resources, evidence of effectiveness provides a useful parameter for prioritizing safety practices, just as with other health care interventions. Defining Patient Safety In the evidence report, we defined a patient safety practice as a type of process or structure whose application reduces the probability of adverse events resulting from exposure to the health care system across a range of diseases and procedures. We intentionally avoided explicit reference to “error” in this definition, both because of its negative connotations and the difficulties in specifying what constitutes “medical error.” The patient safety practices that flow from our definition (TABLE) may strike some readers as insufficiently distinct from quality improvement strategies. The same concerns have been raised regarding alternative definitions used by others. Nonetheless, our definition served several useful functions. First, the focus on prevention of adverse events due to medical care led to identification of a much broader pool of safety practices than would have been the case had we focused more narrowly on the prevention of errors. Second, physicians’ judgments regarding the preventability of errors tend to be poorly reproducible. Third, our definition served a pragmatic function by allowing relatively unambiguous identification of practices that “reduce the probability of adverse events resulting from exposure to the health care system”—in other words, practices that make health care safer. Using this definition, we identified 83 distinct safety practices supported by 70 systematic reviews and 293 additional primary investigations meeting our inclusion criteria, a 10fold higher yield than that of a recent systematic review targeting interventions to reduce medical errors. Our definition allowed us to include the usual practices considered under the patient safety rubric, such as computerized physician order entry (CPOE) and strategies to prevent falls among hospitalized elderly patients, as well as practices that have not traditionally been grouped under patient safety (perhaps because they may not result from discrete “errors”) but that clearly seek to prevent complications that fall within the same family of adverse events (Table).

[1]  D. Bates,et al.  What practices will most improve safety? Evidence-based medicine meets patient safety. , 2002, JAMA.

[2]  James H. Diaz,et al.  Estimating Hospital Deaths Due to Medical Errors: Preventability Is in the Eye of the Reviewer , 2002 .

[3]  S. Ancoli-Israel,et al.  Sleep deprivation and clinical performance. , 2002, JAMA.

[4]  K. McDonald,et al.  Making health care safer: a critical analysis of patient safety practices. , 2001, Evidence report/technology assessment.

[5]  J. Lau,et al.  Evidence on interventions to reduce medical errors: an overview and recommendations for future research. , 2001, Journal of general internal medicine.

[6]  Jerry Phillips,et al.  'High-alert' medications and patient safety. , 2001, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[7]  A. Jha 46 . Fatigue , Sleepiness , and Medical Errors , 2001 .

[8]  R. Hayward,et al.  What is an error? , 2000, Effective clinical practice : ECP.

[9]  S. Allen,et al.  Systematic root cause analysis of adverse drug events in a tertiary referral hospital. , 2000, The Joint Commission journal on quality improvement.

[10]  L. Kohn,et al.  To Err Is Human : Building a Safer Health System , 2007 .

[11]  T W Nolan,et al.  Reducing adverse drug events: lessons from a breakthrough series collaborative. , 2000, The Joint Commission journal on quality improvement.

[12]  W. McGaghie,et al.  Simulation technology for health care professional skills training and assessment. , 1999, JAMA.

[13]  G. Guyatt,et al.  Users' guides to the medical literature: XIX. Applying clinical trial results. A. How to use an article measuring the effect of an intervention on surrogate end points. Evidence-Based Medicine Working Group. , 1999, JAMA.

[14]  Jonathan M. Teich,et al.  The impact of computerized physician order entry on medication error prevention. , 1999, Journal of the American Medical Informatics Association : JAMIA.

[15]  Charles Perrow,et al.  Normal accidents : living with high-risk technologies : with a new afterword and a postscript on the Y2K problem , 1999 .

[16]  J D Kleinke,et al.  Release 0.0: clinical information technology in the real world. , 1998, Health affairs.

[17]  D. Bates,et al.  Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. , 1998, JAMA.

[18]  E. Vittinghoff,et al.  Randomized trial of estrogen plus progestin for secondary prevention of coronary heart disease in postmenopausal women. Heart and Estrogen/progestin Replacement Study (HERS) Research Group. , 1998, JAMA.

[19]  David M. Gaba,et al.  Assessment of Clinical Performance during Simulated Crises Using Both Technical and Behavioral Ratings , 1998, Anesthesiology.

[20]  T. Clemmer,et al.  A computer-assisted management program for antibiotics and other antiinfective agents. , 1998, The New England journal of medicine.

[21]  Paul N. Gorman,et al.  Physician order entry in U.S. hospitals , 1998, AMIA.

[22]  D. Roblin,et al.  Medical accidents in hospital care: applications of failure analysis to hospital quality appraisal. , 1997, The Joint Commission journal on quality improvement.

[23]  J. Marc Overhage,et al.  Research Paper: A Randomized Trial of "Corollary Orders" to Prevent Errors of Omission , 1997, J. Am. Medical Informatics Assoc..

[24]  J. Rall Why Things Bite Back: Technology and the Revenge of Unintended Consequences. , 1997 .

[25]  J. Pilcher,et al.  Effects of sleep deprivation on performance: a meta-analysis. , 1996, Sleep.

[26]  V Torri,et al.  Beware of Surrogate Outcome Measures , 1996, International Journal of Technology Assessment in Health Care.

[27]  K N Barker,et al.  Comparison of medication errors in an American and a British hospital. , 1995, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[28]  M. Schwedler,et al.  Are Postoperative Complications Related to Resident Sleep Deprivation? , 1995, Southern medical journal.

[29]  D W West,et al.  Pediatric medication order error rates related to the mode of order transmission. , 1994, Archives of pediatrics & adolescent medicine.

[30]  Barbara G. Kanki,et al.  Cockpit Resource Management , 1993 .

[31]  C. Laine,et al.  The impact of a regulation restricting medical house staff working hours on the quality of patient care. , 1993, JAMA.

[32]  T. Massaro,et al.  Introducing Physician Order Entry at a Major Academic Medical Center: II. Impact on Medical Education , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[33]  Jan M. Davies,et al.  Accident analysis of large-scale technological disasters applied to an anaesthetic complication , 1992, Canadian journal of anaesthesia = Journal canadien d'anesthesie.

[34]  T. Brennan,et al.  INCIDENCE OF ADVERSE EVENTS AND NEGLIGENCE IN HOSPITALIZED PATIENTS , 2008 .

[35]  Robert H. Brook,et al.  Efficacy, Effectiveness, Variations, and Quality , 1991 .

[36]  W. Rogers,et al.  Preliminary report: effect of encainide and flecainide on mortality in a randomized trial of arrhythmia suppression after myocardial infarction. , 1989, The New England journal of medicine.

[37]  R H Brook,et al.  Preventable deaths: who, how often, and why? , 1988, Annals of internal medicine.

[38]  Oddis Ja Unit dose drug distribution systems. , 1986 .

[39]  J A Oddis Unit dose drug distribution systems. , 1986, Resident and staff physician.

[40]  D. Sackett,et al.  The Ends of Human Life: Medical Ethics in a Liberal Polity , 1992, Annals of Internal Medicine.

[41]  D. L. Simms,et al.  Normal Accidents: Living with High-Risk Technologies , 1986 .

[42]  Second Circuit American Medical Association v. F.T.C. , 1980, The Federal reporter.