Impact of CPOE on Mortality Rates – Contradictory Findings, Important Messages

OBJECTIVE To analyze the seemingly contradictory results of the Han study (Pediatrics 2005) and the Del Beccaro study (Pediatrics 2006), both analyzing the effect of CPOE systems on mortality rates in pediatric intensive care settings. METHODS Seven CPOE system experts from the United States and Europe comment on these papers. RESULTS The two studies are not contradictory, but almost non-comparable due to differences in design and implementation. They demonstrate the range of outcomes that can be obtained from introducing informatics applications in complex health care settings. Implementing informatics applications is a sociotechnical activity, which often depends more on the organizational context than on a specific technology. As health informaticians, we must not only learn from failures, but also avoid both uncritical scepticism that may arise from drawing overly general conclusions from one negative trial, as much as uncritical optimism from limited successful ones. CONCLUSION The commentaries emphasize the need to promote systematic studies for assessing the socio-technical factors that influence the introduction of increasingly sophisticated informatics applications within complex organizations. The emergence of evidence-based health informatics will be based both on evaluation guidelines and implementation guidelines, both of which increase the chances of successful implementation. In addition, well-educated health informaticians are needed to manage and guide the implementation processes.

[1]  John Karat,et al.  Iterative usability testing: ensuring a usable clinical workstation , 1997, AMIA.

[2]  Jakob Nielsen,et al.  Estimating the number of subjects needed for a thinking aloud test , 1994, Int. J. Hum. Comput. Stud..

[3]  D. Coplen.  Types of Unintended Consequences Related to Computerized Provider Order Entry , 2007 .

[4]  Charlene R. Weir,et al.  Usability Testing as Evaluation: Development of a Tool. , 1996 .

[5]  Reinhold Haux,et al.  Recommendations of the International Medical Informatics Association (IMIA) on Education in Health and Medical Informatics , 2000, Methods of Information in Medicine.

[6]  J Brender,et al.  Factors Influencing Success and Failure of Health Informatics Systems , 2006, Methods of Information in Medicine.

[7]  N. Shaw,et al.  Bad Health Informatics Can Kill – Is Evaluation the Answer? , 2005, Methods of Information in Medicine.

[8]  H. Rex Hartson,et al.  Developing user interfaces: ensuring usability through product & process , 1993 .

[9]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[10]  L. Kohn,et al.  To Err Is Human : Building a Safer Health System , 2007 .

[11]  G. Kuperman,et al.  Computer Physician Order Entry: Benefits, Costs, and Issues , 2003, Annals of Internal Medicine.

[12]  Joan S. Ash,et al.  Principles for a Successful Computerized Physician Order Entry Implementation , 2003, AMIA.

[13]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[14]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[15]  Peter L. Elkin,et al.  Human Factors Engineering for clinical applications , 2006, MIE.

[16]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[17]  M Berg,et al.  Same Systems, Different Outcomes , 2006, Methods of Information in Medicine.

[18]  Elske Ammenwerth,et al.  Publication Bias in Medical Informatics evaluation research: Is it an issue or not? , 2006, MIE.

[19]  R. T. Riley,et al.  Managing change: an overview. , 2000, Journal of the American Medical Informatics Association : JAMIA.

[20]  Joan S. Ash,et al.  Implementing computerized physician order entry: the importance of special people , 2003, Int. J. Medical Informatics.

[21]  Dominique L. Scapin,et al.  Ergonomic criteria for the evaluation of human-computer interfaces , 1993 .

[22]  Paul J. Feltovich,et al.  Expertise in context: human and machine , 1997 .

[23]  Elske Ammenwerth,et al.  Bmc Medical Informatics and Decision Making It-adoption and the Interaction of Task, Technology and Individuals: a Fit Framework and a Case Study , 2022 .

[24]  James D. Carpenter,et al.  Adding insight: a qualitative cross-site study of physician order entry. , 2005, Studies in health technology and informatics.

[25]  Y. Han,et al.  Unexpected Increased Mortality After Implementation of a Commercially Sold Computerized Physician Order Entry System , 2005, Pediatrics.

[26]  Hans-Ulrich Prokosch,et al.  Visions and strategies to improve evaluation of health information systems: Reflections and lessons based on the HIS-EVAL workshop in Innsbruck , 2004, Int. J. Medical Informatics.

[27]  D. Bates,et al.  Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. , 2003, Archives of internal medicine.

[28]  D. Lindberg.  Research Opportunities and Challenges in 2005 , 2005, Methods of Information in Medicine.

[29]  J L Talmon,et al.  Special Section: Assessing Information Technologies for Health: Evaluation and Implementation: A Call for Action , 2006, Yearbook of Medical Informatics.

[30]  M Michael Shabot,et al.  Ten Commandments for Implementing Clinical Information Systems , 2004, Proceedings.

[31]  Vimla L. Patel,et al.  Cognitive models of directional inference in expert medical reasoning , 1997 .

[32]  Patty Curthoys,et al.  Developing user interfaces: Ensuring usability through product and process , 1997 .

[33]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[34]  David Coghlan,et al.  Insider action research: opportunities and challenges , 2007 .

[35]  R M Gardner,et al.  The International Partnership for Health Informatics Education , 2005, Methods of Information in Medicine.

[36]  J. Rothschild.  Computerized physician order entry in the critical care and general inpatient setting: a narrative review. , 2004, Journal of critical care.

[37]  R. Wears,et al.  Computer technology and clinical work: still waiting for Godot. , 2005, JAMA.

[38]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005, JAMA.

[39]  P. Gorman,et al.  Perceptions of physician order entry: results of a cross-site qualitative study. , 2003, Methods of information in medicine.

[40]  J J Cimino,et al.  Cognitive evaluation of the user interface and vocabulary of an outpatient information system. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[41]  Patrice Degoulet,et al.  Impact of CPOE on doctor-nurse cooperation for the medication ordering and administration process , 2005, Int. J. Medical Informatics.

[42]  Gilad J. Kuperman,et al.  Synthesis of Research Paper: A Consensus Statement on Considerations for a Successful CPOE Implementation , 2003, J. Am. Medical Informatics Assoc..

[43]  Dean F. Sittig,et al.  Lessons From “Unexpected Increased Mortality After Implementation of a Commercially Sold Computerized Physician Order Entry System” , 2006, Pediatrics.

[44]  Thomas H. Payne,et al.  A cross-site qualitative study of physician order entry. , 2003, Journal of the American Medical Informatics Association : JAMIA.

[45]  K. J. Gilhooly,et al.  Users’ perceptions of a computerised information system in intensive care (ABICUS) on introduction and after 2 months use , 1991, International journal of clinical monitoring and computing.

[46]  Pascal Bonnabry,et al.  Use of a prospective risk analysis method to improve the safety of the cancer chemotherapy process. , 2006, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[47]  T. Clemmer,et al.  A computer-assisted management program for antibiotics and other antiinfective agents. , 1998, The New England journal of medicine.

[48]  Matthew A. Eisenberg,et al.  Computerized Provider Order Entry Implementation: No Association With Increased Mortality Rates in an Intensive Care Unit , 2006, Pediatrics.