Research Paper: Interventions to Regulate Ordering of Serum Magnesium Levels: Report of an Unintended Consequence of Decision Support

BACKGROUND Unintended consequences of computerized patient care system interventions may increase resource use, foster clinical errors, and reduce users' confidence. OBJECTIVE To evaluate three successive interventions designed to reduce serum magnesium test ordering through a care provider order entry system (CPOE). The second, modeled after a previously successful intervention, caused paradoxical increases in magnesium test ordering rates. DESIGN A time-series analysis modeled weekly rates of magnesium test ordering, underlying trends, the impact of the three successive interventions, and the impact of potential covariates. The first intervention exhorted users to discontinue unnecessary tests recurring more than 72 hours into the future. The second displayed recent magnesium, calcium, and phosphorus test results, limited testing to one test instance per order, and provided education regarding appropriate indications for testing. The third targeted only magnesium ordering, displayed recent results, limited testing to one instance per order, summarized indications for testing, and required users to select an indication. PARTICIPANTS Clinicians at Vanderbilt University Hospital, a 609-bed academic inpatient tertiary care facility, from 1998 through 2003. MEASUREMENTS Weekly rates of new serum magnesium test orders, instances, and results. RESULTS At baseline, there were 539 magnesium tests ordered per week. This decreased to 380 (p = 0.001) per week after the first intervention, increased to 491 per week (p < 0.001) after the second, and decreased to 276 per week (p < 0.001) after the third. CONCLUSION A clinical decision support intervention intended to regulate testing increased test order rates as an unintended result of decision support. CPOE implementers must carefully design resource-related interventions and monitor their impact over time.

[1]  C. McDonald,et al.  A computerized reminder system to increase the use of preventive care for hospitalized patients. , 2001, The New England journal of medicine.

[2]  Randolph A. Miller,et al.  The effects on clinician ordering patterns of a computerized decision support system for neuroradiology imaging studies , 2001, AMIA.

[3]  Patrik Eklund,et al.  Development and maintenance of guideline-based decision support for pharmacological treatment of hypertension , 2000, Comput. Methods Programs Biomed..

[4]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[5]  P. Diggle.  Time Series: A Biostatistical Introduction , 1990 .

[6]  R. Raschke,et al.  A computer alert system to prevent injury from adverse drug events: development and evaluation in a community teaching hospital. , 1998, JAMA.

[7]  D. Bates,et al.  Improving response to critical laboratory results with automation: results of a randomized controlled trial. , 1999, Journal of the American Medical Informatics Association : JAMIA.

[8]  R L Jackson,et al.  Calcium, magnesium, and phosphorus: emergency department testing yield. , 1997, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[9]  H R Warner,et al.  Computerized practice guidelines for heart failure management: the HeartMan system. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[10]  R. Haynes,et al.  Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. , 1998, JAMA.

[11]  G W Sun,et al.  Inappropriate use of bivariable analysis to screen risk factors for use in multivariable analysis. , 1996, Journal of clinical epidemiology.

[12]  K Dumbaugh,et al.  A successful experiment to reduce unnecessary laboratory use in a community hospital. , 1988, Medical care.

[13]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[14]  David Blumenthal,et al.  Improving Preventive Care by Prompting Physicians , 2001 .

[15]  D A Giuse,et al.  Increasing the availability of the computerized patient record. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[16]  Tom Fahey,et al.  Evaluation of computer based clinical decision support system and risk chart for management of hypertension in primary care: randomised controlled trial , 2000, BMJ : British Medical Journal.

[17]  William W. Stead,et al.  Review: Computer-based Physician Order Entry: The State of the Art , 1994, J. Am. Medical Informatics Assoc..

[18]  G J Kuperman,et al.  A randomized trial of a computer-based intervention to reduce utilization of redundant laboratory tests. , 1999, The American journal of medicine.

[19]  C J McDonald,et al.  Medical Heuristics: The Silent Adjudicators of Clinical Practice , 1996, Annals of Internal Medicine.

[20]  J. Marc Overhage,et al.  Case Report: Computerizing Guidelines to Improve Care and Patient Outcomes: The Example of Heart Failure , 1995, J. Am. Medical Informatics Assoc..

[21]  Enrico W. Coiera,et al.  Research Paper: Comparative Impact of Guidelines, Clinical Data, and Decision Support on Prescribing Decisions: An Interactive Web Experiment with Simulated Cases , 2004, J. Am. Medical Informatics Assoc..

[22]  William DuMouchel,et al.  A meta-analysis of 16 randomized controlled trials to evaluate computer-based clinical reminder systems for preventive care in the ambulatory setting. , 1996, Journal of the American Medical Informatics Association : JAMIA.

[23]  W M Tierney,et al.  Effectiveness of Computer-Generated Reminders for Increasing Discussions about Advance Directives and Completion of Advance Directive Forms , 1998, Annals of Internal Medicine.

[24]  J. Griffith,et al.  Use of the Electrocardiograph-Based Thrombolytic Predictive Instrument To Assist Thrombolytic and Reperfusion Therapy for Acute Myocardial Infarction: A Multicenter, Randomized, Controlled, Clinical Effectiveness Trial , 2002, Annals of Internal Medicine.

[25]  David L. Schriger,et al.  Implementation of clinical guidelines via a computer charting system: effect on the care of febrile children less than three years of age. , 2000, Journal of the American Medical Informatics Association : JAMIA.

[26]  J. Grimshaw,et al.  The design and analysis of a randomized controlled trial to evaluate computerized decision support in primary care: the COGENT study. , 2000, Family practice.

[27]  R A Miller,et al.  A new approach to the implementation of direct care-provider order entry. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[28]  M. J. Long,et al.  The Effects of Price Information on Physicians' Test-Ordering Behavior: Ordering of Diagnostic Tests , 1982, Medical care.

[29]  G O Barnett,et al.  Interactive query workstation: a demonstration of the practical use of UMLS knowledge sources. , 1992, Proceedings. Symposium on Computer Applications in Medical Care.

[30]  William W. Stead,et al.  Review Paper: Integration and Beyond: Linking Information from Disparate Sources and into Workflow , 2000, J. Am. Medical Informatics Assoc..

[31]  A. Skolnick,et al.  Medical Monikers—Reply , 1998 .

[32]  J Studnicki,et al.  A feedback system for reducing excessive laboratory tests. , 1993, Archives of pathology & laboratory medicine.

[33]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[34]  W A Ray,et al.  Policy and Program Analysis Using Administrative Databases , 1997, Annals of Internal Medicine.

[35]  Nadine Bazilinski,et al.  Brenner and Rector's The Kidney , 1997 .

[36]  C. McDonald,et al.  Reminders to physicians from an introspective computer medical record. A two-year randomized trial. , 1984, Annals of internal medicine.

[37]  R. Haynes,et al.  Effects of Computer-based Clinical Decision Support Systems on Clinician Performance and Patient Outcome: A Critical Appraisal of Research , 1994, Annals of Internal Medicine.

[38]  H. Krumholz,et al.  Utilization and effectiveness of a weight-based heparin nomogram at a large academic medical center. , 2000, The American journal of managed care.

[39]  H H Hawkins,et al.  A computerized physician order entry system for the promotion of ordering compliance and appropriate test utilization. , 1999, Journal of healthcare information management : JHIM.

[40]  KAVEH G. SHOJANIA,et al.  Research Paper: Reducing Vancomycin Use Utilizing a Computer Guideline: Results of a Randomized Controlled Trial , 1998, J. Am. Medical Informatics Assoc..

[41]  M Eccles,et al.  Experimental and quasi-experimental designs for evaluating guideline implementation strategies. , 2000, Family practice.

[42]  R. Haynes,et al.  Effects of Computer-Based Clinical Decision Support Systems on Physician Performance and Patient Outcomes , 1998 .

[43]  H. Warner,et al.  HELP--a program for medical decision-making. , 1972, Computers and biomedical research, an international journal.

[44]  Kevin B. Johnson,et al.  The Impact of Peer Management on Test-Ordering Behavior , 2004, Annals of Internal Medicine.

[45]  Patrice Degoulet,et al.  Clinical Information Systems: A Component-Based Approach , 2003 .

[46]  C J McDonald,et al.  The effect on test ordering of informing physicians of the charges for outpatient diagnostic tests. , 1990, The New England journal of medicine.

[47]  C. McDonald.  Protocol-based computer reminders, the quality of care and the non-perfectability of man. , 1976, The New England journal of medicine.

[48]  R. Rizza,et al.  Impact of a Diabetes Electronic Management System on the Care of Patients Seen in a Subspecialty Diabetes Clinic , 1998, Diabetes Care.

[49]  Randolph A. Miller,et al.  Review: Medical Diagnostic Decision Support Systems - Past, Present, And Future: A Threaded Bibliography and Brief Commentary , 1994, J. Am. Medical Informatics Assoc..

[50]  Blackford Middleton,et al.  Does national regulatory mandate of provider order entry portend greater benefit than risk for health care delivery? The 2001 ACMI debate. The American College of Medical Informatics. , 2002, Journal of the American Medical Informatics Association : JAMIA.

[51]  C. McDonald,et al.  The Promise of Computerized Feedback Systems for Diabetes Care , 1996, Annals of Internal Medicine.

[52]  Douglas A. Talbert,et al.  Experience using a programmable rules engine to implement a complex medical protocol during order entry , 2000, AMIA.

[53]  D. Bates,et al.  Effects of computerized physician order entry on prescribing practices. , 2000, Archives of internal medicine.

[54]  David W. Bates,et al.  Synthesis of Research Paper: Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality , 2003, J. Am. Medical Informatics Assoc..

[55]  S. Cretin,et al.  Implementation of clinical guidelines using a computer charting system. Effect on the initial care of health care workers exposed to body fluids. , 1997, JAMA.