Model Formulation: A Conceptual Framework for Evaluating Outpatient Electronic Prescribing Systems Based on Their Functional Capabilities

OBJECTIVE Electronic prescribing (e-prescribing) may substantially improve health care quality and efficiency, but the available systems are complex and their heterogeneity makes comparing and evaluating them a challenge. The authors aimed to develop a conceptual framework for anticipating the effects of alternative designs for outpatient e-prescribing systems. DESIGN Based on a literature review and on telephone interviews with e-prescribing vendors, the authors identified distinct e-prescribing functional capabilities and developed a conceptual framework for evaluating e-prescribing systems' potential effects based on their capabilities. Analyses of two commercial e-prescribing systems are presented as examples of applying the conceptual framework. MEASUREMENTS Major e-prescribing functional capabilities identified and the availability of evidence to support their specific effects. RESULTS The proposed framework for evaluating e-prescribing systems is organized using a process model of medication management. Fourteen e-prescribing functional capabilities are identified within the model. Evidence is identified to support eight specific effects for six of the functional capabilities. The evidence also shows that a functional capability with generally positive effects can be implemented in a way that creates unintended hazards. Applying the framework involves identifying an e-prescribing system's functional capabilities within the process model and then assessing the effects that could be expected from each capability in the proposed clinical environment. CONCLUSION The proposed conceptual framework supports the integration of available evidence in considering the full range of effects from e-prescribing design alternatives. More research is needed into the effects of specific e-prescribing functional alternatives. Until more is known, e-prescribing initiatives should include provisions to monitor for unintended hazards.

[1]  Jonathan M. Teich,et al.  Improving allergy alerting in a computerized physician order entry system , 2000, AMIA.

[2]  J. Reason Human error: models and management , 2000, BMJ : British Medical Journal.

[3]  David C Classen,et al.  Evaluation of a Computer-Assisted Antibiotic-Dose Monitor , 1999, The Annals of pharmacotherapy.

[4]  J. Marc Overhage,et al.  Controlled Trial of Direct Physician Order Entry , 2001 .

[5]  J M Teich,et al.  Impact of computerized physician order entry on physician time. , 1994, Proceedings. Symposium on Computer Applications in Medical Care.

[6]  M. Daschbach,et al.  Initiation of warfarin therapy: comparison of physician dosing with computer-assisted dosing. , 1987, Journal of general internal medicine.

[7]  R. Haynes,et al.  Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. , 1998, JAMA.

[8]  M. Langdorf,et al.  Physician versus computer knowledge of potential drug interactions in the emergency department. , 2000, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[9]  R. Haynes,et al.  Effects of Computer-based Clinical Decision Support Systems on Clinician Performance and Patient Outcome: A Critical Appraisal of Research , 1994, Annals of Internal Medicine.

[10]  D M Nadzam,et al.  Development of medication-use indicators by the Joint Commission on Accreditation of Healthcare Organizations. , 1991, American journal of hospital pharmacy.

[11]  C. McDonald,et al.  Physician inpatient order writing on microcomputer workstations. Effects on resource utilization. , 1993, JAMA.

[12]  D S Stein,et al.  Factors related to errors in medication prescribing. , 1997, JAMA.

[13]  K L Melmon,et al.  Preventable drug reactions--causes and cures. , 1971, The New England journal of medicine.

[14]  Robert S Van Hare Potential adverse drug interactions in the emergency room (An issue in the quality of care) , 1990 .

[15]  P. Sandercock,et al.  Framework for design and evaluation of complex interventions to improve health , 2000, BMJ : British Medical Journal.

[16]  David Classen,et al.  Implementing Antibiotic Practice Guidelines through Computer-Assisted Decision Support: Clinical and Financial Outcomes , 1996, Annals of Internal Medicine.

[17]  R. Kapp,et al.  Food, Drug, and Cosmetic Act , 2005 .

[18]  B L Lambert,et al.  Similarity as a risk factor in drug-name confusion errors: the look-alike (orthographic) and sound-alike (phonetic) model. , 1999, Medical care.

[19]  Herbert A. Simon,et al.  The Science of Design: Creating the Artificial , 1988 .

[20]  D. Bates,et al.  The Costs of Adverse Drug Events in Hospitalized Patients , 1997 .

[21]  D. Bates,et al.  Effects of computerized physician order entry on prescribing practices. , 2000, Archives of internal medicine.

[22]  T I Poirier,et al.  Evaluation of drug interaction microcomputer software: an updated comparison. , 1995, Hospital pharmacy.

[23]  Cabral Jd Poor physician penmanship. , 1997 .

[24]  James G. Anderson,et al.  Evaluating the potential effectiveness of using computerized information systems to prevent adverse drug events , 1997, AMIA.

[25]  B L Lambert,et al.  Effect of orthographic and phonological similarity on false recognition of drug names. , 2001, Social science & medicine.

[26]  N. Dickey,et al.  Systems analysis of adverse drug events. , 1996, JAMA.

[27]  J D Cabral Poor physician penmanship. , 1997, JAMA.

[28]  William W. Stead,et al.  Review: Computer-based Physician Order Entry: The State of the Art , 1994, J. Am. Medical Informatics Assoc..

[29]  K. McDonald,et al.  Making health care safer: a critical analysis of patient safety practices. , 2001, Evidence report/technology assessment.

[30]  T. Brennan,et al.  The nature of adverse events in hospitalized patients. Results of the Harvard Medical Practice Study II. , 1991, The New England journal of medicine.

[31]  J. Chan,et al.  Medication misadventures resulting in emergency department visits at and HMO medical center. , 1996, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[32]  S D Small,et al.  Incidence of adverse drug events and potential adverse drug events. Implications for prevention. ADE Prevention Study Group. , 1995, JAMA.

[33]  T. Massaro Introducing Physician Order Entry at a Major Academic Medical Center: I. Impact on Organizational Culture and Behavior , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[34]  N. Laird,et al.  Incidence of adverse drug events and potential adverse drug events , 1995 .

[35]  N. Laird,et al.  Incidence of Adverse Drug Events and Potential Adverse Drug Events: Implications for Prevention , 1995 .

[36]  D. Bates,et al.  Patient risk factors for adverse drug events in hospitalized patients. ADE Prevention Study Group. , 1999, Archives of internal medicine.

[37]  Christopher G. Chute,et al.  Viewpoint: Clinical Classification and Terminology: Some History and Current Observations , 2000, J. Am. Medical Informatics Assoc..

[38]  Joshua Borus,et al.  Adverse drug events in ambulatory care. , 2003, The New England journal of medicine.

[39]  D. Bates,et al.  Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. , 1998, JAMA.

[40]  Vimla L. Patel,et al.  Toward a cognitive taxonomy of medical errors , 2002, AMIA.

[41]  James G. McDaniel,et al.  Improving system quality through software evaluation , 2002, Comput. Biol. Medicine.

[42]  S D Small,et al.  The costs of adverse drug events in hospitalized patients. Adverse Drug Events Prevention Study Group. , 1998, JAMA.

[43]  C J McDonald,et al.  Medical students' and housestaff's opinions of computerized order‐writing , 1994, Academic medicine : journal of the Association of American Medical Colleges.

[44]  Reed M. Gardner,et al.  The HELP hospital information system: update 1998 , 1999, Int. J. Medical Informatics.

[45]  R. Wachter,et al.  Safe but sound: patient safety meets evidence-based medicine. , 2002, JAMA.

[46]  G. Schiff,et al.  Computerized prescribing: building the electronic infrastructure for better medication usage. , 1998, JAMA.

[47]  Nancy G. Leveson,et al.  An investigation of the Therac-25 accidents , 1993, Computer.

[48]  Joel Lexchin,et al.  Effects of restrictive formularies in the ambulatory care setting. , 2002, The American journal of managed care.

[49]  Jonathan M. Teich,et al.  The impact of computerized physician order entry on medication error prevention. , 1999, Journal of the American Medical Informatics Association : JAMIA.

[50]  D. Bates,et al.  What practices will most improve safety? Evidence-based medicine meets patient safety. , 2002, JAMA.

[51]  et al.,et al.  The Regenstrief Medical Record System: a quarter century experience , 1999, Int. J. Medical Informatics.

[52]  P M Gertman,et al.  Iatrogenic illness on a general medical service at a university hospital* , 1981, Quality and Safety in Health Care.

[53]  Paul N. Gorman,et al.  Physician order entry in U.S. hospitals , 1998, AMIA.

[54]  P M Wax,et al.  Elixirs, Diluents, and the Passage of the 1938 Federal Food, Drug and Cosmetic Act , 1995, Annals of Internal Medicine.

[55]  Fred Charatan News and Features: Compensation awarded for death after illegible prescription , 2000 .

[56]  John F. Burnum,et al.  Preventability of Adverse Drug Reactions , 1976 .

[57]  Marilyn M. Anderson,et al.  Research Paper: Evaluating the Capability of Information Technology to Prevent Adverse Drug Events: A Computer Simulation Approach , 2002, J. Am. Medical Informatics Assoc..

[58]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[59]  E. Winslow,et al.  Legibility and completeness of physicians' handwritten medication orders. , 1997, Heart & lung : the journal of critical care.

[60]  J M Teich,et al.  Computerized physician order entry and quality of care. , 1994, Quality management in health care.

[61]  I N Purves,et al.  PRODIGY: implementing clinical guidance using computers. , 1998, The British journal of general practice : the journal of the Royal College of General Practitioners.

[62]  David W. Bates,et al.  Research Paper: Using Computerized Data to Identify Adverse Drug Events in Outpatients , 2001, J. Am. Medical Informatics Assoc..

[63]  D. Bates,et al.  Systems analysis of adverse drug events. ADE Prevention Study Group. , 1995, JAMA.

[64]  J. Marc Overhage,et al.  Research Paper: A Randomized Trial of "Corollary Orders" to Prevent Errors of Omission , 1997, J. Am. Medical Informatics Assoc..

[65]  R. Goldberg,et al.  Drug-drug and drug-disease interactions in the ED: analysis of a high-risk population. , 1996, The American journal of emergency medicine.

[66]  R H Brook,et al.  A Method for the Detailed Assessment of the Appropriateness of Medical Technologies , 1986, International Journal of Technology Assessment in Health Care.

[67]  Jakob Nielsen,et al.  Chapter 6 – Usability Testing , 1993 .

[68]  T. Clemmer,et al.  A computer-assisted management program for antibiotics and other antiinfective agents. , 1998, The New England journal of medicine.

[69]  F. Charatan,et al.  Compensation awarded for death after illegible prescription. , 2000, The Western journal of medicine.

[70]  J. Marc Overhage,et al.  Research Paper: Controlled Trial of Direct Physician Order Entry: Effects on Physicians' Time Utilization in Ambulatory Primary Care Internal Medicine Practices , 2001, J. Am. Medical Informatics Assoc..

[71]  J. McCulloch,et al.  CHAPTER 7 – Implications for Prevention , 1972 .

[72]  C. Bailey Medication Errors and Adverse Drug Events in Pediatric Inpatients , 2002 .

[73]  T R Einarson,et al.  Drug-Related Hospital Admissions , 1993, The Annals of pharmacotherapy.

[74]  D. Bates,et al.  Incidence and preventability of adverse drug events among older persons in the ambulatory setting. , 2003, JAMA.