Research Paper: Effect of CPOE User Interface Design on User-Initiated Access to Educational and Patient Information during Clinical Care

OBJECTIVE Authors evaluated whether displaying context sensitive links to infrequently accessed educational materials and patient information via the user interface of an inpatient computerized care provider order entry (CPOE) system would affect access rates to the materials. DESIGN The CPOE of Vanderbilt University Hospital (VUH) included "baseline" clinical decision support advice for safety and quality. Authors augmented this with seven new primarily educational decision support features. A prospective, randomized, controlled trial compared clinicians' utilization rates for the new materials via two interfaces. Control subjects could access study-related decision support from a menu in the standard CPOE interface. Intervention subjects received active notification when study-related decision support was available through context sensitive, visibly highlighted, selectable hyperlinks. MEASUREMENTS Rates of opportunities to access and utilization of study-related decision support materials from April 1999 through March 2000 on seven VUH Internal Medicine wards. RESULTS During 4,466 intervention subject-days, there were 240,504 (53.9/subject-day) opportunities for study-related decision support, while during 3,397 control subject-days, there were 178,235 (52.5/subject-day) opportunities for such decision support, respectively (p = 0.11). Individual intervention subjects accessed the decision support features at least once on 3.8% of subject-days logged on (278 responses); controls accessed it at least once on 0.6% of subject-days (18 responses), with a response rate ratio adjusted for decision support frequency of 9.17 (95% confidence interval 4.6-18, p < 0.0005). On average, intervention subjects accessed study-related decision support materials once every 16 days individually and once every 1.26 days in aggregate. CONCLUSION Highlighting availability of context-sensitive educational materials and patient information through visible hyperlinks significantly increased utilization rates for study-related decision support when compared to "standard" VUH CPOE methods, although absolute response rates were low.

[1]  Edward H. Shortliffe,et al.  The adolescence of AI in medicine: will the field come of age in the '90s? , 1993, Artif. Intell. Medicine.

[2]  James D. Carpenter,et al.  Adding Insight: A Qualitative Cross-Site Study of Physician Order Entry , 2004, MedInfo.

[3]  K Dumbaugh,et al.  A successful experiment to reduce unnecessary laboratory use in a community hospital. , 1988, Medical care.

[4]  R M Gardner,et al.  Computerized detection of nosocomial infections in newborns. , 1994, Proceedings. Symposium on Computer Applications in Medical Care.

[5]  D. Bates,et al.  Effects of computerized physician order entry on prescribing practices. , 2000, Archives of internal medicine.

[6]  William W. Stead,et al.  Review Paper: Integration and Beyond: Linking Information from Disparate Sources and into Workflow , 2000, J. Am. Medical Informatics Assoc..

[7]  Paul N. Gorman,et al.  Computerized physician order entry in U.S. hospitals: results of a 2002 survey. , 2003, Journal of the American Medical Informatics Association : JAMIA.

[8]  M. Graffar.  [Modern epidemiology]. , 1971, Bruxelles medical.

[9]  C. McDonald.  Protocol-based computer reminders, the quality of care and the non-perfectability of man. , 1976, The New England journal of medicine.

[10]  D. Bates,et al.  Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. , 1998, JAMA.

[11]  R M Gardner,et al.  Improved perioperative antibiotic use and reduced surgical wound infections through use of computer decision analysis. , 1989, Infection control and hospital epidemiology.

[12]  D A Giuse,et al.  Increasing the availability of the computerized patient record. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[13]  Tom Fahey,et al.  Evaluation of computer based clinical decision support system and risk chart for management of hypertension in primary care: randomised controlled trial , 2000, BMJ : British Medical Journal.

[14]  V Florance,et al.  The Informationist: A New Health Profession? , 2000, Annals of Internal Medicine.

[15]  C. McDonald,et al.  A computerized reminder system to increase the use of preventive care for hospitalized patients. , 2001, The New England journal of medicine.

[16]  R. Haynes,et al.  Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. , 1998, JAMA.

[17]  J. Myers,et al.  The INTERNIST-1/QUICK MEDICAL REFERENCE project--status report. , 1986, The Western journal of medicine.

[18]  Patrik Eklund,et al.  Development and maintenance of guideline-based decision support for pharmacological treatment of hypertension , 2000, Comput. Methods Programs Biomed..

[19]  B. Buchanan,et al.  Physicians' information needs: analysis of questions posed during clinical teaching. , 1991, Annals of internal medicine.

[20]  G. Kuperman,et al.  Computer Physician Order Entry: Benefits, Costs, and Issues , 2003, Annals of Internal Medicine.

[21]  M. S. Klein,et al.  Effect of online literature searching on length of stay and patient care costs , 1994, Academic medicine : journal of the Association of American Medical Colleges.

[22]  H. Binns,et al.  Language Barriers and Resource Utilization in a Pediatric Emergency Department , 1998, Pediatrics.

[23]  Reed M. Gardner,et al.  The HELP hospital information system: update 1998 , 1999, Int. J. Medical Informatics.

[24]  Hagland Mm.  A greener image. Hospitals take on environmental challenges of the '90s. , 1993 .

[25]  J. P. Kichak,et al.  Computerized physician order entry: helpful or harmful? , 2003, Journal of the American Medical Informatics Association : JAMIA.

[26]  M G Kahn,et al.  An expert system for culture-based infection control surveillance. , 1993, Proceedings. Symposium on Computer Applications in Medical Care.

[27]  N. Dean,et al.  Implementation of admission decision support for community-acquired pneumonia. , 2000, Chest.

[28]  R A Miller,et al.  A new approach to the implementation of direct care-provider order entry. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[29]  J. Grimshaw,et al.  The design and analysis of a randomized controlled trial to evaluate computerized decision support in primary care: the COGENT study. , 2000, Family practice.

[30]  C J McDonald,et al.  Physician response to computer reminders. , 1980, JAMA.

[31]  T A Pryor,et al.  Application of a computerized medical decision-making process to the problem of digoxin intoxication. , 1984, Journal of the American College of Cardiology.

[32]  G J Kuperman,et al.  A randomized trial of a computer-based intervention to reduce utilization of redundant laboratory tests. , 1999, The American journal of medicine.

[33]  Peter J. Haug,et al.  An integrated decision support system for diagnosing and managing patients with community-acquired pneumonia , 1999, AMIA.

[34]  M Eccles,et al.  Experimental and quasi-experimental designs for evaluating guideline implementation strategies. , 2000, Family practice.

[35]  G F Cooper,et al.  CHARTLINE: providing bibliographic references relevant to patient charts using the UMLS Metathesaurus Knowledge Sources. , 1992, Proceedings. Symposium on Computer Applications in Medical Care.

[36]  Kevin B. Johnson,et al.  The Impact of Peer Management on Test-Ordering Behavior , 2004, Annals of Internal Medicine.

[37]  Alastair Baker,et al.  Crossing the Quality Chasm: A New Health System for the 21st Century , 2001, BMJ : British Medical Journal.

[38]  Patrice Degoulet,et al.  Clinical Information Systems: A Component-Based Approach , 2003 .

[39]  C J McDonald,et al.  Delayed Feedback of Physician Performance Versus Immediate Reminders to Perform Preventive Care: Effects on Physician Compliance , 1986, Medical care.

[40]  R. Rizza,et al.  Impact of a Diabetes Electronic Management System on the Care of Patients Seen in a Subspecialty Diabetes Clinic , 1998, Diabetes Care.

[41]  C J McDonald,et al.  Computer-stored medical records. Their future role in medical practice. , 1988, JAMA.

[42]  Frank Drews,et al.  Research Paper: The Employment of an Iterative Design Process to Develop a Pulmonary Graphical Display , 2003, J. Am. Medical Informatics Assoc..

[43]  P. Diggle.  Analysis of Longitudinal Data , 1995 .

[44]  H. Krumholz,et al.  Utilization and effectiveness of a weight-based heparin nomogram at a large academic medical center. , 2000, The American journal of managed care.

[45]  Donald E Moore,et al.  Practice-based learning and improvement. , 2003, The Journal of continuing education in the health professions.

[46]  H H Hawkins,et al.  A computerized physician order entry system for the promotion of ordering compliance and appropriate test utilization. , 1999, Journal of healthcare information management : JHIM.

[47]  B. Buchanan,et al.  Expanding the concept of medical information: an observational study of physicians' information needs. , 1992, Computers and biomedical research, an international journal.

[48]  J Studnicki,et al.  A feedback system for reducing excessive laboratory tests. , 1993, Archives of pathology & laboratory medicine.

[49]  M. Ebell,et al.  Analysis of questions asked by family doctors regarding patient care , 1999, BMJ.

[50]  R A Bankowitz,et al.  Physicians' use of computer software in answering clinical questions. , 1993, Bulletin of the Medical Library Association.

[51]  H. Binns,et al.  The effect of price information on test-ordering behavior and patient outcomes in a pediatric emergency department. , 1999, Pediatrics.

[52]  M M Hagland.  Physicians using computers show lower resource utilization. , 1993, Hospitals.

[53]  P Mongerson,et al.  A patient's perspective of medical informatics. , 1995, Journal of the American Medical Informatics Association : JAMIA.

[54]  R A Greenes,et al.  Knowledge management as a decision support method: a diagnostic workup strategy application. , 1989, Computers and biomedical research, an international journal.

[55]  G O Barnett,et al.  “Just‐in‐time” clinical information , 1997, Academic medicine : journal of the Association of American Medical Colleges.

[56]  R. Raschke,et al.  A computer alert system to prevent injury from adverse drug events: development and evaluation in a community teaching hospital. , 1998, JAMA.

[57]  J. Marc Overhage,et al.  Case Report: Computerizing Guidelines to Improve Care and Patient Outcomes: The Example of Heart Failure , 1995, J. Am. Medical Informatics Assoc..

[58]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[59]  Nancy Staggers,et al.  Research Paper: Comparing Response Time, Errors, and Satisfaction Between Text-based and Graphical User Interfaces During Nursing Order Tasks , 2000, J. Am. Medical Informatics Assoc..

[60]  Gilad J. Kuperman,et al.  Synthesis of Research Paper: A Consensus Statement on Considerations for a Successful CPOE Implementation , 2003, J. Am. Medical Informatics Assoc..

[61]  William DuMouchel,et al.  A meta-analysis of 16 randomized controlled trials to evaluate computer-based clinical reminder systems for preventive care in the ambulatory setting. , 1996, Journal of the American Medical Informatics Association : JAMIA.

[62]  J W Williamson,et al.  Health science information management and continuing education of physicians. A survey of U.S. primary care practitioners and their opinion leaders. , 1989, Annals of internal medicine.

[63]  A D Oxman,et al.  Changing physician performance. A systematic review of the effect of continuing medical education strategies. , 1995, JAMA.

[64]  J. Wyatt,et al.  INFORMATION FOR CLINICIANS Use and sources of medical knowledge , 1991, The Lancet.

[65]  W. Hammond,et al.  Computerized decision support based on a clinical practice guideline improves compliance with care standards. , 1997, The American journal of medicine.

[66]  C. McDonald,et al.  Reminders to physicians from an introspective computer medical record. A two-year randomized trial. , 1984, Annals of internal medicine.

[67]  W M Tierney,et al.  Application of Information Technology: Pilot Study of a Point-of-use Decision Support Tool for Cancer Clinical Trials Eligibility , 1999, J. Am. Medical Informatics Assoc..

[68]  G. Octo Barnett,et al.  Overcoming Information Overload: an Information System for the Primary Care Physician , 2004, MedInfo.

[69]  M. J. Long,et al.  The Effects of Price Information on Physicians' Test-Ordering Behavior: Ordering of Diagnostic Tests , 1982, Medical care.

[70]  R. Haynes,et al.  Effects of Computer-based Clinical Decision Support Systems on Clinician Performance and Patient Outcome: A Critical Appraisal of Research , 1994, Annals of Internal Medicine.

[71]  Hagland Mm.  Physicians using computers show lower resource utilization. , 1993 .

[72]  H. E. Pople,et al.  Internist-1, an experimental computer-based diagnostic consultant for general internal medicine. , 1982, The New England journal of medicine.

[73]  G. Hripcsak,et al.  IAIMS architecture. , 1997, Journal of the American Medical Informatics Association : JAMIA.

[74]  William M. Tierney,et al.  Improving clinical decisions and outcomes with information: a review , 2001, Int. J. Medical Informatics.

[75]  Richard N. Shiffman,et al.  Model Formulation: GEM: A Proposal for a More Comprehensive Guideline Document Model Using XML , 2000, J. Am. Medical Informatics Assoc..

[76]  J. Wyatt,et al.  Use and sources of medical knowledge. , 1991, Lancet.

[77]  H. E. Pople,et al.  Internist-I, an Experimental Computer-Based Diagnostic Consultant for General Internal Medicine , 1982 .

[78]  M. Chambliss,et al.  Answering clinical questions. , 1996, The Journal of family practice.

[79]  C J McDonald,et al.  The effect on test ordering of informing physicians of the charges for outpatient diagnostic tests. , 1990, The New England journal of medicine.

[80]  C J McDonald,et al.  Computer predictions of abnormal test results. Effects on outpatient testing. , 1988, JAMA.

[81]  R M Gardner,et al.  Computer surveillance of hospital-acquired infections and antibiotic use. , 1986, JAMA.

[82]  W M Tierney,et al.  Effectiveness of Computer-Generated Reminders for Increasing Discussions about Advance Directives and Completion of Advance Directive Forms , 1998, Annals of Internal Medicine.

[83]  M. Green,et al.  Residents' medical information needs in clinic: are they being met? , 2000, The American journal of medicine.

[84]  Paul E. Mazmanian,et al.  Continuing Medical Education: A New Vision of the Professional Development of Physicians , 2000, Academic medicine : journal of the Association of American Medical Colleges.

[85]  William W. Stead,et al.  VUMC Clinical Information System , 2003 .

[86]  R A Miller,et al.  Why the standard view is standard: people, not machines, understand patients' problems. , 1990, The Journal of medicine and philosophy.

[87]  N. Davis,et al.  A new metric for continuing medical education credit. , 2004, The Journal of continuing education in the health professions.

[88]  C. McDonald,et al.  Computerized display of past test results. Effect on outpatient testing. , 1987, Annals of internal medicine.

[89]  Gina Pugliese,et al.  Reducing Vancomycin Use Utilizing a Computer Guideline , 1999, Infection Control &#x0026; Hospital Epidemiology.

[90]  W. Kapoor,et al.  A computer-assisted medical diagnostic consultation service. Implementation and prospective evaluation of a prototype. , 1989, Annals of internal medicine.

[91]  Thomas H. Payne,et al.  A cross-site qualitative study of physician order entry. , 2003, Journal of the American Medical Informatics Association : JAMIA.

[92]  D. Covell,et al.  Information needs in office practice: are they being met? , 1985, Annals of internal medicine.

[93]  R M Gardner,et al.  Development of a computerized adverse drug event monitor. , 1991, Proceedings. Symposium on Computer Applications in Medical Care.

[94]  M. Ebell,et al.  Obstacles to answering doctors' questions about patient care with evidence: qualitative study , 2002, BMJ : British Medical Journal.

[95]  P. Gorman,et al.  Can primary care physicians' questions be answered using the medical journal literature? , 1994, Bulletin of the Medical Library Association.

[96]  D W Bates,et al.  A computer based intervention to reduce unnecessary serologic testing. , 1999, The Journal of rheumatology.

[97]  Joan S. Ash,et al.  Principles for a Successful Computerized Physician Order Entry Implementation , 2003, AMIA.

[98]  G O Barnett,et al.  The sensitivity of medical diagnostic decision-support knowledge bases in delineating appropriate terms to document in the medical record. , 1991, Proceedings. Symposium on Computer Applications in Medical Care.

[99]  R A Miller,et al.  INTERNIST-1/CADUCEUS: Problems Facing Expert Consultant Programs , 1984, Methods of Information in Medicine.

[100]  R. Gardner,et al.  Computer-critiqued blood ordering using the HELP system. , 1990, Computers and biomedical research, an international journal.

[101]  E A Balas,et al.  Improving preventive care by prompting physicians. , 2000, Archives of internal medicine.

[102]  S Trent Rosenbloom,et al.  Providing Evidence-Based Answers to Complex Clinical Questions: Evaluating the Consistency of Article Selection , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[103]  S. Cretin,et al.  Implementation of clinical guidelines using a computer charting system. Effect on the initial care of health care workers exposed to body fluids. , 1997, JAMA.

[104]  Dario A. Giuse,et al.  Research Paper: Information Needs of Health Care Professionals in an Aids Outpatient Clinic as Determined by Chart Review , 1994, J. Am. Medical Informatics Assoc..

[105]  H R Warner,et al.  Computerized practice guidelines for heart failure management: the HeartMan system. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[106]  E. DeLong,et al.  Effect of daily charge feedback on inpatient charges and physician knowledge and behavior. , 1989, Archives of internal medicine.

[107]  J. Griffith,et al.  Use of the Electrocardiograph-Based Thrombolytic Predictive Instrument To Assist Thrombolytic and Reperfusion Therapy for Acute Myocardial Infarction: A Multicenter, Randomized, Controlled, Clinical Effectiveness Trial , 2002, Annals of Internal Medicine.

[108]  Blackford Middleton,et al.  Does national regulatory mandate of provider order entry portend greater benefit than risk for health care delivery? The 2001 ACMI debate. The American College of Medical Informatics. , 2002, Journal of the American Medical Informatics Association : JAMIA.

[109]  C. McDonald,et al.  The Promise of Computerized Feedback Systems for Diabetes Care , 1996, Annals of Internal Medicine.

[110]  A. Potts,et al.  Computerized physician order entry and medication errors in a pediatric critical care unit. , 2004, Pediatrics.

[111]  D. Bates,et al.  Improving response to critical laboratory results with automation: results of a randomized controlled trial. , 1999, Journal of the American Medical Informatics Association : JAMIA.

[112]  M F Collen,et al.  Computer-stored medical record. , 1968, Computers and biomedical research, an international journal.

[113]  Randolph A. Miller,et al.  The effects on clinician ordering patterns of a computerized decision support system for neuroradiology imaging studies , 2001, AMIA.

[114]  H. Chandler.  Database , 1985 .

[115]  J J Cimino,et al.  The MEDLINE Button. , 1992, Proceedings. Symposium on Computer Applications in Medical Care.