A review on systematic reviews of health information system studies

The purpose of this review is to consolidate existing evidence from published systematic reviews on health information system (HIS) evaluation studies to inform HIS practice and research. Fifty reviews published during 1994-2008 were selected for meta-level synthesis. These reviews covered five areas: medication management, preventive care, health conditions, data quality, and care process/outcome. After reconciliation for duplicates, 1276 HIS studies were arrived at as the non-overlapping corpus. On the basis of a subset of 287 controlled HIS studies, there is some evidence for improved quality of care, but in varying degrees across topic areas. For instance, 31/43 (72%) controlled HIS studies had positive results using preventive care reminders, mostly through guideline adherence such as immunization and health screening. Key factors that influence HIS success included having in-house systems, developers as users, integrated decision support and benchmark practices, and addressing such contextual issues as provider knowledge and perception, incentives, and legislation/policy.

[1]  Nicolette de Keizer,et al.  The impact of computerized physician medication order entry in hospitalized patients - A systematic review , 2008, Int. J. Medical Informatics.

[2]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005 .

[3]  F. Oski,et al.  Impact of a system of computer-assisted diagnosis. Initial evaluation of the hospitalized patient. , 1975, American journal of diseases of children.

[4]  T Timpka,et al.  Design Participation as an Insurance: Risk-management and End-user Participation in the Development of Information Systems in Healthcare Organizations , 2002, Methods of Information in Medicine.

[5]  Christine Urquhart,et al.  Nursing record systems: effects on nursing practice and healthcare outcomes. , 2009, The Cochrane database of systematic reviews.

[6]  JUDITH W. DEXHEIMER,et al.  Review Paper: Prompting Clinicians about Preventive Care Measures: A Systematic Review of Randomized Controlled Trials , 2008, J. Am. Medical Informatics Assoc..

[7]  Sarah Muttitt,et al.  A proposed benefits evaluation framework for health information systems in Canada. , 2007, Healthcare quarterly.

[8]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[9]  Arie Hasman,et al.  Review Paper: Determinants of Success of Inpatient Clinical Information Systems: A Literature Review , 2003, J. Am. Medical Informatics Assoc..

[10]  S. Boren,et al.  The use and effectiveness of electronic clinical decision support tools in the ambulatory/primary care setting: a systematic review of the literature. , 2008, Informatics in primary care.

[11]  E. Keeler,et al.  Costs and benefits of health information technology. , 2006, Evidence report/technology assessment.

[12]  R M Gardner,et al.  Factors impacting the success of computerized preadmission screening. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[13]  Joyce A. Mitchell,et al.  The clinical value of computerized information services. A review of 98 randomized clinical trials. , 1996, Archives of family medicine.

[14]  James C. Thomas,et al.  The effect on cost of medical care for patients treated with an automated clinical audit system , 1983, Journal of Medical Systems.

[15]  R. Haynes,et al.  Effects of Computer-based Clinical Decision Support Systems on Clinician Performance and Patient Outcome: A Critical Appraisal of Research , 1994, Annals of Internal Medicine.

[16]  Silvia Miksch,et al.  Development and evaluation of VIE-PNN, a knowledge-based system for calculating the parenteral nutrition of newborn infants , 2002, Artif. Intell. Medicine.

[17]  Janet M. Corrigan,et al.  Key Capabilities of an Electronic Health Record System: Letter Report , 2004 .

[18]  Frank Sullivan,et al.  Has general practitioner computing made a difference to patient care? A systematic review of published reports , 1995, BMJ.

[19]  James D. Carpenter,et al.  Categorizing the unintended sociotechnical consequences of computerized provider order entry , 2007, Int. J. Medical Informatics.

[20]  Michael M. Wagner,et al.  Review: Accuracy of Data in Computer-based Patient Records , 1997, J. Am. Medical Informatics Assoc..

[21]  Patrice Degoulet,et al.  An overview of the effect of computer-assisted management of anticoagulant therapy on the quality of anticoagulation , 1998, Int. J. Medical Informatics.

[22]  Patrice Degoulet,et al.  Decision aids for triage of patients with chest pain: a systematic review of field evaluation studies. , 1999, Proceedings. AMIA Symposium.

[23]  Dominik Aronsky,et al.  Review Paper: Biomedical Informatics Applications for Asthma Care: A Systematic Review , 2006, J. Am. Medical Informatics Assoc..

[24]  Mack T Ruffin,et al.  Information Technology and Cancer Prevention , 2006, CA: a cancer journal for clinicians.

[25]  M. Jaana,et al.  Prioritizing the Risk Factors Influencing the Success of Clinical Information System Projects , 2008, Methods of Information in Medicine.

[26]  L. Trinquart,et al.  Computerized advice on drug dosage to improve prescribing practice. , 2008, The Cochrane database of systematic reviews.

[27]  Fitzmaurice,et al.  Review of computerized decision support systems for oral anticoagulation management , 1998, British journal of haematology.

[28]  Wei Wu,et al.  The Effect of Computerized Physician Order Entry with Clinical Decision Support on the Rates of Adverse Drug Events: A Systematic Review , 2008, Journal of General Internal Medicine.

[29]  J. Knottnerus,et al.  Influencing diagnostic and preventive performance in ambulatory care by feedback and reminders. A review. , 1993, Family practice.

[30]  G. Guyatt,et al.  Users' guides to the medical literature. , 1993, JAMA.

[31]  J P Ornato,et al.  Use of the Acute Cardiac Ischemia Time-Insensitive Predictive Instrument (ACI-TIPI) To Assist with Triage of Patients with Chest Pain or Other Symptoms Suggestive of Acute Cardiac Ischemia: A Multicenter, Controlled Clinical Trial , 1998, Annals of Internal Medicine.

[32]  Marc Berg,et al.  Review Paper: Overriding of Drug Safety Alerts in Computerized Physician Order Entry , 2006, J. Am. Medical Informatics Assoc..

[33]  Nick Freemantle,et al.  Computer support for determining drug dose: systematic review and meta-analysis , 1999, BMJ.

[34]  Susan M. Gorden,et al.  Research Paper: Measuring the Effects of Reminders for Outpatient Influenza Immunizations at the Point of Clinical Opportunity , 1999, J. Am. Medical Informatics Assoc..

[35]  Rebecca Randell,et al.  Effects of computerized decision support systems on nursing performance and patient outcomes: a systematic review , 2007, Journal of health services research & policy.

[36]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[37]  V. Sintchenko,et al.  Are we measuring the right end-points? Variables that affect the impact of computerised decision support on patient outcomes: A systematic review , 2007, Medical informatics and the Internet in medicine.

[38]  D G Altman,et al.  Systematic reviews of clinical decision tools for acute abdominal pain. , 2006, Health technology assessment.

[39]  M Greaves,et al.  Screening for thrombophilia in high-risk situations: systematic review and cost-effectiveness analysis. The Thrombosis: Risk and Economic Assessment of Thrombophilia Screening (TREATS) study. , 2006, Health technology assessment.

[40]  George Hripcsak,et al.  Review Paper: Detecting Adverse Events Using Information Technology , 2003, J. Am. Medical Informatics Assoc..

[41]  E. Balas,et al.  Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success , 2005, BMJ : British Medical Journal.

[42]  C. Anandan,et al.  The impact of eHealth on the quality & safety of healthcare: a systematic overview & synthesis of the literature , 2008 .

[43]  Robyn Tamblyn,et al.  Review Paper: The Impact of Electronic Health Records on Time Efficiency of Physicians and Nurses: A Systematic Review , 2005, J. Am. Medical Informatics Assoc..

[44]  Margaret Williamson,et al.  The impact of computerised physician order entry systems on pathology services: A systematic review , 2007, Int. J. Medical Informatics.

[45]  ELSKE AMMENWERTH,et al.  Review Paper: The Effect of Electronic Prescribing on Medication Errors and Adverse Drug Events: A Systematic Review , 2008, J. Am. Medical Informatics Assoc..

[46]  Paul C. Tang,et al.  Research Paper: Measuring the Effects of Reminders for Outpatient Influenza Immunizations at the Point of Clinical Opportunity , 1999, J. Am. Medical Informatics Assoc..

[47]  E. Balas,et al.  Computerized Knowledge Management in Diabetes Care , 2004, Medical care.

[48]  Patrice Degoulet,et al.  Determinants of Success for Computerized Clinical Decision Support Systems Integrated into CPOE Systems: a Systematic Review , 2006, AMIA.

[49]  Jonathan M. Teich,et al.  The impact of computerized physician order entry on medication error prevention. , 1999, Journal of the American Medical Informatics Association : JAMIA.

[50]  R. Haynes,et al.  Effects of Computer-Based Clinical Decision Support Systems on Physician Performance and Patient Outcomes , 1998 .

[51]  C. Jackson,et al.  A systematic review of interactive computer-assisted technology in diabetes care: interactive information technology in diabetes care , 2006 .

[52]  Shari Bolen,et al.  A systematic review of interactive computer-assisted technology in diabetes care , 2006, Journal of General Internal Medicine.

[53]  Nicolette de Keizer,et al.  Review Paper: Evaluation of Outpatient Computerized Physician Medication Order Entry Systems: A Systematic Review , 2007, J. Am. Medical Informatics Assoc..

[54]  T. Fahey,et al.  A systematic review of the use of computers in the management of hypertension. , 1998, Journal of epidemiology and community health.

[55]  ETA S. BERNER,et al.  Review Paper: Will the Wave Finally Break? A Brief View of the Adoption of Electronic Medical Records in the United States , 2004, J. Am. Medical Informatics Assoc..

[56]  D. Bates,et al.  Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. , 2003, Archives of internal medicine.

[57]  C. Schoen,et al.  On the front lines of care: primary care doctors' office systems, experiences, and views in seven countries. , 2006, Health affairs.

[58]  Y. Han,et al.  Unexpected Increased Mortality After Implementation of a Commercially Sold Computerized Physician Order Entry System , 2005, Pediatrics.

[59]  G. Guyatt,et al.  Users ' Guides to the Medical Literature : III . How to Use an Article About a Diagnostic Test : A . Are the Results of the Study Valid ? , 2022 .

[60]  F. Sullivan,et al.  A descriptive feast but an evaluative famine: systematic review of published articles on primary care computing during 1980-97 , 2001, BMJ : British Medical Journal.

[61]  K. Tan,et al.  Clinical decision support systems for neonatal care. , 2005, The Cochrane database of systematic reviews.

[62]  J. Rothschild.  Computerized physician order entry in the critical care and general inpatient setting: a narrative review. , 2004, Journal of critical care.

[63]  Bryony Dean Franklin,et al.  Clinical decision support systems and antibiotic use , 2007, Pharmacy World & Science.

[64]  Kensaku Kawamoto,et al.  Clinical Decision Support Provided within Physician Order Entry Systems: A Systematic Review of Features Effective for Changing Clinician Behavior , 2003, AMIA.

[65]  E. Oren,et al.  Impact of emerging technologies on medication errors and adverse drug events. , 2003, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[66]  R. Haynes,et al.  Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. , 1998, JAMA.

[67]  Matthew A. Eisenberg,et al.  Computerized Provider Order Entry Implementation: No Association With Increased Mortality Rates in an Intensive Care Unit , 2006, Pediatrics.

[68]  Vimla L. Patel,et al.  Cognitive and usability engineering methods for the evaluation of clinical information systems , 2004, J. Biomed. Informatics.

[69]  John F Hurdle,et al.  High rates of adverse drug events in a highly computerized hospital. , 2005, Archives of internal medicine.

[70]  Richard N. Shiffman,et al.  Review: Computer-based Guideline Implementation Systems: A Systematic Review of Functionality and Effectiveness , 1999, J. Am. Medical Informatics Assoc..

[71]  A. Jerant,et al.  Does the use of electronic medical records improve surrogate patient outcomes in outpatient settings? , 2000, Journal of Family Practice.

[72]  Gordon H. Guyatt,et al.  Users' Guides to the Medical Literature: III. How to Use an Article About a Diagnostic Test A. Are the Results of the Study Valid? , 1994 .

[73]  Nicolette de Keizer,et al.  UvA-DARE ( Digital Academic Repository ) An inventory of evaluation studies of information technology in health care trends in evaluation research 1982-2002 , 2005 .

[74]  J. Corrigan,et al.  COMMITTEE ON DATA STANDARDS FOR PATIENT SAFETY , 2004 .

[75]  Peter Croft,et al.  Quality of morbidity coding in general practice computerized medical records: a systematic review. , 2004, Family practice.

[76]  K. Thiru,et al.  Systematic review of scope and quality of electronic patient record data in primary care , 2003, BMJ : British Medical Journal.

[77]  P. Glasziou,et al.  Computerised reminders and feedback in medication management: a systematic review of randomised controlled trials , 2003, The Medical journal of Australia.

[78]  Philipp Dahm,et al.  Evidence-Based Surgery Chirurgie factuelle Users ’ guides to the surgical literature : how to use an article about a diagnostic test , 2001 .

[79]  P. Shekelle,et al.  Systematic Review: Impact of Health Information Technology on Quality, Efficiency, and Costs of Medical Care , 2006, Annals of Internal Medicine.

[80]  Amy N. Cohen,et al.  Review paper: Informatics Systems to Promote Improved Care for Chronic Illness: A Literature Review , 2007, J. Am. Medical Informatics Assoc..

[81]  T J O'Leary,et al.  Evaluation of a computer‐assisted method for individualized anticoagulation: Retrospective and prospective studies with a pharmacodynamic model , 1982, Clinical pharmacology and therapeutics.

[82]  Peter W. Moorman,et al.  Effects of electronic communication in general practice , 2000, Int. J. Medical Informatics.

[83]  C. Delpierre,et al.  A systematic review of computer-based patient record systems and quality of care: more randomized clinical trials or a broader approach? , 2004, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[84]  L. Howard,et al.  Administrative registers in psychiatric research: a systematic review of validity studies , 2005, Acta psychiatrica Scandinavica.

[85]  William DuMouchel,et al.  A meta-analysis of 16 randomized controlled trials to evaluate computer-based clinical reminder systems for preventive care in the ambulatory setting. , 1996, Journal of the American Medical Informatics Association : JAMIA.

[86]  Subashan Perera,et al.  Research Paper: A Systematic Review of the Performance Characteristics of Clinical Event Monitor Signals Used to Detect Adverse Drug Events in the Hospital Setting , 2007, J. Am. Medical Informatics Assoc..

[87]  Joyce A. Mitchell,et al.  Effect of physician reminders on preventive care: meta-analysis of randomized clinical trials. , 1994, Proceedings. Symposium on Computer Applications in Medical Care.