Evidence Based Health Informatics: 10 Years of Efforts to Promote the Principle

OBJECTIVES To present the importance of Evidence-based Health Informatics (EBHI) and the ethical imperative of this approach; to highlight the work of the IMIA Working Group on Technology Assessment and Quality Improvement and the EFMI Working Group on Assessment of Health Information Systems; and to introduce the further important evaluation and evidence aspects being addressed. METHODS Reviews of IMIA, EFMA and other initiatives, together with literature reviews on evaluation methods and on published systematic reviews. RESULTS Presentation of the rationale for the health informatics domain to adopt a scientific approach by assessing impact, avoiding harm, and empirically demonstrating benefit and best use; reporting of the origins and rationale of the IMIA- and EQUATOR-endorsed Statement on Reporting of Evaluation Studies in Health Informatics (STARE-HI) and of the IMIA WG's Guideline for Good Evaluation Practice in Health Informatics (GEP-HI); presentation of other initiatives for objective evaluation; and outlining of further work in hand on usability and indicators; together with the case for development of relevant evaluation methods in newer applications such as telemedicine. The focus is on scientific evaluation as a reliable source of evidence, and on structured presentation of results to enable easy retrieval of evidence. CONCLUSIONS EBHI is feasible, necessary for efficiency and safety, and ethically essential. Given the significant impact of health informatics on health systems, care delivery and personal health, it is vital that cultures change to insist on evidence-based policies and investment, and that emergent global moves for this are supported.

[1]  K Walshe,et al.  Evidence-based management: from theory to practice in health care. , 2001, The Milbank quarterly.

[2]  René von Schomberg,et al.  Implementing the Precautionary Principle: Perspectives and Prospects , 2006 .

[3]  J. Marc Overhage,et al.  AMIA Board White Paper: Core Content for the Subspecialty of Clinical Informatics , 2009, J. Am. Medical Informatics Assoc..

[4]  Edward H. Shortliffe,et al.  Evaluation Methods in Biomedical Informatics , 2000 .

[5]  Christian Nøhr,et al.  Nordic eHealth Indicators: Organisation of Research, First Results and Plan for the Future , 2013, MedInfo.

[6]  Douglas G. Altman,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials , 2001, The Lancet.

[7]  Elske Ammenwerth,et al.  Seeking Evidence to Support Usability Principles for Medication-Related Clinical Decision Support (CDS) Functions , 2013, MedInfo.

[8]  M Rigby,et al.  Evaluation – The Cinderella Science of ICT in Health , 2006, Yearbook of Medical Informatics.

[9]  N. Shaw,et al.  Bad Health Informatics Can Kill – Is Evaluation the Answer? , 2005, Methods of Information in Medicine.

[10]  Elske Ammenwerth,et al.  The Quality of Reporting of Health Informatics Evaluation Studies: A Pilot Study , 2007, MedInfo.

[11]  Elske Ammenwerth,et al.  Vision and challenges of Evidence-Based Health Informatics: A case study of a CPOE meta-analysis , 2010, Int. J. Medical Informatics.

[12]  Elske Ammenwerth,et al.  Evidence based health informatics. , 2010, Studies in health technology and informatics.

[13]  Nicolette de Keizer,et al.  Next Steps in Evaluation and Evidence - from Generic to Context-Related , 2011, MIE.

[14]  Nicolette de Keizer,et al.  UvA-DARE ( Digital Academic Repository ) An inventory of evaluation studies of information technology in health care trends in evaluation research 1982-2002 , 2005 .

[15]  Nancy M. Lorenzi,et al.  People and Organizational Aspects of Medical Informatics , 1998, MedInfo.

[16]  David Moher,et al.  Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Standards for Reporting of Diagnostic Accuracy. , 2003, Clinical chemistry.

[17]  S Pelayo,et al.  Evolution of Human Factors Research and Studies of Health Information Technologies: The Role of Patient Safety , 2013, Yearbook of Medical Informatics.

[18]  J Brender,et al.  Health Informatics 3.0 and other Increasingly Dispersed Technologies Require Even Greater Trust: Promoting Safe Evidence-based Health Informatics , 2011, Yearbook of Medical Informatics.

[19]  David Tuck,et al.  White Paper: Training the Next Generation of Informaticians: The Impact of "BISTI" and Bioinformatics - A Report from the American College of Medical Informatics , 2004, J. Am. Medical Informatics Assoc..

[20]  Johanna Kaipio,et al.  Evaluation of the national nursing model and four nursing documentation systems in Finland - Lessons learned and directions for the future , 2012, Int. J. Medical Informatics.

[21]  Shariq Khoja,et al.  Conceptual framework for development of comprehensive e-health evaluation tool. , 2013, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[22]  J Brender,et al.  Systematic Prioritization of the STARE-HI Reporting Items , 2011, Methods of Information in Medicine.

[23]  Ray Pawson,et al.  Evidence-based policy: a realist perspective. , 2006 .

[24]  M. Lawrence,et al.  Indicators of Quality in Health Care , 1997 .

[25]  T. Beauchamp,et al.  Principles of biomedical ethics , 1991 .

[26]  Nicolette de Keizer,et al.  Exploring a methodology for eHealth indicator development , 2012, MIE.

[27]  André Kushniruk,et al.  Where do Technology-Induced Errors Come From? Towards a Model for Conceptualizing and Diagnosing Errors Caused by Technology , 2008 .

[28]  Christian Nøhr,et al.  A comparative review of patient safety initiatives for national health information technology , 2013, Int. J. Medical Informatics.

[29]  I. Olkin,et al.  Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement , 1999, The Lancet.

[30]  Jytte Brender Handbook of evaluation methods for health informatics , 2005 .

[31]  Nicolette de Keizer,et al.  STARE-HI -Statement on Reporting of Evaluation Studies in Health Informatics , 2009, Yearbook of Medical Informatics.

[32]  Michael Rigby,et al.  Evaluation: 16 Powerful Reasons Why Not to Do It - And 6 Over-Riding Imperatives , 2001, MedInfo.

[33]  Elizabeth M Borycki,et al.  Technology induced error and usability: The relationship between usability problems and prescription errors when using a handheld application , 2005, Int. J. Medical Informatics.

[34]  Anastasia Papazafeiropoulou,et al.  An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit) , 2008, Int. J. Medical Informatics.

[35]  Nicolette de Keizer,et al.  The effect of electronic medical record-based clinical decision support on HIV care in resource-constrained settings: A systematic review , 2012, Int. J. Medical Informatics.

[36]  Andre Kushniruk,et al.  Identifying and preventing technology-induced error using simulations: application of usability engineering techniques. , 2005, Healthcare quarterly.

[37]  Nancy M. Lorenzi,et al.  Review: Antecedents of the People and Organizational Aspects of Medical Informatics: Review of the Literature , 1997, J. Am. Medical Informatics Assoc..

[38]  Jeremy Wyatt Assessing and improving evidence based health informatics research. , 2010, Studies in health technology and informatics.

[39]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[40]  Alireza Ahmadvand CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions , 2011 .

[41]  J. D. Patrick The Validity of Personal Experiences in Evaluating HIT. , 2010, Applied clinical informatics.

[42]  Hans-Ulrich Prokosch,et al.  Visions and strategies to improve evaluation of health information systems: Reflections and lessons based on the HIS-EVAL workshop in Innsbruck , 2004, Int. J. Medical Informatics.

[43]  M Berg,et al.  Medical Work and the ComputerBased Patient Record: A Sociological Perspective , 1998, Methods of Information in Medicine.

[44]  Marc Berg,et al.  Case Report: Understanding Implementation: The Case of a Computerized Physician Order Entry System in a Large Dutch University Medical Center , 2004, J. Am. Medical Informatics Assoc..

[45]  Peter Elkin,et al.  The Human Factors Engineering Approach to Biomedical Informatics Projects: State of the Art, Results, Benefits and Challenges , 2007, Yearbook of Medical Informatics.

[46]  D. Sackett,et al.  Evidence based medicine: what it is and what it isn't , 1996, BMJ.

[47]  A. Hewison Evidence-Based Policy , 2008, Policy, politics & nursing practice.

[48]  Roland Bal,et al.  Reporting Qualitative Research in Health Informatics: REQ-HI Recommendations , 2011, MIE.

[49]  Elske Ammenwerth,et al.  Mini Stare-HI: Guidelines for reporting health informatics evaluations in conference papers , 2010, MedInfo.

[50]  James S Briggs,et al.  STAT-HI: A Socio-Technical Assessment Tool for Health Informatics Implementations , 2010, The open medical informatics journal.

[51]  Monique W. M. Jaspers,et al.  Usability Studies on Interactive Health Information Systems; Where Do We Stand? , 2008, MIE.

[52]  Nicolette de Keizer,et al.  Guideline for good evaluation practice in health informatics (GEP-HI) , 2011, Int. J. Medical Informatics.

[53]  E Ammenwerth Health technology assessment. Findings from the Section on Assessing Information Technologies for Health. , 2006, Yearbook of medical informatics.

[54]  Georgy Kopanitsa,et al.  Analysis of Metrics for the Usability Evaluation of Electronic Health Record Systems , 2012, EFMI-STC.

[55]  E. Goorman,et al.  Modelling nursing activities: electronic patient records and their discontents. , 2000, Nursing inquiry.

[56]  D J Hunter,et al.  Evidence based policymaking , 1995, BMJ.

[57]  R B Haynes,et al.  Evidence based health informatics: an overview of the Health Information Research Unit at McMaster University. , 1996, Leadership in health services = Leadership dans les services de sante.

[58]  J. Gray,et al.  Evidence-Based Healthcare: How to Make Health Policy and Management Decisions , 2001 .

[59]  James D. Carpenter,et al.  Categorizing the unintended sociotechnical consequences of computerized provider order entry , 2007, Int. J. Medical Informatics.

[60]  Michael Rigby,et al.  Evidence for building a smarter health and wellness future - Key messages and collected visions from a Joint OECD and NSF workshop , 2013, Int. J. Medical Informatics.