STARE-HI – Statement on Reporting of Evaluation Studies in Health Informatics

BACKGROUND Improving the quality of reporting of evaluation studies in health informatics is an important requirement towards the vision of evidence-based health informatics. The STARE-HI - Statement on Reporting of Evaluation Studies in health informatics, published in 2009, provides guidelines on the elements to be contained in an evaluation study report. OBJECTIVES To elaborate on and provide a rationale for the principles of STARE-HI and to guide authors and readers of evaluation studies in health informatics by providing explanatory examples of reporting. METHODS A group of methodologists, researchers and editors prepared the present elaboration of the STARE-HI statement and selected examples from the literature. RESULTS The 35 STARE-HI items to be addressed in evaluation papers describing health informatics interventions are discussed one by one and each is extended with examples and elaborations. CONCLUSION The STARE-HI statement and this elaboration document should be helpful resources to improve reporting of both quantitative and qualitative evaluation studies. Evaluation manuscripts adhering to the principles will enable readers of such papers to better place the studies in a proper context and judge their validity and generalizability, and thus in turn optimize the exploitation of the evidence contained therein. LIMITATIONS This paper is based on experiences of a group of editors, reviewers, authors of systematic reviews and readers of the scientific literature. The applicability of the details of these principles has to evolve as a function of their use in practice.

[1]  Reinhold Haux,et al.  Medical informatics: Past, present, future , 2010, Int. J. Medical Informatics.

[2]  D. Moher,et al.  The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration , 2001, Annals of Internal Medicine.

[3]  Marcel L. Bouvy,et al.  SMS reminders improve adherence to oral medication in type 2 diabetes patients who are real time electronically monitored , 2012, Int. J. Medical Informatics.

[4]  Nicolette de Keizer,et al.  STARE-HI -Statement on Reporting of Evaluation Studies in Health Informatics , 2009, Yearbook of Medical Informatics.

[5]  Monique W. M. Jaspers,et al.  The significance of a usability evaluation of an emerging laboratory order entry system , 2007, Int. J. Medical Informatics.

[6]  Hans-Ulrich Prokosch,et al.  Visions and strategies to improve evaluation of health information systems: Reflections and lessons based on the HIS-EVAL workshop in Innsbruck , 2004, Int. J. Medical Informatics.

[7]  P. Fayers,et al.  The Visual Display of Quantitative Information , 1990 .

[8]  Y. Han,et al.  Unexpected Increased Mortality After Implementation of a Commercially Sold Computerized Physician Order Entry System , 2005, Pediatrics.

[9]  N. Black CONSORT , 1996, The Lancet.

[10]  D. Bates,et al.  Guided prescription of psychotropic medications for geriatric inpatients. , 2005, Archives of internal medicine.

[11]  Alfred Winter,et al.  Health information systems : architectures and strategies , 2011 .

[12]  Vimla L. Patel,et al.  Anticipating and addressing the unintended consequences of health IT and policy: a report from the AMIA 2009 Health Policy Meeting , 2011, J. Am. Medical Informatics Assoc..

[13]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[14]  Hugh Coolican,et al.  Introduction to Research Methods and Statistics in Psychology , 1995 .

[15]  Sven Ove Hansson,et al.  Values in pure and applied science , 2007 .

[16]  Elske Ammenwerth,et al.  The Quality of Reporting of Health Informatics Evaluation Studies: A Pilot Study , 2007, MedInfo.

[17]  Johanna I. Westbrook,et al.  Research Paper: The Effect of Physicians' Long-term Use of CPOE on Their Test Management Work Practices , 2006, J. Am. Medical Informatics Assoc..

[18]  Patrice Degoulet,et al.  Determinants of User Satisfaction with a Clinical Information System , 2006, AMIA.

[19]  Icmje,et al.  Uniform requirements for manuscripts submitted to biomedical journals: writing and editing for biomedical publication updated October 2004. , 2005, Mymensingh medical journal : MMJ.

[20]  Douglas G Altman,et al.  [The Strengthening the Reporting of Observational Studies in Epidemiology [STROBE] statement: guidelines for reporting observational studies]. , 2007, Gaceta sanitaria.

[21]  Ermenegyldo Munhoz Junior Requisitos uniformes para manuscritos submetidos a periódicos biomédicos: escrevendo e editando para publicações biomédicas , 2006 .

[22]  Charles E. Leonard,et al.  Unintended effects of a computerized physician order entry nearly hard-stop alert to prevent a drug interaction: a randomized controlled trial. , 2010, Archives of internal medicine.

[23]  Elizabeth M Borycki,et al.  Technology induced error and usability: The relationship between usability problems and prescription errors when using a handheld application , 2005, Int. J. Medical Informatics.

[24]  Eta S Berner,et al.  Improving ambulatory prescribing safety with a handheld decision support system: a randomized controlled trial. , 2006, Journal of the American Medical Informatics Association : JAMIA.

[25]  Mona Choi,et al.  Handbook of Evaluation Methods for Health Informatics , 2011, Healthcare Informatics Research.

[26]  Sigrun Espelien Aasen,et al.  MeSH - Medical Subject Headings , 2014 .

[27]  Eta S. Berner,et al.  Viewpoint Paper: Informatics Challenges for the Impending Patient Information Explosion , 2005, J. Am. Medical Informatics Assoc..

[28]  Jeremy C Wyatt,et al.  Teledermatologic consultation and reduction in referrals to dermatologists: a cluster randomized controlled trial. , 2009, Archives of dermatology.

[29]  A. Potts,et al.  Computerized physician order entry and medication errors in a pediatric critical care unit. , 2004, Pediatrics.

[30]  J Brender,et al.  On using references as evidence. , 2009, Methods of information in medicine.

[31]  A. Hasman,et al.  Effect of guideline based computerised decision support on decision making of multidisciplinary teams: cluster randomised trial in cardiac rehabilitation , 2009, BMJ : British Medical Journal.

[32]  Joseph Finkelstein,et al.  The use and interpretation of quasi-experimental studies in medical informatics. , 2006, Journal of the American Medical Informatics Association : JAMIA.

[33]  D. Bates,et al.  Outpatient prescribing errors and the impact of computerized prescribing , 2005, Journal of General Internal Medicine.

[34]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005, JAMA.

[35]  Charles P. Friedman,et al.  Evaluation Methods in Medical Informatics , 1997, Computers and Medicine.

[36]  [Uniform requirements for manuscripts submitted to biomedical journals: writing and editing for biomedical publication]. , 2004 .

[37]  D. Fraenkel,et al.  Quality benefits of an intensive care clinical information system , 2003, Critical care medicine.

[38]  D. Bates,et al.  Guided medication dosing for inpatients with renal insufficiency. , 2001, JAMA.

[39]  D. Moher,et al.  CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials , 2010, BMJ : British Medical Journal.

[40]  Jan H. van Bemmel,et al.  Involving the patient: A prospective study on use, appreciation and effectiveness of an information system in head and neck cancer care , 2005, Int. J. Medical Informatics.

[41]  Nicolette de Keizer,et al.  Guideline for good evaluation practice in health informatics (GEP-HI) , 2011, Int. J. Medical Informatics.

[42]  F B ROGERS,et al.  Medical Subject Headings , 1948, Nature.

[43]  Marion J. Ball,et al.  Evaluation Methods in Biomedical Informatics , 2006 .

[44]  Sharon E. Straus,et al.  Development of a prototype clinical decision support tool for osteoporosis disease management: a qualitative study of focus groups , 2010, BMC Medical Informatics Decis. Mak..

[45]  S. Pocock,et al.  Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration , 2007, PLoS medicine.

[46]  M Rigby,et al.  Evaluation – The Cinderella Science of ICT in Health , 2006, Yearbook of Medical Informatics.

[47]  Y. Han,et al.  Han YY, Carcillo JA, Venkataraman ST, Clark RS, Watson RS, Nguyen TC, Bayir H, Orr RA. Unexpected increased mortality after implementation of a commercially sold computerized physician order entry system. Pediatrics , 2011 .

[48]  CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials , 2011, BMJ : British Medical Journal.

[49]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .

[50]  Joan S. Ash,et al.  Organizational factors that influence information technology diffusion in academic health sciences centers. , 1997, Journal of the American Medical Informatics Association : JAMIA.