Human Factors in the Large: Experiences from Denmark, Finland and Canada in Moving Towards Regional and National Evaluations of Health Information System Usability

OBJECTIVES The objective of this paper is to explore approaches to understanding the usability of health information systems at regional and national levels. METHODS Several different methods are discussed in case studies from Denmark, Finland and Canada. They range from small scale qualitative studies involving usability testing of systems to larger scale national level questionnaire studies aimed at assessing the use and usability of health information systems by entire groups of health professionals. RESULTS It was found that regional and national usability studies can complement smaller scale usability studies, and that they are needed in order to understand larger trends regarding system usability. Despite adoption of EHRs, many health professionals rate the usability of the systems as low. A range of usability issues have been noted when data is collected on a large scale through use of widely distributed questionnaires and websites designed to monitor user perceptions of usability. CONCLUSION As health information systems are deployed on a widespread basis, studies that examine systems used regionally or nationally are required. In addition, collection of large scale data on the usability of specific IT products is needed in order to complement smaller scale studies of specific systems.

[1]  Patrice Degoulet,et al.  Impact of CPOE on doctor-nurse cooperation for the medication ordering and administration process , 2005, Int. J. Medical Informatics.

[2]  Elizabeth M Borycki,et al.  Technology induced error and usability: The relationship between usability problems and prescription errors when using a handheld application , 2005, Int. J. Medical Informatics.

[3]  R M Felciano,et al.  Lamprey: tracking users on the World Wide Web. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[4]  Karolin Papst,et al.  Human Factors For Informatics Usability , 2016 .

[5]  Robert M. Schumacher,et al.  How to Select an Electronic Health Record System that Healthcare Professionals can Use , 2009 .

[6]  Morten Hertzum,et al.  Images of Usability , 2010, Int. J. Hum. Comput. Interact..

[7]  Andre Kushniruk,et al.  Increasing the safety of healthcare information systems through improved procurement: toward a framework for selection of safe healthcare systems. , 2010, Healthcare quarterly.

[8]  Päivi Hämäläinen,et al.  Informaatio- ja kommunikaatioteknologian käyttö Suomen terveydenhuollossa vuonna 2007 : Tilanne ja kehityksen suunta , 2006 .

[9]  Timo Jokela,et al.  Usability in RFP's: The Current Practice and Outline for the Future , 2013, HCI.

[10]  Alan Cooper,et al.  The Inmates Are Running the Asylum: Why High Tech Products Drive Us Crazy and How to Restore the Sanity (2nd Edition) , 1999 .

[11]  Vimla L. Patel,et al.  Using usability heuristics to evaluate patient safety of medical devices , 2003, J. Biomed. Informatics.

[12]  Margaret M. Burnett,et al.  Mining problem-solving strategies from HCI data , 2010, TCHI.

[13]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[14]  Tinja Lääveri,et al.  Finnish physicians' experiences with computer-supported patient information exchange and communication in clinical work , 2011, Int. J. Electron. Heal..

[15]  Jan Stage,et al.  Instant data analysis: conducting usability evaluations in a day , 2004, NordiCHI '04.

[16]  Vimla L. Patel,et al.  Usability in the real world: assessing medical information technologies in patients' homes , 2003, J. Biomed. Informatics.

[17]  Tinja Lääveri,et al.  Physicians' experiences of participation in healthcare IT development in Finland: Willing but not able , 2012, Int. J. Medical Informatics.

[18]  Elizabeth M Borycki,et al.  Ensuring the safety of health information systems: using heuristics for patient safety. , 2009, Healthcare quarterly.

[19]  Christian Nøhr,et al.  Nordic eHealth Indicators: Organisation of Research, First Results and Plan for the Future , 2013, MedInfo.

[20]  Henrik Wramner Tracking Users on the World Wide Web. , 2011 .

[21]  Tinja Lääveri,et al.  National questionnaire study on clinical ICT systems proofs: Physicians suffer from poor usability , 2011, Int. J. Medical Informatics.

[22]  Reima Suomi,et al.  Towards a National Health Information System Evaluation , 2010, MedInfo.

[23]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[24]  Lou S. Davis Problems facing large Health Information Systems , 1973, ACM Annual Conference.