Developing and Testing a Clinical Information System Evaluation Tool: Prioritizing Modifications Through End-User Input

Objective: The objectives were to develop and validate the Information System Evaluation Tool (ISET), use feedback to modify the institution's clinical information system (CIS), and determine the modifications' success. Background: The ability of a CIS to increase patient safety and care quality is dependent on its systems and processes. A survey was needed to provide the specificity necessary to make meaningful system improvements. Methods: The ISET was pilot tested and revised before being administered before implementation of the CIS. It was administered at 2 times after implementation. The ISET was revised after analysis of the results, and comparisons were made between the times. Results: The ISET is a valid and reliable instrument. Perceptions of the CIS initially decreased, but had significantly improved by 16 months after implementation. Conclusions: End-users must be convinced that the CIS supports their practice and improves care for adoption to be successful. The ISET measures these perceptions and highlights areas for improvement.

[1]  Janet M. Corrigan,et al.  Envisioning the national health care quality report , 2001 .

[2]  Alastair Baker,et al.  Crossing the Quality Chasm: A New Health System for the 21st Century , 2001, BMJ : British Medical Journal.

[3]  Andreas P. Gambrellac.  Technological change and the growth of health care spending , 2010 .

[4]  P. D Harper,et al.  Improving user satisfaction: the questionnaire for user interaction satisfaction version 5 , 1993 .

[5]  Paul Kline,et al.  An easy guide to factor analysis , 1993 .

[6]  P. Maurette.  [To err is human: building a safer health system]. , 2002, Annales francaises d'anesthesie et de reanimation.

[7]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[8]  A. Wall,et al.  Book ReviewTo Err is Human: building a safer health system Kohn L T Corrigan J M Donaldson M S Washington DC USA: Institute of Medicine/National Academy Press ISBN 0 309 06837 1 $34.95 , 2000 .

[9]  D. Swinglehurst,et al.  Tensions and paradoxes in electronic patient record research: a systematic literature review using the meta-narrative method. , 2009, The Milbank quarterly.

[10]  Brian Gugerty,et al.  CPOE systems: success factors and implementation issues. , 2004, Journal of healthcare information management : JHIM.

[11]  Jiajie Zhang,et al.  Improving the Human Computer Interface Design for a Physician Order Entry System , 2003, AMIA.

[12]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[13]  Vimla L. Patel,et al.  Cognitive and usability engineering methods for the evaluation of clinical information systems , 2004, J. Biomed. Informatics.

[14]  Sara Rosenbaum,et al.  Electronic health records' limited successes suggest more targeted uses. , 2010, Health affairs.

[15]  C. Heckler.  A Step-by-Step Approach to Using the SAS™ System for Factor Analysis and Structural Equation Modeling , 1996 .

[16]  G. Robert,et al.  Diffusion of innovations in service organizations: systematic review and recommendations. , 2004, The Milbank quarterly.

[17]  B. Karsh.  Beyond usability: designing effective technology implementation systems to promote patient safety , 2004, Quality and Safety in Health Care.

[18]  Patrice Degoulet,et al.  Determinants of User Satisfaction with a Clinical Information System , 2006, AMIA.

[19]  April Saathoff,et al.  Human factors considerations relevant to CPOE implementations. , 2005, Journal of healthcare information management : JHIM.