A quantitative analysis of the impact of a computerised information system on nurses' clinical practice using a realistic evaluation framework

OBJECTIVE To explore nurses' perceptions of the impact on clinical practice of the use of a computerised hospital information system. DESIGN A realistic evaluation design based on Pawson and Tilley's work has been used across all the phases of the study. This is a theory-driven approach and focuses evaluation on the study of what works, for whom and in what circumstances. These relationships are constructed as context-mechanisms-outcomes (CMO) configurations. MEASUREMENTS A questionnaire was distributed to all nurses working in in-patient units of a university hospital in Spain (n=227). Quantitative data were analysed using SPSS 13.0. Descriptive statistics were used for an overall overview of nurses' perception. Inferential analysis, including both bivariate and multivariate methods (path analysis), was used for cross-tabulation of variables searching for CMO relationships. RESULTS Nurses (n=179) participated in the study (78.8% response rate). Overall satisfaction with the IT system was positive. Comparisons with context variables show how nursing units' context had greater influence on perceptions than users' characteristics. Path analysis illustrated that the influence of unit context variables are on outcomes and not on mechanisms. CONCLUSION Results from the study looking at subtle variations in users and units provide insight into how important professional culture and working practices could be in IT (information technology) implementation. The socio-technical approach on IT systems evaluation suggested in the recent literature appears to be an adequate theoretical underpinning for IT evaluation research. Realistic evaluation has proven to be an adequate method for IT evaluation.

[1]  B. Kaplan,et al.  Future Directions in Evaluation Research: People, Organizational, and Social Issues , 2004, Methods of Information in Medicine.

[2]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[3]  A. D. B. Clarke,et al.  Evaluation Research: An Introduction to Principles, Methods and Practice , 1999 .

[4]  Sven A. Carlsson.  Using Critical Realism in IS Research , 2004 .

[5]  J. A. Adams,et al.  Psychological bulletin. , 1962, Psychological bulletin.

[6]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[7]  David Richards,et al.  Critical realism: a way forward for evaluation research in nursing? , 2003, Journal of advanced nursing.

[8]  H. A. Heathfield,et al.  Evaluating clinical systems: the social programme perspective , 2001 .

[9]  Christine Urquhart,et al.  Reviewing the evidence on nursing record systems , 2005, Health Informatics J..

[10]  R. Watson,et al.  Review: evaluating information systems in nursing. , 2008, Journal of clinical nursing.

[11]  Marc Berg,et al.  Implementing information systems in health care organizations: myths and challenges , 2001, Int. J. Medical Informatics.

[12]  B. Leca,et al.  A Critical Realist Approach To Institutional Entrepreneurship , 2006 .

[13]  Yeshika Alversia,et al.  Doing quantitative research in education with SPSS , 2011 .

[14]  Leanne M. Currie,et al.  Evaluation frameworks for nursing informatics , 2005, Int. J. Medical Informatics.

[15]  Amy B. Woszczynski,et al.  The Handbook of Information Systems Research , 2003 .

[16]  E. Weir,et al.  Realist Evaluation in Practice: Health and Social Work , 2003 .

[17]  Bonnie Kaplan,et al.  Expanding multi-disciplinary approaches to healthcare information technologies: What does information systems offer medical informatics? , 2007, Int. J. Medical Informatics.

[18]  K. Dontje,et al.  Electronic health record: implementation across the Michigan Academic Consortium. , 2006, Computers, informatics, nursing : CIN.

[19]  Fadhel Kaboub.  Realistic Evaluation , 2004 .

[20]  Michael Ivor Reed,et al.  Reflections on the 'Realist Turn' in Organization and Management Studies , 2005 .

[21]  Sven A. Carlsson,et al.  Advancing Information Systems Evaluation (Research): A Critical Realist Approach , 2003 .

[22]  Elske Ammenwerth,et al.  Evaluation of health information systems - problems and challenges , 2003, Int. J. Medical Informatics.

[23]  Dimitrios G. Katehakis,et al.  Electronic Health Record , 2006 .

[24]  C. Oroviogoicoechea.  A realistic evaluation of the impact of a computerised information system on clinical practice : the nurses' perspective , 2008 .

[25]  Mansoor A. F. Kazi,et al.  Realist evaluation in practice , 2003 .

[26]  K. Neil Jenkings.  Problems encountered in integrated care records research , 2004, Health Informatics J..

[27]  Duncan Cramer,et al.  Advanced Quantitative Data Analysis , 2003 .