Evaluating health information systems: an assessment of frameworks.

The rapid increase in investments for computerised systems is a major concern for all health organisations. Questions about these investments arise as information technology is only one of the areas that are competing for a finite amount of resources. There is also some concern that some of the failures of information technology would have been detected if proper evaluation of information systems were conducted. The state of the art of evaluating information systems shows changes from a very positivist approach to more comprehensive approaches that would incorporate multiple methods. This paper presents an assessment of the techniques and methods for information systems evaluation, followed by an application to a case study in community health to illustrate the value of the contextualist approach to evaluation. The paper argues for the use of longitudinal, contextualist approaches to information systems evaluation if decision-makers seek to improve the situation of information systems in the health industry.

[1]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[2]  Dan Remenyi,et al.  A Guide to Measuring and Managing It Benefits , 1994 .

[3]  Frank F. Land,et al.  Matching an IT Project with an appropriate method of evaluation: a research note on ‘Evaluating Investments in IT’ , 1994, J. Inf. Technol..

[4]  Chris Sauer,et al.  Why information systems fail: a case study approach , 1993 .

[5]  John S. Chandler.  A Multiple Criteria Approach for Evaluating Information Systems , 1982, MIS Q..

[6]  Chrisanthi Avgerou,et al.  Evaluating information systems by consultation and negotiation , 1995 .

[7]  Kalle Lyytinen,et al.  Different perspectives on information systems: problems and solutions , 1987, CSUR.

[8]  Joan A. Ballantine,et al.  How to assess your IT investment: A study of methods and practice: B Farbey, F Land and D Targett Butterworth-Heinemann (1993) 158 pp £19.99 ISBN 0 7506 0654 1 , 1995, J. Strateg. Inf. Syst..

[9]  E. Guba,et al.  Fourth Generation Evaluation , 1989 .

[10]  Veronica Symons,et al.  Evaluation of information systems: IS development in the Processing Company , 1990, J. Inf. Technol..

[11]  Frank F. Land,et al.  Evaluating investments in IT , 1992, J. Inf. Technol..

[12]  Steve Smithson,et al.  The management of change for information systems evaluation practice: Experience from a case study , 1996 .

[13]  Tom Renkema.  Boekbespreking Farbey, B.; Land, F.; Targett, D.: how to assess your IT investment, a study of methods and practice (Butterworth Heinemann, Oxford, 1993) , 1994 .

[14]  M Zviran.  Evaluating user satisfaction in a hospital environment: An exploratory study , 1992, Health care management review.

[15]  P. Rossi,et al.  Evaluating Social Programs; Theory, Practice, and Politics. Quantitative Studies in Social Relations Series. , 1972 .

[16]  G. Walsham,et al.  The evaluation of information systems: a critique , 1991 .

[17]  R. Shapiro,et al.  Benefit-cost analysis of hospital information systems: the state of the (non) art. , 1988, Journal of health and human resources administration.

[18]  C. Achilles,et al.  Evaluation: A Systematic Approach , 1980 .

[19]  A. Dowling.  Do Hospital Staff Interfere with Computer System Implementation? , 1980, Health care management review.

[20]  Scott Hamilton,et al.  Evaluating Information Systems Effectiveness - Part I: Comparing Evaluation Approaches , 1981, MIS Q..

[21]  A. Pettigrew.  Contextualist Research and the Study of Organizational Change Processes , 1985 .

[22]  W. Peterson.  Rossi, Peter H., and Walter Williams, eds., Evaluating Social Programs: Theory, Practice, and Politics, New York, Seminar Press, Inc., 1972, xviii + 326 pp. ($10.95) , 1973 .

[23]  Glandon Gl,et al.  Benefit-cost analysis of hospital information systems: the state of the (non) art. , 1988 .