A Framework Facilitating Ex-Ante Evaluation of Information Systems

As organizations continually implement changes to their information and communication technologies (ICT) infrastructure, change has become an increasing part of "business as usual". Managers are routinely requested to justify expenditure, explain business benefits, and provide ex-ante and ex-post evaluations of ICT initiatives. Ex-ante evaluation is defined as predictive evaluation, and is often based upon quantitative measures such as financial predictions. However, the perception that many organizations are underperforming with regard to the effectiveness of ICT suggests that an approach to ex-ante evaluation employing both qualitative and quantitative components is appropriate. This paper presents a framework designed to facilitate qualitative evaluation of the likely impact of an information system by analyzing a series of key themes derived from a study of the literature of change and change management. The paper concludes with an application of the framework to an ICT development, the intention being to assess the validity of the theoretical framework proposed.

[1]  Frederick M. Nickols,et al.  Empowerment: The Emperor's New Clothes , 1998 .

[2]  Maurice Kogan,et al.  Process and structure in higher education , 1980 .

[3]  Cyrus F. Gibson,et al.  IT-enabled Business Change: An Approach to Understanding and Managing Risk , 2004, MIS Q. Executive.

[4]  K. Lewin Field theory in social science , 1951 .

[5]  Burt Nanus,et al.  Visionary Leadership: Creating a Compelling Sense of Direction for Your Organization , 1992 .

[6]  Robert K. Yin,et al.  Applications of case study research , 1993 .

[7]  M. Patton,et al.  Qualitative evaluation and research methods , 1992 .

[8]  Peter Cressey,et al.  Doing research in organisations: Edited by Alan Bryman, Routledge, 1988, 268p, £8.95 , 1988 .

[9]  M. Fullan The New Meaning of Educational Change , 1990 .

[10]  Michael Fullan,et al.  Coordinating Top-Down and Bottom-Up Strategies for Educational Reform , 2003 .

[11]  Judith C. Kingstone,et al.  Managing at the Speed of Change , 1998 .

[12]  M. Meldrum,et al.  Creating change from below: early lessons for agents of change , 1999 .

[13]  Martin Harris,et al.  Strategic planning for information systems , 1991, J. Inf. Technol..

[14]  W. Doll,et al.  The development of a tool for measuring the perceived impact of information technology on work , 1999 .

[15]  M. Patton Qualitative evaluation and research methods, 2nd ed. , 1990 .

[16]  Wanda J. Orlikowski,et al.  Studying Information Technology in Organizations: Research Approaches and Assumptions , 1991, Inf. Syst. Res..

[17]  R. Fincham Narratives of Success and Failure in Systems Development , 2002 .

[18]  Guy Fitzgerald,et al.  Evaluating information systems projects: a multidimensional approach , 1998, J. Inf. Technol..

[19]  Bill Robson Strategic Management and Information Systems , 1997 .