A structured model for evaluating information systems effectiveness

Research in information systems (IS) indicates an absence of clear-cut models to assess IS effectiveness. While the costs are easily identifiable it is the benefits which are most difficult to assess due to the scope of impact of information systems. In order to provide structure to the problem this paper presents a hierarchical approach to develop an IS effectiveness model using structured modelling techniques. This study uses the prior research work and a survey to identify and relate factors of IS effectiveness. The results of the model show that ‘improving systems integration’ has the highest influence on information systems effectiveness, followed by ‘facilitating information retrieval’. We were able to validate our results by showing that they are consistent with the widely accepted ‘stages model’ of IS development. Of particular interest is the finding that significantly high levels of IS effectiveness are experienced by organizations in the penultimate or final stage of IS development. The most significant contribution of this study is the development of a comprehensive IS effectiveness evaluation framework that resolves many subjective dilemmas of traditional user-centred evaluation approaches. Copyright © 1999 John Wiley & Sons, Ltd.

[1]  Ananth Srinivasan,et al.  Alternative Measures of Systems Effectiveness: Associations and Implications , 1985, MIS Q..

[2]  Prem Vrat,et al.  Impact of indirect relationships in classification of variables—a micmac analysis for energy conservation , 1990 .

[3]  Erik Brynjolfsson,et al.  The productivity paradox of information technology , 1993, CACM.

[4]  Michael J. Earl,et al.  Management Strategies for Information Technology , 1989 .

[5]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[6]  J. Miller.  Information systems effectiveness: the fit between business needs and system capabilities , 1989, ICIS '89.

[7]  T. S. Raghunathan,et al.  Information systems planning and effectiveness: An empirical analysis , 1991 .

[8]  E. Schein.  The role of the CEO in the management of change : the case of information technology , 1975 .

[9]  Wanda J. Orlikowski,et al.  A Short Form Measure of User Information Satisfaction: A Psychometric Evaluation and Notes on Use , 1987, J. Manag. Inf. Syst..

[10]  Peter Weill,et al.  The Relationship Between Investment in Information Technology and Firm Performance: A Study of the Valve Manufacturing Sector , 1992, Inf. Syst. Res..

[11]  Adolph I. Katz.  MEASURING TECHNOLOGY’S BUSINESS VALUE: Organizations Seek to Prove IT Benefits , 1993 .

[12]  Norman,et al.  Structural Models: An Introduction to the Theory of Directed Graphs. , 1966 .

[13]  Robert J. Kauffman,et al.  An evaluative framework for research on the performance effects of information technology investment , 1989, ICIS '89.

[14]  Dan Remenyi,et al.  A Guide to Measuring and Managing It Benefits , 1994 .

[15]  C. Wiseman.  Strategic Information Systems: Trends and Challenges over the Next Decade. , 1988 .

[16]  Tridas Mukhopadhyay,et al.  Impact of management information systems on decisions , 1992 .

[17]  Magid Igbaria,et al.  User acceptance of microcomputer technology: An empirical test , 1993 .

[18]  Tridas Mukhopadhyay,et al.  A Microeconomic Production Assessment of the Business Value of Management Information Systems: The Case of Inventory Control , 1993, J. Manag. Inf. Syst..

[19]  Louis Raymond,et al.  Validating and applying user satisfaction as a measure of MIS success in small organizations , 1987, Inf. Manag..

[20]  Ali R. Montazemi,et al.  Factors Affecting Information Satisfaction in the Context of the Small Business Environment , 1988, MIS Q..

[21]  Peter Weill,et al.  Managing Investment in Information Technology: Mini Case Examples and Implications , 1989, MIS Q..

[22]  Louis Raymond,et al.  Organizational Characteristics and MIS Success in the Context of Small Business , 1985, MIS Q..

[23]  Jean-Marc Martel,et al.  A fuzzy outranking relation in multicriteria decision making , 1986 .

[24]  Niv Ahituv,et al.  A Systematic Approach Toward Assessing the Value of an Information System , 1980, MIS Q..

[25]  Kenneth L. Kraemer,et al.  OR Practice - Computer-Based Models for Policy Making: Uses and Impacts in the U.S. Federal Government , 1986, Oper. Res..

[26]  K. Peffers,et al.  Rewards to Investors in Innovative Information Technology Applications: First Movers and Early Followers in ATMs , 1995 .