Evaluating business information systems fit: from concept to practical application

Attempting to explain information systems success and failure is a complex task. To measure it is perhaps more complex and compounded by difficulties related to the concept of measurement in a social context. The prevalent approach taken to date revolves around the concept of ‘fit’, as defined by the contingency approach in organizational theory. In reviewing this, a proposal is made for an interpretive approach to measurement. This paper attempts to provide such an approach through the development of a framework that aims to improve understanding for the researcher and practitioner alike. The formative part of the framework seeks to collect data relating to the fit of the information system and its environment along the dimensions of decision making, innovation and information acquisition and distribution. The latter part of the framework uses repertory grids to gain an understanding of both what is perceived as wrong with the system and what is perceived as wanted from the system; the latter acting as a basis for corrective action. A description of action research applying the framework in an organizational setting is given and representative empirical results are examined. The paper concludes with a discussion of the value of the framework and the major conclusions that can be drawn from its application.

[1]  Izak Benbasat,et al.  An experimental study of the human/computer interface , 1981, CACM.

[2]  J. Gill,et al.  Research Methods For Managers , 1991 .

[3]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[4]  Kalle Lyytinen,et al.  Information systems development and data modelling: conceptual and philosophical foundations , 1995 .

[5]  G. Kelly The Psychology of Personal Constructs , 2020 .

[6]  Guy Paré,et al.  Matching information technology and organizational structure: an empirical study with implications for performance , 1995 .

[7]  Peter Weill,et al.  An Assessment of the Contingency Theory of Management Information Systems , 1989, J. Manag. Inf. Syst..

[8]  M. Lynne Markus,et al.  Power, politics, and MIS implementation , 1987, CACM.

[9]  M. Patton,et al.  Qualitative evaluation and research methods , 1992 .

[10]  C. Lindblom THE SCIENCE OF MUDDLING THROUGH , 1959 .

[11]  R. Boland Phenomenology: a preferred approach to research on information systems , 1986, Trends in Information Systems.

[12]  G. Huber The Nature and Design of Post-Industrial Organizations , 1984 .

[13]  R. Bhaskar,et al.  The Possibility of Naturalism: A Philosophical Critique of the Contemporary Human Sciences , 1979 .

[14]  Michael Newman,et al.  INTEGRATED SYSTEM, AUTONOMOUS DEPARTMENTS: ORGANIZATIONAL INVALIDITY AND SYSTEM CHANGE IN A UNIVERSITY* , 1993 .

[15]  Richard Leifer,et al.  Matching Computer-Based Information Systems with Organizational Structures , 1988, MIS Q..

[16]  Geoff Walsham,et al.  The Emergence of Interpretivism in IS Research , 1995, Inf. Syst. Res..

[17]  M. Porter,et al.  How Information Gives You Competitive Advantage , 1985 .

[18]  A. Stewart,et al.  Business applications of repertory grid , 1981 .

[19]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..

[20]  Andrew Sayer,et al.  Method in Social Science: A Realist Approach , 1984 .

[21]  E. B. Swanson,et al.  Management Information Systems: Appreciation and Involvement , 1974 .

[22]  Nava Pliskin,et al.  Presumed Versus Actual Organizational Culture: Managerial Implications for Implementation of Information Systems , 1993, Comput. J..

[23]  T. Jick Mixing Qualitative and Quantitative Methods: Triangulation in Action. , 1979 .

[24]  G. A. Ferguson,et al.  Statistical analysis in psychology and education , 1960 .

[25]  Phillip Ein-Dor,et al.  Organizational Context and MIS Structure: Some Empirical Evidence , 1982, MIS Q..

[26]  Blake Ives,et al.  The measurement of user information satisfaction , 1983, CACM.

[27]  Geoff Walsham,et al.  Interpreting Information Systems in Organizations , 1993 .

[28]  R. E. Miles,et al.  Fit, Failure and the Hall of Fame , 1984 .

[29]  Richard Bell,et al.  A manual for repertory grid technique , 1977 .

[30]  David J. Miller,et al.  Stale in the Saddle: CEO Tenure and the Match Between Organization and Environment , 1991 .

[31]  P. Lawrence,et al.  Organization and environment , 1967 .

[32]  P. Beynon-Davies,et al.  Information systems ‘failure’: the case of the London Ambulance Service's Computer Aided Despatch project , 1995 .

[33]  Mark Lycett,et al.  Philosophical Directions for Information Systems Development , 1997 .

[34]  Lawrence A. Gordon,et al.  A contingency framework for the design of accounting information systems , 1976 .

[35]  Henry C. Lucas,et al.  Why information systems fail , 1975 .