A conceptual framework for evaluation of information technology investments

The decision to acquire a new information technology poses a number of serious evaluation and selection problems to technology managers, because the new system must not only meet current information requirements of the organisation, but also the needs for future expansion. Tangible and intangible benefits factors, as well as risks factors, must be identified and evaluated. The paper provides a review of ten major evaluation categories and available models, which fall under each category, showing their advantages and disadvantages in handling the above difficulties. This paper describes strategic implications involved in the selection decision, and the inherent difficulties in: (1) choosing or developing a model, (2) obtaining realistic inputs for the model, and (3) making tradeoffs among the conflicting factors. It proposes a conceptual framework to help the decision maker in choosing the most appropriate methodology in the evaluation process. It also offers a new model, called GAHP, for the evaluation problem combining integer goal linear programming and Analytic Hierarchy Process (AHP) in a single hybrid multiple objective multi-criteria model. A goal programming methodology, with zero-one integer variables and mixed integer constraints, is used to set goal target values against which information technology alternatives are evaluated and selected. AHP is used to structure the evaluation process providing pairwise comparison mechanisms to quantify subjective, nonmonetary, intangible benefits and risks factors, in deriving data for the model. A case illustration is provided showing how GAHP can be formulated and solved.

[1]  Peter Weill,et al.  Managing Investment in Information Technology: Mini Case Examples and Implications , 1989, MIS Q..

[2]  Kar Yan Tam,et al.  Capital budgeting in information systems development , 1992, Inf. Manag..

[3]  Eduardo S. Schwartz,et al.  Investment Under Uncertainty. , 1994 .

[4]  G. W. Evans,et al.  An Overview of Techniques for Solving Multiobjective Mathematical Programs , 1984 .

[5]  Robert J. Kauffman,et al.  An evaluative framework for research on the performance effects of information technology investment , 1989, ICIS '89.

[6]  P. Strassmann Information Payoff: The Transformation of Work in the Electronic Age , 1985 .

[7]  R. Hogarth Judgement and choice: The psychology of decision , 1982 .

[8]  David Brookfield Risk and capital budgeting , 1995 .

[9]  Bay Arinze,et al.  A method for quality precoordination in a quality assurance information system , 1991 .

[10]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[11]  Charles T. Horngren Introduction to Management Accounting , 1981 .

[12]  Vijay Sethi,et al.  Development of measures to assess the extent to which an information technology application provides competitive advantage , 1994 .

[13]  Murat Köksalan,et al.  Interactive Approaches for Discrete Alternative Multiple Criteria Decision Making with Monotone Utility Functions , 1995 .

[14]  P. Keen Value Analysis: Justifying Decision Support Systems , 1993 .

[15]  Donald H. Bender,et al.  Financial Impact of Information Processing , 1986, J. Manag. Inf. Syst..

[16]  Eric R. Zieyel Operations research : applications and algorithms , 1988 .

[17]  Niv Ahituv,et al.  Assessing the value of information , 1989, ICIS '89.

[18]  Paul Slovic,et al.  From Shakespeare to Simon: speculations--and some evidence-- about man's ability to process information , 1972 .

[19]  James C. Wetherbe,et al.  Key Issues in Information Systems Management: 1994-95 SIM Delphi Results , 1996, MIS Q..

[20]  John Leslie King,et al.  Cost-Benefit Analysis in Information Systems Development and Operation , 1978, CSUR.

[21]  Eugene F. Bryan Information Systems Investment Strategies , 1990 .

[22]  Marion G. Sobol,et al.  The relationship between computerization and performance: A strategy for maximizing the economic benefits of computerization , 1983, Inf. Manag..

[23]  F. W. McFarlan,et al.  Portfolio approach to information systems , 1989 .

[24]  R. Kelly Rainer,et al.  The Keys to Executive Information Systems Success , 1995, J. Manag. Inf. Syst..