An Approach to Evaluating E-Business Information Systems Projects

Capital investments in the e-business infrastructure add complexity to the IT payoff question because e-business interorganizational investments are deployed across multiple platforms, projects, vendors and partners. Traditional MIS research has been devoted to measuring the payoff from information technology (IT) investment without any specific focus on e-business. Flaws in the mature MIS performance measures seem to yield weak guidance for managers when evaluating IT success, thus diluting the potential for these measures to be adapted for use in the new e-business environment. A review of the conventional MIS payoff literature indicates that these measures may be incomplete, inaccurate, or inefficient for application to electronic commerce investments. This paper brings four new points to the e-business IT investment evaluation dialogue: (1) we first explore performance measurement validity flaws in our long established measures; (2) the paper discusses a two-by-two matrix delineating the gap between the quantitative versus qualitative performance measures of management information systems (MIS) initiatives; (3) sample e-business payoff techniques are discussed and reviewed in light of these historical imperfections, and (4) fourth, the paper proposes and describes an innovative framework derived from production theory economics for future research in evaluating e-business MIS implementations.

[1]  T. C. Powell,et al.  Information technology as competitive advantage: the role of human , 1997 .

[2]  Vasja Vehovar,et al.  Sensitivity of Electronic Commerce Measurement to the Survey Instrument , 2001, Int. J. Electron. Commer..

[3]  Kaj Grønbæk,et al.  CSCW challenges: cooperative design in engineering projects , 1993, CACM.

[4]  Peter Weill,et al.  The Relationship Between Investment in Information Technology and Firm Performance: A Study of the Valve Manufacturing Sector , 1992, Inf. Syst. Res..

[5]  Michael A. Cusumano,et al.  Competing On Internet Time: Lessons From Netscape And Its Battle With Microsoft , 1998 .

[6]  Erik Brynjolfsson,et al.  The productivity paradox of information technology , 1993, CACM.

[7]  Paul Alpar,et al.  Measuring the Efficiency of Web Site Traffic Generation , 2001, Int. J. Electron. Commer..

[8]  M. Hammer,et al.  Reengineering the Corporation , 1993 .

[9]  Ravinder Nath,et al.  Problems and Issues in the Management of International Data Communications Networks: The Experiences of American Companies , 1992, MIS Q..

[10]  Jr. Frederick P. Brooks,et al.  The mythical man-month (anniversary ed.) , 1995 .

[11]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[12]  Peter Weill,et al.  Managing Investment in Information Technology: Mini Case Examples and Implications , 1989, MIS Q..

[13]  Charles H. Kriebel,et al.  Information Technologies and Business Value: An Analytic and Empirical Investigation , 1995, Inf. Syst. Res..

[14]  Edward G. Carmines,et al.  Reliability and Validity Assessment , 1979 .

[15]  M. Porter,et al.  How Information Gives You Competitive Advantage , 1985 .

[16]  Andrea Rangone,et al.  A Performance Measurement System for Planning and Controlling a BtoC E-Commerce Strategy , 2000 .

[17]  M. L. Bariff,et al.  Cognitive and Personality Tests for the Design of Management Information Systems , 1977 .

[18]  P. Keen Competing in Time: Using Telecommunications for Competitive Advantage , 1986 .

[19]  Blake Ives,et al.  The measurement of user information satisfaction , 1983, CACM.

[20]  E. Johnsen Richard M. Cyert & James G. March, A Behavioral Theory of The Firm, Prentice-Hall, Inc., Englewood Cliffs, New Jersey, 1963, 332 s. , 1964 .

[21]  Kar Yan Tam,et al.  The Impact of Information Technology Investments on Firm Performance and Evaluation: Evidence from Newly Industrialized Economies , 1998, Inf. Syst. Res..

[22]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..

[23]  J. Dearden MIS Is a Mirage. , 1972 .

[24]  Ken Peffers,et al.  The Impact of Information Technology Investment Announcements on the Market Value of the Firm , 1993, Inf. Syst. Res..

[25]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[26]  J. March,et al.  A Behavioral Theory of the Firm , 1964 .

[27]  S. Harris,et al.  Organizational Performance and Information Technology Investment Intensity in the Insurance Industry , 1991 .

[28]  T. A. Stewart Intellectual Capital: The New Wealth of Organizations , 1997 .

[29]  N. Melone A theoretical assessment of the user-satisfaction construct in information systems research , 1990 .

[30]  B. Santos Justifying investments in new information technologies , 1991 .

[31]  Izak Benbasat,et al.  Empirical Research in Information Systems: The Practice of Relevance , 1999, MIS Q..

[32]  Varun Grover,et al.  Information technology enabled business process redesign: An integrated planning framework , 1993 .

[33]  Russell L. Ackoff,et al.  Management misinformation systems , 1967 .

[34]  P. Reynolds A Primer in Theory Construction , 1971 .

[35]  Vijay Sethi,et al.  Construct Measurement in Information Systems Research: An Illustration in Strategic Systems , 1991 .

[36]  Fred P. Brooks,et al.  The Mythical Man-Month , 1975, Reliable Software.

[37]  Paul A. Strassmann,et al.  The Business Value of Computers: An Executive's Guide , 1990 .

[38]  Anthony B. Perkins,et al.  The Internet Bubble: Inside the Overvalued World of High-Tech Stocks--- And What You Need to Know to Avoid the Coming Shakeout , 1999 .

[39]  Steven W. Floyd,et al.  Path Analysis of the Relationship between Competitive Strategy, Information Technology, and Financial Performance , 1990, J. Manag. Inf. Syst..

[40]  Michael Hammer,et al.  Reengineering Work: Don’t Automate, Obliterate , 1990 .

[41]  M. Markus,et al.  Information technology and organizational change: causal structure in theory and research , 1988 .

[42]  Erik Brynjolfsson,et al.  Frictionless Commerce? A Comparison of Internet and Conventional Retailers , 2000 .

[43]  Se-Joon Hong Information-Processing Costs in Online Stock Trading , 2000, Electron. Mark..

[44]  Samuel Eilon Measuring quality of information systems , 1993 .

[45]  Thomas H. Davenport,et al.  Process Innovation: Reengineering Work Through Information Technology , 1992 .

[46]  Lorin M. Hitt,et al.  The Three Faces of IT Value: Theory and Evidence , 1994, ICIS.

[47]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[48]  Margaret M. Blair,et al.  Unseen wealth : report of the Brookings Task Force on Intangibles , 2001 .

[49]  Chris F. Kemerer Information Technology and Industrial Competitiveness: How IT Shapes Competition , 1997 .

[50]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .