Critical success factors of decision support systems: An experimental study

Many factors affecting successful implementation of decision support systems have been identified in previous research. However, we still have little knowledge of both the relative importance of those factors and the mechanism by which they affect system usage. This paper proposes a framework, based on Simons three-stage decision process model and Fishbein s intention-behavior model, to integrate those factors and describe the decision process of system adoption. An experiment was conducted to investigate the relative importance of the factors. The results indicated that quality of the system was the most critical factor. Among the factors constituting the quality of the system; the accuracy of the model was the most critical factor affecting decision performance; and the representation format was the most critical factor affecting user attitude. The proposed framework, that applies the Fishbein model to interpret system usage behavior, was partially supported by the research results. User attitude and normative motivation were good predictors for decision performance. However, no significant correlation between system usage and user attitude or normative motivation was found.

[1]  Peter G. W. Keen,et al.  Adaptive design for decision support systems , 1980, DATB.

[2]  Robert W. Zmud.  Note—On the Validity of the Analytic-Heuristic Instrument Utilized in “The Minnesota Experiments” , 1978 .

[3]  Ralph H. Sprague,et al.  Graphical problem solving in DSS , 1980, DATB.

[4]  Henry C. Lucas,et al.  Why information systems fail , 1975 .

[5]  Robert W. Zmud,et al.  AN EMPIRICAL INVESTIGATION OF THE DIMENSIONALITY OF THE CONCEPT OF INFORMATION , 1978 .

[6]  Gerardine L DeSanctis,et al.  An examination of an expectancy theory model of decision support system use , 1982 .

[7]  Izak Benbasat,et al.  An Experimental Investigation of Some MIS Design Variables , 1977, MIS Q..

[8]  Izak Benbasat,et al.  A Critique of Cognitive Styles Theory and Research , 1980, ICIS.

[9]  John Alan Lehman.  A methodology for design of decision support systems based on the human information processing system , 1982 .

[10]  C LucasHenry,et al.  System response time operator productivity, and job satisfaction , 1983 .

[11]  Madeline Weiss,et al.  The human side of systems: an experiential approach , 1983, Inf. Manag..

[12]  Jr. Henry C. Lucas,et al.  Performance and the Use of an Information System , 1975 .

[13]  E. B. Swanson,et al.  Management Information Systems: Appreciation and Involvement , 1974 .

[14]  Donald L. Davis,et al.  User cognitive types for decision support systems , 1984 .

[15]  William Remus,et al.  An Empirical Investigation of the Impact of Graphical and Tabular Data Presentations on Decision Making , 1984 .

[16]  Scott Hamilton,et al.  Evaluating Information Systems Effectiveness - Part I: Comparing Evaluation Approaches , 1981, MIS Q..

[17]  Michael J. Ginzberg,et al.  Early Diagnosis of MIS Implementation Failure: Promising Results and Unanswered Questions , 1981 .

[18]  Daniel Robey,et al.  Human Information Processing in Information and Decisoin Support Systems , 1982, MIS Q..

[19]  Alexander M. Maish.  A User's Behavior Toward His MIS , 1979, MIS Q..

[20]  Henry C. Lucas,et al.  Organizational power and the information services department , 1984, CACM.

[21]  William R. King,et al.  ASSESSING INFORMATION SYSTEM VALUE: AN EXPERIMENTAL STUDY , 1983 .

[22]  B. K. Blaylock,et al.  COGNITIVE STYLE AND THE USEFULNESS OF INFORMATION , 1984 .

[23]  Scott Hamilton,et al.  Evaluating Information Systems Effectiveness - Part II: Comparing Evaluator Viewpoints , 1981, MIS Q..

[24]  Blake Ives,et al.  User Involvement and MIS Success: A Review of Research , 1984 .

[25]  Marion G. Sobol,et al.  The relationship between computerization and performance: A strategy for maximizing the economic benefits of computerization , 1983, Inf. Manag..

[26]  D. Robey.  Cognitive Style and DSS Design: A Comment on Huber's Paper , 1983 .

[27]  Henry C. Lucas,et al.  The Impact of the Mode of Information Presentation on Learning and Performance , 1980 .

[28]  D. Larcker,et al.  PERCEIVED USEFULNESS OF INFORMATION: A PSYCHOMETRIC EXAMINATION* , 1980 .

[29]  Ralph H. Sprague,et al.  Invited Article: A Framework for the Development of Decisoin Support Systems , 1980, MIS Q..

[30]  Edward J. Lusk,et al.  The Effect of Cognitive Style and Report Format on Task Performance: The MIS Design Consequences , 1979 .

[31]  Thomas J. Goodman,et al.  The effect of System Response Time on interactive computer aided problem solving , 1978, SIGGRAPH.

[32]  Andrew B. Whinston,et al.  THE EVOLVING ROLES OF MODELS IN DECISION SUPPORT SYSTEMS , 1980 .

[33]  W DicksonGary,et al.  Methodological issues in experimental IS research , 1985 .

[34]  Henry C. Lucas,et al.  An Experimental Investigation of the Use of Computer-Based Graphics in Decision Making , 1981 .

[35]  Maryam Alavi,et al.  An Assessment of the Concept of Decision Support Systems as Viewed by Senior-Level Executives , 1982, MIS Q..

[36]  Peter G. W. Keen,et al.  Decision support systems : an organizational perspective , 1978 .

[37]  Thomas J. Goodman,et al.  The Effect of Computer System Response Time Variability on Interactive Graphical Problem Solving , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[38]  Gerardine DeSanctis,et al.  ICIS Paper: Methodological Issues in Experimental IS Research: Experiences and Recommendations , 1985, MIS Q..

[39]  John F. Rockart,et al.  Future Role of the Information Systems Executive , 1982, MIS Q..

[40]  Martin De Waele.  Managerial style and the design of decision aids , 1978 .

[41]  C. Adams.  HOW MANAGEMENT USERS VIEW INFORMATION SYSTEMS , 1975 .

[42]  William R. King,et al.  Note-Participative Design of Strategic Decision Support Systems: An Empirical Assessment , 1981 .

[43]  Paul R. Watkins.  A Measurement Approach to Cognitive Complexity and Perception of Information: Implications for information Systems Design , 1981, ICIS.

[44]  Ralph H. Sprague,et al.  Building Effective Decision Support Systems , 1982 .

[45]  Henry C. Lucas,et al.  Empirical Evidence for a Descriptive Model of Implementation , 1978, MIS Q..

[46]  Jan Bell,et al.  The Effect of Presentation Form on the Use of Information in Annual Reports , 1984 .

[47]  Paul R. Watkins.  PERCEIVED INFORMATION STRUCTURE: IMPLICATIONS FOR DECISION SUPPORT SYSTEM DESIGN , 1982 .

[48]  Ronald J. Roland,et al.  A model of organizational variables for DSS , 1980, DATB.

[49]  Izak Benbasat.  Cognitive style considerations in DSS design , 1977, DATB.

[50]  Ralph H. Sprague,et al.  A Framework for the Development of Decision Support Systems , 1993 .

[51]  N. A. Schreiner-Novick.  Processes and tools for decision support , 1983, Inf. Manag..

[52]  Daniel Robey,et al.  User Attitudes and Management Information System Use , 1979 .

[53]  James R. Burns,et al.  Environmental factors affecting decision support system design , 1983, DATB.

[54]  Gordon B. Davis,et al.  A Framework for Research in Computer-Based Management Information Systems , 1980 .

[55]  Robert B. Miller,et al.  Response time in man-computer conversational transactions , 1899, AFIPS Fall Joint Computing Conference.

[56]  Jawaid Abdul Ghani,et al.  The effects of information representation and modification on decision performance , 1981 .

[57]  Izak Benbasat,et al.  The Impact of Cognitive Styles on Information System Design , 1978, MIS Q..

[58]  Izak Benbasat,et al.  AN EXPERIMENTAL EVALUATION OF THE RELATIONSHIP OF UNCERTAINTY IN THE ENVIRONMENT TO INFORMATION USED BY DECISION MAKERS , 1975 .

[59]  Kj Radford.  Information systems and managerial decision making , 1974 .

[60]  Ronald N. Taylor.  NATURE OF PROBLEM ILL-STRUCTUREDNESS: IMPLICATIONS FOR PROBLEM FORMULATION AND SOLUTION , 1974 .

[61]  Robert P. Bostrom,et al.  MIS Problems and failures: a sociotechnical perspective part I: the cause , 1977 .

[62]  Henry C. Lucas,et al.  System response time operator productivity, and job satisfaction , 1983, CACM.

[63]  John C. Henderson,et al.  An Evolutionary Strategy for Implementing a Decision Support System , 1981 .

[64]  G. Huber.  Cognitive Style as a Basis for MIS and DSS Designs: Much ADO About Nothing? , 1983 .

[65]  Thomas J. Page,et al.  An Examination of the Convergent, Discriminant, and Predictive Validity of Fishbein's Behavioral Intention Model , 1982 .

[66]  John S. Chandler.  A Multiple Criteria Approach for Evaluating Information Systems , 1982, MIS Q..

[67]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[68]  Paul H. Cheney,et al.  Concepts, Theory, and Techniques: FACTORS AFFECTING THE PERCEIVED UTILIZATION OF COMPUTER-BASED DECISION SUPPORT SYSTEMS IN THE OIL INDUSTRY , 1982 .

[69]  Andrew P. Sage,et al.  Behavioral and Organizational Considerations in the Design of Information Systems and Processes for Planning and Decision Support , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[70]  Ian I. Mitroff,et al.  A Program for Research on Management Information Systems , 1973 .

[71]  I. Benbasat,et al.  Individual-Differences In The Use Of Decision Support Aids , 1982 .

[72]  Michael J. Ginzberg.  Dss Success: Measurement and Facilitation , 1981, NATO ASI DBM.

[73]  Sammy W. Pearson,et al.  Measurement of computer user satisfaction , 1980, PERV.

[74]  Herbert A. Simon,et al.  The new science of management decision , 1960 .

[75]  Henry C. Lucas,et al.  Systems Quality, User Reactions, and the Use of Information Systems. , 1974 .

[76]  Gerardine DeSanctis,et al.  COMPUTER GRAPHICS AS DECISION AIDS: DIRECTIONS FOR RESEARCH* , 1984 .

[77]  B. Brabander,et al.  Successful Information System Development in Relation to Situational Factors Which Affect Effective Communication Between MIS-Users and EDP-Specialists , 1984 .

[78]  Izak Benbasat,et al.  Behavioral Aspects of Information Processing for the Design of Management Information Systems , 1982, IEEE Transactions on Systems, Man, and Cybernetics.

[79]  James F. Courtney,et al.  A Field Study of Organizational Factors Influencing DSS Success , 1985, MIS Q..

[80]  Robert W. Zmud,et al.  The Impact of Color Graphic Report Formats on Decision Performance and Learning , 1983, ICIS.

[81]  James A. Senn,et al.  Research in Management Information Systems: The Minnesota Experiments , 1977 .

[82]  R. Zmud.  INDIVIDUAL DIFFERENCES AND MIS SUCCESS: A REVIEW OF THE EMPIRICAL LITERATURE* , 1979 .

[83]  William R. King,et al.  An experimental study of the value of information , 1982 .

[84]  Blake Ives,et al.  The measurement of user information satisfaction , 1983, CACM.

[85]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[86]  R. Blanning.  How managers decide to use planning models , 1980 .

[87]  Paul R. Watkins.  PREFERENCE MAPPING OF PERCEIVED INFORMATION STRUCTURE: IMPLICATIONS FOR DECISION SUPPORT SYSTEMS DESIGN , 1984 .

[88]  Peter G. W. Keen,et al.  Cognitive Style Research: A Perspective for Integration , 2015, ICIS.

[89]  E. B. Swanson,et al.  Measuring user attitudes in MIS research: a review , 1982 .

[90]  M. Lynne Markus,et al.  Power, politics, and MIS implementation , 1987, CACM.

[91]  M. L. Bariff,et al.  Cognitive and Personality Tests for the Design of Management Information Systems , 1977 .

[92]  Michael J. Ginzberg,et al.  Redesign of Managerial Tasks: A Requisite for Successful Decision Support Systems , 1978, MIS Q..

[93]  J. C. Henderson,et al.  The Influence of Decision Style on Decision Making Behavior , 1980 .