An evaluation of empirical research in managerial support systems

Abstract This paper describes, summarizes and comments on the empirical studies in the use of three information technologies to support managerial activities: decision support systems (DSS), group decision support systems (GDSS), and expert systems (ES). These are collectively labelled as managerial support systems (MSS). A classification scheme to organize empirical research in MSS is proposed. An overview of empirical work on two major research themes, namely MSS “design” and “effects of use” of MSS, is then presented for the years 1981–1988. Following this overview, the research strategies suitable for empirical research in MSS are discussed. The paper concludes with suggestions about future research directions in the field.

[1]  Wayne Zachary,et al.  A Cognitively-Based Functional Taxonomy of Decision Support Techniques , 1986, SGCH.

[2]  Paul Gray,et al.  Group decision support systems , 1987, Decis. Support Syst..

[3]  Lawrence M. Fagan,et al.  Antimicrobial selection by a computer. A blinded evaluation by infectious diseases experts. , 1979, JAMA.

[4]  Jay F. Nunamaker,et al.  Facilitating Group Creativity: Experience with a Group Decision Support System , 1987, J. Manag. Inf. Syst..

[5]  Edward H. Shortliffe,et al.  Production Rules as a Representation for a Knowledge-Based Consultation Program , 1977, Artif. Intell..

[6]  Shelby H. McIntyre,et al.  An Experimental Study of the Impact of Judgment-Based Marketing Models , 1982 .

[7]  Ralph H. Sprague,et al.  A Framework for the Development of Decision Support Systems , 1993 .

[8]  Ting-Peng Liang,et al.  Critical success factors of decision support systems: An experimental study , 1986, DATB.

[9]  Frederick Hayes-Roth,et al.  Building expert systems , 1983, Advanced book program.

[10]  H. Albert Napier,et al.  An experiment in applying the adaptive design approach to DSS development , 1984, Inf. Manag..

[11]  James D. Thompson.  Organizations in Action , 1967 .

[12]  Daniel J. Power,et al.  AN EMPIRICAL ASSESSMENT OF COMPUTER‐ASSISTED DECISION ANALYSIS* , 1986 .

[13]  Sirkka L. Jarvenpaa,et al.  The effect of task demands and graphical format on information processing strategies , 1989 .

[14]  Gerardine DeSanctis,et al.  ICIS Paper: Methodological Issues in Experimental IS Research: Experiences and Recommendations , 1985, MIS Q..

[15]  Izak Benbasat,et al.  The Case Research Strategy in Studies of Information Systems , 1987, MIS Q..

[16]  John F. Rockart,et al.  Future Role of the Information Systems Executive , 1982, MIS Q..

[17]  N. Pennington,et al.  Inside the Jury. , 1985 .

[18]  Ramesh Sharda,et al.  Decision support system effectiveness: a review and an empirical test , 1988 .

[19]  Joyce J. Elam,et al.  Can Software Influence Creativity? , 1990, Inf. Syst. Res..

[20]  Gerardine DeSanctis,et al.  Computer-Based Support for Group Problem-Finding: An Experimental Investigation , 1988, MIS Q..

[21]  Sirkka L. Jarvenpaa,et al.  Computer Support for Meetings of Groups Working on Unstructured Problems: A Field Experiment , 1988, MIS Q..

[22]  Donald A. Waterman,et al.  A Guide to Expert Systems , 1986 .

[23]  Ralph H. Sprague,et al.  Invited Article: A Framework for the Development of Decisoin Support Systems , 1980, MIS Q..

[24]  Nigel Shadbolt,et al.  A formal evaluation of knowledge elicitation techniques for expert systems: domain 1 , 1988 .

[25]  Brian L. Dos Santos,et al.  A Study of User Interface Aids for Model-Oriented Decision Support Systems , 1988 .

[26]  Martin D. Goslar,et al.  Decision support systems: an empirical assessment for decision making , 1986 .

[27]  Efraim Turban,et al.  Integrating Expert Systems and Decision Support Systems , 1986, MIS Q..

[28]  Ilze Zigurs,et al.  Interaction analysis in GDSS research: description of an experience and some recommendations , 1989, Decis. Support Syst..

[29]  Izak Benbasat,et al.  An experimental investigation of the impact of computer-based decision aids on the process of preferential choice , 1988 .

[30]  Starr Roxanne Hiltz,et al.  Computer Support for Group Versus Individual Decisions , 1982, IEEE Trans. Commun..

[31]  W MaloneThomas,et al.  Expert systems: the next challenge for managers , 1986 .

[32]  Nathan Dickmeyer,et al.  Measuring the Effects of a University Planning Decision Aid , 1983 .

[33]  Izak Benbasat,et al.  Process Tracing Methods in Decision Support Systems Research: Exploring the Black Box , 1987, MIS Q..

[34]  Kenneth L. Kraemer,et al.  Computer-based systems for cooperative work and group decision making , 1988, CSUR.

[35]  Daniel E. O'Leary,et al.  VALIDATION OF EXPERT SYSTEMS- WITH APPLICATIONS TO AUDITING AND ACCOUNTING EXPERT SYSTEMS* , 1987 .

[36]  John P. McDermott,et al.  A KNACK for Knowledge Acquisition , 1987, AAAI.

[37]  Peter G. W. Keen,et al.  Decision support systems : an organizational perspective , 1978 .

[38]  Richard Staelin,et al.  Judgment Based Marketing Decision Models: An Experimental Investigation of the Decision Calculus Approach , 1979 .

[39]  Thomas W. Malone,et al.  Expert systems: the next challenge for managers , 1986 .

[40]  Mark S. Silver,et al.  User Perceptions of Decision Support System Restrictiveness: An Experiment , 1988, J. Manag. Inf. Syst..

[41]  Michael Goul,et al.  PROJECT IPMA: APPLYING DECISION SUPPORT SYSTEM DESIGN PRINCIPLES TO BUILDING EXPERT‐BASED SYSTEMS* , 1987 .

[42]  Randall Steeb,et al.  A Computer-Based Interactive System for Group Decisionmaking , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[43]  John C. Henderson,et al.  An Evolutionary Strategy for Implementing a Decision Support System , 1981 .

[44]  George P. Huber,et al.  DECISION SUPPORT SYSTEMS FOR ILL‐STRUCTURED PROBLEMS: AN EMPIRICAL STUDY , 1987 .

[45]  Izak Benbasat,et al.  An experimental program investigating color-enhanced and graphical information presentation: an integration of the findings , 1986, CACM.

[46]  Kenneth L. Kraemer,et al.  The impact of technological support on groups: An assessment of the empirical research , 1989, Decis. Support Syst..

[47]  E. W. Martin,et al.  Critical Success Factors of Chief MIS/DP Executives , 1982, MIS Q..

[48]  Gerardine DeSanctis,et al.  Understanding the effectiveness of computer graphics for decision support: a cumulative experimental approach , 1986, CACM.

[49]  Max Henrion,et al.  An Experimental Comparison of Knowledge Engineering for Expert Systems and for Decision Analysis , 1987, AAAI.

[50]  William R. King,et al.  Note-Participative Design of Strategic Decision Support Systems: An Empirical Assessment , 1981 .

[51]  John J. Sviokla,et al.  Planpower, Xcon, and Mudman: an in-depth analysis into three commercial expert systems in use , 1986 .

[52]  Izak Benbasat,et al.  A framework for the validation of knowledge acquisition , 1989 .

[53]  Ilze Zigurs,et al.  A Study of Influence in Computer-Mediated Group Decision Making , 1988, MIS Q..

[54]  John P. McDermott,et al.  R1: A Rule-Based Configurer of Computer Systems , 1982, Artif. Intell..

[55]  John C. Henderson.  FINDING SYNERGY BETWEEN DECISION SUPPORT SYSTEMS AND EXPERT SYSTEMS RESEARCH , 1987 .

[56]  Richard O. Mason,et al.  AN EXPERT SYSTEM APPLICATION FOR DECISION SUPPORT IN LAW ENFORCEMENT , 1987 .

[57]  I. Benbasat,et al.  Individual-Differences In The Use Of Decision Support Aids , 1982 .

[58]  Mo Adam Mahmood,et al.  Impact of design methods on decision support systems success: An empirical assessment , 1985, Inf. Manag..

[59]  Gerardine DeSanctis,et al.  Using a GDSS to Facilitate Group Consensus: Some Intended and Unintended Consequences , 1988, MIS Q..

[60]  Edward J. Lusk,et al.  The impact of a change in information representation and a change in the amount of information on decision performance , 1982 .

[61]  Gerardine DeSanctis,et al.  A foundation for the study of group decision support systems , 1987 .

[62]  Joyce J. Elam,et al.  The Nature of DSS literature Presented in major is Conference Proceedings (1980-1985) , 1986, ICIS.