Choice Models for the Evaluation and Selection of Software Packages

Abstract:Microcomputer users are faced with an increasingly difficult choice problem in the evaluation and selection of software packages. For many reasons, users frequently must rely on expert evaluations of the technical functions and features of packages. This paper explores the extent to which multi-attribute choice models are capable of extracting the information content of performance ratings. Five choice models are applied to the expert ratings of software packages in the following areas: word processing, database management systems, and spreadsheet and financial planning. The evaluations and selections made under each model are compared for each software type, and guidelines are suggested for choosing between choice strategies for software evaluation.

[1]  Zvi Griliches,et al.  On an Index of Quality Change , 1961 .

[2]  D. R. J. White,et al.  POED — A method of evaluating system performance , 1963 .

[3]  M. Fishbein.  An Investigation of the Relationships between Beliefs about an Object and the Attitude toward that Object , 1963 .

[4]  C. H. Coombs,et al.  Mathematical psychology : an elementary introduction , 1970 .

[5]  A. Tversky.  Elimination by aspects: A theory of choice. , 1972 .

[6]  M. Beckenstein.  System requirements analysis: A management tool , 1972 .

[7]  E. M. Timmreck.  Computer Selection Methodology , 1973, CSUR.

[8]  Thomas G. Peterson.  A comparison of software and hardware monitors , 1974, PERV.

[9]  John O. Summers,et al.  A Comparison of Linear and Nonlinear Evaluation Process Models , 1975 .

[10]  E. Maynes.  The Concept and Measurement of Product Quality , 1976 .

[11]  William J. Vastine.  Maynes, E. Scott. Decision-Making for Consumers, A Guide to Consumer Economics. New York: Macmillian Publishing Co., forthcoming , 1976 .

[12]  J. J. Bernardo,et al.  A Programming Model of Consumer Choice Among Multi-Attributed Brands , 1977 .

[13]  L. Beach,et al.  A Contingency Model for the Selection of Decision Strategies , 1978 .

[14]  A. Parkin.  Critique on Multi-Criteria Assessment Applied to Alternative Data Processing Systems , 1978, Comput. J..

[15]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[16]  J. Blin.  A Programming Model of Consumer Choice among Multiattributed Brands: Rejoinder , 1979 .

[17]  Jack P. C. Kleijnen,et al.  Scoring methods, multiple criteria, and utility analysis , 1980, PERV.

[18]  Robert F. Erlandson.  System evaluation methodologies: combined multidimensional scaling and ordering techniques , 1980, PERV.

[19]  Sammy W. Pearson,et al.  Measurement of computer user satisfaction , 1980, PERV.

[20]  J. Martin,et al.  Buying software off the rack. Packages can be the solution to the software shortage. , 1983, Harvard business review.

[21]  Ted Dintersmith.  A Separating Choice Hyperplane Algorithm for Evaluating Multiattribute Decisions , 1984, Oper. Res..

[22]  Lem O. Ejiogu.  A simple measure of software complexity , 1985, PERV.

[23]  Valerie Belton.  The Use of a Simple Multiple-Criteria Model to Assist in Selection from a Shortlist , 1985 .

[24]  Benjamin F. Hobbs,et al.  What Can We Learn from Experiments in Multiobjective Decision Analysis? , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[25]  Joseph Shearn.  Selecting the Right Software. , 1987 .

[26]  P. Keys.  A methodology for methodology choice , 1988 .

[27]  Robert S. Billings,et al.  The effects of response mode and importance on decision-making strategies: Judgment versus choice , 1988 .