The proliferation of software packages has created a difficult, complex problem of evaluation and selection for many users. Traditional approaches to the quantification of package performance have relied on compensatory models, such as the linear weighted attribute model, which sums the weighted ratings of software attributes. These approaches define the dimensions of quality too narrowly and, therefore, omit substantial amounts of information from consideration. This paper presents an alternative methodology, previously used in capital rationing and tournament ranking, that expands the opportunity for objective insight into software quality. In particular, it considers three measures of quality, the frequency with which the attribute ratings of one package exceed those of another, the presence of outliers, where very poor performance may exist on a single attribute and be glossed over by compensatory methods, and the cumulative magnitude of attribute ratings on one package that exceed those on others. The proposed methodology is applied to the evaluation of the following software types: word processing, database management systems, spreadsheet/financial planning, integrated software, graphics, data communications and project management.
[1]
Benjamin F. Hobbs,et al.
What Can We Learn from Experiments in Multiobjective Decision Analysis?
,
1986,
IEEE Transactions on Systems, Man, and Cybernetics.
[2]
Jack P. C. Kleijnen,et al.
Scoring methods, multiple criteria, and utility analysis
,
1980,
PERV.
[3]
J. Martin,et al.
Buying software off the rack. Packages can be the solution to the software shortage.
,
1983,
Harvard business review.
[4]
E. M. Timmreck.
Computer Selection Methodology
,
1973,
CSUR.
[5]
Robert F. Erlandson.
System evaluation methodologies: combined multidimensional scaling and ordering techniques
,
1980,
PERV.
[6]
F ErlandsonRobert.
System evaluation methodologies
,
1980
.
[7]
Valerie Belton.
The Use of a Simple Multiple-Criteria Model to Assist in Selection from a Shortlist
,
1985
.
[8]
Jon Clark,et al.
Managing the introduction of new technology
,
1985
.
[9]
Fatemeh Zahedi,et al.
Applications and Implementation DATA‐BASE MANAGEMENT SYSTEM EVALUATION AND SELECTION DECISIONS*
,
1985
.
[10]
W. Cook,et al.
On the Minimum Violations Ranking of a Tournament
,
1986
.