Comparing methods for multiattribute decision making with ordinal weights

This paper is concerned with procedures for ranking discrete alternatives when their values are evaluated precisely on multiple attributes and the attribute weights are known only to obey ordinal relations. There are a variety of situations where it is reasonable to use ranked weights, and there have been various techniques developed to deal with ranked weights and arrive at a choice or rank alternatives under consideration. The most common approach is to determine a set of approximate weights (e.g., rank-order centroid weights) from the ranked weights. This paper presents a different approach that does not develop approximate weights, but rather uses information about the intensity of dominance that is demonstrated by each alternative. Under this approach, several different, intuitively plausible, procedures are presented, so it may be interesting to investigate their performance. These new procedures are then compared against existing procedures using a simulation study. The simulation result shows that the approximate weighting approach yields more accurate results in terms of identifying the best alternatives and the overall rank of alternatives. Although the quality of the new procedures appears to be less accurate when using ranked weights, they provide a complete capability of dealing with arbitrary linear inequalities that signify possible imprecise information on weights, including mixtures of ordinal and bounded weights.

[1]  G. W. Fischer Range Sensitivity of Attribute Weights in Multiattribute Value Models , 1995 .

[2]  D. A. Seaver,et al.  A comparison of weight approximation techniques in multiattribute utility decision making , 1981 .

[3]  Ami Arbel,et al.  Approximate articulation of preference and priority derivation , 1989 .

[4]  David L. Olson,et al.  Comparison of centroid and simulation approaches for selection sensitivity analysis , 1999 .

[5]  D. Winterfeldt,et al.  The effect of varying value trees on multiattribute evaluations , 1988 .

[6]  Andrew P. Sage,et al.  ARIADNE: A knowledge-based interactive system for planning and decision support , 1984, IEEE Transactions on Systems, Man, and Cybernetics.

[7]  Chang Hee Han,et al.  Multi-attribute decision aid under incomplete information and hierarchical structure , 2000, Eur. J. Oper. Res..

[8]  Ralph L. Keeney,et al.  Decisions with multiple objectives: preferences and value tradeoffs , 1976 .

[9]  C. Kirkwood,et al.  The Effectiveness of Partial Information about Attribute Weights for Ranking Alternatives in Multiattribute Decision Making , 1993 .

[10]  Jean Pierre Brans,et al.  A PREFERENCE RANKING ORGANIZATION METHOD , 1985 .

[11]  Z. Kmietowicz,et al.  Decision theory, linear partial information and statistical dominance , 1984 .

[12]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[13]  James S. Dyer,et al.  Attribute weighting methods and decision quality in the presence of response error: A simulation study , 1998 .

[14]  W. Edwards,et al.  Decision Analysis and Behavioral Research , 1986 .

[15]  Behnam Malakooti,et al.  Ranking and screening multiple criteria alternatives with partial information and use of ordinal and cardinal strength of preferences , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[16]  David J. Weiss,et al.  SMARTS and SMARTER: Improved Simple Methods for Multiattribute Utility Measurement , 2008 .

[17]  B. Roy The outranking approach and the foundations of electre methods , 1991 .

[18]  C. C. Waid,et al.  An Experimental Comparison of Different Approaches to Determining Weights in Additive Utility Models , 1982 .

[19]  D. Brinberg,et al.  Assessing attribute importance: a comparison of six methods , 1986 .

[20]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[21]  K. S. Park,et al.  Mathematical programming models for characterizing dominance and potential optimality when multicriteria alternative values and weights are simultaneously incomplete , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[22]  B. Roy THE OUTRANKING APPROACH AND THE FOUNDATIONS OF ELECTRE METHODS , 1991 .

[23]  J. Puertoa,et al.  Decision criteria with partial information , 2000 .

[24]  J. Dombi,et al.  A method for determining the weights of criteria: the centralized weights , 1986 .

[25]  Martin Weber Decision Making with Incomplete Information , 1987 .

[26]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[27]  Bruce E. Barrett,et al.  Decision quality using ranked attribute weights , 1996 .

[28]  A. M. Mármol,et al.  The use of partial information on weights in multicriteria decision problems , 1998 .

[29]  R. L. Winkler,et al.  Statistics : Probability, Inference and Decision , 1975 .

[30]  Rakesh K. Sarin,et al.  Ranking with Partial Information: A Method and an Application , 1985, Oper. Res..

[31]  Byeong Seok Ahn,et al.  Extending Malakooti's model for ranking multicriteria alternatives with preference strength and partial information , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[32]  Raimo P. Hämäläinen,et al.  Preference ratios in multiattribute evaluation (PRIME)-elicitation and decision procedures under incomplete information , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[33]  P. Vincke,et al.  Note-A Preference Ranking Organisation Method: The PROMETHEE Method for Multiple Criteria Decision-Making , 1985 .

[34]  P. Fishburn Analysis of Decisions with Incomplete Knowledge of Probabilities , 1965 .