Using Ordinal Data to Estimate Cardinal Values

We investigate methods developed in multiple criteria decision-making that use ordinal information to estimate numerical values. Such methods can be used to estimate attribute weights, attribute values, or event probabilities given ranks or partial ranks. We first review related studies and then develop a generalized rank-sum (GRS) approach in which we provide a derivation of the rank-sum approach that had been previously proposed. The GRS approach allows for incorporating the concept of degree of importance (or, difference in likelihood with respect to probabilities and difference in value for attribute values), information that most other rank-based formulas do not utilize. We then present simulation results comparing the GRS method with other rank-based formulas such as the rank order centroid method and comparing the GRS methods using as many as three levels of importance (i.e., GRS-3) with Simos' procedure (which can also incorporate degree of importance). To our surprise, our results show that the incorporation of additional information (i.e., the degree of the importance), both GRS-3 and Simos' procedure, did not result in better performance than rank order centroid or GRS. Further research is needed to investigate the modelling of such extra information. We also explore the scenario when a decision-maker has indifference judgments and cannot provide a complete rank order. Copyright © 2014 John Wiley & Sons, Ltd.

[1]  D. A. Seaver,et al.  A comparison of weight approximation techniques in multiattribute utility decision making , 1981 .

[2]  R. Y. Rubinstein Generating random vectors uniformly distributed inside and on the surface of different regions , 1982 .

[3]  Robert T. Clemen,et al.  Subjective Probability Assessment in Decision Analysis: Partition Dependence and Bias Toward the Ignorance Prior , 2005, Manag. Sci..

[4]  K. Steiglitz,et al.  Adaptive step size random search , 1968 .

[5]  Salvatore Greco,et al.  Ordinal regression revisited: Multiple criteria ranking using a set of additive value functions , 2008, Eur. J. Oper. Res..

[6]  Warren S. Torgerson,et al.  Distances and ratios in psychophysical scaling , 1961 .

[7]  J. Siskos Assessing a set of additive utility functions for multicriteria decision-making , 1982 .

[8]  Stanley Zionts,et al.  An improved method for solving multiple criteria problems involving discrete alternatives , 1984, IEEE Transactions on Systems, Man, and Cybernetics.

[9]  Theodor J. Stewart,et al.  Multiple Criteria Decision Analysis , 2001 .

[10]  Bruce E. Barrett,et al.  Decision quality using ranked attribute weights , 1996 .

[11]  José Rui Figueira,et al.  Building a set of additive value functions representing a reference preorder and intensities of preference: GRIP method , 2009, Eur. J. Oper. Res..

[12]  James S. Dyer,et al.  Attribute weighting methods and decision quality in the presence of response error: A simulation study , 1998 .

[13]  S. Zionts,et al.  An Interactive Multiple Objective Linear Programming Method for a Class of Underlying Nonlinear Utility Functions , 1983 .

[14]  E. Choo,et al.  Interpretation of criteria weights in multicriteria decision making , 1999 .

[15]  R. L. Winkler,et al.  Separating probability elicitation from utilities , 1988 .

[16]  L. J. Savage Elicitation of Personal Probabilities and Expectations , 1971 .

[17]  B. Roy,et al.  A Theoretical Framework for Analysing the Notion of Relative Importance of Criteria , 1996 .

[18]  Günther F. Schrack,et al.  Optimized relative step size random searches , 1976, Math. Program..

[19]  David L. Olson,et al.  Comparison of centroid and simulation approaches for selection sensitivity analysis , 1999 .

[20]  Bernard Roy,et al.  Determining the weights of criteria in the ELECTRE type methods with a revised Simos' procedure , 2002, Eur. J. Oper. Res..

[21]  Edi Karni,et al.  A Mechanism for Eliciting Probabilities , 2009 .

[22]  Byeong Seok Ahn,et al.  Comparing methods for multiattribute decision making with ordinal weights , 2008, Comput. Oper. Res..

[23]  John C. Butler,et al.  Simulation techniques for the sensitivity analysis of multi-criteria decision models , 1997 .

[24]  J. Dombi,et al.  A method for determining the weights of criteria: the centralized weights , 1986 .