An Experiment on the Numerical Modelling of Verbal Ratio Statements

Verbal statements are intuitively attractive for preference elicitation. In the analytic hierarchy process (AHP) the verbal responses to pairwise comparisons of relative importance are converted into real numbers according to the nine-point integer scale. Several alternative scales have been proposed for the conversion, but sufficient empirical evidence has not been produced to support the choice among these scales. We performed a comparative study in which subjects were requested to quantify verbal ratio statements by adjusting the heights of visually displayed bars. Subjects were also asked to employ verbal expressions in pairwise comparisons of areas of figures with different shapes. The principal result of the experiment was that the perceived meaning of the verbal expressions varies from one subject to the next and also depends on the set of elements involved in the comparison. Our results indicate that there are alternative numerical scales which yield more accurate estimates than the usual 1-to-9 scale and reduce the inconsistency of the comparison matrices. Alternative ways of using verbal preference statements are suggested to overcome the difficulties that arise from the context dependence of verbal pairwise comparisons. © 1997 John Wiley & Sons, Ltd.

[1]  Ruth Beyth-Marom,et al.  How probable is probable? A numerical translation of verbal probability expressions , 1982 .

[2]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[3]  R. Palmer,et al.  Subjective evaluation: linguistic scales in pairwise comparison methods , 1986 .

[4]  W. Edwards,et al.  Decision Analysis and Behavioral Research , 1986 .

[5]  V. Belton A comparison of the analytic hierarchy process and a simple multi-attribute value function , 1986 .

[6]  William C. Wedley,et al.  Alternative Scales in AHP , 1989 .

[7]  T. Saaty Eigenvector and logarithmic least squares , 1990 .

[8]  R. D. Holder,et al.  Some Comments on the Analytic Hierarchy Process , 1990 .

[9]  T. Saaty How to Make a Decision: The Analytic Hierarchy Process , 1990 .

[10]  Thomas L. Saaty,et al.  Response to Holder's Comments on the Analytic Hierarchy Process , 1991 .

[11]  Robert M. Hamm,et al.  Selection of verbal probabilities: A solution for some problems of verbal probability expression. , 1991 .

[12]  Raimo P. Hämäläinen,et al.  Processing interval judgments in the analytic hierarchy process , 1992 .

[13]  T. Stewart A CRITICAL SURVEY ON THE STATUS OF MULTIPLE CRITERIA DECISION MAKING THEORY AND PRACTICE , 1992 .

[14]  A. Tversky,et al.  Context-dependent preferences , 1993 .

[15]  Ahti Salo Inconsistency analysis by approximately specified priorities , 1993 .

[16]  Martin Weber,et al.  Behavioral influences on weight judgments in multiattribute decision making , 1993 .

[17]  Thomas L. Saaty How to Make a Decision: The Analytic Hierarchy Process , 1994 .

[18]  D. Timmermans,et al.  The Roles of Experience and Domain of Expertise in Using Numerical and Verbal Probability Terms in Medical Decisions , 1994, Medical decision making : an international journal of the Society for Medical Decision Making.

[19]  R. Hämäläinen,et al.  Decision analysis interviews in environmental impact assessment , 1995 .

[20]  Raimo P. Hämäläinen,et al.  Decision analysis interviews in environmental impact assessment , 1995 .

[21]  R. Hämäläinen,et al.  Preference programming through approximate ratio comparisons , 1995 .

[22]  R. Hämäläinen,et al.  On the measurement of preferences in the analytic hierarchy process , 1997 .