Judgmental consistency and consensus in stochastic multicriteria decision making

Stochastic multicriteria decision making methods are a class of multicriteria decision making methods in which judgments are not taken to be certain. Recently, this class of models has generated increasing interest in the literature. We unify the notions of judgmental consistency and intra-group consensus under a framework of preference homogeneity in the context of this class of models. We propose new methods and measures for examining departures from consistency by using the Kullback-Leibler divergence. We also propose a new method, the jackknifed Kullback-Leibler divergence, that characterizes the extent to which a group member exhibits preference consensus with the remaining members of the group.

[1]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[2]  J. Borak,et al.  Errors of intuitive logic among physicians. , 1982, Social science & medicine.

[3]  F. Lootsma A model for the relative importance of the criteria in the Multiplicative AHP and SMART , 1996 .

[4]  Nader Ebrahimi,et al.  INFORMATION FUNCTIONS FOR RELIABILITY , 2004 .

[5]  R. C. Van den Honert,et al.  Stochastic group preference modelling in the multiplicative AHP: A model of group consensus , 1998, Eur. J. Oper. Res..

[6]  Holger R. Maier,et al.  Incorporating uncertainty in the PROMETHEE MCDA method , 2003 .

[7]  Fang Yu,et al.  Lay Rationalism and Inconsistency between Predicted Experience and Decision , 2003 .

[8]  Simon French,et al.  Consensus of opinion , 1981 .

[9]  Gregory G. Dess Consensus on strategy formulation and organizational performance: Competitors in a fragmented industry , 1987 .

[10]  I. J. Myung,et al.  Maximum Entropy Aggregation of Expert Predictions , 1996 .

[11]  Refik Soyer,et al.  Information Concepts and Pairwise Comparison Matrices , 1998, Inf. Process. Lett..

[12]  Information and the Likelihood Function in Exponential Families , 1988 .

[13]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[14]  A. Tversky,et al.  Prospect Theory : An Analysis of Decision under Risk Author ( s ) : , 2007 .

[15]  David B. Paradice,et al.  The Effects of Integrating Cognitive Feedback and Multi-attribute Utility-Based Multicriteria Decision-Making Methods in GDSS , 1999 .

[16]  Seung-Jun Kwak,et al.  Applying Multi-attribute Utility Theory to Decision Making in Environmental Planning: A Case Study of the Electric Utility in Korea , 1998 .

[17]  Warren R. Hughes A Note on Consistency in Utility Assessment , 1990 .

[18]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[19]  Theodor J. Stewart,et al.  Multiple Criteria Decision Analysis , 2001 .

[20]  Michael A. West,et al.  Chief executive leadership style, consensus decision making, and top management team effectiveness , 2000 .

[21]  Z. Q. Lu Statistical Inference Based on Divergence Measures , 2007 .

[22]  Stanislav Karapetrovic,et al.  A quality control approach to consistency paradoxes in AHP , 1999, Eur. J. Oper. Res..

[23]  A. Brix Bayesian Data Analysis, 2nd edn , 2005 .

[24]  Risto Lahdelma,et al.  Two ways to handle dependent uncertainties in multi-criteria decision problems , 2009 .

[25]  Karl H. Vesper,et al.  Allocation of Importance in a Hierarchial Goal Structure , 1973 .

[26]  Raimo P. Hämäläinen,et al.  Analyzing AHP-matrices by regression , 2003, Eur. J. Oper. Res..

[27]  D. Winterfeldt,et al.  Comparison of weighting judgments in multiattribute utility measurement , 1991 .

[28]  M. H. Quenouille NOTES ON BIAS IN ESTIMATION , 1956 .

[29]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[30]  Elizabeth E. Noble,et al.  A note on the information content of a consistent pairwise comparison judgment matrix of an AHP decision maker , 1993 .

[31]  Solomon Kullback,et al.  Information Theory and Statistics , 1970, The Mathematical Gazette.

[32]  Eugene D. Hahn Link function selection in stochastic multicriteria decision making models , 2006, Eur. J. Oper. Res..

[33]  N. Harvey,et al.  Combining Advice: The Weight of a Dissenting Opinion in the Consensus , 2004 .

[34]  R. Cooke Experts in Uncertainty: Opinion and Subjective Probability in Science , 1991 .

[35]  Sevgi Erdogan,et al.  An experiment on the consistency of aggregated comparison matrices in AHP , 2006, Eur. J. Oper. Res..

[36]  Matthias Ehrgott,et al.  Multiple criteria decision analysis: state of the art surveys , 2005 .

[37]  Indrani Basak,et al.  On the use of information criteria in analytic hierarchy process , 2002, Eur. J. Oper. Res..

[38]  Berndt Brehmer,et al.  Response consistency in probabilistic inference tasks , 1978 .

[39]  David Lindley,et al.  Improving judgment by reconciling incoherence , 1982 .

[40]  P. Schoemaker,et al.  Probability Versus Certainty Equivalence Methods in Utility Measurement: Are they Equivalent? , 1985 .

[41]  Thomas A. Mazzuchi,et al.  Mathematical reliability :: an expository perspective , 2004 .

[42]  Jason R. W. Merrick,et al.  Analysis of Correlated Expert Judgments from Extended Pairwise Comparisons , 2005, Decis. Anal..

[43]  Spyros Makridakis,et al.  The Value of Decision Making in a Complex Environment: An Experimental Approach , 1981 .

[44]  Eugene D. Hahn Re‐examining informative prior elicitation through the lens of Markov chain Monte Carlo methods , 2006 .

[45]  David L. Olson,et al.  Consistency and Accuracy in Decision Aids: Experiments with Four Multiattribute Systems* , 1995 .

[46]  Guisseppi A. Forgionne,et al.  A multiple-criteria framework for evaluation of decision support systems , 2004 .

[47]  Eugene D. Hahn Decision Making with Uncertain Judgments: A Stochastic Formulation of the Analytic Hierarchy Process , 2003, Decis. Sci..

[48]  R. Hogarth,et al.  BEHAVIORAL DECISION THEORY: PROCESSES OF JUDGMENT AND CHOICE , 1981 .