Exploring Multicriteria Elicitation Model Based on Pairwise Comparisons: Building an Interactive Preference Adjustment Algorithm

Pairwise comparisons have been applied to several real decision making problems. As a result, this method has been recognized as an effective decision making tool by practitioners, experts, and researchers. Although methods based on pairwise comparisons are widespread, decision making problems with many alternatives and criteria may be challenging. This paper presents the results of an experiment used to verify the influence of a high number of preferences comparisons in the inconsistency of the comparisons matrix and identifies the influence of consistencies and inconsistencies in the assessment of the decision-making process. The findings indicate that it is difficult to predict the influence of inconsistencies and that the priority vector may or may not be influenced by low levels of inconsistencies, with a consistency ratio of less than 0.1. Finally, this work presents an interactive preference adjustment algorithm with the aim of reducing the number of pairwise comparisons while capturing effective information from the decision maker to approximate the results of the problem to their preferences. The presented approach ensures the consistency of a comparisons matrix and significantly reduces the time that decision makers need to devote to the pairwise comparisons process. An example application of the interactive preference adjustment algorithm is included.

[1]  P. Harker.  Incomplete pairwise comparisons in the analytic hierarchy process , 1987 .

[2]  T. L. Saaty.  A Scaling Method for Priorities in Hierarchical Structures , 1977 .

[3]  Rafikul Islam,et al.  Deriving weights from pairwise comparison matrices by goal programming , 1996 .

[4]  Sándor Bozóki,et al.  Analysis of pairwise comparison matrices: an empirical research , 2013, Ann. Oper. Res..

[5]  Gang Kou,et al.  An improved statistical approach for consistency test in AHP , 2013, Ann. Oper. Res..

[6]  Matthias Ehrgott,et al.  Multiple criteria decision analysis: state of the art surveys , 2005 .

[7]  Waldemar W. Koczkodaj,et al.  Consistency-Driven Pairwise Comparisons Approach to Software Product Management and Quality Measurement , 2018, DepCoS-RELCOMEX.

[8]  Waldemar W. Koczkodaj,et al.  An LP-based inconsistency monitoring of pairwise comparison matrices , 2011, Math. Comput. Model..

[9]  Carlos A. Bana e Costa,et al.  A critical analysis of the eigenvalue method used to derive priorities in AHP , 2008, Eur. J. Oper. Res..

[10]  Waldemar W. Koczkodaj,et al.  Using consistency-driven pairwise comparisons in knowledge-based systems , 1997, CIKM '97.

[11]  Hendry Raharjo,et al.  Evaluating Relationship of Consistency Ratio and Number of Alternatives on Rank Reversal in the AHP , 2006 .

[12]  Raymond R. Tan,et al.  A methodology for augmenting sparse pairwise comparison matrices in AHP: applications to energy systems , 2013, Clean Technologies and Environmental Policy.

[13]  W. W. Koczkodaj.  A new definition of consistency of pairwise comparisons , 1993 .

[14]  Joaquín Izquierdo,et al.  A simple formula to find the closest consistent matrix to a reciprocal matrix , 2014 .

[15]  Gang Kou,et al.  Questionnaire design improvement and missing item scores estimation for rapid and efficient decision making , 2012, Ann. Oper. Res..

[16]  D. Winterfeldt,et al.  Cognitive and Motivational Biases in Decision and Risk Analysis , 2015, Risk analysis : an official publication of the Society for Risk Analysis.

[17]  H. A. Donegan,et al.  A New Approach to Ahp Decision‐Making , 1992 .

[18]  T. Saaty.  How to Make a Decision: The Analytic Hierarchy Process , 1990 .

[19]  Klaus D. Goepel,et al.  Comparison of Judgment Scales of the Analytical Hierarchy Process - A New Approach , 2019, Int. J. Inf. Technol. Decis. Mak..

[20]  Jacinto González-Pachón,et al.  Consistency-driven approximation of a pairwise comparison matrix , 2003, Kybernetika.

[21]  R. J. Hill.  A Note on Inconsistency in Paired Comparison Judgments , 1953 .

[22]  N. Pankratova,et al.  OF EVALUATION AND IMPROVEMENT OF CONSISTENCY OF EXPERT PAIRWISE COMPARISON JUDGMENTS , 2015 .

[23]  Shi-Woei Lin,et al.  Characterizing Disagreement and Inconsistency in Experts'' Judgments in the Analytic Hierarchy Process , 2011 .

[24]  Joaquín Izquierdo,et al.  Improving consistency in AHP decision-making processes , 2012, Appl. Math. Comput..

[25]  Xia Cui,et al.  Judgment Number Reduction: an Issue in the Analytic Hierarchy Process , 2010, Int. J. Inf. Technol. Decis. Mak..

[26]  Joaquín Izquierdo,et al.  Balancing consistency and expert judgment in AHP , 2011, Math. Comput. Model..

[27]  Thomas L. Saaty,et al.  THE ANALYTIC HIERARCHY PROCESS IN CONFLICT MANAGEMENT , 1990 .

[28]  Julien Reichert.  On the Complexity of Counter Reachability Games , 2013, RP.

[29]  Jacek Szybowski,et al.  The limit of inconsistency reduction in pairwise comparisons , 2016, Int. J. Appl. Math. Comput. Sci..

[30]  Miroslaw Kwiesielewicz,et al.  Inconsistent and contradictory judgements in pairwise comparison method in the AHP , 2004, Comput. Oper. Res..

[31]  Fang Liu,et al.  Consistency analysis of triangular fuzzy reciprocal preference relations , 2014, Eur. J. Oper. Res..

[32]  H. Hou,et al.  What influence domestic and overseas developers’ decisions? , 2019, Journal of Property Investment & Finance.

[33]  Ralph L. Keeney,et al.  Common Mistakes in Making Value Trade-Offs , 2002, Oper. Res..

[34]  Jibin Lan,et al.  New parametric prioritization methods for an analytical hierarchy process based on a pairwise comparison matrix , 2011, Math. Comput. Model..

[35]  Ralph L. Keeney,et al.  Value-Focused Thinking: A Path to Creative Decisionmaking , 1992 .

[36]  Xuanming Su.  Bounded Rationality in Newsvendor Models , 2007 .

[37]  Ralph L. Keeney,et al.  Decisions with multiple objectives: preferences and value tradeoffs , 1976 .

[38]  Yejun Xu,et al.  Eigenvector method, consistency test and inconsistency repairing for an incomplete fuzzy preference relation , 2013 .

[39]  Wolfgang Gaul,et al.  A note on consistency improvements of AHP paired comparison data , 2012, Adv. Data Anal. Classif..

[40]  Valerie Belton,et al.  Structuring problems for Multi-Criteria Decision Analysis in practice: A literature review of method combinations , 2017, Eur. J. Oper. Res..

[41]  Tamás Rapcsák,et al.  On Saaty’s and Koczkodaj’s inconsistencies of pairwise comparison matrices , 2008, J. Glob. Optim..

[42]  Ryszard Janicki,et al.  A weak order solution to a group ranking and consistency-driven pairwise comparisons , 1998, Appl. Math. Comput..

[43]  Ana Paula Cabral Seixas Costa,et al.  A new method for elicitation of criteria weights in additive models: Flexible and interactive tradeoff , 2016, Eur. J. Oper. Res..

[44]  Thomas L. Saaty,et al.  On the measurement of intengibles. a principal Eigenvector approach to relative measurement derived from paired comparisons , 2013 .

[45]  Jacek Szybowski,et al.  Pairwise comparisons simplified , 2013, Appl. Math. Comput..

[46]  David J. Weiss,et al.  SMARTS and SMARTER: Improved Simple Methods for Multiattribute Utility Measurement , 2008 .

[47]  Ward Edwards,et al.  How to Use Multiattribute Utility Measurement for Social Decisionmaking , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[48]  Sylvain Kubler,et al.  Measuring inconsistency and deriving priorities from fuzzy pairwise comparison matrices using the knowledge-based consistency index , 2018, Knowl. Based Syst..

[49]  B. Golany,et al.  A multicriteria evaluation of methods for obtaining weights from ratio-scale matrices , 1993 .

[50]  Ron Vreeker,et al.  Selecting an Appropriate Multi-Criteria Decision Analysis Technique for Renewable Energy Planning , 2006 .

[51]  Z. S. Xu,et al.  Goal programming models for obtaining the priority vector of incomplete fuzzy preference relation , 2004, Int. J. Approx. Reason..

[52]  Michele Fedrizzi,et al.  A note on the proportionality between some consistency indices in the AHP , 2012, Appl. Math. Comput..

[53]  Kevin Kam Fung Yuen,et al.  Important Facts and Observations about Pairwise Comparisons (the special issue edition) , 2016, Fundam. Informaticae.

[54]  Joaquín Izquierdo,et al.  Achieving matrix consistency in AHP through linearization , 2011 .

[55]  Achmad Farid Wadjdi,et al.  Design of Data Collection Form to Ensure Consistency in AHP , 2018, 2018 10th International Conference on Information Technology and Electrical Engineering (ICITEE).

[56]  R. Hämäläinen,et al.  On the measurement of preferences in the analytic hierarchy process , 1997 .

[57]  Michele Fedrizzi,et al.  Inconsistency indices for pairwise comparison matrices: a numerical study , 2013, Annals of Operations Research.

[58]  Konrad Kulakowski,et al.  On the quality evaluation of scientific entities in Poland supported by consistency-driven pairwise comparisons method , 2014, Scientometrics.

[59]  Matteo Brunelli,et al.  A note on the article "Inconsistency of pair-wise comparison matrix with fuzzy elements based on geometric mean" [Fuzzy Sets and Systems 161 (2010) 1604-1613] , 2011, Fuzzy Sets Syst..

[60]  F. Lootsma.  SCALE SENSITIVITY IN THE MULTIPLICATIVE AHP AND SMART , 1993 .

[61]  Okan Duru,et al.  Use of consistency index, expert prioritization and direct numerical inputs for generic fuzzy-AHP modeling: A process model for shipping asset management , 2012, Expert Syst. Appl..

[62]  Francisco Herrera,et al.  Some issues on consistency of fuzzy preference relations , 2004, Eur. J. Oper. Res..

[63]  Jaroslav Ramík,et al.  Inconsistency of pair-wise comparison matrix with fuzzy elements based on geometric mean , 2010, Fuzzy Sets Syst..

[64]  Zeshui Xu,et al.  Interval weight generation approaches for reciprocal relations , 2014 .

[65]  Ashkan Negahban,et al.  Optimizing consistency improvement of positive reciprocal matrices with implications for Monte Carlo Analytic Hierarchy Process , 2018, Comput. Ind. Eng..

[66]  Elliott N. Weiss,et al.  AHP DESIGN ISSUES FOR LARGE-SCALE SYSTEMS , 1987 .

[67]  W. W. Koczkodaj,et al.  APL2 implementation of a new definition of consistency of pairwise comparisons , 1994, APLQ.