Toward Reliability in the MCDA Rankings: Comparison of Distance-Based Methods

The decision-making process is a difficult problem, requiring the decision maker to consider the pros and cons of given options. Systems based on multi-criteria methods are increasingly used to support this. However, their number affects the difficulty of determining which of them is the right choice for a given problem and whether they guarantee similar results. In this paper, the three selected multi-critieria decision analysis (MCDA) methods were used to provide preferences values for alternatives. Decision matrix was created using different number of alternatives and criteria to check the impact of this change to final results. Three rankings were then subjected to two correlation coefficients. It shows that obtained rankings are highly similar, and greater amount of alternatives and criteria have a positive impact on received similarity.

[1]  K. M. Hyde,et al.  A distance-based uncertainty analysis approach to multi-criteria decision analysis for water resource decision making. , 2005, Journal of environmental management.

[2]  Wojciech Salabun,et al.  How the normalization of the decision matrix influences the results in the VIKOR method? , 2020, KES.

[3]  Jarosław Wątróbski,et al.  Guideline for MCDA Method Selection in Production Management Area , 2016 .

[4]  Wojciech Salabun,et al.  A comparative case study of the VIKOR and TOPSIS rankings similarity , 2020, KES.

[5]  Jean Dezert,et al.  The SPOTIS Rank Reversal Free Method for Multi-Criteria Decision-Making Support , 2020, 2020 IEEE 23rd International Conference on Information Fusion (FUSION).

[6]  Morteza Yazdani,et al.  A state-of the-art survey of TOPSIS applications , 2012, Expert Syst. Appl..

[7]  Bartłomiej Kizielewicz,et al.  Identification of Relevant Criteria Set in the MCDA Process—Wind Farm Location Case Study , 2020, Energies.

[8]  Riccardo Dulmin,et al.  Supplier selection using a multi-criteria decision aid method , 2003 .

[9]  Holger R. Maier,et al.  Distance-based and stochastic uncertainty analysis for multi-criteria decision analysis in Excel using Visual Basic for Applications , 2006, Environ. Model. Softw..

[10]  Wojciech Salabun,et al.  The Temporal Supplier Evaluation Model Based on Multicriteria Decision Analysis Methods , 2017, ACIIDS.

[11]  Jakub Wieckowski,et al.  Swimming progression evaluation by assessment model based on the COMET method , 2020, KES.

[12]  Andrzej Piegat,et al.  Comparative analysis of MCDM methods for the assessment of mortality in patients with acute coronary syndrome , 2016, Artificial Intelligence Review.

[13]  Wojciech Sałabun,et al.  Multicriteria Approach to Sustainable Transport Evaluation under Incomplete Knowledge: Electric Bikes Case Study , 2019, Sustainability.

[14]  Gary Klein,et al.  Naturalistic Decision Making , 2008, Hum. Factors.

[15]  Andrea De Montis,et al.  Assessing the quality of different MCDA methods , 2004 .

[16]  Didar Zowghi,et al.  Utilizing TOPSIS: A Multi Criteria Decision Analysis Technique for Non-Functional Requirements Conflicts , 2014, APRES.

[17]  Thomas L. Saaty,et al.  DECISION MAKING WITH THE ANALYTIC HIERARCHY PROCESS , 2008 .

[18]  Plácido Rogério Pinheiro,et al.  Comparison of Two MCDA Classification Methods over the Diagnosis of Alzheimer's Disease , 2009, RSKT.

[19]  Jaroslaw Jankowski,et al.  Knowledge management in MCDA domain , 2015, 2015 Federated Conference on Computer Science and Information Systems (FedCSIS).

[20]  Ting-Yu Chen.  A signed-distance-based approach to importance assessment and multi-criteria group decision analysis based on interval type-2 fuzzy set , 2012, Knowledge and Information Systems.

[21]  David Bamford,et al.  Development, test and comparison of two Multiple Criteria Decision Analysis (MCDA) models: A case of healthcare infrastructure location , 2015, Expert Syst. Appl..

[22]  Bartlomiej Kizielewicz,et al.  Effects of the selection of characteristic values on the accuracy of results in the COMET method , 2020, KES.

[23]  Wojciech Sałabun,et al.  Efficiency of Methods for Determining the Relevance of Criteria in Sustainable Transport Problems: A Comparative Case Study , 2020, Sustainability.

[24]  Wojciech Salabun,et al.  A New Approach to Identifying a Multi-Criteria Decision Model Based on Stochastic Optimization Techniques , 2020, Symmetry.

[25]  Jarosław Wątróbski,et al.  The Rank Reversals Paradox in Management Decisions: The Comparison of the AHP and COMET Methods , 2016, KES-IDT.

[26]  Artur Karczmarczyk,et al.  MCDA-Based Approach to Sustainable Supplier Selection , 2018, 2018 Federated Conference on Computer Science and Information Systems (FedCSIS).

[27]  Artur Karczmarczyk,et al.  Generalised framework for multi-criteria method selection , 2018, Omega.

[28]  Wojciech Salabun,et al.  Are MCDA Methods Benchmarkable? A Comparative Study of TOPSIS, VIKOR, COPRAS, and PROMETHEE II Methods , 2020, Symmetry.

[29]  Wojciech Sałabun,et al.  The Characteristic Objects Method: A New Distance‐based Approach to Multicriteria Decision‐making Problems , 2015 .

[30]  Jarosław Wątróbski,et al.  Multistage Performance Modelling in Digital Marketing Management , 2016 .

[31]  Igor Linkov,et al.  Decision Support Systems and Environment: Role of MCDA , 2009 .

[32]  Wojciech Sałabun,et al.  Green Supplier Selection Framework Based on Multi-Criteria Decision-Analysis Approach , 2016 .

[33]  M. Bazerman.  Judgment in Managerial Decision Making , 1990 .

[34]  Gwo-Hshiung Tzeng,et al.  Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS , 2004, Eur. J. Oper. Res..