Ensemble ranking: Aggregation of rankings produced by different multi-criteria decision-making methods

One of the essential problems in multi-criteria decision-making (MCDM) is ranking a set of alternatives based on a set of criteria. In this regard, there exist several MCDM methods which rank the alternatives in different ways. As such, it would be worthwhile to try and arrive at a consensus on this important subject. In this paper, a new approach is proposed based on the half-quadratic (HQ) theory. The proposed approach determines an optimal weight for each of the MCDM ranking methods, which are used to compute the aggregated final ranking. The weight of each ranking method is obtained via a minimizer function that is inspired by the HQ theory, which automatically fulfills the basic constraints of weights in MCDM. The proposed framework also provides a consensus index and a trust level for the aggregated ranking. To illustrate the proposed approach, the evaluation and comparison of ontology alignment systems are modeled as an MCDM problem and the proposed framework is applied to the ontology alignment evaluation initiative (OAEI) 2018, for which the ranking of participating systems is of the utmost importance.

[1]  Wei Zhang,et al.  A unified framework for M-estimation based robust Kalman smoothing , 2019, Signal Process..

[2]  Ran He,et al.  Two-Stage Nonnegative Sparse Representation for Large-Scale Face Recognition , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Evangelos Triantaphyllou,et al.  Multi-Criteria Decision Making Methods , 2000 .

[4]  Yao-Hua Tan,et al.  Robust group fused lasso for multisample copy number variation detection under uncertainty. , 2016, IET systems biology.

[5]  Kannan Govindan,et al.  Application of a novel PROMETHEE-based method for construction of a group compromise ranking to prioritization of green suppliers in food supply chain , 2017 .

[6]  Raimo P. Hämäläinen,et al.  Decision Support by Interval SMART/SWING - Incorporating Imprecision in the SMART and SWING Methods , 2005, Decis. Sci..

[7]  Donald Geman,et al.  Nonlinear image recovery with half-quadratic regularization , 1995, IEEE Trans. Image Process..

[8]  Vicente Liern,et al.  A VIKOR-based approach for the ranking of mathematical instructional videos , 2019, Management Decision.

[9]  Seyed Amin Seyed Haeri,et al.  Airports evaluation and ranking model using Taguchi loss function, best-worst method and VIKOR technique , 2017 .

[10]  Honggang Wang,et al.  User preferences based software defect detection algorithms selection using MCDM , 2012, Inf. Sci..

[11]  Majid Mohammadi,et al.  Simulated Annealing-based Ontology Matching , 2019, ACM Trans. Manag. Inf. Syst..

[12]  Ana Paula Cabral Seixas Costa,et al.  Improving decision-making and management of hospital resources: An application of the PROMETHEE II method in an Emergency Department , 2014 .

[13]  Ta-Chung Chu,et al.  Facility Location Selection Using Fuzzy TOPSIS Under Group Decisions , 2002, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[14]  Giovanna Guerrini,et al.  A Multi-strategy Approach for Detecting and Correcting Conservativity Principle Violations in Ontology Alignments , 2014, OWLED.

[15]  Yi Peng,et al.  FAMCDM: A fusion approach of MCDM methods to rank multiclass classification algorithms , 2011 .

[16]  J. Euzenat,et al.  Ontology Matching , 2007, Springer Berlin Heidelberg.

[17]  F. H. Barron,et al.  SMARTS and SMARTER: Improved Simple Methods for Multiattribute Utility Measurement , 1994 .

[18]  Mahmoud A. Abo-Sinna,et al.  Extensions of TOPSIS for multi-objective large-scale nonlinear programming problems , 2005, Appl. Math. Comput..

[19]  Hongbin Li,et al.  Maximum Correntropy Derivative-Free Robust Kalman Filter and Smoother , 2018, IEEE Access.

[20]  Yi Peng,et al.  Evaluation of clustering algorithms for financial risk analysis using MCDM methods , 2014, Inf. Sci..

[21]  Yi Peng,et al.  Evaluation of Classification Algorithms Using MCDM and Rank Correlation , 2012, Int. J. Inf. Technol. Decis. Mak..

[22]  Ching-Lai Hwang,et al.  Fuzzy Multiple Attribute Decision Making - Methods and Applications , 1992, Lecture Notes in Economics and Mathematical Systems.

[23]  Gwo-Hshiung Tzeng,et al.  Multicriteria Planning of Post‐Earthquake Sustainable Reconstruction , 2002 .

[24]  J. Rezaei.  Best-worst multi-criteria decision-making method , 2015 .

[25]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[26]  Hu-Chen Liu,et al.  Failure Mode and Effect Analysis Using Cloud Model Theory and PROMETHEE Method , 2017, IEEE Transactions on Reliability.

[27]  Thomas L. Saaty,et al.  Decision Making for Leaders: The Analytical Hierarchy Process for Decisions in a Complex World , 1982 .

[28]  Hu-Chen Liu,et al.  Improving Risk Evaluation in FMEA With Cloud Model and Hierarchical TOPSIS Method , 2019, IEEE Transactions on Fuzzy Systems.

[29]  Mila Nikolova,et al.  Analysis of Half-Quadratic Minimization Methods for Signal and Image Recovery , 2005, SIAM J. Sci. Comput..

[30]  Joseph Sarkis,et al.  Multicriteria Green Supplier Segmentation , 2017, IEEE Transactions on Engineering Management.

[31]  Giovanna Guerrini,et al.  Detecting and Correcting Conservativity Principle Violations in Ontology-to-Ontology Mappings , 2014, SEMWEB.

[32]  Selçuk Perçin,et al.  Evaluation of third‐party logistics (3PL) providers by using a two‐phase AHP and TOPSIS methodology , 2009 .

[33]  Mooyoung Jung,et al.  Satisfaction assessment of multi-objective schedules using neural fuzzy methodology , 2003 .

[34]  S. Mahadevan,et al.  A new method of identifying influential nodes in complex networks based on TOPSIS , 2014 .

[35]  Donald Geman,et al.  Constrained Restoration and the Recovery of Discontinuities , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Jonathan M. Lees,et al.  Robust estimation of background noise and signal detection in climatic time series , 1996 .

[37]  Banu Soylu.  Integrating Prometheeii with the Tchebycheff Function for Multi Criteria Decision Making , 2010, Int. J. Inf. Technol. Decis. Mak..

[38]  Tieniu Tan,et al.  Half-Quadratic-Based Iterative Minimization for Robust Sparse Representation , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Tieniu Tan,et al.  Robust Recovery of Corrupted Low-RankMatrix by Implicit Regularizers , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Zhenan Sun,et al.  Robust Subspace Clustering With Complex Noise , 2015, IEEE Transactions on Image Processing.

[41]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[42]  Gwo-Hshiung Tzeng,et al.  Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS , 2004, Eur. J. Oper. Res..

[43]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[44]  T. L. Saaty.  A Scaling Method for Priorities in Hierarchical Structures , 1977 .