Rank aggregation methods dealing with ordinal uncertain preferences

A two-step rank aggregation model for interval ordinal rankings is proposed.A matrix retrieving dominance possibilities is built from uncertain data.Priority vectors are derived from the dominance aggregate matrix.The model can manage uncertain and incomplete rank information with ties.Computational methods are proposed to solve the optimization problems. The problem of rank aggregation, also known as group-ranking, arises in many fields such as metasearch engines, information retrieval, recommendation systems and multicriteria decision-making. Given a set of alternatives, the problem is to order the alternatives based on ordinal rankings provided by a group of individual experts. The available information is often limited and uncertain in real-world applications. This paper addresses the general group-ranking problem using interval ordinal data as a flexible way to capture uncertain and incomplete information. We propose a two-stage approach. The first stage learns an aggregate preference matrix as a means of gathering group preferences from uncertain and possibly conflicting information. In the second stage, priority vectors are derived from the aggregate preference matrix based on properties of fuzzy preference relations and graph theory. Our approach provides a theoretical framework for studying the problem that extends some of the methods in the literature, efficient computational methods to solve the problem and some performance measures. It relaxes data certainty and completeness assumptions and overcomes some shortcomings of current group-ranking methods.

[1]  G. Munda “Measuring Sustainability”: A Multi-Criterion Framework , 2005 .

[2]  Esther Dopazo,et al.  A parametric GP model dealing with incomplete information for group decision-making , 2011, Appl. Math. Comput..

[3]  Yang Liu,et al.  An Approach to Solve Group-Decision-Making Problems With Ordinal Interval Numbers , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Jian-Bo Yang,et al.  A preference aggregation method through the estimation of utility intervals , 2005, Comput. Oper. Res..

[5]  Ronald Fagin,et al.  Comparing and aggregating rankings with ties , 2004, PODS '04.

[6]  T. Tanino Fuzzy preference orderings in group decision making , 1984 .

[7]  Qi Yue,et al.  An approach to group decision-making with uncertain preference ordinals , 2010, Comput. Ind. Eng..

[8]  Francisco Herrera,et al.  Some issues on consistency of fuzzy preference relations , 2004, Eur. J. Oper. Res..

[9]  Mohamed Farah,et al.  An outranking approach for rank aggregation in information retrieval , 2007, SIGIR.

[10]  L. Seiford,et al.  Priority Ranking and Consensus Formation , 1978 .

[11]  James P. Keener,et al.  The Perron-Frobenius Theorem and the Ranking of Football Teams , 1993, SIAM Rev..

[12]  T. Saaty How to Make a Decision: The Analytic Hierarchy Process , 1990 .

[13]  Jacinto González-Pachón,et al.  Aggregation of partial ordinal rankings: an interval goal programming approach , 2001, Comput. Oper. Res..

[14]  Francisco Herrera,et al.  Cardinal Consistency of Reciprocal Preference Relations: A Characterization of Multiplicative Transitivity , 2009, IEEE Transactions on Fuzzy Systems.

[15]  Esther Dopazo,et al.  Rank aggregation methods dealing with incomplete information applied to Smart Cities , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[16]  G. Watson Approximation theory and numerical methods , 1980 .

[17]  Umberto Straccia,et al.  Web metasearch: rank vs. score based rank aggregation methods , 2003, SAC '03.

[18]  Moni Naor,et al.  Rank aggregation methods for the Web , 2001, WWW '01.

[19]  Pabitra Mitra,et al.  Preference relations based unsupervised rank aggregation for metasearch , 2016, Expert Syst. Appl..

[20]  C. D. Meyer,et al.  Who's #1?: The Science of Rating and Ranking , 2012 .

[21]  Francisco Chiclana,et al.  A social network analysis trust-consensus based approach to group decision-making problems with interval-valued fuzzy reciprocal preference relations , 2014, Knowl. Based Syst..

[22]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.