Mining maximum consensus sequences from group ranking data

In the last decade, the problem of getting a consensus group ranking from all users' ranking data has received increased attention due to its widespread applications. Previous research solved this problem by consolidating the opinions of all users, thereby obtaining an ordering list of all items that represent the achieved consensus. The weakness of this approach, however, is that it always produces a ranking list of all items, regardless of how many conflicts exist among users. This work rejects the forced agreement of all items. Instead, we define a new concept, maximum consensus sequences, which are the longest ranking lists of items that agree with the majority and disagree only with the minority. Based on this concept, algorithm MCS is developed to determine the maximum consensus sequences from users' ranking data, and also to identify conflict items that need further negotiation. Extensive experiments are carried out using synthetic data sets, and the results indicate that the proposed method is computationally efficient. Finally, we discuss how the identified consensus sequences and conflict items information can be used in practice.

[1]  Chun Zhang,et al.  Storing and querying ordered XML using a relational database system , 2002, SIGMOD '02.

[2]  Sushil Kumar,et al.  Analytic hierarchy process: An overview of applications , 2006, Eur. J. Oper. Res..

[3]  Thomas Hofmann,et al.  Latent semantic models for collaborative filtering , 2004, TOIS.

[4]  Timothy W. Butler,et al.  An Interactive Framework for Multi‐Person, Multiobjective Decisions , 1993 .

[5]  L. Seiford,et al.  Information and preference in partial orders: A bimatrix representation , 1986 .

[6]  Dorit S. Hochbaum,et al.  Methodologies and Algorithms for Group-Rankings Decision , 2006, Manag. Sci..

[7]  K. Bogart Preference structures I: Distances between transitive preference relations† , 1973 .

[8]  W. Hoeffding,et al.  Rank Correlation Methods , 1949 .

[9]  Patrick T. Harker,et al.  The Analytic hierarchy process : applications and studies , 1989 .

[10]  Salvatore Greco,et al.  Ordinal regression revisited: Multiple criteria ranking using a set of additive value functions , 2008, Eur. J. Oper. Res..

[11]  L. Seiford,et al.  A general framework for distance-based consensus in ordinal ranking models , 1997 .

[12]  Nesar Ahmad,et al.  Soft Computing Techniques for Rank Aggregation on the World Wide Web , 2003, World Wide Web.

[13]  J. Siskos Assessing a set of additive utility functions for multicriteria decision-making , 1982 .

[14]  M. Köksalan,et al.  An approach for finding the most preferred alternative in the presence of multiple criteria , 1992 .

[15]  David Heckerman,et al.  Empirical Analysis of Predictive Algorithms for Collaborative Filtering , 1998, UAI.

[16]  Ronald Fagin,et al.  Efficient similarity search and classification via rank aggregation , 2003, SIGMOD '03.

[17]  Wade D. Cook,et al.  Distance-based and ad hoc consensus models in ordinal preference ranking , 2006, Eur. J. Oper. Res..

[18]  Boaz Golany,et al.  Creating a consensus ranking of proposals from reviewers' partial ordinal rankings , 2007, Comput. Oper. Res..

[19]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[20]  A. Stam,et al.  Stochastic Judgments in the AHP: The Measurement of Rank Reversal Probabilities , 1997 .

[21]  T. Saaty RANK GENERATION, PRESERVATION, AND REVERSAL IN THE ANALYTIC HIERARCHY DECISION PROCESS , 1987 .

[22]  Jacinto González-Pachón,et al.  Aggregation of partial ordinal rankings: an interval goal programming approach , 2001, Comput. Oper. Res..

[23]  Boaz Golany,et al.  Optimal Allocation of Proposals to Reviewers to Facilitate Effective Ranking , 2005, Manag. Sci..

[24]  M. Trick,et al.  Voting schemes for which it can be difficult to tell who won the election , 1989 .

[25]  K. Bogart Preference Structures. II: Distances Between Asymmetric Relations , 1975 .

[26]  Yoram Singer,et al.  Learning to Order Things , 1997, NIPS.

[27]  Ramakrishnan Srikant,et al.  Mining Sequential Patterns: Generalizations and Performance Improvements , 1996, EDBT.