Positional Scoring Rules with Uncertain Weights

Positional scoring rules are frequently used for aggregating rankings (for example in social choice and in sports). These rules are highly sensitive to the weights associated to positions: depending on the weights, a different winner may be selected. In this paper we explicitly consider the role of weight uncertainty in both the case of monotone decreasing weights and of convex decreasing weights. First we discuss the problem of finding possible winners (candidates that may win for a feasible instantiation of the weights) based on previous works that established a connection with the notion of stochastic dominance. Second, we adopt decision-theoretic methods (minimax regret, maximum advantage, expected value) to pick a winner based on the weight uncertainty and we provide a characterization of these methods. Finally, we show some applications of our methodology in real datasets.

[1]  Craig Boutilier,et al.  Regret-based optimal recommendation sets in conversational recommender systems , 2009, RecSys '09.

[2]  Bonifacio Llamazares,et al.  Preference aggregation and DEA: An analysis of the methods proposed to discriminate efficient candidates , 2009, Eur. J. Oper. Res..

[3]  H. P. Young,et al.  An axiomatization of Borda's rule , 1974 .

[4]  Craig Boutilier,et al.  Robust Approximation and Incremental Elicitation in Voting Protocols , 2011, IJCAI.

[5]  W. Cook,et al.  A data envelopment model for aggregating preference rankings , 1990 .

[6]  L. J. Savage,et al.  The Foundations of Statistics , 1955 .

[7]  Raimo P. Hämäläinen,et al.  Preference ratios in multiattribute evaluation (PRIME)-elicitation and decision procedures under incomplete information , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[8]  Craig Boutilier,et al.  Constraint-based optimization and utility elicitation using the minimax decision criterion , 2006, Artif. Intell..

[9]  A Gerodimos,et al.  Robust Discrete Optimization and its Applications , 1996, J. Oper. Res. Soc..

[10]  Peter C. Fishburn,et al.  Borda's rule, positional voting, and Condorcet's simple majority principle , 1976 .

[11]  Patrice Perny,et al.  Voting with Rank Dependent Scoring Rules , 2014, AAAI.

[12]  Patrice Perny,et al.  Incremental Weight Elicitation for Multiobjective State Space Search , 2015, AAAI.

[13]  William E. Stein,et al.  A stochastic dominance analysis of ranked voting systems with scoring , 1994 .

[14]  H. Young Social Choice Scoring Functions , 1975 .