Statistical Inference for Incomplete Ranking Data: A Comparison of Two Likelihood-Based Estimators

We consider the problem of statistical inference for ranking data, namely the problem of estimating a probability distribution on the permutation space. Since observed rankings could be incomplete in the sense of not comprising all choice alternatives, we propose to tackle the problem as one of learning from imprecise or coarse data. To this end, we associate an incomplete ranking with its set of consistent completions. We instantiate and compare two likelihood-based approaches that have been proposed in the literature for learning from set-valued data, the marginal and the so-called face-value likelihood. Concretely, we analyze a setting in which the underlying distribution is Plackett-Luce and observations are given in the form of pairwise comparisons.

[1]  Eyke Hllermeier,et al.  Preference Learning , 2010 .

[2]  Tie-Yan Liu,et al.  Learning to rank for information retrieval , 2009, SIGIR.

[3]  R. A. Bradley,et al.  RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS THE METHOD OF PAIRED COMPARISONS , 1952 .

[4]  R. Viertl Statistical Methods for Fuzzy Data , 2011 .

[5]  Eyke Hüllermeier,et al.  Learning from imprecise and fuzzy observations: Data disambiguation through generalized loss minimization , 2013, Int. J. Approx. Reason..

[6]  Eyke Hüllermeier,et al.  Statistical Inference for Incomplete Ranking Data: The Case of Rank-Dependent Coarsening , 2017, ICML.

[7]  Thierry Denœux Maximum likelihood estimation from fuzzy data using the EM algorithm , 2011 .

[8]  J. Marden Analyzing and Modeling Rank Data , 1996 .

[9]  A. P. Dawid,et al.  Likelihood and Bayesian Inference from Selectively Reported Data , 1977 .

[10]  R. A. Bradley,et al.  Rank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons , 1952 .

[11]  Didier Dubois,et al.  A general framework for maximizing likelihood under incomplete data , 2018, Int. J. Approx. Reason..

[12]  M. Jaeger Ignorability for categorical data , 2005, math/0508314.

[13]  Thomas Augustin,et al.  Testing of Coarsening Mechanisms: Coarsening at Random Versus Subgroup Independence , 2016, SMPS.

[14]  Thierry Denoeux,et al.  Maximum Likelihood Estimation from Uncertain Data in the Belief Function Framework , 2013, IEEE Transactions on Knowledge and Data Engineering.

[15]  Reinhard Viertl,et al.  Statistical Methods for Fuzzy Data: Viertl/Statistical Methods for Fuzzy Data , 2011 .