The Performance of the MLE in the Bradley-Terry-Luce Model in `∞-Loss and under General Graph Topologies

The Bradley-Terry-Luce (BTL) model is a popular statistical approach for estimating the global ranking of a collection of items of interest using pairwise comparisons. To ensure accurate ranking, it is essential to obtain precise estimates of the model parameters in the `∞-loss. The difficulty of this task depends crucially on the topology of the pairwise comparison graph over the given items. However, beyond very few well-studied cases, such as the complete and Erdös-Rényi comparison graphs, little is known about the performance of the maximum likelihood estimator (MLE) of the BTL model parameters in the `∞-loss under more general graph topologies. In this paper, we derive novel, general upper bounds on the `∞ estimation error of the BTL MLE that depend explicitly on the algebraic connectivity of the comparison graph, the maximal performance gap across items and the sample complexity. We demonstrate that the derived bounds perform well and in some cases are sharper compared to known results obtained using different loss functions and more restricted assumptions and graph topologies. We further provide minimax lower bounds under `∞-error that nearly match the upper bounds over a class of sufficiently regular graph topologies. Finally, we study the implications of our bounds for efficient tournament design. We illustrate and discuss our findings through various examples and simulations. *Equal Contribution.

[1]  Martin J. Wainwright,et al.  Estimation from Pairwise Comparisons: Sharp Minimax Bounds with Topology Dependence , 2015, J. Mach. Learn. Res..

[2]  Arpit Agarwal,et al.  Accelerated Spectral Ranking , 2018, ICML.

[3]  D. Hunter MM algorithms for generalized Bradley-Terry models , 2003 .

[4]  Yuxin Chen,et al.  Spectral Method and Regularized MLE Are Both Optimal for Top-$K$ Ranking , 2017, Annals of statistics.

[5]  L. Fahrmeir,et al.  Dynamic Stochastic Models for Time-Dependent Ordered Paired Comparison Systems , 1994 .

[6]  Devavrat Shah,et al.  Rank Centrality: Ranking from Pairwise Comparisons , 2012, Oper. Res..

[7]  Yuxin Chen,et al.  Spectral MLE: Top-K Rank Aggregation from Pairwise Comparisons , 2015, ICML.

[8]  Roman Vershynin,et al.  Introduction to the non-asymptotic analysis of random matrices , 2010, Compressed Sensing.

[9]  R. A. Bradley,et al.  RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS THE METHOD OF PAIRED COMPARISONS , 1952 .

[10]  Bruce E. Hajek,et al.  Minimax-optimal Inference from Partial Rankings , 2014, NIPS.

[11]  Willem H. Haemers,et al.  Spectra of Graphs , 2011 .

[12]  V. Sunder,et al.  The Laplacian spectrum of a graph , 1990 .

[13]  C. Varin,et al.  Dynamic Bradley–Terry modelling of sports tournaments , 2013 .

[14]  Chao Gao,et al.  Partial recovery for top-k ranking: Optimality of MLE and SubOptimality of the spectral method , 2020, The Annals of Statistics.

[15]  David Firth,et al.  Statistical modelling of citation exchange between statistics journals , 2013, Journal of the Royal Statistical Society. Series A,.

[16]  Yi-Ching Yao,et al.  Asymptotics when the number of parameters tends to infinity in the Bradley-Terry model for paired comparisons , 1999 .

[17]  Philipp Birken,et al.  Numerical Linear Algebra , 2011, Encyclopedia of Parallel Computing.

[18]  M. Kendall A NEW MEASURE OF RANK CORRELATION , 1938 .

[19]  Venkatesh Saligrama,et al.  Minimax Rate for Learning From Pairwise Comparisons in the BTL Model , 2020, ICML.

[20]  Sébastien Bubeck,et al.  Convex Optimization: Algorithms and Complexity , 2014, Found. Trends Mach. Learn..

[21]  Bin Yu Assouad, Fano, and Le Cam , 1997 .

[22]  Kani Chen,et al.  Asymptotic theory of sparse Bradley–Terry model , 2020 .

[23]  S. Stigler Citation Patterns in the Journals of Statistics and Probability , 1994 .

[24]  Jinfeng Xu,et al.  GROUPED SPARSE PAIRED COMPARISONS IN THE BRADLEY-TERRY MODEL , 2011, 1111.5110.

[25]  R. Duncan Luce,et al.  Individual Choice Behavior: A Theoretical Analysis , 1979 .

[26]  Venkatesh Saligrama,et al.  Graph Resistance and Learning from Pairwise Comparisons , 2019, ICML.

[27]  L. R. Ford Solution of a Ranking Problem from Binary Comparisons , 1957 .

[28]  Noga Alon,et al.  An elementary construction of constant-degree expanders , 2007, SODA '07.

[29]  Cristiano Varin,et al.  The ranking lasso and its application to sport tournaments , 2012, 1301.2954.

[30]  R. A. Bradley,et al.  RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS , 1952 .