ℓ∞-Bounds of the MLE in the BTL Model under General Comparison Graphs

The Bradley-Terry-Luce (BTL) model is a popular statistical approach for estimating the global ranking of a collection of items using pairwise comparisons. To ensure accurate ranking, it is essential to obtain precise estimates of the model parameters in the (cid:96) ∞ -loss. The difficulty of this task depends cru-cially on the topology of the pairwise comparison graph over the given items. However, beyond very few well-studied cases, such as the complete and Erdös-Rényi comparison graphs, little is known about the performance of the maximum likelihood estimator (MLE) of the BTL model parameters in the (cid:96) ∞ -loss under more general graph topologies. In this paper, we derive novel, general upper bounds on the (cid:96) ∞ estimation error of the BTL MLE that depend explicitly on the algebraic connectivity of the comparison graph, the maximal performance gap across items and the sample complexity. We demonstrate that the derived bounds perform well and in some cases are sharper compared to known results obtained using different loss functions and more restricted assumptions and graph topologies. We carefully compare our results to Yan et al. (2012), which is closest in spirit to our work. We further provide minimax lower bounds under (cid:96) ∞ -error that nearly match the upper bounds over a class of sufficiently regular graph topologies. Finally, we study the implications of our (cid:96) ∞ bounds for efficient (offline) tournament design. We illustrate and discuss our findings through vari-ous examples and simulations.

[1]  Kani Chen,et al.  Asymptotic theory of sparse Bradley–Terry model , 2020 .

[2]  Venkatesh Saligrama,et al.  Minimax Rate for Learning From Pairwise Comparisons in the BTL Model , 2020, ICML.

[3]  Lalit Jain,et al.  Spectral Methods for Ranking with Scarce Data , 2020, UAI.

[4]  Chao Gao,et al.  Partial recovery for top-k ranking: Optimality of MLE and SubOptimality of the spectral method , 2020, The Annals of Statistics.

[5]  Tao Jin,et al.  Rank Aggregation via Heterogeneous Thurstone Preference Models , 2019, AAAI.

[6]  Ness B. Shroff,et al.  On Sample Complexity Upper and Lower Bounds for Exact Ranking from Noisy Comparisons , 2019, NeurIPS.

[7]  Venkatesh Saligrama,et al.  Graph Resistance and Learning from Pairwise Comparisons , 2019, ICML.

[8]  Arpit Agarwal,et al.  Accelerated Spectral Ranking , 2018, ICML.

[9]  Yuxin Chen,et al.  Spectral Method and Regularized MLE Are Both Optimal for Top-$K$ Ranking , 2017, Annals of statistics.

[10]  Nihar B. Shah,et al.  Active ranking from pairwise comparisons and when parametric assumptions do not help , 2016, The Annals of Statistics.

[11]  Yuxin Chen,et al.  Spectral MLE: Top-K Rank Aggregation from Pairwise Comparisons , 2015, ICML.

[12]  Martin J. Wainwright,et al.  Estimation from Pairwise Comparisons: Sharp Minimax Bounds with Topology Dependence , 2015, J. Mach. Learn. Res..

[13]  Bruce E. Hajek,et al.  Minimax-optimal Inference from Partial Rankings , 2014, NIPS.

[14]  Sébastien Bubeck Convex Optimization: Algorithms and Complexity , 2014, Found. Trends Mach. Learn..

[15]  David Firth,et al.  Statistical modelling of citation exchange between statistics journals , 2013, Journal of the Royal Statistical Society. Series A,.

[16]  C. Varin,et al.  Dynamic Bradley–Terry modelling of sports tournaments , 2013 .

[17]  Cristiano Varin,et al.  The ranking lasso and its application to sport tournaments , 2012, 1301.2954.

[18]  Devavrat Shah,et al.  Rank Centrality: Ranking from Pairwise Comparisons , 2012, Oper. Res..

[19]  Jinfeng Xu,et al.  GROUPED SPARSE PAIRED COMPARISONS IN THE BRADLEY-TERRY MODEL , 2011, 1111.5110.

[20]  Roman Vershynin,et al.  Introduction to the non-asymptotic analysis of random matrices , 2010, Compressed Sensing.

[21]  Noga Alon,et al.  An elementary construction of constant-degree expanders , 2007, SODA '07.

[22]  Stephen P. Boyd,et al.  Convex Optimization , 2004, IEEE Transactions on Automatic Control.

[23]  D. Hunter MM algorithms for generalized Bradley-Terry models , 2003 .

[24]  Yi-Ching Yao,et al.  Asymptotics when the number of parameters tends to infinity in the Bradley-Terry model for paired comparisons , 1999 .

[25]  L. Fahrmeir,et al.  Dynamic Stochastic Models for Time-Dependent Ordered Paired Comparison Systems , 1994 .

[26]  S. Stigler Citation Patterns in the Journals of Statistics and Probability , 1994 .

[27]  V. Sunder,et al.  The Laplacian spectrum of a graph , 1990 .

[28]  R. Duncan Luce,et al.  Individual Choice Behavior: A Theoretical Analysis , 1979 .

[29]  L. R. Ford Solution of a Ranking Problem from Binary Comparisons , 1957 .

[30]  R. A. Bradley,et al.  RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS THE METHOD OF PAIRED COMPARISONS , 1952 .

[31]  M. Kendall A NEW MEASURE OF RANK CORRELATION , 1938 .

[32]  E. Zermelo Die Berechnung der Turnier-Ergebnisse als ein Maximumproblem der Wahrscheinlichkeitsrechnung , 1929 .

[33]  R. A. Bradley,et al.  RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS , 1952 .