On Extending the Bradley-Terry Model to Accommodate Ties in Paired Comparison Experiments

Abstract This study is concerned with the extension of the Bradley-Terry model for paired comparisons to situations which allow an expression of no preference. A new model is developed and its performance compared with a model proposed by Rao and Kupper. The maximum likelihood estimates of the parameters are found using an iterative procedure which, under a weak assumption, converges monotonically to the solution of the likelihood equations. It is noted that for a balanced paired comparison experiment the ranking obtained from the maximum likelihood estimates agrees with that obtained from a scoring system which allots two points for a win, one for a tie and zero for a loss. The likelihood ratio test of the hypothesis of equal preferences is shown to have the same asymptotic efficiency as that for the Rao-Kupper model. Two examples are presented, one of which introduces a set of data for an unbalanced paired comparison experiment. Initial applications of the test of goodness of fit suggest that the propos...

[1]  A. M. Doyle.  TYPEWRITER CARBON PAPERS. , 1908 .

[2]  E. Zermelo.  Die Berechnung der Turnier-Ergebnisse als ein Maximumproblem der Wahrscheinlichkeitsrechnung , 1929 .

[3]  A. Wald.  Tests of statistical hypotheses concerning several parameters when the number of observations is large , 1943 .

[4]  R. A. Bradley,et al.  RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS THE METHOD OF PAIRED COMPARISONS , 1952 .

[5]  R. A. Bradley,et al.  Rank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons , 1952 .

[6]  R. A. Bradley.  SOME STATISTICAL METHODS IN TASTE TESTING AND QUALITY EVALUATION (a, b) , 1953 .

[7]  Erich L. Lehmann,et al.  The Power of Rank Tests , 1953 .

[8]  R. A. Bradley.  Incomplete Block Rank Analysis: On the Appropriateness of the Model for a Method of Paired Comparisons , 1954 .

[9]  R. A. Bradley.  The rank analysis of incomplete block designs. II. Additional tables for the method of paired comparisons. , 1954 .

[10]  R. A. Bradley.  RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS: III. SOME LARGE-SAMPLE RESULTS ON ESTIMATION AND POWER FOR A METHOD OF PAIRED COMPARISONS , 1955 .

[11]  E. J. Hannan,et al.  The Asymptotic Powers of Certain Tests Based on Multiple Correlations , 1956 .

[12]  L. R. Ford.  Solution of a Ranking Problem from Binary Comparisons , 1957 .

[13]  Solomon Kullback,et al.  Information Theory and Statistics , 1960 .

[14]  R. Duncan Luce,et al.  Individual Choice Behavior , 1959 .

[15]  H. A. David,et al.  Ties in Paired-Comparison Experiments Using a Modified Thurstone-Mosteller Model , 1960 .

[16]  H. D. Brunk.  Mathematical Models for Ranking from Paired Comparisons , 1960 .

[17]  Ralph A. Bradley,et al.  The asymptotic properties of ML estimators when sampling from associated populations , 1962 .

[18]  H. A. David,et al.  The method of paired comparisons , 1966 .

[19]  R. A. Bradley.  Another interpretation of a model for paired comparisons , 1965, Psychometrika.

[20]  P. V. Rao,et al.  Ties in Paired-Comparison Experiments: A Generalization of the Bradley-Terry Model , 1967 .