Alternative inference models based on matching for a weighted index of nominal scale response agreement

The kappa (K) statistic developed by Cohen (1960) is an index wellknown in psychology for measuring nominal scale response agreement (see Fleiss, 1973). In a typical application, each of two raters groups the same set of n objects using T unordered categories, A 1, A*, . . . . A T. If the resulting data are formalized as a T X T contingency table, such as that given in Table I, then in terms of this notation, Cohen’s index is defined by

[1]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[2]  R. Light.  Measures of response agreement for qualitative data: Some generalizations and alternatives. , 1971 .

[3]  K. Krippendorff.  Bivariate Agreement Coefficients for Reliability of Data , 1970 .

[4]  N. Mantel.  The detection of disease clustering and a generalized regression approach. , 1967, Cancer research.

[5]  Andrew Whinston,et al.  An Algorithm for the Quadratic Assignment Problem , 1970 .

[6]  R. L. Thorndike.  The problem of classification of personnel , 1950, Psychometrika.

[7]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[8]  B. Everitt,et al.  Statistical methods for rates and proportions , 1973 .

[9]  E. J. Gilbert.  The matching problem , 1956 .

[10]  Brian Everitt,et al.  MOMENTS OF THE STATISTICS KAPPA AND WEIGHTED KAPPA , 1968 .

[11]  M. Klauber,et al.  TWO-SAMPLE RANDOMIZATION TESTS FOR SPACE-TIME CLUSTERING , 1971 .

[12]  L. Hubert,et al.  Inference models for categorical clustering. , 1977 .

[13]  J. Fleiss.  Statistical methods for rates and proportions , 1974 .

[14]  O. Abe.  A Central Limit Theorem for the Number of Edges in the Random Intersection of Two Graphs , 1969 .

[15]  B. Everitt,et al.  Large sample standard errors of kappa and weighted kappa. , 1969 .

[16]  W. A. Scott,et al.  Reliability of Content Analysis ; The Case of Nominal Scale Cording , 1955 .

[17]  Lawrence Hubert.  A relationship between the assignment problem and some simple statistical techniques , 1976 .

[18]  J. V. Bradley.  Distribution-Free Statistical Tests , 1968 .

[19]  L. Hubert,et al.  Quadratic assignment as a general data analysis strategy. , 1976 .

[20]  Jack Edmonds,et al.  Maximum matching and a polyhedron with 0,1-vertices , 1965 .

[21]  Eugene S. Edgington,et al.  Statistical inference : the distribution-free approach , 1969 .

[22]  James D. Laing,et al.  Prediction Analysis of Cross Classifications. , 1976 .

[23]  Lawrence Hubert,et al.  A general formula for the variance of Cohen's weighted kappa. , 1978 .