Chance-corrected measures for 2 × 2 tables that coincide with weighted kappa.

Cohen's kappa is presently a standard tool for the analysis of agreement in a 2 × 2 reliability study, and weighted kappa is a standard statistic for summarizing a 2 × 2 validity study. The special cases of weighted kappa, for example Cohen's kappa, are chance-corrected measures of association. For various measures of 2 × 2 association it has been observed in the literature that, after correction for chance, they coincide with a special case of weighted kappa. This paper presents the general function, linear in both numerator and denominator, that becomes weighted kappa after correction for chance.

[1]  J. Fleiss,et al.  Quantification of agreement in psychiatric diagnosis revisited. , 1987, Archives of general psychiatry.

[2]  Helena C. Kraemer,et al.  Assessment of 2 × 2 Associations: Generalization of Signal-Detection Methodology , 1988 .

[3]  P. Jaccard.  THE DISTRIBUTION OF THE FLORA IN THE ALPINE ZONE.1 , 1912 .

[4]  M. Potter,et al.  Resolving the paradoxes , 2008 .

[5]  H. Brenner,et al.  Dependence of Weighted Kappa Coefficients on the Number of Categories , 1996, Epidemiology.

[6]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[7]  Jacob Cohen,et al.  The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability , 1973 .

[8]  Matthijs J. Warrens.  Inequalities Between Kappa and Kappa-Like Statistics for k×k Tables , 2010 .

[9]  M. Warrens.  On Association Coefficients for 2×2 Tables and Properties That Do Not Depend on the Marginal Distributions , 2008, Psychometrika.

[10]  Christof Schuster,et al.  A Note on the Interpretation of Weighted Kappa and its Relations to Other Rater Agreement Statistics for Metric Scales , 2004 .

[11]  Matthijs J. Warrens,et al.  On the Equivalence of Cohen’s Kappa and the Hubert-Arabie Adjusted Rand Index , 2008, J. Classif..

[12]  J. Gower,et al.  Metric and Euclidean properties of dissimilarity coefficients , 1986 .

[13]  Matthijs J. Warrens,et al.  A Kraemer-type Rescaling that Transforms the Odds Ratio into the Weighted Kappa Coefficient , 2010 .

[14]  Ahmed Albatineh,et al.  On Similarity Indices and Correction for Chance Agreement , 2006, J. Classif..

[15]  F. B. Baulieu.  A classification of presence/absence based dissimilarity coefficients , 1989 .

[16]  J. Fleiss.  Measuring agreement between two judges on the presence or absence of a trait. , 1975, Biometrics.

[17]  F. B. Baulieu.  Two Variant Axiom Systems for Presence/Absence Based Dissimilarity Coefficients , 1997 .

[18]  Helena Chmura Kraemer,et al.  Reconsidering the odds ratio as a measure of 2×2 association in a population , 2004, Statistics in medicine.

[19]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[20]  H. Kraemer.  Ramifications of a population model forκ as a coefficient of reliability , 1979 .

[21]  L. R. Dice.  Measures of the Amount of Ecologic Association Between Species , 1945 .

[22]  A. Tversky.  Features of Similarity , 1977 .

[23]  H. Kraemer,et al.  2 x 2 kappa coefficients: measures of agreement or association. , 1989, Biometrics.

[24]  J. Fleiss,et al.  Quantification of agreement in psychiatric diagnosis. A new approach. , 1967, Archives of general psychiatry.

[25]  Matthijs J. Warrens,et al.  Bounds of Resemblance Measures for Binary (Presence/Absence) Variables , 2008, J. Classif..

[26]  Matthijs J. Warrens,et al.  k-Adic Similarity Coefficients for Binary (Presence/Absence) Data , 2009, J. Classif..

[27]  A. Feinstein,et al.  High agreement but low kappa: II. Resolving the paradoxes. , 1990, Journal of clinical epidemiology.

[28]  Adelin Albert,et al.  A note on the linearly weighted kappa coefficient for ordinal scales , 2009 .

[29]  F. E. Zegers,et al.  A general family of association coefficients , 1986 .

[30]  Roelof Popping.  Overeenstemmingsmaten voor nominale data , 1983 .

[31]  Helena C. Kraemer,et al.  TUTORIAL IN BIOSTATISTICS Kappa coecients in medical research , 2004 .

[32]  Art Noda,et al.  Kappa coefficients in medical research , 2002, Statistics in medicine.

[33]  Matthijs J. Warrens,et al.  On the Indeterminacy of Resemblance Measures for Binary (Presence/Absence) Data , 2008, J. Classif..

[34]  M. Warrens.  On Similarity Coefficients for 2×2 Tables and Correction for Chance , 2008, Psychometrika.

[35]  James C. Reed.  Book Reviews : Visual Perceptual Abilities and Early Reading Progress by Jean Turner Goins, Supplementary Educational Monographs, #87, Chicago: University of Chicago Press, 1958, Pp. x + 108 , 1960 .