Measurement system analysis for categorical measurements: Agreement and kappa-type indices

The standard method for the assessment of the precision of measurement systems that measure on a metric scale is the gauge R&R method, but this method is not applicable for measurement systems that measure on a nominal scale. For nominal measurements, t..

[1]  W. A. Scott,et al.  Reliability of Content Analysis ; The Case of Nominal Scale Cording , 1955 .

[2]  Connie M. Borror,et al.  A Review of Methods for Measurement Systems Capability Analysis , 2003 .

[3]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[4]  Dale J. Prediger,et al.  Coefficient Kappa: Some Uses, Misuses, and Alternatives , 1981 .

[5]  R. Alpert,et al.  Communications Through Limited-Response Questioning , 1954 .

[6]  Stuart R. Lipsitz,et al.  Simple moment estimates of the κ-coefficient and its variance , 1994 .

[7]  E. Iso,et al.  Measurement Uncertainty and Probability: Guide to the Expression of Uncertainty in Measurement , 1995 .

[8]  Jeroen de Mast,et al.  Measurement System Analysis for Bounded Ordinal Data , 2004 .

[9]  A. Feinstein,et al.  High agreement but low kappa: I. The problems of two paradoxes. , 1990, Journal of clinical epidemiology.

[10]  M. J. Allen.  Introduction to Measurement Theory , 1979 .

[11]  S D Walter,et al.  A reappraisal of the kappa coefficient. , 1988, Journal of clinical epidemiology.

[12]  C. Schuster,et al.  Indexing systematic rater agreement with a latent-class model. , 2002, Psychological methods.

[13]  Russell A. Boyles,et al.  Gauge Capability for Pass—Fail Inspection , 2001, Technometrics.

[14]  A Agresti,et al.  Quasi-symmetric latent class models, with application to rater agreement. , 1993, Biometrics.

[15]  J. Ingelfinger,et al.  Biostatistics in clinical medicine , 1983 .

[16]  J. Fleiss,et al.  Measuring Agreement for Multinomial Data , 1982 .

[17]  J. Fleiss.  Measuring nominal scale agreement among many raters. , 1971 .

[18]  W. N. Wieringen,et al.  Statistical Models for the Precision of Categorical Measurement , 2003 .

[19]  A. J. Conger.  Integration and generalization of kappas for multiple raters. , 1980 .