Estimating the Generalized Concordance Correlation Coefficient through Variance Components

The intraclass correlation coefficient (ICC) and the concordance correlation coefficient (CCC) are two of the most popular measures of agreement for variables measured on a continuous scale. Here, we demonstrate that ICC and CCC are the same measure of agreement estimated in two ways: by the variance components procedure and by the moment method. We propose estimating the CCC using variance components of a mixed effects model, instead of the common method of moments. With the variance components approach, the CCC can easily be extended to more than two observers, and adjusted using confounding covariates, by incorporating them in the mixed model. A simulation study is carried out to compare the variance components approach with the moment method. The importance of adjusting by confounding covariates is illustrated with a case example.

[1]  J. Bartko.  The Intraclass Correlation Coefficient as a Measure of Reliability , 1966, Psychological reports.

[2]  Huiman X Barnhart,et al.  Overall Concordance Correlation Coefficient for Evaluating Agreement Among Multiple Observers , 2002, Biometrics.

[3]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[4]  Mark H Russell,et al.  Comparison of pesticide root zone model 3.12: Runoff predictions with field data , 2002, Environmental toxicology and chemistry.

[5]  L. Lin.  Assay Validation Using the Concordance Correlation Coefficient , 1992 .

[6]  V M Chinchilli,et al.  A generalized concordance correlation coefficient for continuous and categorical data , 2001, Statistics in medicine.

[7]  L. Lin,et al.  A concordance correlation coefficient to evaluate reproducibility. , 1989, Biometrics.

[8]  Gabrielle E. Kelly,et al.  Use of the Structural Equations Model in Assessing the Reliability of a New Measurement Technique , 1985 .

[9]  J. Fleiss,et al.  Approximate interval estimation for a certain intraclass correlation coefficient , 1978 .

[10]  C. Nickerson.  A note on a concordance correlation coefficient to evaluate reproducibility , 1997 .

[11]  R. Turcotte,et al.  Development of sampling methods for estimating levels of Varroa jacobsoni (Acari: Varroidae) infestation in colonies of Apis mellifera (Hymenoptera: Apidae) , 1998 .

[12]  M. Ruel,et al.  Validation of single daytime samples of human milk to estimate the 24-h concentration of lipids in urban Guatemalan mothers. , 1997, The American journal of clinical nutrition.

[13]  A. Hedayat,et al.  Statistical Methods in Assessing Agreement , 2002 .

[14]  N. Cox,et al.  A Note on the Concordance Correlation Coefficient , 2002 .

[15]  H. Barnhart,et al.  Modeling Concordance Correlation via GEE to Evaluate Reproducibility , 2001, Biometrics.