Confidence interval construction for a difference between two dependent intraclass correlation coefficients

Inferences for the difference between two dependent intraclass correlation coefficients (ICCs) may arise in studies in which a sample of subjects are each assessed several times with a new device and a standard. The ICC estimates for the two devices may then be compared using a test of significance. However, a confidence interval for a difference between two ICCs is more informative since it combines point estimation and hypothesis testing into a single inference statement. We propose a procedure that uses confidence limits for a single ICC to recover variance estimates needed to set confidence limits for the difference. An advantage of this approach is that it provides a confidence interval that reflects the underlying sampling distribution. Simulation results show that this method performs very well in terms of overall coverage percentage and tail errors. Two data sets are used to illustrate this procedure.

[1]  A Donner,et al.  Construction of confidence limits about effect measures: A general approach , 2008, Statistics in medicine.

[2]  M. Bartlett,et al.  APPROXIMATE CONFIDENCE INTERVALSMORE THAN ONE UNKNOWN PARAMETER , 1953 .

[3]  R. Elston.  On the correlation between correlations , 1975 .

[4]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[5]  John M Lachin,et al.  The role of measurement reliability in clinical trials , 2004, Clinical trials.

[6]  C. A. Smith,et al.  ON THE ESTIMATION OF INTRACLASS CORRELATION , 1957 .

[7]  J. Bartko.  The Intraclass Correlation Coefficient as a Measure of Reliability , 1966, Psychological reports.

[8]  A. Donner.  A Review of Inference Procedures for the Intraclass Correlation Coefficient in the One-Way Random Effects Model , 1986 .

[9]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[10]  Sadanori Konishi,et al.  Normalizing and variance stabilizing transformations for intraclass correlations , 1985 .

[11]  L. S. Feldt,et al.  Testing the Equality of Two Related Intraclass Reliability Coefficients , 1994 .

[12]  B. Efron,et al.  Second thoughts on the bootstrap , 2003 .

[13]  A. Donner,et al.  A comparison of confidence interval methods for the intraclass correlation coefficient. , 1986, Biometrics.

[14]  Robert A. Hultquist,et al.  Interval Estimation for the Unbalanced Case of the One-Way Random Effects Model , 1978 .

[15]  M Defontaine,et al.  In vivo performance of a matrix-based quantitative ultrasound imaging device dedicated to calcaneus investigation. , 2002, Ultrasound in medicine & biology.

[16]  B. Toone,et al.  Computerized tomographic scan changes in early schizophrenia – preliminary findings , 1986, Psychological Medicine.

[17]  K. McGraw,et al.  Forming inferences about some intraclass correlation coefficients. , 1996 .

[18]  Allan Donner,et al.  Testing the equality of dependent intraclass correlation coefficients , 2002 .

[19]  M. Bartlett,et al.  APPROXIMATE CONFIDENCE INTERVALS , 1953 .

[20]  S. Underwood,et al.  The relationship between administered radiopharmaceutical activity in myocardial perfusion scintigraphy and imaging outcome , 2008, European Journal of Nuclear Medicine and Molecular Imaging.

[21]  W. G. Cochran.  Errors of Measurement in Statistics , 1968 .

[22]  Raphaël Porcher,et al.  Power calculation for the likelihood ratio-test when comparing two dependent intraclass correlation coefficients , 2005, Comput. Methods Programs Biomed..