A simplified guide to determination of sample size requirements for estimating the value of intraclass correlation coefficient: a review

Intraclass correlation coefficient (ICC) measures the extent of agreement and consistency among raters for two or more numerical or quantitative variables. This review paper aimed to present several tables that could illustrate the minimum sample sizes required for estimating the desired effect size of ICC, which is a measurement of the magnitude of an agreement. Determination of the minimum sample size under such circumstances is based on the two fundamentally important parameters, namely the actual value of the ICC and the number of observations made by each subject. The sample size calculations are derived from Power Analysis and Sample Size (PASS) software where the alpha and minimum required power is fixed at 0.05 and higher than 0.80 respectively. A discussion on how to use these tables for determining sample sizes required for each of the various scenarios and the limitations associated with their use in each of these scenarios is provided.

[1]  K. Lee,et al.  Pitfalls and Important Issues in Testing Reliability Using Intraclass Correlation Coefficients in Orthopaedic Research , 2012, Clinics in orthopedic surgery.

[2]  Mariana Mohamad Ali,et al.  An audit of the statistics and the comparison with the parameter in the population , 2015 .

[3]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[4]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[5]  Puzziawati Ab Ghani,et al.  A comparison between convenience sampling versus systematic sampling in getting the true parameter in a population: Explore from a clinical database: The Audit Diabetes Control Management (ADCM) registry in 2009 , 2012, 2012 International Conference on Statistics in Science, Business and Engineering (ICSSBE).

[6]  J. Bartko,et al.  On Various Intraclass Correlation Reliability Coefficients , 1976 .

[7]  B. J. Winer.  Statistical Principles in Experimental Design , 1992 .

[8]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .

[9]  W B Young,et al.  An evaluation of a new test of reactive agility and its relationship to sprint speed and change of direction speed. , 2006, Journal of science and medicine in sport.

[10]  Mohamad Adam Bujang,et al.  Sample Size Guideline for Correlation Analysis , 2016 .

[11]  S. Walter,et al.  Sample size and optimal designs for reliability studies. , 1998, Statistics in medicine.

[12]  D. Altman,et al.  A note on the use of the intraclass correlation coefficient in the evaluation of agreement between two methods of measurement. , 1990, Computers in biology and medicine.

[13]  Talita Adão Perini,et al.  Cálculo do erro técnico de medição em antropometria Cálculo del error técnico en la medición de antropometria Technical error of measurement in anthropometry , 2005 .

[14]  R. J. Hunt,et al.  Percent Agreement, Pearson's Correlation, and Kappa as Measures of Inter-examiner Reliability , 1986, Journal of dental research.

[15]  J. Goultschin,et al.  Assessment of inter-examiner agreement in scoring periodontal disease. , 1985, Journal of periodontal research.

[16]  Grant M. Duthie,et al.  The Acute Effects of Heavy Loads on Jump Squat Performance: An Evaluation of the Complex and Contrast Methods of Power Development , 2002, Journal of strength and conditioning research.

[17]  H. Chauncey,et al.  Interexaminer agreement in the measurement of periodontal disease. , 1982, Journal of periodontal research.

[18]  J. Bartko.  The Intraclass Correlation Coefficient as a Measure of Reliability , 1966, Psychological reports.