Methods To Reduce The Impact Of Intraclass Correlation In Group-Randomized Trials

This study reports intraclass correlation (ICC) for dependent variables used in group-randomized trials (GRTs). The authors also document the effect of two methods suggested to reduce the impact of ICC in GRTs; these two methods are modeling time and regression adjustment for covariates. They coded and analyzed 1,188 ICC estimates from 17 published, in press, and unpublished articles representing 21 studies. Findings confirm that both methods can improve the efficiency of analyses shown to be valid across conditions common in GRTs. Investigators planning GRTs should obtain ICC estimates matched to their planned analysis so that they can size their studies properly.

[1]  F. Hsieh,et al.  Sample size formulae for intervention studies with the cluster as unit of randomization. , 1988, Statistics in medicine.

[2]  Helen Brown,et al.  Applied Mixed Models in Medicine , 2000, Technometrics.

[3]  D. Murray,et al.  Intraclass Correlation among Measures Related to Alcohol Use by School Aged Adolescents: Estimates, Correlates and Applications in Intervention Studies , 1996, Journal of drug education.

[4]  S. Zeger,et al.  Longitudinal data analysis using generalized linear models , 1986 .

[5]  Allan Donner,et al.  Design and Analysis of Cluster Randomization Trials in Health Research , 2001 .

[6]  Donald Hedeker,et al.  Analysis of clustered data in community psychology: With an example from a worksite smoking cessation project , 1994, American journal of community psychology.

[7]  Jan de Leeuw,et al.  Introducing Multilevel Modeling , 1998 .

[8]  Kosuke Imai,et al.  Survey Sampling , 1998, Nov/Dec 2017.

[9]  S. Ennett,et al.  Analysis of prevention program effectiveness with clustered data using generalized estimating equations. , 1996, Journal of consulting and clinical psychology.

[10]  D M Murray,et al.  Analysis of data from group-randomized trials with repeat observations on the same groups. , 1998, Statistics in medicine.

[11]  I Kleinschmidt,et al.  Smoking behaviour can be predicted by neighbourhood deprivation measures. , 1995, Journal of epidemiology and community health.

[12]  D. Hedeker,et al.  Random-effects regression models for clustered data with an example from smoking prevention research. , 1994, Journal of consulting and clinical psychology.

[13]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[14]  H A Feldman,et al.  Components of variance in a group-randomized trial analysed via a random-coefficients model: the Rapid Early Action for Coronary Treatment (REACT) trial , 2000, Statistical methods in medical research.

[15]  T D Koepsell,et al.  Explaining community-level variance in group randomized trials. , 1999, Statistics in medicine.

[16]  D. Jacobs,et al.  PARAMETERS TO AID IN THE DESIGN AND ANALYSIS OF COMMUNITY TRIALS: INTRACLASS CORRELATIONS FROM THE MINNESOTA HEART HEALTH PROGRAM , 1994, Epidemiology.

[17]  S. Chinn,et al.  Components of variance and intraclass correlations for the design of community-based surveys and intervention studies: data from the Health Survey for England 1994. , 1999, American journal of epidemiology.

[18]  A Donner,et al.  Design considerations in the estimation of intraclass correlation , 1982, Annals of human genetics.

[19]  David M. Murray,et al.  Intraclass Correlation for Measures from a Middle School Nutrition Intervention Study: Estimates, Correlates, and Applications , 2001, Health education & behavior : the official publication of the Society for Public Health Education.

[20]  S. Ennett,et al.  School and neighborhood characteristics associated with school rates of alcohol, cigarette, and marijuana use. , 1997, Journal of health and social behavior.

[21]  Russell D. Wolfinger,et al.  Analysis Issues in the Evaluation of Community Trials - Progress Toward Solutions in Sas/Stat Mixed , 1994 .

[22]  E H Wagner,et al.  Data analysis and sample size issues in evaluations of community-based health promotion and disease prevention programs: a mixed-model analysis of variance approach. , 1991, Journal of clinical epidemiology.

[23]  Chris J. Skinner,et al.  Analysis of complex surveys , 1991 .

[24]  P J Hannan,et al.  Intraclass correlation among common measures of adolescent smoking: estimates, correlates, and applications in smoking prevention studies. , 1994, American journal of epidemiology.

[25]  B. Short,et al.  Intraclass correlation among measures related to tobacco use by adolescents: estimates, correlates, and applications in intervention studies. , 1997, Addictive behaviors.

[26]  K Y Liang,et al.  Longitudinal data analysis for discrete and continuous outcomes. , 1986, Biometrics.

[27]  L. Wilhelmsen,et al.  Physical activity protects against coronary death and deaths from all causes in middle-aged men. Evidence from a 20-year follow-up of the primary prevention study in Göteborg. , 1997, Annals of epidemiology.

[28]  David M. Murray,et al.  Design and Analysis of Group- Randomized Trials , 1998 .

[29]  D M Murray,et al.  Statistical models appropriate for designs often used in group‐randomized trials , 2001, Statistics in medicine.

[30]  David M Murray,et al.  Intraclass correlation among measures related to cigarette use by adolescents: estimates from an urban and largely African American cohort. , 2002, Addictive behaviors.

[31]  Kenneth W Griffin,et al.  Estimates of Intragroup Dependence for Drug Use and Skill Measures in School-Based Drug Abuse Prevention Trials: An Empirical Study of Three Independent Samples , 2002, Health education & behavior : the official publication of the Society for Public Health Education.

[32]  D. Murray.  Design and Analysis of Group ..Randomized Trials: A Review of Recent Developments , 1997 .

[33]  H A Feldman,et al.  Cohort versus cross-sectional design in large field trials: precision, sample size, and a unifying model. , 1994, Statistics in medicine.

[34]  A C Wagenaar,et al.  Intraclass correlations from a community-based alcohol prevention study: the effect of repeat observations on the same communities. , 2000, Journal of studies on alcohol.

[35]  F B Hu,et al.  Intraclass correlation estimates in a school-based smoking prevention study. Outcome and mediating variables, by sex and ethnicity. , 1996, American journal of epidemiology.

[36]  P. Diggle.  Analysis of Longitudinal Data , 1995 .

[37]  D R Jacobs,et al.  The worksite component of variance: design effects and the Healthy Worker Project. , 1993, Health education research.

[38]  A. Donner,et al.  Randomization by cluster. Sample size requirements and analysis. , 1981, American journal of epidemiology.

[39]  H. Goldstein,et al.  Multilevel Models in Educational and Social Research. , 1989 .

[40]  J Cornfield,et al.  Randomization by group: a formal analysis. , 1978, American journal of epidemiology.

[41]  B. Short,et al.  Intraclass correlation among measures related to alcohol use by young adults: estimates, correlates and applications in intervention studies. , 1995, Journal of studies on alcohol.

[42]  D M Murray,et al.  Intraclass Correlation for Measures from a Worksite Health Promotion Study: Estimates, Correlates, and Applications , 1999, American journal of health promotion : AJHP.

[43]  S. Raudenbush,et al.  Design and Analysis Issues in Community Trials , 1994 .

[44]  J. Allen,et al.  Programmatic prevention of adolescent problem behaviors: The role of autonomy, relatedness, and volunteer service in the teen outreach program , 1994, American Journal of Community Psychology.

[45]  Lisa M Brosseau,et al.  Sample size considerations for studies of intervention efficacy in the occupational setting. , 2002, The Annals of occupational hygiene.

[46]  D M Murray,et al.  An Evaluation of Analysis Options for the One-Group-Per-Condition Design , 2001, Evaluation review.

[47]  D M Murray,et al.  Planning for the appropriate analysis in school-based drug-use prevention studies. , 1990, Journal of consulting and clinical psychology.

[48]  David M. Zucker,et al.  An Analysis of Variance Pitfall: The Fixed Effects Analysis in a Nested Design , 1990 .