Design and analysis of clinical trials with clustering effects due to treatment

Where patients receive therapy as a group, there are good theoretical reasons to believe that variation in the outcome will be smaller for patients treated in the same group than for patients treated in different groups. Similarly, where different therapists treat different groups of patients, outcome for patients treated by the same therapist may differ less than outcome for patients treated by different therapists. Clinical trials evaluating such therapies need to consider this potential lack of independence. As with cluster-randomized trials, this has implications for the precision of treatment effects estimates and statistical power. There are nevertheless differences between clustering due to the organization of treatment and that due to randomization. In cluster-randomized trials the distribution of cluster sizes in each treatment arm should be similar as a consequence of randomization unless there is differential loss to follow-up. With clustering due to therapy group or therapist, cluster size may differ systematically between treatment arms, due to size of therapy groups or differing health professional caseload. Intra-cluster correlation may also differ between treatment arms. The implications of differential cluster size and intracluster correlation for design and analysis will be illustrated by data from two trials, the first comparing nurse practitioner care with general practitioner care, and the second comparing a group therapy with individual treatment as usual. The special case where a group therapy or therapist is compared with an unclustered treatment is examined in detail using a simulation study. The implications of differential clustering effects for sample size and power are addressed. It is argued that the design and analysis of this type of trial should take account of possible heterogeneity in cluster size and intracluster correlation.

[1]  D. Bates,et al.  Mixed-Effects Models in S and S-PLUS , 2001 .

[2]  D M Murray,et al.  A Monte Carlo Study of Alternative Responses To Intraclass Correlation in Community Trials , 1996, Evaluation review.

[3]  J. Levin,et al.  Should providers of treatment be regarded as a random factor? If it ain't broke, don't "fix" it: a comment on Siemer and Joormann (2003). , 2003, Psychological methods.

[4]  H. Wetzel,et al.  [Evaluation of standardized training for the "Positive and Negative Syndrome Scale" (PANSS)]. , 2000, Der Nervenarzt.

[5]  D. A. Kenny,et al.  The statistical analysis of data from small groups. , 2002, Journal of personality and social psychology.

[6]  B. Leese,et al.  Randomised controlled trial comparing cost effectiveness of general practitioners and nurse practitioners in primary care , 2000, BMJ : British Medical Journal.

[7]  David J Torgerson,et al.  Contamination in trials: is cluster randomisation the answer? , 2001, BMJ : British Medical Journal.

[8]  Xin Tu,et al.  Therapists as fixed versus random effects-some statistical and conceptual issues: a comment on Siemer and Joormann (2003). , 2003, Psychological methods.

[9]  D. A. Kenny,et al.  Consequences of violating the independence assumption in analysis of variance. , 1986 .

[10]  C. Roberts,et al.  The implications of variation in outcome between health professionals for the design and analysis of randomized controlled trials. , 1999, Statistics in medicine.

[11]  B. Wampold,et al.  The consequence of ignoring a nested factor on measures of effect size in analysis of variance. , 2000, Psychological methods.

[12]  Rick H. Hoyle,et al.  Analyzing data from individuals in groups: The past, the present, and the future. , 2001 .

[13]  B. Moser,et al.  The two-sample t test versus satterthwaite's approximate f test , 1989 .

[14]  D. Hoover Clinical trials of behavioural interventions with heterogeneous teaching subgroup effects , 2002, Statistics in medicine.

[15]  J. Mintz,et al.  Implications of therapist effects for the design and analysis of comparative studies of psychotherapies. , 1991, Journal of consulting and clinical psychology.

[16]  D. A. Kenny,et al.  Models of Non-Independence in Dyadic Research , 1996 .

[17]  A. Beck,et al.  Meta‐Analysis of Therapist Effects in Psychotherapy Outcome Studies , 1991 .

[18]  F. E. Satterthwaite An approximate distribution of estimates of variance components. , 1946, Biometrics.

[19]  S. Zeger,et al.  Longitudinal data analysis using generalized linear models , 1986 .

[20]  M. H. Wolf,et al.  Parent Satisfaction With Children's Medical Care: Development, Field Test, and Validation of a Questionnaire , 1986, Medical care.

[21]  Allan Donner,et al.  Design and Analysis of Cluster Randomization Trials in Health Research , 2001 .

[22]  C. Martindale,et al.  The therapist-as-fixed-effect fallacy in psychotherapy research. , 1978, Journal of consulting and clinical psychology.

[23]  Satterthwaite Fe An approximate distribution of estimates of variance components. , 1946 .

[24]  Jutta Joormann,et al.  Power and measures of effect size in analysis of variance with fixed versus random nested factors. , 2003, Psychological methods.

[25]  W. Stiles,et al.  The medical interview satisfaction scale: Development of a scale to measure patient perceptions of physician behavior , 1978, Journal of Behavioral Medicine.

[26]  K. Muller,et al.  A COMPARISON OF POWER APPROXIMATIONS FOR SATTERTHWAITE'S TEST. , 1995, Communications in statistics: Simulation and computation.

[27]  S. Kunte,et al.  Statistical computing , 1999 .

[28]  G M Raab,et al.  Balance in cluster randomized trials. , 2001, Statistics in medicine.

[29]  J. L. Myers,et al.  Group dynamics and individual performances: Pseudogroup and quasi-F analyses. , 1981 .

[30]  F. G. Giesbrecht,et al.  Two-stage analysis based on a mixed model: large-sample asymptotic theory and small-sample simulation results , 1985 .

[31]  M. Thase,et al.  The role of therapist characteristics in training effects in cognitive, supportive-expressive, and drug counseling therapies for cocaine dependence. , 2000, The Journal of psychotherapy practice and research.

[32]  S. Kay,et al.  The positive and negative syndrome scale (PANSS) for schizophrenia. , 1987, Schizophrenia bulletin.

[33]  L. Stead,et al.  Group behaviour therapy programmes for smoking cessation. , 2000, The Cochrane database of systematic reviews.