When should matching be used in the design of cluster randomized trials?

For cluster randomized trials (CRTs) with a small number of clusters, the matched-pair (MP) design, where clusters are paired before randomizing one to each trial arm, is often recommended to minimize imbalance on known prognostic factors, add face-validity to the study, and increase efficiency, provided the analysis recognizes the matching. Little evidence exists to guide decisions on when to use matching. We used simulation to compare the efficiency of the MP design with the stratified and simple designs, based on the mean confidence interval width of the estimated intervention effect. Matched and unmatched analyses were used for the MP design; a stratified analysis was used for the stratified design; and analyses without and with post-stratification adjustment for factors that would otherwise have been used for restricted allocation were used for the simple design. Results showed the MP design was generally the most efficient for CRTs with 10 or more pairs when the correlation between cluster-level outcomes within pairs (matching correlation) was moderate to strong (0.3-0.5). There was little gain in efficiency for the MP or stratified designs compared to simple randomization when the matching correlation was weak (0.05-0.1). For trials with four pairs of clusters, the simple and stratified designs were more efficient than the MP design because greater degrees of freedom were available for the analysis, although an unmatched analysis of the MP design recovered precision for weak matching correlations. Practical guidance on choosing between the MP, stratified, and simple designs is provided.

[1]  Gary King,et al.  The essential role of pair matching in cluster-randomized experiments, with application to the Mexican Universal Health Insurance Evaluation , 2009, 0910.3752.

[2]  P Diehr,et al.  Breaking the matches in a paired t-test for community interventions when the number of pairs is small. , 1995, Statistics in medicine.

[3]  P. Chondros,et al.  Observed intra-cluster correlation coefficients in a cluster survey sample of patient encounters in general practice in Australia , 2004, BMC medical research methodology.

[4]  J. Wardle,et al.  Cluster-randomised trial to evaluate the ‘Change for Life’ mass media/ social marketing campaign in the UK , 2012, BMC Public Health.

[5]  A Donner,et al.  Current and future challenges in the design and analysis of cluster randomization trials , 2001, Statistics in medicine.

[6]  J. Simpson,et al.  Accounting for cluster randomization: a review of primary prevention trials, 1990 through 1993. , 1995, American journal of public health.

[7]  Gary King,et al.  A Politically Robust Experimental Design for Public Policy Evaluation, With Application to the Mexican Universal Health Insurance Program , 2007, Journal of policy analysis and management : [the journal of the Association for Public Policy Analysis and Management].

[8]  J. Abbott,et al.  An educational intervention to prevent overweight in pre-school years: a cluster randomised trial with a focus on disadvantaged families , 2019, BMC Public Health.

[9]  G. Moon,et al.  Context, composition and heterogeneity: using multilevel models in health research. , 1998, Social science & medicine.

[10]  Jonathan L. Blitstein,et al.  Design and analysis of group-randomized trials in cancer: a review of current practices. , 2008, Journal of the National Cancer Institute.

[11]  A Donner,et al.  A methodological review of non-therapeutic intervention trials employing cluster randomization, 1979-1989. , 1990, International journal of epidemiology.

[12]  T D Koepsell,et al.  The effect of matching on the power of randomized community intervention studies. , 1993, Statistics in medicine.

[13]  R J Carroll,et al.  On design considerations and randomization-based inference for community intervention trials. , 1996, Statistics in medicine.

[14]  Catherine M Crespi,et al.  Improved Designs for Cluster Randomized Trials. , 2016, Annual review of public health.

[15]  Sally Kerry,et al.  A Practical Guide to Cluster Randomised Trials in Health Services Research , 2012 .

[16]  Eyal Oren,et al.  Statistical analysis and handling of missing data in cluster randomized trials: a systematic review , 2016, Trials.

[17]  Nick Steen,et al.  Sample Size Calculations for Cluster Randomised Trials , 2000, Journal of health services research & policy.

[18]  B. Kahan,et al.  Improper analysis of trials randomised using stratified blocks or minimisation , 2012, Statistics in medicine.

[19]  M J Campbell,et al.  Cluster randomized trials in general (family) practice research , 2000, Statistical methods in medical research.

[20]  S G Thompson,et al.  The design and analysis of paired cluster randomized trials: an application of meta-analysis techniques. , 1997, Statistics in medicine.

[21]  J. Todd,et al.  Impact of improved treatment of sexually transmitted diseases on HIV infection in rural Tanzania: randomised controlled trial , 1995, The Lancet.

[22]  N. Kerse,et al.  Intraclass correlation coefficients from three cluster randomised controlled trials in primary and residential health care , 2005, Australian and New Zealand journal of public health.

[23]  Richard J. Hayes,et al.  Cluster randomised trials , 2009 .

[24]  A Donner,et al.  The merits of matching in community intervention trials: a cautionary tale. , 1997, Statistics in medicine.

[25]  B. Littenberg,et al.  Intra-cluster correlation coefficients in adults with diabetes in primary care practices: the Vermont Diabetes Information System field survey , 2006, BMC medical research methodology.

[26]  J. Sterne,et al.  Methods for evaluating area-wide and organisation-based interventions in health and health care: a systematic review. , 1999, Health technology assessment.

[27]  S. Raudenbush,et al.  Strategies for Improving Precision in Group-Randomized Experiments , 2007 .

[28]  Karen Tu,et al.  Allocation techniques for balance at baseline in cluster randomized trials: a methodological review , 2012, Trials.

[29]  R. J. Hayes,et al.  Design and analysis issues in cluster-randomized trials of interventions against infectious diseases , 2000, Statistical methods in medical research.

[30]  S. Thompson Letter to the Editor: The merits of matching in community intervention trials: a cautionary tale by N. Klar and A. Donner, Statistics in Medicine, 16, 1753–1764 (1997) , 1998 .

[31]  John B. Carlin,et al.  The Intra‐Cluster Correlation Coefficient in Cluster Randomized Trials: A Review of Definitions , 2009 .

[32]  M K Campbell,et al.  Cluster trials in implementation research: estimation of intracluster correlation coefficients and sample size. , 2001, Statistics in medicine.

[33]  John P A Ioannidis,et al.  Evaluation of cluster randomized controlled trials in sub-Saharan Africa. , 2003, American journal of epidemiology.

[34]  A Donner,et al.  Developments in cluster randomized trials and Statistics in Medicine , 2007, Statistics in medicine.

[35]  Deborah Ashby,et al.  Lessons for cluster randomized trials in the twenty-first century: a systematic review of trials in primary care , 2004, Clinical trials.

[36]  D. Torgerson,et al.  Evidence for risk of bias in cluster randomised trials: review of recent trials published in three general medical journals , 2003, BMJ : British Medical Journal.

[37]  Fan Li,et al.  Review of Recent Methodological Developments in Group-Randomized Trials: Part 1-Design. , 2017, American journal of public health.

[38]  Sandra Eldridge,et al.  Patterns of intra-cluster correlation from primary care research to inform study design and analysis. , 2004, Journal of clinical epidemiology.

[39]  Jessica B. Janega,et al.  Design and analysis of group-randomized trials: a review of recent practices. , 2004, American journal of public health.

[40]  William Rhodes,et al.  Pairwise Cluster Randomization , 2014, Evaluation review.

[41]  P Diehr,et al.  Selected statistical issues in group randomized trials. , 2001, Annual review of public health.

[42]  J. Schafer,et al.  A comparison of inclusive and restrictive strategies in modern missing data procedures. , 2001, Psychological methods.