Rerandomization to improve covariate balance in experiments

Randomized experiments are the "gold standard" for estimating causal effects, yet often in practice, chance imbalances exist in covariate distributions between treatment groups. If covariate data are available before units are exposed to treatments, these chance imbalances can be mitigated by first checking covariate balance before the physical experiment takes place. Provided a precise definition of imbalance has been specified in advance, unbalanced randomizations can be discarded, followed by a rerandomization, and this process can continue until a randomization yielding balance according to the definition is achieved. By improving covariate balance, rerandomization provides more precise and trustworthy estimates of treatment effects.

[1]  R Fisher,et al.  Design of Experiments , 1936 .

[2]  J. I.  The Design of Experiments , 1936, Nature.

[3]  Student.  Comparison Between Balanced and Random Arrangements of Field Plots , 1938 .

[4]  Frank Yates,et al.  THE COMPARATIVE ADVANTAGES OF SYSTEMATIC AND RANDOMIZED ARRANGEMENTS IN THE DESIGN OF AGRICULTURAL AND BIOLOGICAL EXPERIMENTS , 1939 .

[5]  F. J. Anscombe,et al.  The Validity of Comparative Experiments , 1948 .

[6]  M. Healy,et al.  Restricted randomization and quasi-Latin squares , 1950 .

[7]  Oscar Kempthorne,et al.  THE RANDOMIZATION THEORY OF' EXPERIMENTAL INFERENCE* , 1955 .

[8]  B. Efron.  Forcing a sequential experiment to be balanced , 1971 .

[9]  W. Youden.  Randomization and Experimentation , 1972 .

[10]  Donald B. Rubin,et al.  Multivariate matching methods that are equal percent bias reducing , 1974 .

[11]  Donald B. Rubin,et al.  MULTIVARIATE MATCHING METHODS THAT ARE EQUAL PERCENT BIAS REDUCING, I: SOME EXAMPLES , 1974 .

[12]  W. G. Cochran,et al.  Controlling Bias in Observational Studies: A Review. , 1974 .

[13]  S. Pocock,et al.  Sequential treatment assignment with balancing for prognostic factors in the controlled clinical trial. , 1975, Biometrics.

[14]  David A. Harville,et al.  Experimental Randomization: Who Needs It? , 1975 .

[15]  Donald B. Rubin,et al.  Multivariate matching methods that are equal percent bias reducing , 1974 .

[16]  Donald B. Rubin,et al.  Bayesian Inference for Causal Effects: The Role of Randomization , 1978 .

[17]  The management of weather resources. , 1978, Science.

[18]  H A Wendel,et al.  Randomization in clinical trials. , 1978, Science.

[19]  L. Freedman,et al.  Allocation of patients to treatment groups in a controlled clinical study. , 1978, British Journal of Cancer.

[20]  R. Simon,et al.  Restricted randomization designs in clinical trials. , 1979, Biometrics.

[21]  Pocock Sj,et al.  Allocation of patients to treatment in clinical trials. , 1979 .

[22]  S J Pocock,et al.  Allocation of patients to treatment in clinical trials. , 1979, Biometrics.

[23]  Carl N. Morris,et al.  A finite selection model for experimental design of the health insurance study , 1979 .

[24]  D. V. Lindley,et al.  Randomization Analysis of Experimental Data: The Fisher Randomization Test Comment , 1980 .

[25]  D. Basu.  Randomization Analysis of Experimental Data: The Fisher Randomization Test , 1980 .

[26]  Norton Holschuh,et al.  Randomization and Design: I , 1980 .

[27]  Teddy Seidenfeld,et al.  Levi on the Dogma of Randomization in Experiments , 1981 .

[28]  Peter Urbach,et al.  Randomization and the Design of Experiments , 1985, Philosophy of Science.

[29]  N. Birkett,et al.  Adaptive allocation in randomized controlled trials. , 1985, Controlled clinical trials.

[30]  Changbao Wu,et al.  Optimality of random allocation design for the control of accidental bias in sequential experiments , 1985 .

[31]  R. A. Bailey,et al.  Valid randomization , 1987, Proceedings of the Royal Society of London. A. Mathematical and Physical Sciences.

[32]  D. Rubin.  [On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9.] Comment: Neyman (1923) and Causal Inference in Experiments and Observational Studies , 1990 .

[33]  Donald B. Rubin,et al.  Affinely Invariant Matching Methods with Ellipsoidal Distributions , 1992 .

[34]  Rory A. Fisher,et al.  The Arrangement of Field Experiments , 1992 .

[35]  J. Tukey.  Tightening the clinical trial. , 1993, Controlled clinical trials.

[36]  D. A. Sprott,et al.  Randomization in experimental science , 1993 .

[37]  Paul H. Garthwaite,et al.  CONFIDENCE INTERVALS FROM RANDOMIZATION TESTS , 1996 .

[38]  Jennifer Hill,et al.  The Health Insurance Experiment: Design Using the Finite Selection Model , 2000 .

[39]  Mikel Aickin,et al.  Randomization, balance, and the validity and efficiency of design-adaptive allocation methods , 2001 .

[40]  W. Rosenberger,et al.  Randomization in Clinical Trials: Theory and Practice , 2002 .

[41]  Marion K Campbell,et al.  The method of minimization for allocation to clinical trials. a review. , 2002, Controlled clinical trials.

[42]  Anthony C. Atkinson,et al.  The comparison of designs for sequential clinical trials with covariate information , 2002 .

[43]  M. Krause,et al.  What random assignment does and does not do. , 2003, Journal of clinical psychology.

[44]  Damian McEntegart,et al.  The Pursuit of Balance Using Stratified and Dynamic Randomization Techniques: An Overview , 2003 .

[45]  Lawrence H Moulton,et al.  Covariate-based constrained randomization of group-randomized trials , 2004, Clinical trials.

[46]  Paul Erdős,et al.  ON THE CENTRAL LIMIT THEOREM FOR SAMPLES FROM A FINITE POPULATION , 2004 .

[47]  Jeffrey H Silber,et al.  Optimal multivariate matching before randomization. , 2004, Biostatistics.

[48]  S. Schneeweiss,et al.  Measuring prescribing improvements in pragmatic trials of educational tools for general practitioners. , 2006, Basic & clinical pharmacology & toxicology.

[49]  D. Rubin.  Matched Sampling for Causal Effects , 2006 .

[50]  Gary King,et al.  Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference , 2007, Political Analysis.

[51]  Jake Bowers,et al.  Covariate balance in simple stratified and clustered comparative studies , 2008, 0808.3857.

[52]  Miriam Bruhn,et al.  In Pursuit of Balance: Randomization in Practice in Development Field Experiments , 2008 .

[53]  Adjusting Experimental Data , 2008 .

[54]  William F. Rosenberger,et al.  Handling Covariates in the Design of Clinical Trials. , 2008, 1102.3773.

[55]  David A. Freedman,et al.  On regression adjustments to experimental data , 2008, Adv. Appl. Math..

[56]  Donald B. Rubin,et al.  Comment: The Design and Analysis of Gold Standard Randomized Experiments , 2008 .

[57]  Gary King,et al.  Misunderstandings between experimentalists and observationalists about causal inference , 2008 .

[58]  D. Rubin.  For objective causal inference, design trumps analysis , 2008, 0811.1640.

[59]  Gary King,et al.  The essential role of pair matching in cluster-randomized experiments, with application to the Mexican Universal Health Insurance Evaluation , 2009, 0910.3752.

[60]  David R. Cox,et al.  Randomization in the Design of Experiments , 2009 .

[61]  J. Worrall.  Evidence: philosophy of science meets medicine. , 2010, Journal of evaluation in clinical practice.

[62]  Zhenzhen Xu,et al.  Propensity Score Matching in Randomized Clinical Trials , 2010, Biometrics.

[63]  Kari Frazer Lock,et al.  Rerandomization to Improve Covariate Balance in Randomized Experiments , 2011 .