Early stopping of randomized clinical trials for overt efficacy is problematic.

OBJECTIVE To illustrate controversial issues associated with stopping randomized controlled trials (RCTs) early for apparent benefit. STUDY DESIGN AND SETTING The article presents our review of prior relevant work and our research group's reflections on early stopping. RESULTS Compelling evidence suggests that trials stopped early for benefit systematically overestimate treatment effects, sometimes by a large amount. Unresolved controversies in trials stopped early for benefit include ethical and statistical problems in the interpretation of results. CONCLUSIONS The best strategy to minimize the problems associated with early stopping of RCTs for benefit is not to stop early. As an alternative, we suggest a threefold approach: a low P-value as the threshold for stopping at the time of interim analyses, not to look before a sufficiently large number of events has accrued and continuation of enrollment and follow-up for a further period.

[1]  J. Ioannidis,et al.  Evolution of treatment effects over time: empirical insight from recursive cumulative metaanalyses. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Douglas G. Altman,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials , 2001, The Lancet.

[3]  D. Spiegelhalter,et al.  Reported use of data monitoring committees in the main published reports of randomized controlled trials: a cross-sectional study , 2004, Clinical trials.

[4]  J. Manola,et al.  Celecoxib versus placebo for men with prostate cancer and a rising serum prostate-specific antigen after radical prostatectomy and/or radiation therapy. , 2006, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[5]  Emmanuel Lagarde,et al.  Randomized, Controlled Intervention Trial of Male Circumcision for Reduction of HIV Infection Risk: The ANRS 1265 Trial , 2005, PLoS medicine.

[6]  Gordon H Guyatt,et al.  Randomized trials stopped early for benefit: a systematic review. , 2005, JAMA.

[7]  J. Haybittle,et al.  Repeated assessment of results in clinical trials of cancer treatment. , 1971, The British journal of radiology.

[8]  M. Pike,et al.  Design and analysis of randomized clinical trials requiring prolonged observation of each patient. II. analysis and examples. , 1977, British Journal of Cancer.

[9]  K. K. Lan,et al.  Discrete sequential boundaries for clinical trials , 1983 .

[10]  C. Grady,et al.  What makes clinical research ethical? , 2000, JAMA.

[11]  L. Schieve The promise of single-embryo transfer. , 2006, The New England journal of medicine.

[12]  R Peto,et al.  Why do we need some large, simple randomized trials? , 1984, Statistics in medicine.

[13]  Michel Camus,et al.  In vitro fertilization with single blastocyst-stage versus single cleavage-stage embryos. , 2006, The New England journal of medicine.

[14]  J. Stockman Male circumcision for HIV prevention in men in Rakai, Uganda: a randomised trial , 2008 .

[15]  I. Olkin,et al.  Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement , 1999, The Lancet.

[16]  Sydes,et al.  A proposed charter for clinical trial data monitoring committees: helping them to do their job well , 2005, The Lancet.

[17]  E. Veys,et al.  HL-A AND INFECTIVE SACROILEITIS , 1974 .

[18]  G. Guyatt,et al.  Are the recommendations to use perioperative β-blocker therapy in patients undergoing noncardiac surgery based on reliable evidence? , 2004, Canadian Medical Association Journal.

[19]  Stuart J Pocock,et al.  Current controversies in data monitoring for clinical trials , 2006, Clinical trials.

[20]  D. Berry Bayesian clinical trials , 2006, Nature Reviews Drug Discovery.

[21]  Jeroen J. Bax,et al.  The effect of bisoprolol on perioperative mortality and myocardial infarction in high-risk patients undergoing vascular surgery. Dutch Echocardiographic Cardiac Risk Evaluation Applying Stress Echocardiography Study Group. , 1999, The New England journal of medicine.

[22]  R. DuBois,et al.  Cyclooxygenase-2 selective inhibitors and prostate cancer: what is the clinical benefit? , 2006, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[23]  R. Glazier,et al.  A randomized, double-blind, placebo-controlled trial of combined nevirapine and zidovudine compared with nevirapine alone in the prevention of perinatal transmission of HIV in Zimbabwe. , 2007, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[24]  G. Guyatt,et al.  Systematic reviewers neglect bias that results from trials stopped early for benefit. , 2007, Journal of clinical epidemiology.

[25]  B. Freedman Equipoise and the ethics of clinical research. , 1987, The New England journal of medicine.

[26]  K. Schulz,et al.  Multiplicity in randomised trials II: subgroup and interim analyses , 2005, The Lancet.

[27]  Rachel Churchill,et al.  Effect sizes in cumulative meta-analyses of mental health randomized trials evolved over time. , 2004, Journal of clinical epidemiology.

[28]  P. Armitage,et al.  Design and analysis of randomized clinical trials requiring prolonged observation of each patient. I. Introduction and design. , 1976, British Journal of Cancer.

[29]  Sarah Parish,et al.  Randomized trial of intravenous streptokinase, oral aspirin, both, or neither among 17,187 cases of suspected acute myocardial infarction: ISIS-2.ISIS-2 (Second International Study of Infarct Survival) Collaborative Group. , 1988, Journal of the American College of Cardiology.

[30]  G. Guyatt,et al.  Ethical Issues in Stopping Randomized Trials Early Because of Apparent Benefit , 2007, Annals of Internal Medicine.

[31]  S. Pocock,et al.  Stopping rules and estimation problems in clinical trials. , 1988, Statistics in medicine.

[32]  M Gent,et al.  How should results from completed studies influence ongoing clinical trials? The CAFA Study experience. , 1991, Annals of internal medicine.

[33]  S. Pocock,et al.  Trials stopped early: too good to be true? , 1999, The Lancet.

[34]  M D Hughes,et al.  Practical problems in interim analyses, with particular regard to estimation. , 1989, Controlled clinical trials.

[35]  P. O'Brien,et al.  A multiple testing procedure for clinical trials. , 1979, Biometrics.

[36]  M. Hallman,et al.  Pretreatment cortisol values may predict responses to hydrocortisone administration for the prevention of bronchopulmonary dysplasia in high-risk infants. , 2005, The Journal of pediatrics.

[37]  Arthur S Slutsky,et al.  Data safety and monitoring boards. , 2004, The New England journal of medicine.

[38]  I. Olkin,et al.  Improving the Quality of Reports of Meta-Analyses of Randomised Controlled Trials: The QUOROM Statement , 2000, Oncology Research and Treatment.

[39]  B. Thiers Male circumcision for HIV prevention in young men in Kisumu, Kenya: a randomised controlled trial , 2008 .