Response to “Why all randomized controlled trials produce biased results”

In April 2018, the Annals of Medicine published a provocative piece titled “Why all randomised controlled trials produce biased results.” While the strengths and limitations of RCTs remain a fertile discussion topic, the piece in question leaves much to be desired. In many places, the piece ignores prior literature that explains and/or refutes several key points. Absent a formal response, this piece may create confusion to understanding of RCTs in the research community.

[1]  A. Krauss.  Why all randomised controlled trials produce biased results , 2018, Annals of medicine.

[2]  Imbalance control in clinical trial subject randomization-from philosophy to strategy. , 2018, Journal of clinical epidemiology.

[3]  M. Parmar,et al.  Adding abiraterone or docetaxel to long-term hormone therapy for prostate cancer: directly randomised data from the STAMPEDE multi-arm, multi-stage platform protocol , 2018, Annals of oncology : official journal of the European Society for Medical Oncology.

[4]  M. Parmar,et al.  Testing many treatments within a single protocol over 10 years at MRC Clinical Trials Unit at UCL: Multi-arm, multi-stage platform, umbrella and basket protocols , 2017, Clinical trials.

[5]  John D. Davis,et al.  Effects of RG7652, a Monoclonal Antibody Against PCSK9, on LDL-C, LDL-C Subfractions, and Inflammatory Biomarkers in Patients at High Risk of or With Established Coronary Heart Disease (from the Phase 2 EQUATOR Study). , 2017, The American journal of cardiology.

[6]  Deepak L. Bhatt,et al.  Adaptive Designs for Clinical Trials. , 2016, The New England journal of medicine.

[7]  Giovanni Parmigiani,et al.  I-SPY 2--A Glimpse of the Future of Phase 2 Drug Development? , 2016, The New England journal of medicine.

[8]  R. Laing,et al.  Addition of docetaxel, zoledronic acid, or both to first-line long-term hormone therapy in prostate cancer (STAMPEDE): survival results from an adaptive, multiarm, multistage, platform randomised controlled trial , 2016, The Lancet.

[9]  S. Berry,et al.  Efficiencies of platform clinical trials: A vision of the future , 2016, Clinical trials.

[10]  Derek C Angus,et al.  Fusing Randomized Trials With Big Data: The Key to Self-learning Health Care Systems? , 2015, JAMA.

[11]  J. Connor,et al.  The platform trial: an efficient strategy for evaluating multiple treatments. , 2015, JAMA.

[12]  Noel W Clarke,et al.  Combining enzalutamide with abiraterone, prednisone, and androgen deprivation therapy in the STAMPEDE trial. , 2014, European urology.

[13]  Jason T Connor,et al.  The utility of Bayesian predictive probabilities for interim monitoring of clinical trials , 2014, Clinical trials.

[14]  N. Simon,et al.  Adaptive enrichment designs for clinical trials. , 2013, Biostatistics.

[15]  Feifang Hu,et al.  Balancing continuous covariates based on Kernel densities. , 2013, Contemporary clinical trials.

[16]  S. Senn.  Seven myths of randomisation in clinical trials , 2011, Statistics in medicine.

[17]  M. Parmar,et al.  Flexible trial design in practice - stopping arms for lack-of-benefit and adding research arms mid-trial in STAMPEDE: a multi-arm multi-stage randomized controlled trial , 2012, Trials.

[18]  Yunzhi Lin,et al.  Balancing continuous and categorical baseline covariates in sequential clinical trials using the area between empirical cumulative distribution functions , 2012, Statistics in medicine.

[19]  Wenle Zhao,et al.  Block urn design - a new randomization algorithm for sequential trials with two or more treatments and balanced or unbalanced allocation. , 2011, Contemporary clinical trials.

[20]  関 厚二朗,et al.  Tissue plasminogen activator for acute ischemic stroke , 2011 .

[21]  Zheng Su.  Balancing multiple baseline characteristics in randomized clinical trials. , 2011, Contemporary clinical trials.

[22]  Wenle Zhao,et al.  Quantifying the cost in power of ignoring continuous covariate imbalances in clinical trial randomization. , 2011, Contemporary clinical trials.

[23]  Richard Emsley,et al.  Ian R White interventions Mediation and moderation of treatment effects in randomised controlled trials of complex , 2010 .

[24]  D. Taves,et al.  Rank-Minimization for balanced assignment of subjects in clinical trials. , 2010, Contemporary clinical trials.

[25]  M. Parmar,et al.  Issues in applying multi-arm multi-stage methodology to a clinical trial in prostate cancer: the MRC STAMPEDE trial , 2009, Trials.

[26]  Edward S. Kim,et al.  Bayesian adaptive design for targeted therapy development in lung cancer — a step toward personalized medicine , 2008, Clinical trials.

[27]  Mark Cary,et al.  Causal mediation analyses for randomized trials , 2008, Health Services and Outcomes Research Methodology.

[28]  Kevin G Lynch,et al.  Causal Mediation Analyses with Rank Preserving Models , 2007, Biometrics.

[29]  Isao Yoshimura,et al.  Minimization method for balancing continuous prognostic variables between treatment and control groups using Kullback-Leibler divergence. , 2006, Contemporary clinical trials.

[30]  Stephen Senn,et al.  Controversies concerning randomization and additivity in clinical trials , 2004, Statistics in medicine.

[31]  J. Robins,et al.  Estimation of treatment effects in randomised trials with non-compliance and a dichotomous outcome using structural mean models , 2004 .

[32]  J. Berlin,et al.  Bevacizumab plus irinotecan, fluorouracil, and leucovorin for metastatic colorectal cancer. , 2004, The New England journal of medicine.

[33]  Anastasia Ivanova,et al.  Minimizing predictability while retaining balance through the use of less restrictive randomization procedures , 2003, Statistics in medicine.

[34]  Marshall Joffe,et al.  Causal logistic models for non‐compliance under randomized treatment with univariate binary response , 2003, Statistics in medicine.

[35]  H. Kraemer,et al.  Mediators and moderators of treatment effects in randomized clinical trials. , 2002, Archives of general psychiatry.

[36]  B. Bistrian,et al.  Intensive insulin therapy in critically ill patients. , 2002, The New England journal of medicine.

[37]  M Schetz,et al.  Intensive insulin therapy in critically ill patients. , 2001, The New England journal of medicine.

[38]  Chen Yung-Pin,et al.  Biased coin design with imbalance tolerance , 1999 .

[39]  James Frane,et al.  A Method of Biased Coin Randomization, Its Implementation, and Its Validation , 1998 .

[40]  Koroshetz Wj,et al.  Tissue plasminogen activator for acute ischemic stroke. , 1996, The New England journal of medicine.

[41]  Joseph P. Broderick,et al.  Tissue plasminogen activator for acute ischemic stroke. The National Institute of Neurological Disorders and Stroke rt-PA Stroke Study Group. , 1995 .

[42]  L Wasserman,et al.  Robust Bayesian methods for monitoring clinical trials. , 1995, Statistics in medicine.

[43]  S. Senn.  Testing for baseline balance in clinical trials. , 1994, Statistics in medicine.

[44]  J. Robins.  Correcting for non-compliance in randomized trials using structural nested mean models , 1994 .

[45]  S J Senn,et al.  Covariate imbalance and random allocation in clinical trials. , 1989, Statistics in medicine.

[46]  F K Hoehler,et al.  Balancing allocation of subjects in biomedical research: a minimization strategy based on ranks. , 1987, Computers and biomedical research, an international journal.

[47]  D. Altman.  Comparability of Randomised Groups , 1985 .

[48]  C. F. Wu,et al.  Some Restricted randomization rules in sequential designs , 1983 .

[49]  S. Pocock,et al.  Sequential treatment assignment with balancing for prognostic factors in the controlled clinical trial. , 1975, Biometrics.

[50]  D R Taves,et al.  Minimization: A new method of assigning patients to treatment and control groups , 1974, Clinical pharmacology and therapeutics.