Ethics, data-dependent designs, and the strategy of clinical trials: time to start learning-as-we-go?

The seeds of modern clinical trials were unwittingly sown with the first use of randomization in a 1920s agricultural field experiment. The historical development of trials is briefly reviewed here, as are multi-farious pressures and problems faced by those involved with clinical trials today. These challenges include recruitment difficulties, the emerging rôle of patient support groups, and legal threats over informed consent, to name three. Fundamentally, they re‘ect an overall shift towards patient-centred, individual ethics. I suggest many problems may be overcome by increased implementation of hitherto neglected, data-dependent designs for clinical trials. Over a dozen arguments against their use are countered, primarily through ethical considerations. Benefits and costs of refining clinical trials strategy are explored hypothetically under enhanced use of such ‘learn-as-you-go’ designs, in contrast to traditional, equal-allocation, fixed-sample-size and frequentist-based designs. These latter methods mirror crop field trials in which one cannot make scientific progress until after gathering objective data at harvest time. Some attempts to alleviate certain problems, such as Zelen randomization to boost recruitment, or over-reliance on ‘large and simple trials’ to detect moderate-sized treatment effects, are discussed and found inadequate. A proposal for wider discussion is made to assist the selective introduction of ‘small and complex trials,’ which could simultaneously expedite medical research, satisfy the concerns of regulators, statisticians, and doctors alike, and help address the growing demands of 21st-century patients.

[1]  K. Pearson Mathematical Contributions to the Theory of Evolution. III. Regression, Heredity, and Panmixia , 1896 .

[2]  Student,et al.  THE PROBABLE ERROR OF A MEAN , 1908 .

[3]  G. K. Hirst British Medical Journal , 1927 .

[4]  Student The Lanarkshire Milk Experiment , 1931 .

[5]  E. M. Elderton THE LANARKSHIRE MILK EXPERIMENT , 1933 .

[6]  F. J. Anscombe Sequential Medical Trials , 1963 .

[7]  T. Colton A Model for Selecting One of Two Medical Treatments , 1963 .

[8]  L. H. Long The world almanac and book of facts , 1966 .

[9]  M. Zelen,et al.  Play the Winner Rule and the Controlled Clinical Trial , 1969 .

[10]  B. Efron Forcing a sequential experiment to be balanced , 1971 .

[11]  J. Lellouch,et al.  L'essai therapeutique: ethique individuelle ou ethique collective? , 1971 .

[12]  P. Armitage,et al.  Sequential medical trials. 2nd edition. , 1975 .

[13]  R. Simon,et al.  Adaptive treatment assignment methods and clinical trials. , 1977, Biometrics.

[14]  S. Pocock Group sequential methods in the design and analysis of clinical trials , 1977 .

[15]  L. J. Wei,et al.  The Randomized Play-the-Winner Rule in Medical Trials , 1978 .

[16]  M. Zelen A new design for randomized clinical trials. , 1979, The New England journal of medicine.

[17]  J. Gittins Bandit processes and dynamic allocation indices , 1979 .

[18]  P. O'Brien,et al.  A multiple testing procedure for clinical trials. , 1979, Biometrics.

[19]  D. DeMets,et al.  How informed is informed consent?: The BHAT experience , 1981 .

[20]  D. Clayton,et al.  Ethically optimised designs. , 1982, British journal of clinical pharmacology.

[21]  R. Kirby Ethics and Regulation Of Clinical Research , 1982 .

[22]  R Peto,et al.  Why do we need some large, simple randomized trials? , 1984, Statistics in medicine.

[23]  S. Pocock,et al.  Clinical Trials: A Practical Approach , 1984 .

[24]  P. Armitage The search for optimality in clinical trials , 1985 .

[25]  J. Ware,et al.  Extracorporeal circulation in neonatal respiratory failure: a prospective randomized study. , 1985, Pediatrics.

[26]  Bayes Rules for a Clinical-Trials Model with Dichotomous Responses , 1986 .

[27]  P. W. Jones,et al.  Bandit Problems, Sequential Allocation of Experiments , 1987 .

[28]  K. Boyd,et al.  Ethics and Regulation of Clinical Research , 1988 .

[29]  Stephen G. Eick,et al.  The two-armed bandit with delayed responses , 1988 .

[30]  R. Simon,et al.  Optimal two-stage designs for phase II clinical trials. , 1989, Controlled clinical trials.

[31]  W. Silverman,et al.  The myth of informed consent: in daily practice and in clinical trials. , 1989, Journal of medical ethics.

[32]  Colin B. Begg,et al.  On inferences from Wei's biased coin design for clinical trials , 1990 .

[33]  L. J. Wei,et al.  Statistical Inference with Data-Dependent Treatment Allocation Rules , 1990 .

[34]  M Zelen,et al.  Randomized consent designs for clinical trials: an update. , 1990, Statistics in medicine.

[35]  C R Palmer A comparative phase II clinical trials procedure for choosing the best of three treatments. , 1991, Statistics in medicine.

[36]  R. Lilford,et al.  At what level of collective equipoise does a clinical trial become ethical? , 1991, Journal of medical ethics.

[37]  D G Altman,et al.  Statistics in medical journals: developments in the 1980s. , 1991, Statistics in medicine.

[38]  P Armitage,et al.  Comparison of Bayesian with group sequential methods for monitoring clinical trials. , 1991, Controlled clinical trials.

[39]  [Ethics and Statistics in Randomized Clinical Trials]: Rejoinder , 1991 .

[40]  C. J. Williams,et al.  Introducing new treatments for cancer : practical, ethical and legal problems , 1992 .

[41]  S S Ellenberg,et al.  Randomized consent designs for clinical trials: an update. , 1992, Statistics in Medicine.

[42]  R Peto,et al.  Large-scale randomized evidence: large, simple trials and overviews of trials. , 1993, Annals of the New York Academy of Sciences.

[43]  C R Palmer Ethics and statistical methodology in clinical trials. , 1993, Journal of medical ethics.

[44]  J M Lachin,et al.  The use of response-adaptive designs in clinical trials. , 1993, Controlled clinical trials.

[45]  S. Ellenberg,et al.  The utility of large, simple trials in the evaluation of AIDS treatment strategies. , 1994, Statistics in medicine.

[46]  Douglas E. Faries,et al.  A Case Study of an Adaptive Clinical Trial in the Treatment of Out-Patients with Depressive Disorder , 1994 .

[47]  D G Altman,et al.  The scandal of poor medical research , 1994, BMJ.

[48]  David J. Spiegelhalter,et al.  Bayesian Approaches to Randomized Trials , 1994, Bayesian Biostatistics.

[49]  R. Gelber,et al.  Reduction of maternal-infant transmission of human immunodeficiency virus type 1 with zidovudine treatment. Pediatric AIDS Clinical Trials Group Protocol 076 Study Group. , 1994, The New England journal of medicine.

[50]  R J Lilford,et al.  Equipoise and the ethics of randomization. , 1995, Journal of the Royal Society of Medicine.

[51]  J B Kadane,et al.  Prime time for Bayes. , 1995, Controlled clinical trials.

[52]  M. Niu,et al.  Nevirapine, Zidovudine, and Didanosine Compared with Zidovudine and Didanosine in Patients with HIV-1 Infection , 1996, Annals of Internal Medicine.

[53]  D G Altman,et al.  Absence of evidence is not evidence of absence. , 1996, Australian veterinary journal.

[54]  William F. Rosenberger,et al.  New directions in adaptive designs , 1996 .

[55]  D. Chadwick,et al.  Implications of socio-cultural contexts for the ethics of clinical trials. , 1997, Health technology assessment.

[56]  J. Donovan,et al.  Diagnosis, management and screening of early localised prostate cancer. , 1997, Health technology assessment.

[57]  S. Senn Are placebo run ins justified? , 1997, BMJ.

[58]  Surrogate endpoints. , 1997, AIDS clinical review.

[59]  M. Angell The ethics of clinical research in the Third World. , 1997, The New England journal of medicine.

[60]  David Braunholtz,et al.  Why “underpowered” trials are not necessarily unethical , 1997, The Lancet.

[61]  Fifty years of randomised controlled trials , 1998 .

[62]  When big may not be beautiful , 1998, BMJ.

[63]  R. Lilford,et al.  The ethics of randomised controlled trials from the perspectives of patients, the public, and healthcare professionals , 1998, BMJ.

[64]  A. Carr,et al.  Primary total hip replacement surgery: a systematic review of outcomes and modelling of cost-effectiveness associated with different prostheses. , 1998, Health technology assessment.

[65]  R. Lilford,et al.  Informed consent for clinical trials: in search of the "best" method. , 1998, Social science & medicine.

[66]  R. Hammerschlag Methodological and ethical issues in clinical trials of acupuncture. , 1998, Journal of alternative and complementary medicine.

[67]  R J Lilford,et al.  Ethical issues in the design and conduct of randomised controlled trials. , 1998, Health technology assessment.

[68]  G. Murray The design and analysis of sequential clinical trials. , 1998 .

[69]  A. Vail Experiences of a biostatistician on a U.K. Research Ethics Committee. , 1998, Statistics in medicine.

[70]  T. Treasure,et al.  Minimisation: the platinum standard for trials? , 1998, BMJ.

[71]  J. Gatell,et al.  Avanti 1: Randomized, Double-Blind Trial to Evaluate the Efficacy and Safety of Zidovudine plus Lamivudine versus Zidovudine plus Lamivudine plus Loviride in HIV-Infected Antiretroviral-Naive Patients , 1998, Antiviral therapy.

[72]  C. Palmer,et al.  Ethics and Practice , 1999 .

[73]  B. Turnbull,et al.  Group Sequential Methods with Applications to Clinical Trials , 1999 .

[74]  J. Whitehead On being the statistician on a Data and Safety Monitoring Board. , 1999, Statistics in medicine.

[75]  D. Elbourne,et al.  Zelen randomization: attitudes of parents participating in a neonatal clinical trial. , 1998, Controlled clinical trials.

[76]  E Bjørn,et al.  Can the written information to research subjects be improved?--an empirical study. , 1999, Journal of medical ethics.

[77]  J. Williamson,et al.  Health outcomes associated with calcium antagonists compared with other first-line antihypertensive therapies: a meta-analysis of randomised controlled trials , 2000, The Lancet.

[78]  S J Evans,et al.  Pharmacovigilance: a science or fielding emergencies? , 2000, Statistics in medicine.

[79]  C. Begg,et al.  On the use of surrogate end points in randomized trials , 2000 .

[80]  J. Hutton,et al.  Statistical review by research ethics committees , 2000 .

[81]  Giuseppe Mancia,et al.  Morbidity and mortality in patients randomised to double-blind treatment with a long-acting calcium-channel blocker or diuretic in the International Nifedipine GITS study: Intervention as a Goal in Hypertension Treatment (INSIGHT) , 2000, The Lancet.

[82]  J. Hutton Ethics of medical research in developing countries: the role of international codes of conduct , 2000, Statistical methods in medical research.

[83]  N Stallard,et al.  Optimal Adaptive Designs for Binary Response Trials , 2001, Biometrics.

[84]  M. Tattersall,et al.  Examining informed consent to cancer clinical trials , 2001, The Lancet.

[85]  Hiroshi Nishiyama,et al.  Points to consider on switching between superiority and non-inferiority. , 2006, British journal of clinical pharmacology.

[86]  D. Pullman,et al.  Adaptive designs, informed consent, and the ethics of research. , 2001, Controlled clinical trials.

[87]  J A Nelder,et al.  Statistics in medical journals: some recent trends. , 2001, Statistics in medicine.

[88]  R. Lilford,et al.  Monitoring clinical trials—interim data should be publicly available , 2001, BMJ : British Medical Journal.

[89]  S M Bird Monitoring clinical trials. Dissemination of decisions on interim analyses needs wider debate. , 2001, BMJ.

[90]  R. Horton,et al.  The clinical trial: deceitful, disputable, unbelievable, unhelpful, and shameful--what next? , 2001, Controlled clinical trials.

[91]  A. Biswas Adaptive designs for binary treatment responses in phase III clinical trials: controversies and progress , 2001, Statistical methods in medical research.

[92]  J G Thornton,et al.  Prospective application of Bayesian monitoring and analysis in an ‘open’ randomized clinical trial , 2001, Statistics in medicine.

[93]  Steven Joffe,et al.  Quality of informed consent in cancer clinical trials: a cross-sectional survey , 2001, The Lancet.

[94]  B. Wiens,et al.  Choosing an equivalence limit for noninferiority or equivalence studies. , 2002, Controlled clinical trials.

[95]  B. Fildes,et al.  Graduated licensing programmes and young-driver crashes , 2002, The Lancet.

[96]  William F. Rosenberger,et al.  Asymptotic Properties of Adaptive designs for Clinical Trials with delayed Response , 2002 .

[97]  S Holm,et al.  Principles of Biomedical Ethics, 5th edn. , 2002 .

[98]  J. Matthews,et al.  Randomization in Clinical Trials: Theory and Practice; , 2003 .