Determining optimal sample sizes for multistage adaptive randomized clinical trials from an industry perspective using value of information methods

Background  Most often, sample size determinations for randomized clinical trials are based on frequentist approaches that depend on somewhat arbitrarily chosen factors, such as type I and II error probabilities and the smallest clinically important difference. As an alternative, many authors have proposed decision-theoretic (full Bayesian) approaches, often referred to as value of information methods that attempt to determine the sample size that maximizes the difference between the trial’s expected utility and its expected cost, referred to as the expected net gain. Taking an industry perspective, Willan proposes a solution in which the trial’s utility is the increase in expected profit. Furthermore, Willan and Kowgier, taking a societal perspective, show that multistage designs can increase expected net gain. Purpose  The purpose of this article is to determine the optimal sample size using value of information methods for industry-based, multistage adaptive randomized clinical trials, and to demonstrate the increase in expected net gain realized. At the end of each stage, the trial’s sponsor must decide between three actions: continue to the next stage, stop the trial and seek regulatory approval, or stop the trial and abandon the drug. Methods  A model for expected total profit is proposed that includes consideration of per-patient profit, disease incidence, time horizon, trial duration, market share, and the relationship between trial results and probability of regulatory approval. The proposed method is extended to include multistage designs with a solution provided for a two-stage design. An example is given. Results  Significant increases in the expected net gain are realized by using multistage designs. Limitations  The complexity of the solutions increases with the number of stages, although far simpler near-optimal solutions exist. The method relies on the central limit theorem, assuming that the sample size is sufficiently large so that the relevant statistics are normally distributed. Conclusion  From a value of information perspective, the use of multistage designs in industry trials leads to significant gains in the expected net gain.

[1]  Hamid. Pezeshk,et al.  How large should a clinical trial be , 2000 .

[2]  Hamid Pezeshk,et al.  A Bayesian cost–benefit approach to the determination of sample size in clinical trials , 2008, Statistics in medicine.

[3]  Andrew R Willan,et al.  Time and expected value of sample information wait for no patient. , 2008, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[4]  John Gittins,et al.  A Behavioral Bayes Method for Determining the Size of a Clinical Trial , 2000 .

[5]  Andrew R Willan,et al.  Clinical decision making and the expected value of information , 2007, Clinical trials.

[6]  Hamid Pezeshk,et al.  A Fully Bayesian Approach to Calculating Sample Sizes for Clinical Trials with Binary Responses , 2002 .

[7]  Andrew R Willan,et al.  Expected value of information and decision making in HTA. , 2007, Health economics.

[8]  K Claxton,et al.  The irrelevance of inference: a decision-making approach to the stochastic evaluation of health care technologies. , 1999, Journal of health economics.

[9]  Andrew R Willan,et al.  Planned caesarean section versus planned vaginal birth for breech presentation at term: a randomised multicentre trial , 2000, The Lancet.

[10]  K Claxton,et al.  An economic approach to clinical trial design and research priority-setting. , 1996, Health economics.

[11]  K M Thompson,et al.  A dynamic programming approach to the efficient design of clinical trials. , 2001, Journal of health economics.

[12]  Andrew R Willan,et al.  Globally optimal trial design for local decision making. , 2009, Health economics.

[13]  Andrew R Willan,et al.  The value of information and optimal clinical trial design , 2005, Statistics in medicine.

[14]  Andrew R Willan,et al.  Optimal sample size determinations from an industry perspective based on the expected value of information , 2008, Clinical trials.

[15]  H. Raiffa,et al.  Applied Statistical Decision Theory. , 1961 .

[16]  J Halpern,et al.  Designing a cost-effective clinical trial. , 1995, Statistics in medicine.

[17]  Hamid Pezeshk,et al.  Bayesian techniques for sample size determination in clinical trials: a short review , 2003, Statistical methods in medical research.

[18]  C. Adcock.  Sample size determination : a review , 1997 .

[19]  Andrew R Willan,et al.  Optimal clinical trial design using value of information methods with imperfect implementation. , 2009, Health economics.

[20]  C. J. Adcock,et al.  The choice of sample size. Commentaries. Author's reply , 1997 .

[21]  Andrew R Willan,et al.  Accounting for between-study variation in incremental net benefit in value of information methodology. , 2012, Health economics.

[22]  H Pezeshk,et al.  A DECISION THEORETIC APPROACH TO SAMPLE SIZE DETERMINATION IN CLINICAL TRIALS , 2002, Journal of biopharmaceutical statistics.

[23]  Matthew Kowgier,et al.  Determining optimal sample sizes for multi-stage randomized clinical trials using value of information methods , 2008, Clinical trials.

[24]  D. Lindley.  The choice of sample size , 1997 .

[25]  A R Willan,et al.  Argon green vs. krypton red laser photocoagulation for extrafoveal choroidal neovascularization secondary to age-related macular degeneration: 3-year results of a multicentre randomized trial. Canadian Ophthalmology Study Group. , 1996, Canadian journal of ophthalmology. Journal canadien d'ophtalmologie.

[26]  M. J. R. Healy,et al.  Economic Choice of the Amount of Experimentation , 1956 .

[27]  Andrew R Willan,et al.  The Option Value of Delay in Health Technology Assessment , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[28]  J Hornberger,et al.  The cost-benefit of a randomized trial to a health care organization. , 1998, Controlled clinical trials.

[29]  B W Brown,et al.  The sample size for a clinical trial: A Bayesian–decision theoretic approach , 2001, Statistics in medicine.

[30]  Ron Goeree,et al.  Value of information methods for planning and analyzing clinical studies optimize decision making and research planning. , 2012, Journal of clinical epidemiology.