Value of information methods to design a clinical trial in a small population to optimise a health economic utility function

BackgroundMost confirmatory randomised controlled clinical trials (RCTs) are designed with specified power, usually 80% or 90%, for a hypothesis test conducted at a given significance level, usually 2.5% for a one-sided test. Approval of the experimental treatment by regulatory agencies is then based on the result of such a significance test with other information to balance the risk of adverse events against the benefit of the treatment to future patients. In the setting of a rare disease, recruiting sufficient patients to achieve conventional error rates for clinically reasonable effect sizes may be infeasible, suggesting that the decision-making process should reflect the size of the target population.MethodsWe considered the use of a decision-theoretic value of information (VOI) method to obtain the optimal sample size and significance level for confirmatory RCTs in a range of settings. We assume the decision maker represents society. For simplicity we assume the primary endpoint to be normally distributed with unknown mean following some normal prior distribution representing information on the anticipated effectiveness of the therapy available before the trial. The method is illustrated by an application in an RCT in haemophilia A. We explicitly specify the utility in terms of improvement in primary outcome and compare this with the costs of treating patients, both financial and in terms of potential harm, during the trial and in the future.ResultsThe optimal sample size for the clinical trial decreases as the size of the population decreases. For non-zero cost of treating future patients, either monetary or in terms of potential harmful effects, stronger evidence is required for approval as the population size increases, though this is not the case if the costs of treating future patients are ignored.ConclusionsDecision-theoretic VOI methods offer a flexible approach with both type I error rate and power (or equivalently trial sample size) depending on the size of the future population for whom the treatment under investigation is intended. This might be particularly suitable for small populations when there is considerable information about the patient population.

[1]  John Gittins,et al.  A Behavioral Bayes Method for Determining the Size of a Clinical Trial , 2000 .

[2]  D. Berry,et al.  Choosing sample size for a clinical trial using decision analysis , 2003 .

[3]  Cyrus R Mehta,et al.  Adaptive, group sequential and decision theoretic approaches to sample size determination , 2006, Statistics in medicine.

[4]  Hamid Pezeshk,et al.  A Fully Bayesian Approach to Calculating Sample Sizes for Clinical Trials with Binary Responses , 2002 .

[5]  A. Willan,et al.  Value of Information and Pricing New Healthcare Interventions , 2012, PharmacoEconomics.

[6]  D. Dixon.  Bayesian methods and ethics in a clinical trial design , 1997 .

[7]  J. Kadane,et al.  Experiences in elicitation , 1998 .

[8]  C. Chiaverini,et al.  Prevalence of inherited ichthyosis in France: a study using capture-recapture method , 2014, Orphanet Journal of Rare Diseases.

[9]  J. Gittins,et al.  A behavioral Bayes method to determine the sample size of a clinical trial considering efficacy and safety , 2009, Statistics in medicine.

[10]  P. Marriott,et al.  An Optimization Approach to Calculating Sample Sizes With Binary Responses , 2014, Journal of biopharmaceutical statistics.

[11]  J. Madan,et al.  Does the low prevalence affect the sample size of interventional clinical trials of rare diseases? An analysis of data from the aggregate analysis of clinicaltrials.gov , 2017, Orphanet Journal of Rare Diseases.

[12]  Lisa V Hampson,et al.  Bayesian methods for the design and interpretation of clinical trials in very rare diseases , 2014, Statistics in medicine.

[13]  Andrew R Willan,et al.  Determining optimal sample sizes for multistage adaptive randomized clinical trials from an industry perspective using value of information methods , 2013, Clinical trials.

[14]  Andrew R Willan,et al.  Expected value of information and decision making in HTA. , 2007, Health economics.

[15]  A E Ades,et al.  Expected Value of Sample Information Calculations in Medical Decision Modeling , 2004, Medical decision making : an international journal of the Society for Medical Decision Making.

[16]  Hamid. Pezeshk,et al.  How large should a clinical trial be , 2000 .

[17]  Nitin R Patel,et al.  A Bayesian approach for incorporating economic factors in sample size design for clinical trials of individual drugs and portfolios of drugs , 2007, Statistics in medicine.

[18]  Anthony O'Hagan,et al.  Eliciting expert beliefs in substantial practical applications , 1998 .

[19]  C. Tudur Smith,et al.  A comparison of interventional clinical trials in rare versus non-rare diseases: an analysis of ClinicalTrials.gov , 2014, Orphanet Journal of Rare Diseases.

[20]  J. Beyene,et al.  Using Value-of-Information Methods when the Disease Is Rare and the Treatment Is Expensive—The Example of Hemophilia A , 2013, Journal of General Internal Medicine.

[21]  J Hornberger,et al.  The cost-benefit of a randomized trial to a health care organization. , 1998, Controlled clinical trials.

[22]  B W Brown,et al.  The sample size for a clinical trial: A Bayesian–decision theoretic approach , 2001, Statistics in medicine.

[23]  B. Buckley.  Clinical trials of orphan medicines , 2008, The Lancet.

[24]  Thomas A. Louis,et al.  Graphical Elicitation of a Prior Distribution for a Clinical Trial , 1993 .

[25]  Donald A. Berry,et al.  Group sequential clinical trials: a classical evaluation of Bayesian decision-theoretic designs , 1994 .

[26]  Andrew R Willan,et al.  The value of information and optimal clinical trial design , 2005, Statistics in medicine.

[27]  J. Gittins,et al.  The choice of sample size: a mixed Bayesian / frequentist approach , 2009, Statistical methods in medical research.

[28]  Vahid Montazerhodjat,et al.  Is the Fda Too Conservative or Too Aggressive?: A Bayesian Decision Analysis of Clinical Trial Design , 2015, Journal of Econometrics.

[29]  Martin Posch,et al.  Decision-theoretic designs for small trials and pilot studies: A review , 2015, Statistical methods in medical research.

[30]  Haolun Shi,et al.  Bayesian randomized clinical trials: From fixed to adaptive design. , 2017, Contemporary clinical trials.

[31]  D A Berry,et al.  One-sided sequential stopping boundaries for clinical trials: a decision-theoretic approach. , 1988, Biometrics.

[32]  Andrew R Willan,et al.  Optimal sample size determinations from an industry perspective based on the expected value of information , 2008, Clinical trials.

[33]  Simon Day,et al.  Structured approach to the elicitation of expert beliefs for a Bayesian‐designed clinical trial: a case study , 2013, Pharmaceutical statistics.

[34]  Martin Posch,et al.  Determination of the optimal sample size for a clinical trial accounting for the population size , 2016, Biometrical journal. Biometrische Zeitschrift.