Incorporating individual historical controls and aggregate treatment effect estimates into a Bayesian survival trial: a simulation study

BackgroundPerforming well-powered randomised controlled trials (RCTs) of new treatments for rare diseases is often infeasible. However, with the increasing availability of historical data, incorporating existing information into trials with small sample sizes is appealing in order to increase the power. Bayesian approaches enable one to incorporate historical data into a trial’s analysis through a prior distribution.MethodsMotivated by a RCT intended to evaluate the impact on event-free survival of mifamurtide in patients with osteosarcoma, we performed a simulation study to evaluate the impact on trial operating characteristics of incorporating historical individual control data and aggregate treatment effect estimates. We used power priors derived from historical individual control data for baseline parameters of Weibull and piecewise exponential models, while we used a mixture prior to summarise aggregate information obtained on the relative treatment effect. The impact of prior-data conflicts, both with respect to the parameters and survival models, was evaluated for a set of pre-specified weights assigned to the historical information in the prior distributions.ResultsThe operating characteristics varied according to the weights assigned to each source of historical information, the variance of the informative and vague component of the mixture prior and the level of commensurability between the historical and new data. When historical and new controls follow different survival distributions, we did not observe any advantage of choosing a piecewise exponential model compared to a Weibull model for the new trial analysis. However, we think that it remains appealing given the uncertainty that will often surround the shape of the survival distribution of the new data.ConclusionIn the setting of Sarcome-13 trial, and other similar studies in rare diseases, the gains in power and accuracy made possible by incorporating different types of historical information commensurate with the new trial data have to be balanced against the risk of biased estimates and a possible loss in power if data are not commensurate. The weights allocated to the historical data have to be carefully chosen based on this trade-off. Further simulation studies investigating methods for incorporating historical data are required to generalise the findings.

[1]  J. Ibrahim,et al.  Power prior distributions for regression models , 2000 .

[2]  M. Parmar,et al.  How do you design randomised trials for smaller populations? A framework , 2016, BMC Medicine.

[3]  J. Blay,et al.  The value of research collaborations and consortia in rare cancers. , 2016, The Lancet. Oncology.

[4]  Anastasios A. Tsiatis,et al.  The asymptotic joint distribution of the efficient scores test for the proportional hazards model calculated over time , 1981 .

[5]  Yvette van Norden,et al.  Including historical data in the analysis of clinical trials: Is it worth the effort? , 2017, Statistical methods in medical research.

[6]  Michael Branson,et al.  A note on the power prior , 2009, Statistics in medicine.

[7]  J. Blay,et al.  Zoledronate in combination with chemotherapy and surgery to treat osteosarcoma (OS2006): a randomised, multicentre, open-label, phase 3 trial. , 2016, The Lancet. Oncology.

[8]  P. Royston,et al.  Flexible parametric proportional‐hazards and proportional‐odds models for censored survival data, with application to prognostic modelling and estimation of treatment effects , 2002, Statistics in medicine.

[9]  Andrew D. Martin,et al.  MCMCpack: Markov chain Monte Carlo in R , 2011 .

[10]  Bruno Giraudeau,et al.  Finding Alternatives to the Dogma of Power Based Sample Size Calculation: Is a Fixed Sample Size Prospective Meta-Experiment a Potential Alternative? , 2016, PloS one.

[11]  Paul A Meyers,et al.  Osteosarcoma: the addition of muramyl tripeptide to chemotherapy improves overall survival--a report from the Children's Oncology Group. , 2008, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[12]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[13]  L. M. Berliner,et al.  Robust Bayes and Empirical Bayes Analysis with $_\epsilon$-Contaminated Priors , 1986 .

[14]  Rosalind Walley,et al.  Addressing potential prior‐data conflict when using informative priors in proof‐of‐concept studies , 2016, Pharmaceutical statistics.

[15]  D. Spiegelhalter,et al.  Summarizing historical information on controls in clinical trials , 2010, Clinical trials.

[16]  Joel B Greenhouse,et al.  Using prior distributions to synthesize historical evidence: comments on the Goodman–Sladky case study of IVIg in Guillain–Barré syndrome , 2005, Clinical trials.

[17]  Whole Grain Label Statements Guidance for Industry and FDA Staff , 2006 .

[18]  S J Pocock,et al.  The combination of randomized and historical controls in clinical trials. , 1976, Journal of chronic diseases.

[19]  Boris Freidlin,et al.  Statistical Challenges in the Evaluation of Treatments for Small Patient Populations , 2013, Science Translational Medicine.

[20]  Lisa V. Hampson,et al.  Bayesian survival analysis in clinical trials: What methods are used in practice? , 2017, Clinical trials.

[21]  Karel G M Moons,et al.  Incorporation of historical data in the analysis of randomized therapeutic trials. , 2011, Contemporary clinical trials.

[22]  John A Scott,et al.  Addressing prior-data conflict with empirical meta-analytic-predictive priors in clinical studies with historical information , 2016, Journal of biopharmaceutical statistics.

[23]  K. Dear,et al.  Strategy for randomised clinical trials in rare cancers , 2003, BMJ : British Medical Journal.

[24]  Bhaswati Mukherjee,et al.  A Bayesian Approach for Inference from a Bridging Study with Binary Outcomes , 2012, Journal of biopharmaceutical statistics.

[25]  D. Huntsman,et al.  Rare cancers: a sea of opportunity. , 2016, The Lancet. Oncology.

[26]  Heinz Schmidli,et al.  Using historical control information for the design and analysis of clinical trials with overdispersed count data , 2013, Statistics in medicine.

[27]  Anthony O'Hagan,et al.  Robust meta‐analytic‐predictive priors in clinical trials with historical control information , 2014, Biometrics.

[28]  Lisa V. Hampson,et al.  “Threshold‐crossing”: A Useful Way to Establish the Counterfactual in Clinical Trials? , 2016, Clinical pharmacology and therapeutics.

[29]  D. Schoenfeld,et al.  Sample-size formula for the proportional-hazards regression model. , 1983, Biometrics.

[30]  J. Blay,et al.  Clinical trial designs for rare diseases: Studies developed and discussed by the International Rare Cancers Initiative , 2015, European journal of cancer.

[31]  R. Cuffe The inclusion of historical control data may reduce the power of a confirmatory study , 2011, Statistics in medicine.

[32]  Joseph G Ibrahim,et al.  Bayesian Meta‐Experimental Design: Evaluating Cardiovascular Risk in New Antidiabetic Therapies to Treat Type 2 Diabetes , 2012, Biometrics.

[33]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[34]  Bradley P Carlin,et al.  Hierarchical Commensurate and Power Prior Models for Adaptive Incorporation of Historical Information in Clinical Trials , 2011, Biometrics.

[35]  Fang Chen,et al.  Use of historical control data for assessing treatment effects in clinical trials , 2014, Pharmaceutical statistics.

[36]  John H. Healey,et al.  Addition of muramyl tripeptide to chemotherapy for patients with newly diagnosed metastatic osteosarcoma: A report from the Children’s Oncology Group , 2008 .

[37]  P. Williamson,et al.  Methodology of clinical trials for rare diseases. , 2014, Best practice & research. Clinical rheumatology.

[38]  L. Billingham,et al.  Small sample sizes in clinical trials: a statistician's perspective , 2012 .

[39]  Leonhard Held,et al.  Adaptive power priors with empirical Bayes for clinical trials , 2017, Pharmaceutical statistics.

[40]  L. Billingham,et al.  Research methods to change clinical practice for patients with rare cancers. , 2016, The Lancet. Oncology.

[41]  Lisa V Hampson,et al.  Extrapolation of efficacy and other data to support the development of new medicines for children: A systematic review of methods , 2018, Statistical methods in medical research.

[42]  Hsiao-Hui Tsou,et al.  Use of Prior Information for Bayesian Evaluation of Bridging Studies , 2007, Journal of biopharmaceutical statistics.

[43]  Bradley P Carlin,et al.  Commensurate Priors for Incorporating Historical Information in Clinical Trials Using General and Generalized Linear Models. , 2012, Bayesian analysis.

[44]  J G Thornton,et al.  Clinical trials and rare diseases: a way out of a conundrum , 1995, BMJ.