Using Evidence from Randomised Controlled Trials in Economic Models: What Information is Relevant and is There a Minimum Amount of Sample Data Required to Make Decisions?

Evidence from randomised controlled trials (RCTs) is used to support regulatory approval and reimbursement decisions. I discuss how these decisions are typically made and argue that the amount of sample data and regulatory authorities’ concerns over multiplicity are irrelevant when making reimbursement decisions. Decision analytic models (DAMs) are usually necessary to meet the requirements of an economic evaluation. DAMs involve inputs relating to health benefits and resource use that represent unknown true population parameters. Evidence about parameters may come from a variety of sources, including RCTs, and uncertainty about parameters is represented by their joint posterior distribution. Any impact of multiplicity is mitigated through the prior distribution. I illustrate my perspective with three examples: the estimation of a treatment effect on a rare event; the number of RCTs available in a meta-analysis; and the estimation of population mean overall survival. I conclude by recommending that reimbursement decisions should be followed by an assessment of the value of sample information and the DAM revised structurally as necessary and to include any new sample data that may be generated.

[1]  Ralf Bender,et al.  Methods to estimate the between‐study variance and its uncertainty in meta‐analysis† , 2015, Research synthesis methods.

[2]  Anthony O’Hagan,et al.  Inference for the Cost-Effectiveness Acceptability Curve and Cost-Effectiveness Ratio , 2000, PharmacoEconomics (Auckland).

[3]  M. Kendall,et al.  Kendall's advanced theory of statistics , 1995 .

[4]  Nicky J. Welton,et al.  Extrapolation of Survival Curves from Cancer Trials Using External Information , 2016, Medical decision making : an international journal of the Society for Medical Decision Making.

[5]  Ken Stein,et al.  Informing Reimbursement Decisions Using Cost-Effectiveness Modelling: A Guide to the Process of Generating Elicited Priors to Capture Model Uncertainties , 2017, PharmacoEconomics.

[6]  Paul W Dickman,et al.  Estimating and modeling the cure fraction in population-based cancer survival analysis. , 2007, Biostatistics.

[7]  Anthony O'Hagan,et al.  INCORPORATION OF GENUINE PRIOR INFORMATION IN COST-EFFECTIVENESS ANALYSIS OF CLINICAL TRIAL DATA , 2002, International Journal of Technology Assessment in Health Care.

[8]  Simon G Thompson,et al.  Predicting the extent of heterogeneity in meta-analysis, using empirical data from the Cochrane Database of Systematic Reviews , 2012, International journal of epidemiology.

[9]  Nicky J Welton,et al.  Evidence Synthesis for Decision Making in Healthcare , 2012 .

[10]  Alexander J Sutton,et al.  What to add to nothing? Use and avoidance of continuity corrections in meta-analysis of sparse data. , 2004, Statistics in medicine.

[11]  Jeremy E. Oakley,et al.  Uncertain Judgements: Eliciting Experts' Probabilities , 2006 .

[12]  Adrian Bagust,et al.  Survival Analysis and Extrapolation Modeling of Time-to-Event Clinical Trial Data for Economic Evaluation , 2014, Medical decision making : an international journal of the Society for Medical Decision Making.

[13]  David J Spiegelhalter,et al.  A re-evaluation of random-effects meta-analysis , 2009, Journal of the Royal Statistical Society. Series A,.

[14]  Z. Philips,et al.  Network meta‐analysis of parametric survival curves , 2010, Research synthesis methods.

[15]  Anthony O'Hagan,et al.  Kendall's Advanced Theory of Statistics, volume 2B: Bayesian Inference, second edition , 2004 .

[16]  Christopher Cox,et al.  The generalized F distribution: An umbrella for parametric survival analysis , 2008, Statistics in medicine.

[17]  Noemi Kreif,et al.  Overview of Parametric Survival Analysis for Health-Economic Applications , 2013, PharmacoEconomics.

[18]  Nicholas R Latimer,et al.  Survival Analysis for Economic Evaluations Alongside Clinical Trials—Extrapolation with Patient-Level Data , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[19]  A. O'Hagan,et al.  Probabilistic sensitivity analysis of complex models: a Bayesian approach , 2004 .

[20]  A. Gelman Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper) , 2004 .

[21]  L. Wasserman,et al.  The Selection of Prior Distributions by Formal Rules , 1996 .

[22]  Karl Claxton,et al.  Establishing the cost-effectiveness of new pharmaceuticals under conditions of uncertainty--when is there sufficient evidence? , 2005, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[23]  S. Senn Two cheers for P-values? , 2001, Journal of epidemiology and biostatistics.

[24]  Alex J. Sutton,et al.  Evidence Synthesis for Decision Making 2 , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[25]  Shannon Cope,et al.  Meta-regression models to address heterogeneity and inconsistency in network meta-analysis of survival outcomes , 2012, BMC Medical Research Methodology.

[26]  Nicky J Welton,et al.  Evidence Synthesis for Decision Making in Healthcare: Welton/Evidence Synthesis for Decision Making in Healthcare , 2012 .

[27]  M. Sculpher,et al.  Probabilistic sensitivity analysis for NICE technology assessment: not an optional extra. , 2005, Health economics.

[28]  L. Hedges,et al.  Fixed- and random-effects models in meta-analysis. , 1998 .

[29]  Stephen Senn,et al.  Controversies concerning randomization and additivity in clinical trials , 2004, Statistics in medicine.

[30]  P. Royston,et al.  Flexible parametric proportional‐hazards and proportional‐odds models for censored survival data, with application to prognostic modelling and estimation of treatment effects , 2002, Statistics in medicine.

[31]  Jeremy E. Oakley,et al.  Incorporating Genuine Prior Information about Between-Study Heterogeneity in Random Effects Pairwise and Network Meta-analyses , 2017, Medical decision making : an international journal of the Society for Medical Decision Making.

[32]  A. Briggs,et al.  A Criterion-based Approach for the Systematic and Transparent Extrapolation of Clinical Trial Survival Data , 2015, Journal of health economics and outcomes research.

[33]  G. Dranitsaris,et al.  Modelling the Survival Outcomes of Immuno-Oncology Drugs in Economic Evaluations: A Systematic Approach to Data Analysis and Extrapolation , 2017, PharmacoEconomics.

[34]  J. Jansen Network meta-analysis of survival data with fractional polynomials , 2011, BMC medical research methodology.

[35]  M. Drummond,et al.  Whither trial-based economic evaluation for health care decision making? , 2006, Health economics.

[36]  Eric R. Ziegel,et al.  Statistical Issues in Drug Development , 1997 .

[37]  Jeremy E. Oakley,et al.  Estimating the Expected Value of Sample Information Using the Probabilistic Sensitivity Analysis Sample , 2015, Medical decision making : an international journal of the Society for Medical Decision Making.

[38]  K Claxton,et al.  The irrelevance of inference: a decision-making approach to the stochastic evaluation of health care technologies. , 1999, Journal of health economics.

[39]  L. Sharples,et al.  This is a repository copy of Extrapolating survival from randomised trials using external data : a review of methods , 2019 .