A Review of Survival Analysis Methods Used in NICE Technology Appraisals of Cancer Treatments: Consistency, Limitations, and Areas for Improvement

Objectives. In June 2011, the National Institute for Health and Care Excellence (NICE) Decision Support Unit published a Technical Support Document (TSD) providing recommendations on survival analysis for NICE technology appraisals (TAs). Survival analysis outputs are influential inputs into economic models estimating the cost-effectiveness of new cancer treatments. Hence, it is important that systematic and justifiable model selection approaches are used. This study investigates the extent to which the TSD recommendations have been followed since its publication. Methods. We reviewed NICE cancer TAs completed between July 2011 and July 2017. Information on survival analyses undertaken and associated critiques for overall survival (OS) and progression-free survival were extracted from the company submissions, Evidence Review Group (ERG) reports, and final appraisal determination documents. Results. Information was extracted from 58 TAs. Only 4 (7%) followed all TSD recommendations for OS outcomes. The vast majority (91%) compared a range of common parametric models and assessed their fit to the data (86%). Only a minority of TAs included an assessment of the shape of the hazard function (38%) or proportional hazards assumption (40%). Validation of the extrapolated portion of the survival function using external data was attempted in a minority of TAs (40%). Extrapolated survival functions were frequently criticized by ERGs (71%). Conclusions. Survival analysis within NICE TAs remains suboptimal, despite publication of the TSD. Model selection is not undertaken in a systematic way, resulting in inconsistencies between TAs. More attention needs to be given to assessing hazard functions and validation of extrapolated survival functions. Novel methods not described in the TSD have been used, particularly in the context of immuno-oncology, suggesting that an updated TSD may be of value.

[1]  M. Drummond,et al.  Key principles for the improved conduct of health technology assessments for resource allocation decisions , 2008, International Journal of Technology Assessment in Health Care.

[2]  A. Briggs,et al.  A Criterion-based Approach for the Systematic and Transparent Extrapolation of Clinical Trial Survival Data , 2015, Journal of health economics and outcomes research.

[3]  N. Welton,et al.  Survival time outcomes in randomized, controlled trials and meta-analyses: the parallel universes of efficacy and cost-effectiveness. , 2011, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[4]  Nicholas R Latimer,et al.  Survival Analysis for Economic Evaluations Alongside Clinical Trials—Extrapolation with Patient-Level Data , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[5]  Andrew Briggs,et al.  The “Hazards” of Extrapolating Survival Curves , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[6]  John W. Stevens,et al.  Using Evidence from Randomised Controlled Trials in Economic Models: What Information is Relevant and is There a Minimum Amount of Sample Data Required to Make Decisions? , 2018, PharmacoEconomics.

[7]  Bayesian inference in a piecewise Weibull proportional hazards model with unknown change points. , 2007, Journal of animal breeding and genetics = Zeitschrift fur Tierzuchtung und Zuchtungsbiologie.

[8]  Noemi Kreif,et al.  Overview of Parametric Survival Analysis for Health-Economic Applications , 2013, PharmacoEconomics.

[9]  M. Stevenson,et al.  Cabazitaxel for the Second-Line Treatment of Metastatic Hormone-Refractory Prostate Cancer: A NICE Single Technology Appraisal , 2013, PharmacoEconomics.

[10]  Adrian Bagust,et al.  Survival Analysis and Extrapolation Modeling of Time-to-Event Clinical Trial Data for Economic Evaluation , 2014, Medical decision making : an international journal of the Society for Medical Decision Making.

[11]  Nicholas R Latimer,et al.  Survival Extrapolation in Cancer Immunotherapy: A Validation-Based Case Study. , 2019, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[12]  K. Abrams,et al.  Good Practice Guidelines for the use of Statistical Regression Models in Economic Evaluations , 2013, PharmacoEconomics.

[13]  Susi Sadler,et al.  Cost-effectiveness of screening for ovarian cancer amongst postmenopausal women: a model-based economic evaluation , 2016, BMC Medicine.

[14]  T. Trikalinos,et al.  Recommendations for Conduct, Methodological Practices, and Reporting of Cost-effectiveness Analyses: Second Panel on Cost-Effectiveness in Health and Medicine. , 2016, JAMA.