R You Still Using Excel? The Advantages of Modern Software Tools for Health Technology Assessment.

Economic models are used in health technology assessments (HTAs) to evaluate the cost-effectiveness of competing medical technologies and inform the efficient use of healthcare resources. Historically, these models have been developed with specialized commercial software (such as TreeAge) or more commonly with spreadsheet software (almost always Microsoft Excel). Although these tools may be sufficient for relatively simple analyses, they put unnecessary constraints on the analysis that may ultimately limit its credibility and relevance. In contrast, modern programming languages such as R, Python, Matlab, and Julia facilitate the development of models that are (i) clinically realistic, (ii) capable of quantifying decision uncertainty, (iii) transparent and reproducible, and (iv) reusable and adaptable. An HTA environment that encourages use of modern software can therefore help ensure that coverage and pricing decisions confer greatest possible benefit and capture all scientific uncertainty, thus enabling correct prioritization of future research.

[1]  Christopher McCabe,et al.  A Comparison of Four Software Programs for Implementing Decision Analytic Cost-Effectiveness Models , 2017, PharmacoEconomics.

[2]  M. Sculpher,et al.  Representing uncertainty: the role of cost-effectiveness acceptability curves. , 2001, Health economics.

[3]  Deborah M Caldwell,et al.  Oral anticoagulants for prevention of stroke in atrial fibrillation: systematic review, network meta-analysis, and cost effectiveness analysis , 2017, BMJ.

[4]  D. Owens,et al.  State-transition modeling: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force--3. , 2012, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[5]  M. Sculpher,et al.  Probabilistic sensitivity analysis for NICE technology assessment: not an optional extra. , 2005, Health economics.

[6]  Alan Edelman,et al.  Julia: A Fresh Approach to Numerical Computing , 2014, SIAM Rev..

[7]  Hadley Wickham,et al.  testthat: Get Started with Testing , 2011, R J..

[8]  K. Chalkidou About the National Institute for Health and Care Excellence - NICE. , 2013, Acta medica portuguesa.

[9]  Andrew Glover,et al.  Continuous Integration: Improving Software Quality and Reducing Risk (The Addison-Wesley Signature Series) , 2007 .

[10]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[11]  Jeffrey W. Eaton,et al.  HIV Treatment as Prevention: Systematic Comparison of Mathematical Models of the Potential Impact of Antiretroviral Therapy on HIV Incidence in South Africa , 2012, PLoS medicine.

[12]  Guido Van Rossum,et al.  Python Tutorial , 1999 .

[13]  Gianluca Baio,et al.  Bayesian Methods in Health Economics , 2012 .

[14]  Peter Bryden,et al.  Screening strategies for atrial fibrillation: a systematic review and cost-effectiveness analysis. , 2017, Health technology assessment.

[15]  Nicolas A. Menzies,et al.  Bayesian Methods for Calibrating Health Policy Models: A Tutorial , 2017, PharmacoEconomics.

[16]  Hein Putter,et al.  Reduced-rank proportional hazards regression and simulation-based prediction for multi-state models. , 2008, Statistics in medicine.

[17]  G. Chowell,et al.  Transmission dynamics and control of Ebola virus disease (EVD): a review , 2014, BMC Medicine.

[18]  J. de Haes,et al.  Quality-adjusted survival analysis. , 1991, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[19]  Jeroen P. Jansen,et al.  Meta-regression models to address heterogeneity and inconsistency in network meta-analysis of survival outcomes , 2012 .

[20]  H Putter,et al.  Tutorial in biostatistics: competing risks and multi‐state models , 2007, Statistics in medicine.

[21]  Fernando Alarid-Escudero,et al.  Microsimulation Modeling for Health Decision Sciences Using R: A Tutorial , 2018, Medical decision making : an international journal of the Society for Medical Decision Making.

[22]  Gianluca Baio,et al.  Estimating the expected value of partial perfect information in health economic evaluations using integrated nested Laplace approximation , 2015, Statistics in medicine.

[23]  Viral B. Shah,et al.  Julia: A Fresh Approach to Numerical Computing | SIAM Review | Vol. 59, No. 1 | Society for Industrial and Applied Mathematics , 2017 .

[24]  Claire Williams,et al.  Cost-effectiveness Analysis in R Using a Multi-state Modeling Survival Analysis Framework: A Tutorial , 2016, Medical decision making : an international journal of the Society for Medical Decision Making.

[25]  Fernando Alarid-Escudero,et al.  An Overview of R in Health Decision Sciences , 2017, Medical decision making : an international journal of the Society for Medical Decision Making.

[26]  Raffaele Vardavas,et al.  A Cost-effectiveness Analysis of Preexposure Prophylaxis for the Prevention of HIV Among Los Angeles County Men Who Have Sex With Men. , 2016, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[27]  Jeremy E. Oakley,et al.  Estimating the Expected Value of Sample Information Using the Probabilistic Sensitivity Analysis Sample , 2015, Medical decision making : an international journal of the Society for Medical Decision Making.

[28]  Andrew H Briggs,et al.  Optimal cost-effectiveness decisions: the role of the cost-effectiveness acceptability curve (CEAC), the cost-effectiveness acceptability frontier (CEAF), and the expected value of perfection information (EVPI). , 2008, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[29]  Gianluca Baio,et al.  Efficient Monte Carlo Estimation of the Expected Value of Sample Information Using Moment Matching , 2016, Medical decision making : an international journal of the Society for Medical Decision Making.

[30]  Nicky J Welton,et al.  NICE DSU Technical Support Document 2: A Generalised Linear Modelling Framework for Pairwise and Network Meta-Analysis of Randomised Controlled Trials , 2011 .

[31]  Nicky J Welton,et al.  Network Meta-Analysis for Decision-Making , 2018 .

[32]  Ren Johansen An Empirical Transition Matrix for Non-homogeneous Markov Chains Based on Censored Observations , 1978 .

[33]  Klas Bergenheim,et al.  Assessing the Relationship between Computational Speed and Precision , 2012, PharmacoEconomics.