Dealing with Time in Health Economic Evaluation: Methodological Issues and Recommendations for Practice

Time is an important aspect of health economic evaluation, as the timing and duration of clinical events, healthcare interventions and their consequences all affect estimated costs and effects. These issues should be reflected in the design of health economic models. This article considers three important aspects of time in modelling: (1) which cohorts to simulate and how far into the future to extend the analysis; (2) the simulation of time, including the difference between discrete-time and continuous-time models, cycle lengths, and converting rates and probabilities; and (3) discounting future costs and effects to their present values. We provide a methodological overview of these issues and make recommendations to help inform both the conduct of cost-effectiveness analyses and the interpretation of their results. For choosing which cohorts to simulate and how many, we suggest analysts carefully assess potential reasons for variation in cost effectiveness between cohorts and the feasibility of subgroup-specific recommendations. For the simulation of time, we recommend using short cycles or continuous-time models to avoid biases and the need for half-cycle corrections, and provide advice on the correct conversion of transition probabilities in state transition models. Finally, for discounting, analysts should not only follow current guidance and report how discounting was conducted, especially in the case of differential discounting, but also seek to develop an understanding of its rationale. Our overall recommendations are that analysts explicitly state and justify their modelling choices regarding time and consider how alternative choices may impact on results.

[1]  Murray Krahn,et al.  Conceptualizing a model: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force--2. , 2012, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[2]  Mark Jit,et al.  Economic evaluation of human papillomavirus vaccination in the United Kingdom , 2008, BMJ : British Medical Journal.

[3]  J. Mauskopf,et al.  Categorization of methods used in cost–effectiveness analyses of vaccination programs based on outcomes from dynamic transmission models , 2012, Expert review of pharmacoeconomics & outcomes research.

[4]  Martin Hoyle,et al.  Whose Costs and Benefits? Why Economic Evaluations Should Simulate Both Prevalent and All Future Incident Patient Cohorts , 2010, Medical decision making : an international journal of the Society for Medical Decision Making.

[5]  Joost van Rosmalen,et al.  A Mathematical Approach for Evaluating Markov Models in Continuous Time without Discrete-Event Simulation , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[6]  J. P. Dehollain,et al.  Understanding the Cost-Effectiveness of Influenza Vaccination in Children: Methodological Choices and Seasonal Variability , 2013, PharmacoEconomics.

[7]  G. Sanders,et al.  Cost-Effectiveness in Health and Medicine , 2016 .

[8]  Jagpreet Chhatwal,et al.  Economic Evaluations with Agent-Based Modelling: An Introduction , 2015, PharmacoEconomics.

[9]  N. Welton,et al.  Estimation of Markov Chain Transition Probabilities and Rates from Fully and Partially Observed Data: Uncertainty Propagation, Evidence Synthesis, and Model Calibration , 2005, Medical decision making : an international journal of the Society for Medical Decision Making.

[10]  M. Hoyle Future Drug Prices and Cost-Effectiveness Analyses , 2012, PharmacoEconomics.

[11]  Milton C Weinstein,et al.  Principles of good practice for decision analytic modeling in health-care evaluation: report of the ISPOR Task Force on Good Research Practices--Modeling Studies. , 2003, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[12]  J. Killewo,et al.  Epidemiology and demography in public health , 2010 .

[13]  A. Zauber,et al.  Multicohort Models in Cost-Effectiveness Analysis , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[14]  Karl Claxton,et al.  Discounting and decision making in the economic evaluation of health-care technologies. , 2011, Health economics.

[15]  Dennis G. Fryback,et al.  Assessing the effectiveness of health interventions for cost-effectiveness analysis , 1997, Journal of General Internal Medicine.

[16]  Nicholas R Latimer,et al.  Survival Analysis for Economic Evaluations Alongside Clinical Trials—Extrapolation with Patient-Level Data , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[17]  J. Barendregt The Half-Cycle Correction: Banish Rather Than Explain It , 2009, Medical decision making : an international journal of the Society for Medical Decision Making.

[18]  Maureen A Smith,et al.  Retrospective cost-effectiveness analysis of screening mammography. , 2006, Journal of the National Cancer Institute.

[19]  Jonathan Karnon,et al.  When to Use Discrete Event Simulation (DES) for the Economic Evaluation of Health Technologies? A Review and Critique of the Costs and Benefits of DES , 2014, PharmacoEconomics.

[20]  C. Marra,et al.  Effectiveness and Cost Effectiveness of Human Papillomavirus Vaccine , 2012, PharmacoEconomics.

[21]  David M J Naimark,et al.  Response to “The Life Table Method of Half-Cycle Correction: Getting It Right” , 2014, Medical decision making : an international journal of the Society for Medical Decision Making.

[22]  Stephen Palmer,et al.  The Half-Life of Truth: What Are Appropriate Time Horizons for Research Decisions? , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[23]  Jan J. Barendregt,et al.  Chronic Disease Modeling , 2008 .

[24]  M. Postma,et al.  On discounting of health gains from human papillomavirus vaccination: effects of different approaches. , 2012, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[25]  S. Dewilde,et al.  The Cost-Effectiveness of Screening Programs Using Single and Multiple Birth Cohort Simulations: A Comparison Using a Model of Cervical Cancer , 2004, Medical decision making : an international journal of the Society for Medical Decision Making.

[26]  M S Thompson,et al.  First principles of cost-effectiveness analysis in health. , 1979, Public health reports.

[27]  Christopher McCabe,et al.  Navigating Time and Uncertainty in Health Technology Appraisal: Would a Map Help? , 2013, PharmacoEconomics.

[28]  K Cooper,et al.  Choice of modelling technique for evaluating health care interventions , 2007, J. Oper. Res. Soc..

[29]  S. Pauker,et al.  The Markov Process in Medical Prognosis , 1983, Medical decision making : an international journal of the Society for Medical Decision Making.

[30]  PREDICTING SURVIVAL IN COST-EFFECTIVENESS ANALYSES BASED ON CLINICAL TRIALS , 2003, International Journal of Technology Assessment in Health Care.

[31]  E. Keeler,et al.  Discounting of Life-Saving and Other Nonmonetary Effects , 1983 .

[32]  J. Mauskopf,et al.  Prevalence-based economic evaluation. , 1998, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[33]  Stirling Bryan,et al.  Modelling in the economic evaluation of health care: selecting the appropriate approach , 2004, Journal of health services research & policy.

[34]  G. Loewenstein,et al.  Time Discounting and Time Preference: A Critical Review , 2002 .

[35]  J. Chhatwal,et al.  Changing Cycle Lengths in State-Transition Models: Doing it the Right Way , 2014 .

[36]  K. Claxton,et al.  Budget allocation and the revealed social rate of time preference for health. , 2012, Health economics.

[37]  M. Weinstein,et al.  Foundations of cost-effectiveness analysis for health and medical practices. , 1977, The New England journal of medicine.

[38]  Andrea Manca,et al.  PCV59 Where Did the Time Go?: Temporal Uncertainty in Cost-Effectiveness Decision Models , 2012 .

[39]  M. Gold,et al.  Panel on cost-effectiveness in health and medicine. , 1996, Medical care.

[40]  J. Berkhof,et al.  How to screen for cervical cancer after HPV16/18 vaccination in The Netherlands. , 2009, Vaccine.

[41]  D. Owens,et al.  State-transition modeling: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force--3. , 2012, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[42]  J R Beck,et al.  Markov Models in Medical Decision Making , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[43]  J. Habbema,et al.  Practical implications of differential discounting in cost-effectiveness analyses with varying numbers of cohorts. , 2011, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[44]  Murray Krahn,et al.  The Half-Cycle Correction Explained: Two Alternative Pedagogical Approaches , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[45]  G. Gazelle,et al.  Use of modeling to evaluate the cost-effectiveness of cancer screening programs. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[46]  S. Cantor,et al.  Impact of Generic Drug Entry on Cost-Effectiveness Analysis , 2005, Medical decision making : an international journal of the Society for Medical Decision Making.

[47]  Jonathan Karnon,et al.  A Critique and Impact Analysis of Decision Modeling Assumptions , 2007, Medical decision making : an international journal of the Society for Medical Decision Making.

[48]  A S Detsky,et al.  Primer on Medical Decision Analysis: Part 2—Building a Tree , 1997, Medical decision making : an international journal of the Society for Medical Decision Making.

[49]  H. Gravelle,et al.  Discounting for health effects in cost-benefit and cost-effectiveness analysis. , 2001, Health economics.

[50]  Andrew Briggs,et al.  An Introduction to Markov Modelling for Economic Evaluation , 1998, PharmacoEconomics.

[51]  D. Schopper,et al.  Cost-effectiveness of opportunistic versus organised mammography screening in Switzerland. , 2009, European journal of cancer.

[52]  Marta O. Soares,et al.  Continuous Time Simulation and Discretized Models for Cost-Effectiveness Analysis , 2012, PharmacoEconomics.

[53]  B. Standaert,et al.  Population–versus Cohort–Based Modelling Approaches , 2012, PharmacoEconomics.

[54]  P. Beutels,et al.  Economic evaluations of implemented vaccination programmes: key methodological challenges in retrospective analyses. , 2014, Vaccine.

[55]  W. Edmunds,et al.  Economic Evaluation of Vaccination Programs: The Impact of Herd-Immunity , 2003, Medical decision making : an international journal of the Society for Medical Decision Making.

[56]  Ben A. van Hout,et al.  Discounting costs and effects: a reconsideration. , 1998 .

[57]  C. Harvey The reasonableness of non-constant discounting , 1994 .

[58]  Jonathan Karnon,et al.  Alternative decision modelling techniques for the evaluation of health care technologies: Markov processes versus discrete event simulation. , 2003, Health economics.

[59]  C. Hollenbeak,et al.  Rates and probabilities in economic modelling: transformation, translation and appropriate application. , 2007, PharmacoEconomics.

[60]  Johan L Severens,et al.  Discounting health outcomes in economic evaluation: the ongoing debate. , 2004, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[61]  Murray Krahn,et al.  Conceptualizing a Model , 2012, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[62]  J. Caro,et al.  Pharmacoeconomic analyses using discrete event simulation , 2012, PharmacoEconomics.

[63]  B. van Hout Discounting costs and effects: a reconsideration. , 1998, Health economics.

[64]  J. Olsen,et al.  On what basis should health be discounted? , 1993, Journal of health economics.

[65]  Jeremy D Goldhaber-Fiebert,et al.  Chapter 18: Public health policy for cervical cancer prevention: the role of decision science, economic evaluation, and mathematical modeling. , 2006, Vaccine.

[66]  Andrew R Willan,et al.  Time and expected value of sample information wait for no patient. , 2008, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[67]  J. Mauskopf,et al.  Modelling the effect of conjugate vaccines in pneumococcal disease: cohort or population models? , 2010, Vaccine.