Model Parameter Estimation and Uncertainty: a Report of the Ispor-smdm Modeling Good Research Practices Task Force-6 Background to the Task Forcemodel-parameter-estimation-and- Uncertainty-analysis.asp). a Summary of These Articles Was Pre- Sented at a Plenary Session at the Ispor 16th Annual Intern

A model's purpose is to inform medical decisions and health care resource allocation. Modelers employ quantitative methods to structure the clinical, epidemiological, and economic evidence base and gain qualitative insight to assist decision makers in making better decisions. From a policy perspective, the value of a model-based analysis lies not simply in its ability to generate a precise point estimate for a specific outcome but also in the systematic examination and responsible reporting of uncertainty surrounding this outcome and the ultimate decision being addressed. Different concepts relating to uncertainty in decision modeling are explored. Stochastic (first-order) uncertainty is distinguished from both parameter (second-order) uncertainty and from heterogeneity, with structural uncertainty relating to the model itself forming another level of uncertainty to consider. The article argues that the estimation of point estimates and uncertainty in parameters is part of a single process and explores the link between parameter uncertainty through to decision uncertainty and the relationship to value of information analysis. The article also makes extensive recommendations around the reporting of uncertainty, in terms of both deterministic sensitivity analysis techniques and probabilistic methods. Expected value of perfect information is argued to be the most appropriate presentational technique, alongside cost-effectiveness acceptability curves, for representing decision uncertainty from probabilistic analysis.

[2]  A E Ades,et al.  Expected Value of Sample Information Calculations in Medical Decision Modeling , 2004, Medical decision making : an international journal of the Society for Medical Decision Making.

[3]  W. Edmunds,et al.  Impact of Model, Methodological, and Parameter Uncertainty in the Economic Analysis of Vaccination Programs , 2006, Medical decision making : an international journal of the Society for Medical Decision Making.

[4]  M. Sculpher,et al.  Decision Modelling for Health Economic Evaluation , 2006 .

[5]  Karl Claxton,et al.  A Framework for Addressing Structural Uncertainty in Decision Models , 2011, Medical decision making : an international journal of the Society for Medical Decision Making.

[6]  Andrew Thomas,et al.  The BUGS project: Evolution, critique and future directions , 2009, Statistics in medicine.

[7]  Milton C. Weinstein,et al.  Incorporating Calibrated Model Parameters into Sensitivity Analyses , 2012, PharmacoEconomics.

[8]  A A Stinnett,et al.  The negative side of cost-effectiveness analysis. , 1997, JAMA.

[9]  M. Mcgrath Cost Effectiveness in Health and Medicine. , 1998 .

[10]  Mirjam Kretzschmar,et al.  Dynamic Transmission Modeling: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-5 , 2012, Value in Health.

[11]  Simon G Thompson,et al.  Accounting for uncertainty in health economic decision models by using model averaging , 2009, Journal of the Royal Statistical Society. Series A,.

[12]  J. Caro,et al.  Model transparency and validation: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force--7. , 2012, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[13]  V Demicheli,et al.  Are guidelines for peer-reviewing economic evaluations necessary? A survey of current editorial practice. , 1995, Health economics.

[14]  Uwe Siebert,et al.  Modeling good research practices--overview: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force--1. , 2012, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[15]  Jonathan Karnon,et al.  A Hybrid Cohort Individual Sampling Natural History Model of Age-Related Macular Degeneration: Assessing the Cost-Effectiveness of Screening Using Probabilistic Calibration , 2009, Medical decision making : an international journal of the Society for Medical Decision Making.

[16]  Richard G. White,et al.  Calibrating Models in Economic Evaluation , 2012, PharmacoEconomics.

[17]  Bas Groot Koerkamp,et al.  Identifying key parameters in cost-effectiveness analysis using value of information: a comparison of methods. , 2006, Health economics.

[18]  D. Goodin The cambridge dictionary of statistics , 1999 .

[19]  A Briggs,et al.  Uncertainty in the economic evaluation of health care technologies: the role of sensitivity analysis. , 1994, Health economics.

[20]  Jonathan Karnon,et al.  Modeling using discrete event simulation: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force--4. , 2012, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[21]  Karl Claxton,et al.  Exploring Uncertainty in Cost-Effectiveness Analysis , 2012, PharmacoEconomics.

[22]  M. Drummond,et al.  A rational framework for decision making by the National Institute For Clinical Excellence (NICE) , 2002, The Lancet.

[23]  Murray Krahn,et al.  Conceptualizing a model: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force--2. , 2012, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[24]  Jeremy E. Oakley,et al.  Uncertain Judgements: Eliciting Experts' Probabilities , 2006 .

[25]  Karl Claxton,et al.  Characterizing structural uncertainty in decision analytic models: a review and application of methods. , 2009, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[26]  T. Lumley Network meta‐analysis for indirect treatment comparisons , 2002, Statistics in medicine.

[27]  A E Ades,et al.  Markov Chain Monte Carlo Estimation of a Multiparameter Decision Model: Consistency of Evidence and the Accurate Assessment of Uncertainty , 2002, Medical decision making : an international journal of the Society for Medical Decision Making.

[28]  A Briggs,et al.  Confidence intervals or surfaces? Uncertainty on the cost-effectiveness plane. , 1998, Health economics.

[29]  Anthony O'Hagan,et al.  Calculating Partial Expected Value of Perfect Information via Monte Carlo Sampling Algorithms , 2007, Medical decision making : an international journal of the Society for Medical Decision Making.

[30]  Karen M Kuntz,et al.  Multiparameter calibration of a natural history model of cervical cancer. , 2007, American journal of epidemiology.

[31]  D. Owens,et al.  State-transition modeling: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force--3. , 2012, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.