Quantifying Parameter Uncertainty in EQ-5D-3L Value Sets and Its Impact on Studies That Use the EQ-5D-3L to Measure Health Utility

Background. Parameter uncertainty in EQ-5D value sets is routinely ignored. Sources of parameter uncertainty include uncertainty in the estimated regression coefficients of the scoring algorithm and uncertainty that arises from the need to use a nonsaturated functional form when creating the scoring algorithm. We hypothesize that this latter source is the major contributor to parameter uncertainty in the value sets. Methods. We used data from the United States EQ-5D-3L valuation study to assess the extent of parameter uncertainty in the value set. We refitted the US scoring algorithm to quantify contributors to the mean square prediction errors and used a Bayesian approach to estimate the predictive distribution of the mean utilities. The impact of parameter uncertainty in the value set was assessed using survey data. Results. Parameter uncertainty in the estimated regression coefficients explained 16% of the mean squared prediction error; uncertainty in the functional form explained the remaining 84%. The median width of the 95% credible intervals for the mean utilities was 0.15. In estimating mean utility in our survey population, parameter uncertainty in the value set was responsible for 93% of the total variance, with sampling variation in the survey population being responsible for the remaining 7%. Conclusion. EQ-5D-3L value sets are estimated subject to considerable parameter uncertainty; the median credible interval width is large compared with reported values of the minimum important difference for the EQ-5D-3L, which have been reported to be as small as 0.03. Other countries’ scoring algorithms are based on smaller studies and are hence subject to greater uncertainty. This uncertainty should be accounted for when using EQ-5D health utilities in economic evaluations.

[1]  G. Torrance Measurement of health state utilities for economic appraisal. , 1986, Journal of health economics.

[2]  David J Spiegelhalter,et al.  Bayesian approaches to multiple sources of evidence and uncertainty in complex cost‐effectiveness modelling , 2003, Statistics in medicine.

[3]  Adrian E. Raftery,et al.  [Practical Markov Chain Monte Carlo]: Comment: One Long Run with Diagnostics: Implementation Strategies for Markov Chain Monte Carlo , 1992 .

[4]  Deborah J Street,et al.  Time trade-off derived EQ-5D weights for Australia. , 2011, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[5]  John Geweke,et al.  Evaluating the accuracy of sampling-based approaches to the calculation of posterior moments , 1991 .

[6]  P. Dolan,et al.  Modeling valuations for EuroQol health states. , 1997, Medical care.

[7]  Jason N Doctor,et al.  Minimal clinically important differences for the EQ-5D and QWB-SA in Post-traumatic Stress Disorder (PTSD): results from a Doubly Randomized Preference Trial (DRPT) , 2013, Health and Quality of Life Outcomes.

[8]  A. Williams EuroQol : a new facility for the measurement of health-related quality of life , 1990 .

[9]  D. Street,et al.  International comparisons in valuing EQ-5D health states: a review and analysis. , 2009, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[10]  Anthony O'Hagan,et al.  Modelling SF-6D health state preference data using a nonparametric Bayesian method. , 2007, Journal of health economics.

[11]  Anthony O'Hagan,et al.  Estimating utilities from individual health preference data: a nonparametric Bayesian method , 2005 .

[12]  John E. Brazier,et al.  Comparison of the minimally important difference for two health state utility measures: EQ-5D and SF-6D , 2005, Quality of Life Research.

[13]  Andrew Thomas,et al.  WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility , 2000, Stat. Comput..

[14]  Philip Heidelberger,et al.  Simulation Run Length Control in the Presence of an Initial Transient , 1983, Oper. Res..

[15]  Remko Soer,et al.  Clinimetric properties of the EuroQol-5D in patients with chronic low back pain. , 2012, The spine journal : official journal of the North American Spine Society.

[16]  Jose Leal,et al.  How important is parameter uncertainty around the UK EQ-5D-3L value set when estimating treatment effects? , 2012 .

[17]  James S. Dyer,et al.  Maut — Multiattribute Utility Theory , 2005 .

[18]  Roger A. Sugden,et al.  Multiple Imputation for Nonresponse in Surveys , 1988 .

[19]  Stephen Joel Coons,et al.  US Valuation of the EQ-5D Health States: Development and Testing of the D1 Valuation Model , 2005, Medical care.

[20]  Anthony O'Hagan,et al.  Modelling covariates for the SF-6D standard gamble health state preference data using a nonparametric Bayesian method. , 2007, Social science & medicine.

[21]  M. Neary,et al.  Estimation of minimally important differences in EQ-5D utility and VAS scores in cancer , 2010, Health and Quality of Life Outcomes.

[22]  P. J. Huber The behavior of maximum likelihood estimates under nonstandard conditions , 1967 .

[23]  H. White Maximum Likelihood Estimation of Misspecified Models , 1982 .

[24]  K. Perampaladas,et al.  Comparing EQ-5D valuation studies: A systematic review and methodological reporting checklist , 2013 .