Best-worst scaling vs. discrete choice experiments: an empirical comparison using social care data.

This paper presents empirical findings from the comparison between two principal preference elicitation techniques: discrete choice experiments and profile-based best-worst scaling. Best-worst scaling involves less cognitive burden for respondents and provides more information than traditional "pick-one" tasks asked in discrete choice experiments. However, there is lack of empirical evidence on how best-worst scaling compares to discrete choice experiments. This empirical comparison between discrete choice experiments and best-worst scaling was undertaken as part of the Outcomes of Social Care for Adults project, England, which aims to develop a weighted measure of social care outcomes. The findings show that preference weights from best-worst scaling and discrete choice experiments do reveal similar patterns in preferences and in the majority of cases preference weights--when normalised/rescaled--are not significantly different.

[1]  Sean M. Puckett,et al.  Observed Efficiency of a D-Optimal Design in an Interactive Agency Choice Experiment , 2009 .

[2]  J. Bond,et al.  Developing attributes for a generic quality of life measure for older people: preferences or capabilities? , 2006, Social science & medicine.

[3]  P. Burge,et al.  Estimating the value of social care. , 2010, Journal of health economics.

[4]  J. Marti A best-worst scaling survey of adolescents' level of concern for health and non-health consequences of smoking. , 2012, Social science & medicine.

[5]  C. Glendinning,et al.  Evaluation of the Individual Budgets Pilot Programme: Final Report , 2008 .

[6]  J. Forder,et al.  Measuring the outcomes of low-level services: final report , 2010 .

[7]  J. Brazier,et al.  Outcomes of social care for adults (OSCA): interim findings , 2009 .

[8]  J. Brazier,et al.  Outcomes of Social Care for Adults , 2012 .

[9]  Terry N. Flynn,et al.  Quantifying response shift or adaptation effects in quality of life by synthesising best-worst scaling and discrete choice data , 2013 .

[10]  Joanna Coast,et al.  Using discrete choice experiments to understand preferences for quality of life. Variance-scale heterogeneity matters. , 2010, Social science & medicine.

[11]  J. Louviere,et al.  Determining the Appropriate Response to Evidence of Public Concern: The Case of Food Safety , 1992 .

[12]  Martin Knapp,et al.  Measuring and understanding social services outputs , 2005 .

[13]  Denzil G. Fiebig,et al.  The Generalized Multinomial Logit Model: Accounting for Scale and Coefficient Heterogeneity , 2010, Mark. Sci..

[14]  Younger adults' understanding of questions for a service user experience survey: a report to the Information Centre for Health and Social Care , 2006 .

[15]  R. Sander Overview: Outcomes of Social Care for Older People and Carers , 1999 .

[16]  R. D. Cook,et al.  A Comparison of Algorithms for Constructing Exact D-Optimal Designs , 1980 .

[17]  John M. Rose,et al.  Efficiency and sample size requirements for stated choice studies , 2005 .

[18]  T. Flynn Using Conjoint Analysis and Choice Experiments to Estimate QALY Values , 2012, PharmacoEconomics.

[19]  J. Forder,et al.  Measuring the outcomes of care homes , 2010 .

[20]  T. Peters,et al.  Best--worst scaling: What it can do for health care research and how to do it. , 2007, Journal of health economics.

[21]  J. Round Is a QALY still a QALY at the end of life? , 2012, Journal of health economics.

[22]  H. Bleichrodt A new explanation for the difference between time trade-off utilities and standard gamble utilities. , 2002, Health economics.

[23]  K. Jones,et al.  Evaluation of the Individual Budgets Pilot Programme , 2008 .

[24]  J. Louviere,et al.  Probabilistic models of set-dependent and attribute-level best-worst choice , 2008 .

[25]  Jordan J. Louviere,et al.  Modeling the effects of including/excluding attributes in choice experiments on systematic and random components , 2007 .

[26]  Andrew Daly,et al.  Calculating Errors for Measures Derived from Choice Modeling Estimates , 2012 .

[27]  Hong Il Yoo,et al.  The use of alternative preference elicitation methods in complex discrete choice experiments. , 2013, Journal of health economics.

[28]  A. Petch,et al.  Outcomes Important to People With Intellectual Disabilities , 2008 .

[29]  C. Carswell Measuring and Valuing Health Benefits for Economic Valuation , 2007, PharmacoEconomics.

[30]  J. Louviere,et al.  The Role of the Scale Parameter in the Estimation and Comparison of Multinomial Logit Models , 1993 .

[31]  Mandy Ryan,et al.  Discrete choice experiments in health economics: a review of the literature. , 2012, Health economics.

[32]  T. Wykes,et al.  The development of a measure of social care outcome for older people. Funded/commissioned by: Department of Health , 2002 .

[33]  T. Flynn Valuing citizen and patient preferences in health: recent developments in three types of best–worst scaling , 2010, Expert review of pharmacoeconomics & outcomes research.

[34]  Jordan J. Louviere,et al.  What You Don’t Know Might Hurt You: Some Unresolved Issues in the Design and Analysis of Discrete Choice Experiments , 2006 .

[35]  W. J. Studden,et al.  Theory Of Optimal Experiments , 1972 .