Constructing experimental designs for discrete-choice experiments: report of the ISPOR Conjoint Analysis Experimental Design Good Research Practices Task Force.

Stated-preference methods are a class of evaluation techniques for studying the preferences of patients and other stakeholders. While these methods span a variety of techniques, conjoint-analysis methods-and particularly discrete-choice experiments (DCEs)-have become the most frequently applied approach in health care in recent years. Experimental design is an important stage in the development of such methods, but establishing a consensus on standards is hampered by lack of understanding of available techniques and software. This report builds on the previous ISPOR Conjoint Analysis Task Force Report: Conjoint Analysis Applications in Health-A Checklist: A Report of the ISPOR Good Research Practices for Conjoint Analysis Task Force. This report aims to assist researchers specifically in evaluating alternative approaches to experimental design, a difficult and important element of successful DCEs. While this report does not endorse any specific approach, it does provide a guide for choosing an approach that is appropriate for a particular study. In particular, it provides an overview of the role of experimental designs for the successful implementation of the DCE approach in health care studies, and it provides researchers with an introduction to constructing experimental designs on the basis of study objectives and the statistical model researchers have selected for the study. The report outlines the theoretical requirements for designs that identify choice-model preference parameters and summarizes and compares a number of available approaches for constructing experimental designs. The task-force leadership group met via bimonthly teleconferences and in person at ISPOR meetings in the United States and Europe. An international group of experimental-design experts was consulted during this process to discuss existing approaches for experimental design and to review the task force's draft reports. In addition, ISPOR members contributed to developing a consensus report by submitting written comments during the review process and oral comments during two forum presentations at the ISPOR 16th and 17th Annual International Meetings held in Baltimore (2011) and Washington, DC (2012).

[1]  Mandy Ryan,et al.  Using discrete choice experiments to value health and health care , 2008 .

[2]  D. Hensher,et al.  Stated Choice Methods: Analysis and Applications , 2000 .

[3]  Peter Martinsson,et al.  Design techniques for stated preference methods in health economics. , 2003, Health economics.

[4]  M Wardman,et al.  THE DESIGN OF STATED PREFERENCE TRAVEL CHOICE EXPERIMENTS. WITH SPECIAL REFERENCE TO INTERPERSONAL TASTE VARIATIONS , 1988 .

[5]  T. Peters,et al.  Best--worst scaling: What it can do for health care research and how to do it. , 2007, Journal of health economics.

[6]  Michel Wedel,et al.  Heterogeneous Conjoint Choice Designs , 2005 .

[7]  M. Wedel,et al.  Designing Conjoint Choice Experiments Using Managers' Prior Beliefs , 2001 .

[8]  Barbara Kanninen,et al.  Optimal Design for Multinomial Choice Experiments , 2002 .

[9]  Mandy Ryan,et al.  Using discrete choice experiments to value health care programmes: current practice and future research reflections. , 2003, Applied health economics and health policy.

[10]  T. Flynn.  Valuing citizen and patient preferences in health: recent developments in three types of best–worst scaling , 2010, Expert review of pharmacoeconomics & outcomes research.

[11]  Emily Lancsar,et al.  Choice experiments in health: the good, the bad, the ugly and toward a brighter future , 2009, Health Economics, Policy and Law.

[12]  John M. Rose,et al.  Stated choice experimentation, contextual influences and food choice: A case study , 2008 .

[13]  T Fowkes,et al.  Non-orthogonal stated preference design , 1993 .

[14]  W. J. Studden,et al.  Theory Of Optimal Experiments , 1972 .

[15]  John M. Rose,et al.  Designing efficient stated choice experiments in the presence of reference alternatives , 2008 .

[16]  Sheryl L. Szeinbach,et al.  Outcomes Assessment Understanding Conjoint Analysis Applications in Health , 2011 .

[17]  Michel Wedel,et al.  Profile Construction in Experimental Choice Designs for Mixed Logit Models , 2002 .

[18]  F. Reed Johnson,et al.  Experimental Design For Stated-Choice Studies , 2006 .

[19]  J. Louviere,et al.  Determining the Appropriate Response to Evidence of Public Concern: The Case of Food Safety , 1992 .

[20]  Albert Hauber,et al.  Patient Preference Methods - A Patient Centered Evaluation Paradigm , 2007 .

[21]  Damaraju Raghavarao,et al.  Choice-Based Conjoint Analysis: Models and Designs , 2010 .

[22]  John M. Rose,et al.  Efficient stated choice experiments for estimating nested logit models , 2009 .

[23]  Rosalie Viney,et al.  Using stated preference discrete choice modelling to evaluate the introduction of varicella vaccination. , 2002, Health economics.

[24]  D. Street,et al.  The Construction of Optimal Stated Choice Experiments: Theory and Methods by STREET, D. J. and BURGESS, L. , 2007 .

[25]  Carol Mansfield,et al.  Survey-Design and Analytical Strategies for Better Healthcare Stated-Choice Studies , 2008 .

[26]  Mark J. Garratt,et al.  Efficient Experimental Design with Marketing Research Applications , 1994 .

[27]  Kathryn A Phillips,et al.  An experiment on simplifying conjoint analysis designs for measuring preferences. , 2003, Health economics.

[28]  B. Kanninen,et al.  Valuing environmental amenities using stated choice studies : a common sense approach to theory and practice , 2010 .

[29]  Emily Lancsar,et al.  Deleting 'irrational' responses from discrete choice experiments: a case of investigating or imposing preferences? , 2006, Health economics.

[30]  John M. Rose,et al.  Efficiency and sample size requirements for stated choice studies , 2005 .

[31]  Judith M. E. Walsh,et al.  PCN76 COMPARISON OF PHYSICIAN AND PATIENT PREFERENCES FOR COLORECTAL CANCER SCREENING USING A DISCRETE CHOICE EXPERIMENT , 2007 .

[32]  Terry N Flynn,et al.  Using Best-Worst Scaling Choice Experiments to Measure Public Perceptions and Preferences for Healthcare Reform in Australia , 2010, The patient.

[33]  Esther Seiden,et al.  On Orthogonal Arrays , 1966 .

[34]  M. Bliemer,et al.  Construction of experimental designs for mixed logit models allowing for correlation across choice observations , 2010 .

[35]  R. D. Cook,et al.  A Comparison of Algorithms for Constructing Exact D-Optimal Designs , 1980 .

[36]  Jordan J. Louviere,et al.  Designing Discrete Choice Experiments for Health Care , 2008 .

[37]  John M. Rose,et al.  Stated choice experimental design theory: the who, the what and the why , 2014 .

[38]  John F P Bridges,et al.  Stated preference methods in health care evaluation: an emerging methodological paradigm in health economics. , 2003, Applied health economics and health policy.

[39]  J. Louviere,et al.  Conducting Discrete Choice Experiments to Inform Healthcare Decision Making , 2012, PharmacoEconomics.

[40]  Andrew Lloyd,et al.  Conjoint analysis applications in health--a checklist: a report of the ISPOR Good Research Practices for Conjoint Analysis Task Force. , 2011, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[41]  Joel Huber,et al.  The Importance of Utility Balance in Efficient Choice Designs , 1996 .

[42]  Rosalie Viney,et al.  Empirical investigation of experimental design properties of discrete choice experiments in health care. , 2005, Health economics.

[43]  Deborah Marshall,et al.  Conjoint Analysis Applications in Health — How are Studies being Designed and Reported? , 2010, The patient.

[44]  John M. Rose,et al.  Applied Choice Analysis: A Primer , 2005 .

[45]  B. Orme.  Getting Started with Conjoint Analysis: Strategies for Product Design and Pricing Research , 2005 .

[46]  John M. Rose,et al.  Design Efficiency for Non-Market Valuation with Choice Modelling: How to Measure it, What to Report and Why , 2008 .

[47]  N. Cox.  Statistical Models in Engineering , 1970 .

[48]  J. Louviere,et al.  Discrete Choice Experiments Are Not Conjoint Analysis , 2010 .

[49]  Peter Goos,et al.  An Efficient Algorithm for Constructing Bayesian Optimal Choice Designs , 2009 .

[50]  Joel Huber,et al.  A General Method for Constructing Efficient Choice Designs , 1996 .