A Framework for Instrument Development of a Choice Experiment: An Application to Type 2 Diabetes

ObjectiveChoice experiments are increasingly used to obtain patient preference information for regulatory benefit–risk assessments. Despite the importance of instrument design, there remains a paucity of literature applying good research principles. We applied a novel framework for instrument development of a choice experiment to measure type 2 diabetes mellitus treatment preferences.MethodsApplying the framework, we used evidence synthesis, expert consultation, stakeholder engagement, pretest interviews, and pilot testing to develop a best–worst scaling (BWS) and discrete choice experiment (DCE). We synthesized attributes from published DCEs for type 2 diabetes, consulted clinical experts, engaged a national advisory board, conducted local cognitive interviews, and pilot tested a national survey.ResultsFrom published DCEs (n = 17), ten attribute categories were extracted with cost (n = 11) having the highest relative attribute importance (RAI) (range 6–10). Clinical consultation and stakeholder engagement identified six attributes for inclusion. Cognitive pretesting with local diabetes patients (n = 25) ensured comprehension of the choice experiment. Pilot testing with patients from a national sample (n = 50) identified nausea as most important (RAI for DCE: 10 [95 % CI 8.5–11.5]; RAI for BWS: 10 [95 % CI 8.9–11.1]). The developed choice experiment contained five attributes (A1c decrease, blood glucose stability, low blood glucose, nausea, additional medicine, and cost).ConclusionThe framework for instrument development of a choice experiment included five stages of development and incorporated multiple stakeholder perspectives. Further comparisons of instrument development approaches are needed to identify best practices. To facilitate comparisons, researchers need to be encouraged to publish or discuss their instrument development strategies and findings.

[1]  Barbara Kanninen,et al.  Optimal Design for Multinomial Choice Experiments , 2002 .

[2]  Nisa M. Maruthur,et al.  Comparative Effectiveness and Safety of Medications for Type 2 Diabetes: An Update Including New Drugs and 2-Drug Combinations , 2011, Annals of Internal Medicine.

[3]  A. Hauber,et al.  A Survey of Patient Preferences for Oral Antihyperglycemic Therapy in Patients with Type 2 Diabetes Mellitus , 2015, Diabetes Therapy.

[4]  K. Boye,et al.  Evaluating preferences for profiles of GLP-1 receptor agonists among injection-naïve type 2 diabetes patients in the UK , 2015, Patient preference and adherence.

[5]  A. Hauber,et al.  Effect of pill burden on dosing preferences, willingness to pay, and likely adherence among patients with type 2 diabetes , 2013, Patient preference and adherence.

[6]  B. Monz,et al.  Preferences for medication attributes among patients with type 2 diabetes mellitus in the UK , 2013, Diabetes, obesity & metabolism.

[7]  T. Vilsbøll,et al.  Patient preferences for diabetes management among people with type 2 diabetes in Denmark – a discrete choice experiment , 2011, Current medical research and opinion.

[8]  Maarten J. IJzerman,et al.  Statistical Methods for the Analysis of Discrete Choice Experiments: A Report of the ISPOR Conjoint Analysis Good Research Practices Task Force. , 2016, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[9]  E. Wittenberg,et al.  Measuring the Preferences of Homeless Women for Cervical Cancer Screening Interventions: Development of a Best–Worst Scaling Survey , 2015, The Patient - Patient-Centered Outcomes Research.

[10]  M. Ridderstråle,et al.  Willingness to pay for health improvements associated with anti-diabetes treatments for people with type 2 diabetes , 2010, Current medical research and opinion.

[11]  J. Segal,et al.  Perceived Barriers and Potential Strategies to Improve Self-Management Among Adults with Type 2 Diabetes: A Community-Engaged Research Approach , 2016, The Patient - Patient-Centered Outcomes Research.

[12]  A. Hauber,et al.  A discrete-choice experiment to quantify patient preferences for frequency of glucagon-like peptide-1 receptor agonist injections in the treatment of type 2 diabetes , 2016, Current medical research and opinion.

[13]  N. Clark,et al.  Standards of Medical Care in Diabetes: Response to Power , 2006 .

[14]  S. Heller,et al.  Willingness to pay for improvements in chronic long-acting insulin therapy in individuals with type 1 or type 2 diabetes mellitus. , 2011, Clinical therapeutics.

[15]  E. Hannan,et al.  A Qualitative Study of Vulnerable Patient Views of Type 2 Diabetes Consumer Reports , 2016, The Patient - Patient-Centered Outcomes Research.

[16]  M. Weinstein,et al.  Foundations of cost-effectiveness analysis for health and medical practices. , 1977, The New England journal of medicine.

[17]  Tanjala S. Purnell,et al.  Patient Preferences for Noninsulin Diabetes Medications: A Systematic Review , 2014, Diabetes Care.

[18]  Andrew Lloyd,et al.  Conjoint analysis applications in health--a checklist: a report of the ISPOR Good Research Practices for Conjoint Analysis Task Force. , 2011, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[19]  A. Mühlbacher,et al.  What matters in type 2 diabetes mellitus oral treatment? A discrete choice experiment to evaluate patient preferences , 2016, The European Journal of Health Economics.

[20]  Lori Frank,et al.  The PCORI perspective on patient-centered outcomes research. , 2014, JAMA.

[21]  K. Howard,et al.  Assessing Stated Preferences for Colorectal Cancer Screening: A Critical Systematic Review of Discrete Choice Experiments , 2014, The Patient - Patient-Centered Outcomes Research.

[22]  Joel Huber,et al.  The Importance of Utility Balance in Efficient Choice Designs , 1996 .

[23]  Emily Lancsar,et al.  A Systematic Review of Stated Preference Studies Reporting Public Preferences for Healthcare Priority Setting , 2014, The Patient - Patient-Centered Outcomes Research.

[24]  Tanjala S. Purnell,et al.  Patient Preferences for the Treatment of Type 2 Diabetes: A Scoping Review , 2013, PharmacoEconomics.

[25]  Nikos Maniadakis,et al.  Patient preference and willingness-to-pay for Humalog Mix25 relative to Humulin 30/70: a multicountry application of a discrete choice experiment. , 2004, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[26]  J. Bridges,et al.  Understanding the Experience of Age-Related Vestibular Loss in Older Individuals: A Qualitative Study , 2016, The Patient - Patient-Centered Outcomes Research.

[27]  J. Bridges,et al.  Identifying the Benefits and Risks of Emerging Treatments for Idiopathic Pulmonary Fibrosis: A Qualitative Study , 2015, The Patient - Patient-Centered Outcomes Research.

[28]  John F P Bridges,et al.  A community-engaged approach to quantifying caregiver preferences for the benefits and risks of emerging therapies for Duchenne muscular dystrophy. , 2014, Clinical therapeutics.

[29]  Marta Botella,et al.  Patients’ and physicians’ preferences for type 2 diabetes mellitus treatments in Spain and Portugal: a discrete choice experiment , 2015, Patient preference and adherence.

[30]  Shari Bolen,et al.  Systematic Review: Comparative Effectiveness and Safety of Oral Medications for Type 2 Diabetes Mellitus , 2007, Annals of Internal Medicine.

[31]  Mandy Ryan,et al.  Discrete choice experiments in health economics: a review of the literature. , 2012, Health economics.

[32]  G. Willis,et al.  Research Synthesis: The Practice of Cognitive Interviewing , 2007 .

[33]  M. Augustin,et al.  Feasibility of Using Qualitative Interviews to Explore Patients’ Treatment Goals: Experience from Dermatology , 2016, The Patient - Patient-Centered Outcomes Research.

[34]  Charles Cunningham,et al.  Using Best–Worst Scaling to Measure Caregiver Preferences for Managing their Child’s ADHD: A Pilot Study , 2015, The Patient - Patient-Centered Outcomes Research.

[35]  M. Hiligsmann,et al.  Focus Groups in Elderly Ophthalmologic Patients: Setting the Stage for Quantitative Preference Elicitation , 2016, The Patient - Patient-Centered Outcomes Research.

[36]  F. Johnson,et al.  Treatment preferences and medication adherence of people with Type 2 diabetes using oral glucose‐lowering agents , 2009, Diabetic medicine : a journal of the British Diabetic Association.

[37]  M. Abrahamson,et al.  The 2015 Standards for Diabetes Care: Maintaining a Patient-Centered Approach , 2015, Annals of Internal Medicine.

[38]  John F P Bridges,et al.  Caregiver Preferences for Emerging Duchenne Muscular Dystrophy Treatments: A Comparison of Best-Worst Scaling and Conjoint Analysis , 2015, The Patient - Patient-Centered Outcomes Research.

[39]  J. Louviere,et al.  Valuing Preferences for the Process and Outcomes of Clinical Genetics Services: A Pilot Study , 2016, The Patient - Patient-Centered Outcomes Research.

[40]  V. Reyna,et al.  Variation in Treatment Priorities for Chronic Hepatitis C: A Latent Class Analysis , 2016, The Patient - Patient-Centered Outcomes Research.

[41]  Scot Simpson,et al.  A discrete choice experiment evaluation of patients’ preferences for different risk, benefit, and delivery attributes of insulin therapy for diabetes management , 2010, Patient preference and adherence.

[42]  F. Johnson,et al.  Risking health to avoid injections: preferences of Canadians with type 2 diabetes. , 2005, Diabetes care.

[43]  M. Nylenna,et al.  Patient-Important Outcomes in the Long-Term Treatment of Bipolar Disorder: A Mixed-Methods Approach Investigating Relative Preferences and a Proposed Taxonomy , 2016, The Patient - Patient-Centered Outcomes Research.

[44]  K. Flanigan,et al.  How a patient advocacy group developed the first proposed draft guidance document for industry for submission to the U.S. Food and Drug Administration , 2015, Orphanet Journal of Rare Diseases.

[45]  Joanna Coast,et al.  Using qualitative methods for attribute development for discrete choice experiments: issues and recommendations. , 2012, Health economics.

[46]  Patient-focused drug development programme takes first steps , 2013, Nature Reviews Drug Discovery.

[47]  Deborah Marshall,et al.  Conjoint Analysis Applications in Health — How are Studies being Designed and Reported? , 2010, The patient.

[48]  Deborah Marshall,et al.  Constructing experimental designs for discrete-choice experiments: report of the ISPOR Conjoint Analysis Experimental Design Good Research Practices Task Force. , 2013, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[49]  S. Jan,et al.  Understanding Patient Preferences in Medication Nonadherence: A Review of Stated Preference Data , 2014, The Patient - Patient-Centered Outcomes Research.

[50]  Mickael Bech,et al.  Designing a stated choice experiment: The value of a qualitative process , 2012 .

[51]  Caroline Vass,et al.  Risk as an Attribute in Discrete Choice Experiments: A Systematic Review of the Literature , 2014, The Patient - Patient-Centered Outcomes Research.

[52]  A. Brett Hauber,et al.  Quantifying Benefit–Risk Preferences for Medical Interventions: An Overview of a Growing Empirical Literature , 2013, Applied Health Economics and Health Policy.

[53]  Elaine L. Zanutto,et al.  A comparison of preferences for two GLP-1 products – liraglutide and exenatide – for the treatment of type 2 diabetes , 2010, Journal of medical economics.

[54]  C. K. Mertz,et al.  PSYCHOLOGICAL SCIENCE Research Article Numeracy and Decision Making , 2022 .

[55]  D. Hensher,et al.  Stated Choice Methods: Analysis and Applications , 2000 .

[56]  Hans-Jürgen Hippler,et al.  Preferences of diabetes patients and physicians: A feasibility study to identify the key indicators for appraisal of health care values , 2010, Health and quality of life outcomes.

[57]  Ambady Ramachandran,et al.  A quantitative assessment of patient barriers to insulin , 2011, International journal of clinical practice.

[58]  John F P Bridges,et al.  Stated preference methods in health care evaluation: an emerging methodological paradigm in health economics. , 2003, Applied health economics and health policy.

[59]  T. Kjær,et al.  The Patient Perspective of Diabetes Care: A Systematic Review of Stated Preference Research , 2014, The Patient - Patient-Centered Outcomes Research.