Prioritizing Healthcare Interventions: A Comparison of Multicriteria Decision Analysis and Cost-Effectiveness Analysis.

Abstract Objectives To investigate the extent to which stated preferences for treatment criteria elicited using multicriteria decision analysis (MCDA) methods are consistent with the trade-offs (implicitly) applied in cost-effectiveness analysis (CEA), and the impact of any differences on the prioritization of treatments. Methods We used existing MCDA and CEA models developed to evaluate interventions for knee osteoarthritis in the New Zealand population. We established equivalent input parameters for each model, for the criteria “treatment effectiveness,” “cost,” “risk of serious harms,” and “risk of mild-to-moderate harms” across a comprehensive range of (hypothetical) interventions to produce a complete ranking of interventions from each model. We evaluated the consistency of these rankings between the 2 models and investigated any systematic differences between the (implied) weight placed on each criterion in determining rankings. Results There was an overall moderate-to-strong correlation in intervention rankings between the MCDA and CEA models (Spearman correlation coefficient = 0.51). Nevertheless, there were systematic differences in the evaluation of trade-offs between intervention attributes and the resulting weights placed on each criterion. The CEA model placed lower weights on risks of harm and much greater weight on cost (at all accepted levels of willingness-to-pay per quality-adjusted life-year than did respondents to the MCDA survey. Conclusions MCDA and CEA approaches to inform intervention prioritization may give systematically different results, even when considering the same criteria and input data. These differences should be considered when designing and interpreting such studies to inform treatment prioritization decisions.

[1]  Anthony J. Culyer,et al.  Does MCDA Trump CEA? , 2018, Applied Health Economics and Health Policy.

[2]  Alec Morton,et al.  Multicriteria Decision Analysis to Support Health Technology Assessment Agencies: Benefits, Limitations, and the Way Forward. , 2019, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[3]  Aris Angelis,et al.  Value-Based Assessment of New Medical Technologies: Towards a Robust Methodological Framework for the Application of Multiple Criteria Decision Analysis in the Context of Health Technology Assessment , 2016, PharmacoEconomics.

[4]  P. Hansen,et al.  Multi-Criteria Decision Analysis (MCDA) in Healthcare Decision-Making , 2019, Oxford Research Encyclopedia of Economics and Finance.

[5]  Zoltán Kaló,et al.  Multiple Criteria Decision Analysis for Health Care Decision Making--Emerging Good Practices: Report 2 of the ISPOR MCDA Emerging Good Practices Task Force. , 2016, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[6]  Martin Weber,et al.  The Effect of Attribute Ranges on Weights in Multiattribute Utility Measurements , 1993 .

[7]  Karl Claxton,et al.  Methods for the estimation of the National Institute for Health and Care Excellence cost-effectiveness threshold. , 2015, Health technology assessment.

[8]  Martina Garau,et al.  Using MCDA as a Decision Aid in Health Technology Appraisal for Coverage Decisions: Opportunities, Challenges and Unresolved Questions , 2017 .

[9]  L. Erickson,et al.  Evidence and Value: Impact on DEcisionMaking – the EVIDEM framework and potential applications , 2008, BMC health services research.

[10]  Paul Hansen,et al.  Health technology prioritization: which criteria for prioritizing new technologies and what are their relative weights? , 2011, Health policy.

[11]  Maarten J. IJzerman,et al.  Multiple Criteria Decision Analysis for Health Care Decision Making--An Introduction: Report 1 of the ISPOR MCDA Emerging Good Practices Task Force. , 2016, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[12]  P. Hansen,et al.  Choosing interventions for hip or knee osteoarthritis - What matters to stakeholders? A mixed-methods study , 2020, Osteoarthritis and cartilage open.

[13]  G. W. Fischer Range Sensitivity of Attribute Weights in Multiattribute Value Models , 1995 .

[14]  A. Briggs,et al.  The cost-effectiveness of recommended adjunctive interventions for knee osteoarthritis: Results from a computer simulation model , 2020, Osteoarthritis and cartilage open.

[15]  Tommi Tervonen,et al.  The Use of MCDA in HTA: Great Potential, but More Effort Needed. , 2017, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[16]  J H Abbott,et al.  Development and validation of a new population-based simulation model of osteoarthritis in New Zealand. , 2018, Osteoarthritis and cartilage.

[17]  Ross A. Wilson,et al.  The projected burden of knee osteoarthritis in New Zealand: healthcare expenditure and total joint replacement provision. , 2019, The New Zealand medical journal.

[18]  P. Hansen,et al.  A new method for scoring additive multi‐attribute value models using pairwise rankings of alternatives , 2008 .

[19]  Ralph L. Keeney,et al.  Common Mistakes in Making Value Trade-Offs , 2002, Oper. Res..

[20]  J. Sachs Macroeconomics and health: investing in health for economic development , 2002 .

[21]  J. Karnon,et al.  Estimating the Reference Incremental Cost-Effectiveness Ratio for the Australian Health System , 2018, PharmacoEconomics.

[22]  Anirban Basu,et al.  Approaches to Aggregation and Decision Making—A Health Economics Approach: An ISPOR Special Task Force Report [5]☆ , 2018, Value in Health.

[23]  P. Hansen,et al.  Stakeholders’ preferences for osteoarthritis interventions in health services: A cross-sectional study using multi-criteria decision analysis , 2020, Osteoarthritis and cartilage open.

[24]  Ralph L. Keeney,et al.  Selecting Attributes to Measure the Achievement of Objectives , 2005, Oper. Res..

[25]  J. Richardson,et al.  Priority setting in health care using multi-attribute utility theory and programme budgeting and marginal analysis (PBMA). , 2007, Social science & medicine.