Multicriteria Decision Analysis to Support Health Technology Assessment Agencies: Benefits, Limitations, and the Way Forward.

OBJECTIVE Recent years have witnessed an increased interest in the use of multicriteria decision analysis (MCDA) to support health technology assessment (HTA) agencies for setting healthcare priorities. However, its implementation to date has been criticized for being "entirely mechanistic," ignoring opportunity costs, and not following best practice guidelines. This article provides guidance on the use of MCDA in this context. METHODS The present study was based on a systematic review and consensus development. We developed a typology of MCDA studies and good implementation practice. We reviewed 36 studies over the period 1990 to 2018 on their compliance with good practice and developed recommendations. We reached consensus among authors over the course of several review rounds. RESULTS We identified 3 MCDA study types: qualitative MCDA, quantitative MCDA, and MCDA with decision rules. The types perform differently in terms of quality, consistency, and transparency of recommendations on healthcare priorities. We advise HTA agencies to always include a deliberative component. Agencies should, at a minimum, undertake qualitative MCDA. The use of quantitative MCDA has additional benefits but also poses design challenges. MCDA with decision rules, used by HTA agencies in The Netherlands and the United Kingdom and typically referred to as structured deliberation, has the potential to further improve the formulation of recommendations but has not yet been subjected to broad experimentation and evaluation. CONCLUSION MCDA holds large potential to support HTA agencies in setting healthcare priorities, but its implementation needs to be improved.

[1]  W. Friedman,et al.  Deliberative Democracy and the Problem of Scope , 2006 .

[2]  Guenka Petrova,et al.  Health technology assessment in Poland, the Czech Republic, Hungary, Romania and Bulgaria , 2014, The European Journal of Health Economics.

[3]  Douglas K. Martin,et al.  A Strategy to Improve Priority Setting in Developing Countries , 2007, Health Care Analysis.

[4]  Hector Eduardo Castro Jaramillo,et al.  TESTING MULTI-CRITERIA DECISION ANALYSIS FOR MORE TRANSPARENT RESOURCE-ALLOCATION DECISION MAKING IN COLOMBIA , 2016, International Journal of Technology Assessment in Health Care.

[5]  Georgi Iskrov,et al.  Multi-Criteria Decision Analysis for Assessment and Appraisal of Orphan Drugs , 2016, Front. Public Health.

[6]  Anthony J. Culyer,et al.  Does MCDA Trump CEA? , 2018, Applied Health Economics and Health Policy.

[7]  Norman Daniels,et al.  Accountability for reasonableness , 2000, BMJ : British Medical Journal.

[8]  K. Marsh,et al.  Assessing the Value of Healthcare Interventions Using Multi-Criteria Decision Analysis: A Review of the Literature , 2014, PharmacoEconomics.

[9]  Maarten J. IJzerman,et al.  Multiple Criteria Decision Analysis for Health Care Decision Making--An Introduction: Report 1 of the ISPOR MCDA Emerging Good Practices Task Force. , 2016, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[10]  Mita Giacomini,et al.  Bringing 'the public' into health technology assessment and coverage policy decisions: from principles to practice. , 2007, Health policy.

[11]  Rob Baltussen,et al.  Mapping of multiple criteria for priority setting of health interventions: an aid for decision makers , 2012, BMC Health Services Research.

[12]  P. Wahlster,et al.  Balancing costs and benefits at different stages of medical innovation: a systematic review of Multi-criteria decision analysis (MCDA) , 2015, BMC Health Services Research.

[13]  Aris Angelis,et al.  Using health technology assessment to assess the value of new medicines: results of a systematic review and expert consultation across eight European countries , 2017, The European Journal of Health Economics.

[14]  Rob Baltussen,et al.  The art of priority setting , 2017, The Lancet.

[15]  Praveen Thokala,et al.  Cost-Effectiveness Thresholds: the Past, the Present and the Future , 2018, PharmacoEconomics.

[16]  Valerie Belton,et al.  Structuring problems for Multi-Criteria Decision Analysis in practice: A literature review of method combinations , 2017, Eur. J. Oper. Res..

[17]  A. Morton Treacle and Smallpox: Two Tests for Multicriteria Decision Analysis Models in Health Technology Assessment. , 2017, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[18]  Kalipso Chalkidou,et al.  Evidence and values: paying for end-of-life drugs in the British NHS , 2012, Health Economics, Policy and Law.

[19]  Tommi Tervonen,et al.  The Use of MCDA in HTA: Great Potential, but More Effort Needed. , 2017, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[20]  Gerald Gartlehner,et al.  [GRADE guidelines: 10. Considering resource use and rating the quality of economic evidence]. , 2013, Zeitschrift fur Evidenz, Fortbildung und Qualitat im Gesundheitswesen.

[21]  Georges Adunlin,et al.  Application of multicriteria decision analysis in health care: a systematic review and bibliometric analysis , 2015, Health expectations : an international journal of public participation in health care and health policy.

[22]  N. Devlin,et al.  Incorporating Multiple Criteria in HTA: Methods and Processes , 2011 .

[23]  N. Daniels,et al.  Accountability for reasonableness. , 2000, BMJ.

[24]  Marcia Tummers,et al.  Value Assessment Frameworks for HTA Agencies: The Organization of Evidence-Informed Deliberative Processes. , 2017, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[25]  S Holm,et al.  The second phase of priority setting. Goodbye to the simple solutions: the second phase of priority setting in health care. , 1998, BMJ.

[26]  Aris Angelis,et al.  Multiple criteria decision analysis in the context of health technology assessment: a simulation exercise on metastatic colorectal cancer with multiple stakeholders in the English setting , 2017, BMC Medical Informatics and Decision Making.

[27]  R. Baltussen,et al.  Multicriteria decision analysis for including health interventions in the universal health coverage benefit package in Thailand. , 2012, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[28]  Craig Mitton,et al.  Cost Effectiveness and Resource Allocation Open Access Health Care Priority Setting: Principles, Practice and Challenges , 2022 .

[29]  Ole Frithjof Norheim,et al.  Combining evidence and values in priority setting: testing the balance sheet method in a low-income country , 2007, BMC Health Services Research.

[30]  Martina Garau,et al.  Using MCDA as a Decision Aid in Health Technology Appraisal for Coverage Decisions: Opportunities, Challenges and Unresolved Questions , 2017 .

[31]  Sabin,et al.  The second phase of priority setting , 1998, BMJ.

[32]  Praveen Thokala,et al.  Multi-Criteria Decision Analysis to Support Healthcare Decisions , 2017 .

[33]  Maarten Joost IJzerman,et al.  PHP143 – Multi Criteria Decision Analysis Methods In Health Care: Current Status, Good Practice And Future Recommendations , 2014 .

[34]  M. Cowie National Institute for Health and Care Excellence. , 2015, European heart journal.

[35]  Zoltán Kaló,et al.  Multiple Criteria Decision Analysis for Health Care Decision Making--Emerging Good Practices: Report 2 of the ISPOR MCDA Emerging Good Practices Task Force. , 2016, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[36]  R. Baltussen,et al.  Priority setting of health interventions: the need for multi-criteria decision analysis , 2006, Cost effectiveness and resource allocation : C/E.

[37]  Theodor J. Stewart,et al.  Multiple criteria decision analysis - an integrated approach , 2001 .

[38]  E. Lee,et al.  Eliciting societal preferences of reimbursement decision criteria for anti cancer drugs in South Korea , 2017, Expert review of pharmacoeconomics & outcomes research.