Multi-criteria Decision Analysis Software in Healthcare Priority Setting: A Systematic Review

Objective The objectives of this systematic review were to identify studies using Multi-Criteria Decision Analysis (MCDA) software tools to support health prioritisation processes and describe the technical capabilities of the MCDA software tools identified. Methods First, a systematic literature review was conducted in the MEDLINE, EMBASE, Web of Science, EconLit and Cochrane databases in July 2019 to identify studies that have used MCDA software for priority setting in health-related problems. Second, the MCDA software tools found in the review were downloaded (full versions, where freely available, and trial versions otherwise) and tested to extract their key technical characteristics. Results Nine studies were included, from which seven different software tools, 1000minds ® , M-MACBETH, Socio Technical Allocation of Resources (STAR), Strategic Multi-Attribute Ranking Tool (SMART), Visual PROMETHEE, EVIDEM and the Prioritisation Framework, were identified. These software tools differed in terms of the operating systems (including web interface), MCDA technique(s) available for use, visualisation features, and the capability to perform Value for Money (VfM) and sensitivity analyses. Conclusions The use of MCDA software in prioritisation processes has a number of advantages such as inclusion of several types of stakeholders and the ability to analyse a greater number of alternatives and criteria and perform real-time sensitivity analyses. Proprietary software (i.e. software with licensing fees) seemed to have more features than freely available software. However, this field is still developing, with only a few studies where MCDA software was used to support health priority setting and opportunity costs not explicitly captured in many software tools.

[1]  A. Kuandykov,et al.  Multi-Criteria Decision Support Systems. Comparative Analysis , 2013 .

[2]  Praveen Thokala,et al.  Cost-Effectiveness Thresholds: the Past, the Present and the Future , 2018, PharmacoEconomics.

[3]  Paul Hansen,et al.  Which health technologies should be funded? A prioritization framework based explicitly on value for money , 2012, Israel Journal of Health Policy Research.

[4]  Hector Eduardo Castro Jaramillo,et al.  TESTING MULTI-CRITERIA DECISION ANALYSIS FOR MORE TRANSPARENT RESOURCE-ALLOCATION DECISION MAKING IN COLOMBIA , 2016, International Journal of Technology Assessment in Health Care.

[5]  Paul Hansen,et al.  Determining Criteria and Weights for Prioritizing Health Technologies Based on the Preferences of the General Population: A New Zealand Pilot Study. , 2016, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[6]  Guruprasad Madhavan,et al.  Committee on Identifying and Prioritizing New Preventive Vaccines for Development, Phase III , 2013 .

[7]  Ralph L. Keeney,et al.  Decisions with multiple objectives: preferences and value tradeoffs , 1976 .

[8]  Jyri Mustajoki,et al.  Comparison of Multi-Criteria Decision Analytical Software - Searching for ideas for developing a new EIA-specific multi-criteria software , 2013 .

[9]  Priority Setting in Health Care: A Complementary Approach , 2013, Health Care Analysis.

[10]  Maarten J. IJzerman,et al.  A Review and Classification of Approaches for Dealing with Uncertainty in Multi-Criteria Decision Analysis for Healthcare Decisions , 2015, PharmacoEconomics.

[11]  Peter C Smith,et al.  Measuring value for money in healthcare : concepts and tools , 2009 .

[12]  Zoltán Kaló,et al.  Multiple Criteria Decision Analysis for Health Care Decision Making--Emerging Good Practices: Report 2 of the ISPOR MCDA Emerging Good Practices Task Force. , 2016, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[13]  Theodor J. Stewart,et al.  Multiple criteria decision analysis - an integrated approach , 2001 .

[14]  Aparna Gupta,et al.  Decision Sciences : Theory and Practice , 2016 .

[15]  Maarten J. IJzerman,et al.  A Systematic Review to Identify the Use of Preference Elicitation Methods in Healthcare Decision Making , 2014, Pharmaceutical Medicine.

[16]  Marcia Tummers,et al.  Value Assessment Frameworks for HTA Agencies: The Organization of Evidence-Informed Deliberative Processes. , 2017, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[17]  Alec Morton,et al.  STAR—People-Powered Prioritization , 2014, Medical decision making : an international journal of the Society for Medical Decision Making.

[18]  Yan Li,et al.  A Multiple Criteria Decision Analysis (MCDA) Software Selection Framework , 2014, 2014 47th Hawaii International Conference on System Sciences.

[19]  K. Marsh,et al.  Incorporating MCDA into HTA: challenges and potential solutions, with a focus on lower income settings , 2018, Cost Effectiveness and Resource Allocation.

[20]  Jyri Mustajoki,et al.  Comparison of multi-criteria decision analytical software for supporting environmental planning processes , 2017, Environ. Model. Softw..

[21]  P. Thokala,et al.  Stakeholder involvement in Multi-Criteria Decision Analysis , 2018, Cost Effectiveness and Resource Allocation.

[22]  Lazim Abdullah,et al.  Simple Additive Weighting Methods of Multi criteria Decision Making and Applications: A Decade Review , 2014 .

[23]  D. Fryback,et al.  Ranking Vaccines: A Prioritization Framework: Phase I: Demonstration of Concept and a Software Blueprint , 2013 .

[24]  Daniel A. Keim,et al.  Knowledge Generation Model for Visual Analytics , 2014, IEEE Transactions on Visualization and Computer Graphics.

[25]  P. Vincke,et al.  Preference ranking organization method for enrichment evaluations , 1985 .

[26]  R. Rappuoli,et al.  Ranking Vaccines: Applications of a Prioritization Software Tool: Phase III: Use Case Studies and Data Framework , 2015 .

[27]  L. Sabik,et al.  Priority setting in health care: Lessons from the experiences of eight countries , 2008, International Journal for Equity in Health.

[28]  J. Waaub,et al.  Multi-Stakeholder Decision Aid for Improved Prioritization of the Public Health Impact of Climate Sensitive Infectious Diseases , 2016, International journal of environmental research and public health.

[29]  Theodor J. Stewart,et al.  Multiple Criteria Decision Analysis , 2001 .

[30]  P. Mullen,et al.  Quantifying priorities in healthcare: transparency or illusion? , 2004, Health services management research.

[31]  Marianna Jacyna,et al.  Multicriteria Decision Support in Designing Transport Systems , 2015, TST.

[32]  Georges Adunlin,et al.  Application of multicriteria decision analysis in health care: a systematic review and bibliometric analysis , 2015, Health expectations : an international journal of public participation in health care and health policy.

[33]  Aris Angelis,et al.  Value-Based Assessment of New Medical Technologies: Towards a Robust Methodological Framework for the Application of Multiple Criteria Decision Analysis in the Context of Health Technology Assessment , 2016, PharmacoEconomics.

[34]  M. Sculpher,et al.  Developing a Value Framework: The Need to Reflect the Opportunity Costs of Funding Decisions. , 2017, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[35]  Yan Li,et al.  Multiple Criteria Decision Analysis Software , 2016 .

[36]  Azza Shoaibi,et al.  Priority setting for the prevention and control of cardiovascular diseases: multi-criteria decision analysis in four eastern Mediterranean countries , 2014, International Journal of Public Health.

[37]  P. Hansen,et al.  A new method for scoring additive multi‐attribute value models using pairwise rankings of alternatives , 2008 .

[38]  K. Marsh,et al.  Assessing the Value of Healthcare Interventions Using Multi-Criteria Decision Analysis: A Review of the Literature , 2014, PharmacoEconomics.

[39]  Andrew Mirelman,et al.  Health care priority setting in Norway a multicriteria decision analysis , 2012, BMC Health Services Research.

[40]  Alessio Ishizaka,et al.  Multi-criteria Decision Analysis: Methods and Software , 2013 .

[41]  Guruprasad Madhavan,et al.  Ranking Vaccines: A Prioritization Software Tool: Phase II: Prototype of a Decision-Support System , 2013 .

[42]  Rob Baltussen,et al.  Priority setting of public spending in developing countries: do not try to do everything for everybody. , 2006, Health policy.

[43]  Carlos A. Bana e Costa,et al.  MACBETH (Measuring Attractiveness by a Categorical Based Evaluation Technique) , 2011 .

[44]  C. Mitton,et al.  Past, present and future challenges in health care priority setting. , 2018, Journal of health organization and management.

[45]  Crawford W. Revie,et al.  Multi-Criteria Decision Analysis Tools for Prioritising Emerging or Re-Emerging Infectious Diseases Associated with Climate Change in Canada , 2013, PloS one.