MCDA Index Tool: an interactive software to develop indices and rankings

A web-based software, called MCDA Index Tool (https://www.mcdaindex.net/), is presented in this paper. It allows developing indices and ranking alternatives, based on multiple combinations of normalization methods and aggregation functions. Given the steadily increasing importance of accounting for multiple preferences of the decision-makers and assessing the robustness of the decision recommendations, this tool is a timely instrument that can be used primarily by non-multiple criteria decision analysis (MCDA) experts to dynamically shape and evaluate their indices. The MCDA Index Tool allows the user to (i) input a dataset directly from spreadsheets with alternatives and indicators performance, (ii) build multiple indices by choosing several normalization methods and aggregation functions, and (iii) visualize and compare the indices’ scores and rankings to assess the robustness of the results. A novel perspective on uncertainty and sensitivity analysis of preference models offers operational solutions to assess the influence of different strategies to develop indices and visualize their results. A case study for the assessment of the energy security and sustainability implications of different global energy scenarios is used to illustrate the application of the MCDA Index Tool. Analysts have now access to an index development tool that supports constructive and dynamic evaluation of the stability of rankings driven by a single score while including multiple decision-makers’ and stakeholders’ preferences.

[1]  Thierry Marchant,et al.  Evaluation and Decision Models with Multiple Criteria: Stepping Stones for the Analyst , 2006 .

[2]  Davide Geneletti,et al.  Multicriteria analysis for sustainability assessment: concepts and case studies , 2015 .

[3]  S. Greco,et al.  On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness , 2019 .

[4]  B. Sudhakara Reddy,et al.  Three blind men and an elephant: The case of energy indices to measure energy security and energy sustainability , 2015 .

[5]  Luis C. Dias,et al.  Dealing with uncertainty in Decision Support Systems: Recent trends (2000-2011) , 2012, Intell. Decis. Technol..

[6]  I. Linkov,et al.  A matrix approach to community resilience assessment: an illustrative case at Rockaway Peninsula , 2015, Environment Systems and Decisions.

[7]  Luis C. Dias,et al.  Additive aggregation with variable interdependent parameters: the VIP analysis software , 2000, J. Oper. Res. Soc..

[8]  David Lindén Exploration of implicit weights in composite indicators : The case of resilience assessment of countries’ electricity supply , 2018 .

[9]  M. Cinelli The Art of Supporting Decision-Making , 2017 .

[10]  Stefano Tarantola,et al.  Handbook on Constructing Composite Indicators: Methodology and User Guide , 2005 .

[11]  Jacinto González-Pachón,et al.  Measuring systems sustainability with multi-criteria methods: A critical review , 2017, Eur. J. Oper. Res..

[12]  Ali Jahan,et al.  A state-of-the-art survey on the influence of normalization techniques in ranking: Improving the materials selection process in engineering design , 2015 .

[13]  Matthias Ehrgott,et al.  Multiple criteria decision analysis: state of the art surveys , 2005 .

[14]  S. Greco,et al.  Axiomatization of utility, outranking and decision-rule preference models for multiple-criteria classification problems under partial inconsistency with the dominance principle , 2002 .

[15]  Patrick Meyer,et al.  Diviz: A software for modeling, processing and sharing algorithmic workflows in MCDA , 2012, Intell. Decis. Technol..

[16]  Trinidad Gómez,et al.  Building composite indicators using multicriteria methods: a review , 2019 .

[17]  Gerd Gigerenzer,et al.  Heuristics are Tools for Uncertainty , 2017 .

[18]  H. Heinimann,et al.  Infrastructure Resilience Assessment, Management and Governance – State and Perspectives , 2017 .

[19]  A. Kuandykov,et al.  Multi-Criteria Decision Support Systems. Comparative Analysis , 2013 .

[20]  Luis C. Dias,et al.  Evaluation and Decision Models With Multiple Criteria: Case Studies , 2015 .

[21]  M. Grabisch,et al.  Fuzzy Measures and Integrals in MCDA , 2004 .

[22]  Mohammad Ghaderi,et al.  Contingent preference disaggregation model for multiple criteria sorting problem , 2020, Eur. J. Oper. Res..

[23]  Ying Luo,et al.  On rank reversal in decision analysis , 2009, Math. Comput. Model..

[24]  Love Ekenberg,et al.  State-of-the-Art Prescriptive Criteria Weight Elicitation , 2012, Adv. Decis. Sci..

[25]  Raimo P. Hämäläinen,et al.  Web-HIPRE - Global decision support by value tree and AHP analysis , 1999 .

[26]  R. Hämäläinen,et al.  Preference programming through approximate ratio comparisons , 1995 .

[27]  Stefan Hirschberg,et al.  Comprehensive resilience assessment of electricity supply security for 140 countries , 2020, Ecological Indicators.

[28]  Yan Li,et al.  Multiple Criteria Decision Analysis Software , 2016 .

[29]  Alessio Ishizaka,et al.  Multi-criteria Decision Analysis: Methods and Software , 2013 .

[30]  Matthias Ehrgott,et al.  Multiple Criteria Decision Analysis , 2016 .

[31]  Luis C. Dias,et al.  Perspectives on Multi-criteria Decision Analysis and Life-Cycle Assessment , 2019, Multiple Criteria Decision Making.

[32]  S. Greco,et al.  Multiple Criteria Hierarchy Process with ELECTRE and PROMETHEE , 2013 .

[33]  A. Ghasemi,et al.  Normality Tests for Statistical Analysis: A Guide for Non-Statisticians , 2012, International journal of endocrinology and metabolism.

[34]  Ludovico Carrino Data Versus Survey-based Normalisation in a Multidimensional Analysis of Social Inclusion , 2016 .

[35]  Alvaro José Abackerli,et al.  Techniques to model uncertain input data of multi-criteria decision-making problems: a literature review , 2018, Int. Trans. Oper. Res..

[36]  Caterina Cruciani,et al.  Constructing the FEEM Sustainability Index: A Choquet-Integral Application , 2012 .

[37]  Giuseppe Munda,et al.  The Issue of Consistency: Basic Methodological Concepts , 2008 .

[38]  B. Roy Two conceptions of decision aiding , 2010 .

[39]  R. Słowiński,et al.  Aiding decisions with multiple criteria: essays in honor of Bernard Roy , 2002 .

[40]  Gregory M Peters,et al.  Aggregating sustainability indicators: beyond the weighted sum. , 2012, Journal of environmental management.

[41]  Fabio Blanco-Mesa,et al.  A bibliometric analysis of aggregation operators , 2019, Appl. Soft Comput..

[42]  G. Munda Social Multi-Criteria Evaluation for a Sustainable Economy , 2007 .

[43]  Virginia H. Dale,et al.  Normalization in sustainability assessment: Methods and implications , 2016 .

[44]  Union européenne,et al.  Handbook on Constructing Composite Indicators: Methodology and User Guide , 2008 .

[45]  Jyri Mustajoki,et al.  Comparison of multi-criteria decision analytical software for supporting environmental planning processes , 2017, Environ. Model. Softw..

[46]  S. Giove,et al.  The Italian Regional Well-Being in a Multi-expert Non-additive Perspective , 2018 .

[47]  Leonardo Tomazeli Duarte,et al.  A Novel Multicriteria Decision Aiding Method Based on Unsupervised Aggregation via the Choquet Integral , 2018, IEEE Transactions on Engineering Management.

[48]  Igor Linkov,et al.  Multi-criteria risk management with the use of DecernsMCDA: methods and case studies , 2016, Environment Systems and Decisions.

[49]  Valentina Ferretti,et al.  How to support the design and evaluation of redevelopment projects for disused railways? A methodological proposal and key lessons learned , 2017 .

[50]  Patrice Perny,et al.  Aiding Decisions with Multiple Criteria , 2002 .

[51]  William Becker,et al.  Weights and importance in composite indicators: Closing the gap , 2017, Ecological indicators.

[52]  PROBLEM FORMULATION AND STRUCTURING: THE DECISION AIDING PROCESS , 2019 .

[53]  Alireza Alinezhad,et al.  New Methods and Applications in Multiple Attribute Decision Making (MADM) , 2019, International Series in Operations Research & Management Science.

[54]  M. Mazziotta,et al.  Synthesis of Indicators: The Composite Indicators Approach , 2017 .

[55]  Marco Cinelli,et al.  Analysis of the potentials of multi criteria decision analysis methods to conduct sustainability assessment , 2014 .

[56]  Patrick Meyer,et al.  Eliciting Preferences on Multiattribute Societies with a Choquet Integral , 2008 .

[57]  Peter Reichert,et al.  The method matters: a guide for indicator aggregation in ecological assessments , 2014 .

[58]  Peter Reichert,et al.  The conceptual foundation of environmental decision support. , 2015, Journal of environmental management.

[59]  Roman Słowiński,et al.  How to support the application of multiple criteria decision analysis? Let us start with a comprehensive taxonomy , 2020, Omega.

[60]  E. Triantaphyllou,et al.  A Sensitivity Analysis Approach for Some Deterministic Multi-Criteria Decision-Making Methods* , 1997 .

[61]  Saisana Michaela,et al.  Sustainable Society Index (SSI): Taking societies' pulse along social, environmental and economic issues. The Joint Research Centre audit on the SSI , 2012 .

[62]  Ludovico Carrino The Role of Normalisation in Building Composite Indicators. Rationale and Consequences of Different Strategies, Applied to Social Inclusion , 2017 .

[63]  A. Saltelli,et al.  On the Relative Importance of Input Factors in Mathematical Models , 2002 .

[64]  William Becker,et al.  Why so many published sensitivity analyses are false: A systematic review of sensitivity analysis practices , 2017, Environ. Model. Softw..

[65]  A. Tversky,et al.  On the study of statistical intuitions , 1982, Cognition.

[66]  S. Greco,et al.  Decision Rule Approach , 2005 .

[67]  F. Maggino Complexity in Society: From Indicators Construction to their Synthesis , 2017 .

[68]  Renata Pelissari,et al.  SMAA methods and their applications: a literature review and future research directions , 2020, Ann. Oper. Res..

[69]  Milosz Kadzinski,et al.  Scoring procedures for multiple criteria decision aiding with robust and stochastic ordinal regression , 2016, Comput. Oper. Res..

[70]  Emily Nicholson,et al.  Navigating uncertainty in environmental composite indicators , 2017 .

[71]  S. Hirschberg,et al.  Security of electricity supply indicators in a resilience context , 2017 .

[72]  Igor Linkov,et al.  Tiered Approach to Resilience Assessment , 2018, Risk analysis : an official publication of the Society for Risk Analysis.

[73]  P. Burgherr,et al.  Indices under the Spotlight: An Approach to Unveil and Manage the Implicit Trade-offs between Indicators , 2019, Proceedings of the 29th European Safety and Reliability Conference (ESREL).

[74]  Tommi Tervonen,et al.  JSMAA: open source software for SMAA computations , 2014, Int. J. Syst. Sci..

[75]  Thomas Dyllick,et al.  The Gap Frame - Translating the SDGs into relevant national grand challenges for strategic business opportunities , 2017 .