Evaluating Ranking Robustness in Multi-indicator Uncertain Matrices: An Application Based on Simulation and Global Sensitivity Analysis

Multi-indicator matrices represent a set of objects or alternatives characterized simultaneously by several criteria or attributes. In many situations, a decision-maker is interested in assessing each object, by considering simultaneously all criteria, and defining a ranking able to synthesize the global characteristic of each object, for example, from best to worst. However the assessment could be influenced by uncertain factors. For example, the cost of a project could be affected by variations in the interest rate. The effects of such variations could affect the initial or base rank. In this chapter, the robustness of the base rank is analyzed. The first part analyzes how the uncertainty in the numerical value of the criteria associated with each objects affects its rank. Additionally, it proposes some ideas for assessing the rank robustness. The second part proposes the use of global sensitivity analysis to assess the importance of each uncertain factor on, for example, the base rank. An example related to a real portfolio management, using three techniques that do not require additional preference parameters, is presented.

[1]  Max D. Morris,et al.  Factorial sampling plans for preliminary computational experiments , 1991 .

[2]  Holger R. Maier,et al.  Reliability-Based Approach to Multicriteria Decision Analysis for Water Resources , 2004 .

[3]  Rainer Brüggemann,et al.  An Improved Estimation of Averaged Ranks of Partial Orders , 2011 .

[4]  R. Brüggemann,et al.  Applying Hasse diagram technique for the evaluation of toxicological fish tests , 1995 .

[5]  Ching-Lai Hwang,et al.  Multiple Attribute Decision Making: Methods and Applications - A State-of-the-Art Survey , 1981, Lecture Notes in Economics and Mathematical Systems.

[6]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[7]  A. Azapagic,et al.  Managing uncertainty in multiple-criteria decision making related to sustainability assessment , 2011 .

[8]  E. Triantaphyllou,et al.  A Sensitivity Analysis Approach for Some Deterministic Multi-Criteria Decision-Making Methods* , 1997 .

[9]  McCarthyEd,et al.  A Unified Approach , 2005 .

[10]  Hyde K.m.,et al.  Visual Basic for Applicationsを用いたExcelにおける多基準意思決定解析のための距離ベースの及び確率論的な不確実性解析 , 2006 .

[11]  Ghanima Al-Sharrah,et al.  Ranking Using the Copeland Score: A Comparison with the Hasse Diagram , 2010, J. Chem. Inf. Model..

[12]  Rainer Brüggemann,et al.  Application of the Concept of Partial Order on Comparative Evaluation of Environmental Chemicals , 1999 .

[13]  B. Roy.  Méthodologie multicritère d'aide à la décision , 1985 .

[14]  P. Vincke,et al.  Note-A Preference Ranking Organisation Method: The PROMETHEE Method for Multiple Criteria Decision-Making , 1985 .

[15]  Ganapati P. Patil,et al.  Ranking and Prioritization for Multi-indicator Systems , 2011 .

[16]  Andrea Saltelli,et al.  From screening to quantitative sensitivity analysis. A unified approach , 2011, Comput. Phys. Commun..

[17]  Paola Annoni,et al.  Partial order investigation of multiple indicator systems using variance-based sensitivity analysis , 2011, Environ. Model. Softw..

[18]  B. Mareschal,et al.  NOVEL TYPES OF SENSITIVITY ANALYSIS FOR ANALYSIS FOR ADDITIVE MCDM METHODS , 1995 .

[19]  L Carlsen,et al.  The influence on partial order ranking from input parameter uncertainty. Definition of a robustness parameter. , 2000, Chemosphere.

[20]  Andrea Saltelli,et al.  An effective screening design for sensitivity analysis of large models , 2007, Environ. Model. Softw..

[21]  Bernard De Baets,et al.  Approximation of average ranks in posets , 2011 .

[22]  Stefano Tarantola,et al.  Sensitivity Analysis in Practice , 2002 .

[23]  Holger R. Maier,et al.  Distance-based and stochastic uncertainty analysis for multi-criteria decision analysis in Excel using Visual Basic for Applications , 2006, Environ. Model. Softw..

[24]  Seth D. Guikema,et al.  Sensitivity analysis for multi‐attribute system selection problems in onshore Environmentally Friendly Drilling (EFD) , 2012, Syst. Eng..

[25]  Rainer Brüggemann,et al.  Ranking patterns, an application to refrigerants , 2008 .

[26]  Max Henrion,et al.  Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis , 1990 .

[27]  Ching-Lai Hwang,et al.  Fuzzy Multiple Attribute Decision Making - Methods and Applications , 1992, Lecture Notes in Economics and Mathematical Systems.

[28]  Rainer Brüggemann,et al.  Estimation of Averaged Ranks by a Local Partial Order Model , 2004, J. Chem. Inf. Model..

[29]  Simon French,et al.  A FRAMEWORK FOR SENSITIVITY ANALYSIS IN DISCRETE MULTI OBJECTIVE DECISION MAKING , 1991 .