Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators

Composite indicators are increasingly used for bench-marking countries' performances. Yet doubts are often raised about the robustness of the resulting countries' rankings and about the significance of the associated policy message. We propose the use of uncertainty analysis and sensitivity analysis to gain useful insights during the process of building composite indicators, including a contribution to the indicators' definition of quality and an assessment of the reliability of countries' rankings. We discuss to what extent the use of uncertainty and sensitivity analysis may increase transparency or make policy inference more defensible by applying the methodology to a known composite indicator: the United Nations's technology achievement index. Copyright 2005 Royal Statistical Society.

[1]  J. Church.  Human Development Report , 2001 .

[2]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[3]  David R. Cox,et al.  Quality‐Of‐Life Assessment: Can We Keep it Simple? , 1992 .

[4]  Sidney Addelman,et al.  trans-Dimethanolbis(1,1,1-trifluoro-5,5-dimethylhexane-2,4-dionato)zinc(II) , 2008, Acta crystallographica. Section E, Structure reports online.

[5]  I. Sobol.  On the distribution of points in a cube and the approximate evaluation of integrals , 1967 .

[6]  R. W. Saaty,et al.  The analytic hierarchy process—what it is and how it is used , 1987 .

[7]  Dean T. Jamison,et al.  WHO Ranking of Health System Performance , 2001, Science.

[8]  Stefano Tarantola,et al.  Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models , 2004 .

[9]  Michael Freudenberg,et al.  Composite Indicators of Country Performance: A Critical Assessment , 2003 .

[10]  Bedřich Moldan,et al.  Sustainability indicators : a report on the project on indicators of sustainable development , 1997 .

[11]  A. Saltelli,et al.  On the Relative Importance of Input Factors in Mathematical Models , 2002 .

[12]  Mario Paruggia,et al.  Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models , 2006 .

[13]  Giuseppe Munda,et al.  Version November , 2003 On the Methodological Foundations of Composite Indicators Used for Ranking Countries , 2003 .

[14]  Joseph A. C. Delaney.  Sensitivity analysis , 2018, The African Continental Free Trade Area: Economic and Distributional Effects.

[15]  S. Tarantola,et al.  State-of-the-art Report on Current Methodologies and Practices for Composite Indicator Development , 2002 .

[16]  A. Saltelli,et al.  Making best use of model evaluations to compute sensitivity indices , 2002 .

[17]  A. Saltelli,et al.  Sensitivity Anaysis as an Ingredient of Modeling , 2000 .

[18]  A. Saltelli,et al.  Importance measures in global sensitivity analysis of nonlinear models , 1996 .

[19]  Saltelli Andrea,et al.  Statistical Techniques and Participatory Approaches for the Compilation of the European Internal Market Index 1992-2001 , 2002 .

[20]  Stefano Tarantola,et al.  Sensitivity Analysis as an Ingredient of Modeling , 2000 .