Rethinking the Foundations of Sustainability Measurement: The Limitations of the Environmental Sustainability Index (ESI)

The objective of sustainability measurement is to move environmental decision making toward more rigorous, quantitative and empirical foundations. One of the most comprehensive attempts to lay out the foundations for sustainability measurement has been offered by the Environmental Sustainability Index (ESI). This paper aims to advance the science of sustainability measurement by assessing the validity and reliability of this composite index in order to provide new insights for future indicator development. The architecture of the ESI is validated against the Pressure-State-Response (PSR) model, after which an exploratory factor analysis is conducted to reveal the latent structure of the index. Further, the performance of the ESI is tested in cross-national regression models. The results indicate a lack of consistency with the well established PSR model and a potential bias towards economically developed countries grounded in the architecture and weighting mechanism of the index. A re-weighted index (Equivalised ESI) is constructed, resulting in a new ranking of countries’ sustainability. The Equivalised ESI improves the measurement qualities of the index, and in so doing actually reinforces the rich-country bias of the ESI. Put differently, the Equivalised ESI brings the deficiencies of the original ESI to the fore. This paper illustrates that there are serious conceptual problems and validity concerns with defining the ESI as a sustainability measure. Taken together, the findings reinforce the need to reconsider future foundations of sustainability measurement in order to ensure that it is clear both what is being measured and how well.

[1]  Steven E. Barkan,et al.  Explaining Public Support for the Environmental Movement: A Civic Voluntarism Model* , 2004 .

[2]  Saurabh Gupta,et al.  An overview of sustainability assessment methodologies , 2009 .

[3]  H. Welsch,et al.  Meaningful environmental indices: a social choice approach , 2004 .

[4]  Christoph Böhringer,et al.  Measuring the Immeasurable: A Survey of Sustainability Indices , 2007 .

[5]  Thomas Dietz,et al.  Tracking the Anthropogenic Drivers of Ecological Impacts , 2004, Ambio.

[6]  Andrew K. Jorgenson Unpacking International Power and the Ecological Footprints of Nations: A Quantitative Cross-National Study , 2005 .

[7]  Nick Hanley,et al.  Comparing Augmented Sustainability Measures for Scotland: Is There a Mismatch? , 2006 .

[8]  Andrew K. Jorgenson,et al.  The Economy, Military, and Ecologically Unequal Exchange Relationships in Comparative Perspective: A Panel Study of the Ecological Footprints of Nations, 1975—2000 , 2009 .

[9]  D. Niemeijer Developing indicators for environmental policy: data-driven and theory-driven approaches examined by example , 2002 .

[10]  Geir B. Asheim,et al.  Green National Accounting for Welfare and Sustainability: A Taxonomy of Assumptions and Results , 2002, SSRN Electronic Journal.

[11]  S. Morse,et al.  Making ‘dirty’ nations look clean? The nation state and the problem of selecting and weighting indices as tools for measuring progress towards sustainability , 2005 .

[12]  Aart Kraay,et al.  Governance Matters VII: Aggregate and Individual Governance Indicators, 1996-2007 , 2008 .

[13]  P. Babcicky Single and composite sustainability indicators in comparative sociology , 2012 .

[14]  A. Bonini Cross-National Variation in Individual Life Satisfaction: Effects of National Wealth, Human Development, and Environmental Conditions , 2008 .

[15]  Barbara E. Johnson,et al.  A CROSS-CULTURAL INVESTIGATION OF FACTORS INFLUENCING ENVIRONMENTAL ACTIONS , 2010 .

[16]  Gene Bazan Our Ecological Footprint: Reducing Human Impact on the Earth , 1997 .

[17]  Richard York The Challenges of Measuring Environmental Sustainability , 2009 .

[18]  P. Prew,et al.  World-Economy Centrality and Carbon Dioxide Emissions: A New Look at the Position in the Capitalist World-System and Environmental Pollution , 2010 .

[19]  Brian D. Fath,et al.  Towards a theory of sustainable systems , 2002 .

[20]  E. Rosa,et al.  A rift in modernity? assessing the anthropogenic sources of global climate change with the STIRPAT model , 2003 .

[21]  R. Cattell The Scree Test For The Number Of Factors. , 1966, Multivariate behavioral research.

[22]  Martin Ravallion,et al.  Carbon Emissions and Income Inequality , 2000 .

[23]  F. Agostinho,et al.  Sustainability of nations by indices: Comparative study between environmental sustainability index, ecological footprint and the emergy performance indices , 2008 .

[24]  Rudolf de Groot,et al.  A conceptual framework for selecting environmental indicator sets , 2008 .

[25]  C. Russell,et al.  National culture and environmental sustainability: A cross-national analysis , 2007 .

[26]  Heinz Welsch,et al.  Environmental welfare analysis: A life satisfaction approach , 2007 .

[27]  Andrew K. Jorgenson Global Warming and the Neglected Greenhouse Gas: A Cross-National Study of the Social Causes of Methane Emissions Intensity, 1995 , 2006 .

[28]  E. Rosa,et al.  Effects of population and affluence on CO2 emissions. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Aart Kraay,et al.  Governance Matters VIII: Aggregate and Individual Governance Indicators, 1996-2008 , 2006 .

[30]  J. Asafu-Adjaye BIODIVERSITY LOSS AND ECONOMIC GROWTH, A CROSS COUNTRY ANALYSIS , 2003 .

[31]  Thomas Dietz,et al.  The Ecological Footprint Intensity of National Economies , 2004 .

[32]  S. Morse Greening the United Nations' Human Development Index? , 2003 .

[33]  Thomas J. Burns,et al.  The political-economic causes of change in the ecological footprints of nations, 1991-2001: A quantitative investigation , 2007 .

[34]  J. Pillarisetti,et al.  The World Bank's 'genuine savings' measure and sustainability , 2005 .

[35]  E. Rosa,et al.  STIRPAT, IPAT and ImPACT: analytic tools for unpacking the driving forces of environmental impacts , 2003 .

[36]  Richard York,et al.  Agricultural Exports and the Environment: A Cross-National Study of Fertilizer and Pesticide Consumption. , 2008 .

[37]  Kirk Hamilton,et al.  Measuring the Wealth of Nations , 2003, Environmental monitoring and assessment.

[38]  P. Sutton,et al.  SPECIAL ISSUE: The Dynamics and Value of Ecosystem Services: Integrating Economic and Ecological Perspectives Global estimates of market and non-market values derived from nighttime satellite imagery, land cover, and ecosystem service valuation , 2002 .

[39]  E. Rosa,et al.  Footprints on the Earth: The Environmental Consequences of Modernity , 2003, American Sociological Review.

[40]  Geurt Van de Kerk,et al.  A comprehensive index for a sustainable society: The SSI — the Sustainable Society Index , 2008 .

[41]  Philip Andrew Lawn,et al.  A Stock-Take of Green National Accounting Initiatives , 2007 .

[42]  Justin Kitzes,et al.  Current Methods for Calculating National Ecological Footprint Accounts 【特集論文 エコロジカル・フットプリント指標の現状と課題】 , 2007 .

[43]  B. London,et al.  Ecologically Unequal Exchange and Deforestation: A Cross-National Analysis of Forestry Export Flows , 2009 .

[44]  J. Boyce,et al.  Income, inequality, and pollution: a reassessment of the environmental Kuznets Curve , 1998 .

[45]  J. Bergh,et al.  Sustainable nations: what do aggregate indexes tell us? , 2010 .

[46]  Andrew K. Jorgenson Consumption and Environmental Degradation: A Cross-National Analysis of the Ecological Footprint , 2003 .

[47]  Richard York,et al.  Gender Equality and State Environmentalism , 2005 .

[48]  A. Mayer,et al.  The multidisciplinary influence of common sustainability indices , 2004 .

[49]  D. Bryant,et al.  Environmental indicators : a systematic approach to measuring and reporting on environmental policy performance in the context of sustainable development , 1995 .

[50]  B F Giannetti,et al.  The reliability of experts' opinions in constructing a composite environmental index: the case of ESI 2005. , 2009, Journal of environmental management.

[51]  Soong Sup Lee World development indicators 2010 , 2010 .

[52]  R. Kates,et al.  Characterizing and measuring sustainable development , 2003 .

[53]  G. Grossman,et al.  Economic Growth and the Environment , 1994 .

[55]  Simon Dietz,et al.  Weak and Strong Sustainability in the SEEA: Concepts and Measurement , 2007 .

[56]  Brigette J. Bush Democracy, autocracy, and hybridity: A cross -national analysis of political regimes, environmental sustainability, and performance , 2009 .

[57]  Thomas J. White,et al.  Sharing resources: The global distribution of the Ecological Footprint , 2007 .

[58]  S. Morse On the use of headline indices to link environmental quality and income at the level of the nation state , 2008 .

[59]  McColmFreedom House,et al.  Freedom in the World , 1993 .

[60]  Aleksander Zidanšek,et al.  Sustainable development and happiness in nations , 2007 .

[61]  Audrey L Mayer,et al.  Strengths and weaknesses of common sustainability indices for multidimensional systems. , 2008, Environment international.

[62]  Lucas Reijnders,et al.  Broad sustainability contra sustainability: the proper construction of sustainability indicators , 2004 .

[63]  Keith Pezzoli,et al.  Sustainable Development: A Transdisciplinary Overview of the Literature , 1997 .

[64]  Stephen Morse,et al.  Indices and Indicators in Development: An Unhealthy Obsession with Numbers , 2004 .

[65]  Raghbendra Jha,et al.  A Critique of the Environmental Sustainability Index , 2003 .