Selection of sustainability indicators for planning: combining stakeholders' participation and data reduction techniques

The role of spatial planning for sustainable development has been widely acknowledged in academia and in policy. Monitoring spatial plans increases knowledge of whether they achieved their goals in guaranteeing sustainable development on a territorial level. Indicators are suited for this task and could play an important role in determining the applicability or effectiveness of plans. The contribution of indicator sets for effective strategic sustainability monitoring needs to be supported by an analysis of consistency and meaning at each stage of indicator development, from design to implementation. Indicator selection is usually done by experts and/or through participatory approaches and often little is known about the robustness of the selection stage, its utility, accuracy, validity, feasibility and redundancy. The main goal of this research is to identify, through a participatory approach and data reduction techniques, a set of sustainability indicators for strategic monitoring of regional spatial plans. Decision makers and planning practitioners from regional and local authorities, as well as academics, were asked to assess through a scoring procedure the importance of a base set of sustainability indicators to monitor the effects of a spatial plan. Principal Components Analysis, followed by sensitivity analysis with Monte Carlo simulation were used in the data reduction phase. This approach was tested on a set of outcomes/effects indicators developed for the Algarve's regional spatial plan (southern Portugal). It was possible to highlight the importance of involving different groups of stakeholders and to identify relevant indicator selection criteria, as well as a final set of indicators that are more representative of different stakeholders' opinions and more able to translate, in an integrated way, overall changes in sustainability performance. Factors that can influence the results of the approach are discussed, such as stakeholder representativeness and data availability. Recommendations regarding the use of the approach and its results are also presented, for example concerning the use of information conveyed by indicators in an aggregated way, in the form of an index. The approach could be useful to guide the collection of regional sustainability data, contributing to the reporting and assessment of spatial plans, tailored to each particular territorial reality and stakeholders' perceptions, values, needs and concerns.

[1]  Jon C. Helton,et al.  Uncertainty and sensitivity analysis techniques for use in performance assessment for radioactive waste disposal , 1993 .

[2]  P. Berke,et al.  Are We Planning for Sustainable Development? , 2000 .

[3]  Tomás B. Ramos,et al.  A framework for regional sustainability assessment: developing indicators for a Portuguese region , 2010 .

[4]  Peter Nijkamp,et al.  A Multi-Scenario Forecast of Urban Change: A Study on Urban Growth in the Algarve , 2011 .

[5]  Stephen Morse,et al.  Harnessing the power of the press with three indices of sustainable development , 2011 .

[6]  Mark Seasons,et al.  Monitoring of indicators in local and regional planning practice: concepts and issues , 2004 .

[7]  Helen Briassoulis,et al.  Sustainable Development and its Indicators: Through a (Planner's) Glass Darkly , 2001 .

[8]  Joseph J. Harrington,et al.  Effective dimensionality of environmental indicators: a principal component analysis with bootstrap confidence intervals , 1998 .

[9]  Kathleen V. Diegert,et al.  Error and uncertainty in modeling and simulation , 2002, Reliab. Eng. Syst. Saf..

[10]  J. Scanlan,et al.  Sustainability indicators for measuring planning outcomes , 2004 .

[11]  P. Martens,et al.  An adaptive indicator framework for monitoring regional sustainable development: a case study of the INSURE project in Limburg, The Netherlands , 2010 .

[12]  Judith E. Innes,et al.  Information in Communicative Planning , 1998 .

[13]  A. Onwuegbuzie,et al.  Toward a Definition of Mixed Methods Research , 2007 .

[14]  Ulrika Palme,et al.  Sustainable development indicators: how are they used in Swedish water utilities? , 2008 .

[15]  Matthew Carmona An International Perspective on Measuring Quality in Planning , 2003 .

[16]  A. Faludi The European Spatial Developement Perspective , 2001 .

[17]  Stefano Tarantola,et al.  Handbook on Constructing Composite Indicators: Methodology and User Guide , 2005 .

[18]  D. Hamby A review of techniques for parameter sensitivity analysis of environmental models , 1994, Environmental monitoring and assessment.

[19]  Víctor-Andrés Cloquell-Ballester,et al.  Indicators validation for the improvement of environmental and social impact quantitative assessment , 2006 .

[20]  Jan Kovanda,et al.  A method to assess the relevance of sustainability indicators: Application to the indicator set of the Czech Republic's Sustainable Development Strategy , 2012 .

[21]  P. Coelho,et al.  The role of common local indicators in regional sustainability assessment , 2010 .

[22]  Teresa Fidélis,et al.  A proposal to explore the role of sustainability indicators in local governance contexts: The case of Palmela, Portugal , 2012 .

[23]  MICHAEL B. Jones,et al.  Selecting environmental indicator for use in strategic environmental assessment , 2007 .

[24]  Sara Moreno Pires,et al.  Local sustainability indicators in Portugal: assessing implementation and use in governance contexts , 2015 .

[25]  Hadi Dowlatabadi,et al.  Sensitivity and Uncertainty Analysis of Complex Models of Disease Transmission: an HIV Model, as an Example , 1994 .

[26]  T. Ramos,et al.  The Integration of Environmental Practices and Tools in the Portuguese Local Public Administration , 2014 .

[27]  Ivan Bolis,et al.  When sustainable development risks losing its meaning. Delimiting the concept with a comprehensive literature review and a conceptual model , 2014 .

[28]  I. Sobola,et al.  Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[29]  Matti Melanen,et al.  The role of co-operation between academia and policymakers for the development and use of sustainability indicators – a case from the Finnish Kymenlaakso Region , 2009 .

[30]  Luís Miguel Nunes,et al.  Developing an integrated approach for the strategic monitoring of regional spatial plans , 2012 .

[31]  Louis Albrechts The Planning Community Reflects on Enhancing Public Involvement. Views from Academics and Reflective Practitioners , 2002 .

[32]  J. Doody,et al.  Integrated Coastal Management , 2001 .

[33]  Jean-Thomas Bernard,et al.  The measurement of the energy intensity of manufacturing industries: a principal components analysis , 2005 .

[34]  A. Barrera-Roldán,et al.  Proposal and application of a Sustainable Development Index , 2002 .

[35]  Cecilia Wong,et al.  Monitoring Spatial Strategies: The Case of Local Development Documents in England , 2006 .

[36]  Murray Patterson,et al.  Aggregate eco-efficiency indices for New Zealand--a principal components analysis. , 2004, Journal of environmental management.

[37]  Wil Zonneveld,et al.  Polycentric Development Policies in Europe: Overview and Debate , 2005 .

[38]  Sara Tyskeng,et al.  Analytical framework and tool kit for SEA follow-up , 2009 .

[39]  Rodrigo Lozano,et al.  Sustainability inter-linkages in reporting vindicated: a study of European companies , 2013 .

[40]  Christian Bockstaller,et al.  How to validate environmental indicators , 2003 .

[41]  Narasimha D. Rao,et al.  Assessing rural energy sustainability in developing countries , 2014 .

[42]  Ali Bagheri,et al.  Planning for sustainable development: a paradigm shift towards a process-based approach , 2007 .

[43]  Stefano Tarantola,et al.  Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators , 2005 .

[44]  Marco Keiner,et al.  Advancing Sustainable Development and its Implementation Through Spatial Planning , 2006 .

[45]  Tomás B. Ramos,et al.  Development of regional sustainability indicators and the role of academia in this process: the Portuguese practice , 2009 .

[46]  Saurabh Gupta,et al.  An overview of sustainability assessment methodologies , 2009 .

[47]  Daniel Tyteca,et al.  Towards indicators of sustainable development for firms: A productive efficiency perspective , 1999 .

[48]  Joseph Sarkis,et al.  Towards a national circular economy indicator system in China: an evaluation and critical analysis , 2012 .

[49]  Tomás B. Ramos,et al.  Meta-performance evaluation of sustainability indicators , 2010 .

[50]  W. Eberhard Falck,et al.  Selection of social demand-based indicators: EO-based indicators for mining , 2014 .

[51]  Audrey L Mayer,et al.  Strengths and weaknesses of common sustainability indices for multidimensional systems. , 2008, Environment international.

[52]  P. Soler-Rovira,et al.  Assessment of aggregated indicators of sustainability using PCA: the case of apple trade in Spain , 2008 .

[53]  Mike Gillen,et al.  Planning for sustainable development , 2004 .

[54]  Jochen Jesinghaus Measuring European environmental policy performance , 2012 .