Conceptualising the effectiveness of impact assessment processes

Abstract This paper aims at conceptualising the effectiveness of impact assessment processes through the development of a literature-based framework of criteria to measure impact assessment effectiveness. Four categories of effectiveness were established: procedural, substantive, transactive and normative, each containing a number of criteria; no studies have previously brought together all four of these categories into such a comprehensive, criteria-based framework and undertaken systematic evaluation of practice. The criteria can be mapped within a cycle/or cycles of evaluation, based on the ‘logic model’, at the stages of input, process, output and outcome to enable the identification of connections between the criteria across the categories of effectiveness. This framework is considered to have potential application in measuring the effectiveness of many impact assessment processes, including strategic environmental assessment (SEA), environmental impact assessment (EIA), social impact assessment (SIA) and health impact assessment (HIA).

[1]  Matthias Wismar,et al.  Is HIA effective? A synthesis of concepts, methodologies and results. , 2007 .

[2]  Linda G. Morra,et al.  Case study evaluations , 1999 .

[3]  John Sinclair,et al.  BBC English dictionary , 1993 .

[4]  Chambers.  The Chambers Dictionary , 2006 .

[5]  Riki Therivel,et al.  Sustainability-focused impact assessment: English experiences , 2009 .

[6]  Christopher Wood,et al.  Environmental impact assessment: Retrospect and prospect , 2007 .

[7]  Angus Morrison-Saunders,et al.  Framework for comparing and evaluating sustainability assessment practice , 2013 .

[8]  Martin Birley,et al.  Health impact assessment, integration and critical appraisal , 2003 .

[9]  Alan Bond,et al.  Application of the SEA Directive to EU structural funds: Perspectives on effectiveness , 2010 .

[10]  Luca Del Furia,et al.  The effectiveness of provisions and quality of practices concerning public participation in EIA in Italy , 2000 .

[11]  Marleen Bekker,et al.  Evaluating the impact of HIA on urban reconstruction decision-making: Who manages whose risks? , 2005 .

[12]  Robert Rattle,et al.  Integrating Health and Social Impact Assessment , 2003 .

[13]  Hens Runhaar,et al.  What makes strategic environmental assessment successful environmental assessment? The role of context in the contribution of SEA to decision-making , 2007 .

[14]  R J Quigley,et al.  Evaluating health impact assessment. , 2004, Public health.

[15]  Oran R. Young,et al.  The Effectiveness of International Environmental Regimes , 2010 .

[16]  O. Bina.  A critical review of the dominant lines of argumentation on the need for strategic environmental assessment , 2007 .

[17]  Paola Gazzola,et al.  SEA effectiveness criteria—equally valid in all countries? The case of Italy , 2006 .

[18]  Arwin van Buuren,et al.  Evaluating strategic environmental assessment in The Netherlands: content, process and procedure as indissoluble criteria for effectiveness , 2009 .

[19]  Priti Kumar,et al.  Health impact assessment needs in south-east Asian countries. , 2003, Bulletin of the World Health Organization.

[20]  Lars Emmelin,et al.  Evaluating the effectiveness of impact assessment instruments: Theorising the nature and implications of their political constitution , 2010 .

[21]  G. Henry,et al.  Logic models and content analyses for the explication of evaluation theories: the case of emergent realist evaluation. , 2013, Evaluation and program planning.

[22]  P. Gazzola,et al.  Effectiveness of strategic environmental assessment - the significance of learning , 2009 .

[23]  Kate Ashcroft,et al.  Researching into assessment and evaluation in colleges and universities , 1996 .

[24]  Stephen Jay,et al.  Evaluating the SEA of Land Use Plans , 2005 .

[25]  Michael. Short,et al.  Strategic Environmental Assessment and Land Use Planning: An International Evaluation , 2005 .

[26]  Alan Bond,et al.  Impact mitigation in environmental impact assessment: paper promises or the basis of consent conditions? , 2005 .

[27]  Ortwin Renn,et al.  Including social impact assessment in food safety governance , 2010 .

[28]  John Kemm,et al.  The future challenges for HIA , 2005 .

[29]  A. Bond,et al.  Chapter 3: Challenges in determining the effectiveness of sustainability assessment , 2013 .

[30]  Frank Vanclay,et al.  The Evolving Nature of Environmental Assessment and Management: Linking Tools to Help Deliver Sustainability , 2001 .

[31]  Alan Bond,et al.  The interminable issue of effectiveness: substantive purposes, outcomes and research challenges in the advancement of environmental impact assessment theory , 2004 .

[32]  David Hickie,et al.  Development of guidelines for improving the effectiveness of environmental assessment , 1998 .

[33]  Ciaran O'Faircheallaigh,et al.  Effectiveness in social impact assessment: Aboriginal peoples and resource development in Australia , 2009 .

[34]  Frank Vanclay,et al.  EVALUATING THE USE OF SOCIAL IMPACT ASSESSMENT IN THE CONTEXT OF AGRICULTURAL DEVELOPMENT PROJECTS IN IRAN , 2009 .

[35]  Jiang Ru,et al.  Strategic environmental assessment in China: motivations, politics, and effectiveness. , 2008, Journal of environmental management.

[36]  O. Bina,et al.  Theorising strategic environmental assessment: fresh perspectives and future challenges , 2007 .

[37]  Bo Elling,et al.  Rationality and effectiveness: does EIA/SEA treat them as synonyms? , 2009 .

[38]  L. A. Sandham,et al.  A review of EIA report quality in the North West province of South Africa , 2008 .

[39]  F. Retief.  EFFECTIVENESS OF STRATEGIC ENVIRONMENTAL ASSESSMENT (SEA) IN SOUTH AFRICA , 2007 .

[40]  Maria Rosário Partidário,et al.  Elements of an SEA framework— improving the added-value of SEA , 2000 .

[41]  John Kemm,et al.  HIA: a practitioner’s view , 2004 .

[42]  Angus Morrison-Saunders,et al.  Common sense in environmental impact assessment: It is not as common as it should be , 2004 .

[43]  Jenny Pope,et al.  The state of the art of impact assessment in 2012 , 2012 .

[44]  R. Burdge,et al.  The benefits of social impact assessment in Third World development , 1990 .

[45]  A. L. Brown,et al.  SEA and planning: ‘ownership’ of strategic environmental assessment by the planners is the key to its effectiveness , 2009 .

[46]  Frank Vanclay,et al.  THE TRIPLE BOTTOM LINE AND IMPACT ASSESSMENT: HOW DO TBL, EIA, SIA, SEA AND EMS RELATE TO EACH OTHER? , 2004 .

[47]  John Glasson,et al.  Introduction to Environmental Impact Assessment , 1999 .

[48]  Robin Lin Miller.  Logic models: a useful way to study theories of evaluation practice? , 2013, Evaluation and program planning.

[49]  Alan Bond,et al.  The role and functioning of environmental assessment: theoretical reflections upon an empirical investigation of causation. , 2008, Journal of environmental management.

[50]  Douglas Baker,et al.  Evaluating the effectiveness of British Columbia's environmental assessment process for first nations' participation in mining development , 2003 .

[51]  C. Barrow,et al.  Environmental and Social Impact Assessment: An Introduction , 1997 .

[52]  Erica Wimbush,et al.  An Evaluation Framework for Health Promotion: Theory, Quality and Effectiveness , 2000 .

[53]  Sandy Ross,et al.  The World Food Programme in Global Politics , 2011 .

[54]  T Kauppinen,et al.  The effectiveness of human impact assessment in the Finnish Healthy Cities Network. , 2006, Public health.

[55]  Angus Morrison-Saunders,et al.  Effectiveness of non-legal EIA guidance from the perspective of consultants in Western Australia , 2003 .

[56]  Steven Cummins,et al.  Validating Health Impact Assessment: Prediction is difficult (especially about the future) , 2007 .

[57]  Riki Therivel,et al.  Strategic Environmental Assessment in Action , 2004 .

[58]  Charles C. Harris,et al.  A participatory approach to social impact assessment: The interactive community forum , 2003 .