A simple procedure to harmonize class boundaries of assessment systems at the pan-European scale

A procedure for a large scale harmonization of assessment systems is delineated. The data collected for the two E.U. co-funded projects STAR and AQEM have been used as a benchmark dataset against which a test dataset derived from Italian standard monitoring programs was compared. A central step in the procedure adopted is the calculation of Intercalibration Common Metrics (STAR_ICMs). For both the benchmark and test datasets, six metrics were calculated, normalized and averaged to obtain an ICM index. The median values obtained for this index within each of the High and Good status classes, as defined within the STAR/AQEM dataset, were compared to the classes defined by the National method applied in Italy before WFD approval. The process of harmonization involved the re-positioning of the boundaries between Italian method quality classes until no more differences were found with the values observed in the STAR/AQEM samples. The re-setting of the Italian assessment boundaries by a step-by-step procedure lead to comparable STAR_ICM index values in the two datasets. Within this example, small refinements of the boundaries between high/good and good/moderate status were sufficient to harmonize the Italian assessment quality classes to the benchmark classification. Once a benchmark dataset is agreed among different countries, the procedure outlined can be easily applied to compare and harmonize assessment systems within and outside Europe. The main scientific and practical advantages of the procedure are listed and commented, especially facing the next steps of the Water Framework Directive Intercalibration process.

[1]  P. Verdonschot,et al.  Establishing reference conditions for European streams , 2004, Hydrobiologia.

[2]  Mike T. Furse,et al.  The development of the BEAST: a predictive approach for assessing sediment quality in the North American Great Lakes. , 2000 .

[3]  M. Furse,et al.  Intercalibration and comparison — major results and conclusions from the STAR project , 2006 .

[4]  Andrea Buffagni,et al.  The AQEM Multimetric System for the Southern Italian Apennines: Assessing the Impact of Water Quality and Habitat Degradation on Pool Macroinvertebrates in Mediterranean Rivers , 2004 .

[5]  Christian K. Feld,et al.  Cook book for the development of a Multimetric Index for biological condition of aquatic ecosystems: experiences from the European AQEM and STAR projects and related initiatives , 2006 .

[6]  D. Helsel,et al.  Statistical methods in water resources , 2020, Techniques and Methods.

[7]  Assessment of Organic Pollution Effect Considering Differences between Lotic and Lentic Stream Habitats , 2004 .

[8]  O. Moog,et al.  A stressor specific multimetric approach for monitoring running waters in Austria using benthic macro-invertebrates , 2004, Hydrobiologia.

[9]  W van de Bund,et al.  Towards good ecological status of surface waters in Europe--interpretation and harmonisation of the concept. , 2004, Water science and technology : a journal of the International Association on Water Pollution Research.

[10]  Leonard Sandin,et al.  Overview and application of the AQEM assessment system , 2004, Hydrobiologia.

[11]  D. Hering,et al.  Intercalibration of assessment methods for macrophytes in lowland streams: direct comparison and analysis of common metrics , 2006 .

[12]  Multimetric Assessment of Data Provided by Water Managers from Germany: Assessment of Several Different Types of Stressors with Macrozoobenthos Communities , 2004 .

[13]  Michael Köhl,et al.  Harmonisation and Standardisation in Multi-National Environmental Statistics – Mission Impossible? , 2000 .

[14]  B. Rossaro,et al.  Macroinvertebrate distribution in streams: a comparison of CA ordination with biotic indices , 1993, Hydrobiologia.

[15]  Paulo Pinto,et al.  Assessment of temporary streams: the robustness of metric and multimetric indices under different hydrological conditions , 2004 .

[16]  Sebastian Birk,et al.  Direct comparison of assessment methods using benthic macroinvertebrates: a contribution to the EU Water Framework Directive intercalibration exercise , 2006, Hydrobiologia.

[17]  P. Verdonschot,et al.  Towards a multimetric index for the assessment of Dutch streams using benthic macroinvertebrates , 2004, Hydrobiologia.

[18]  R. Clarke,et al.  Towards European Inter-Calibration for the Water Framework Directive Procedures and Examples for Different River Types from the BC Project STAR , 2005 .

[19]  Andrea Buffagni,et al.  The STAR common metrics approach to the WFD intercalibration process: Full application for small, lowland rivers in three European countries , 2006 .

[20]  O. Moog,et al.  A Europe-wide system for assessing the quality of rivers using macroinvertebrates: the AQEM Project*) and its importance for southern Europe (with special emphasis on Italy) , 2001 .

[21]  Astrid Schmidt-Kloiber,et al.  Effects of sampling and sub-sampling variation using the STAR-AQEM sampling protocol on the precision of macroinvertebrate metrics , 2006 .

[22]  Erik Mostert,et al.  The European Water Framework Directive and water management research , 2003 .

[23]  Andrea Buffagni,et al.  Characterising Hydromorphological Features of Selected Italian Rivers: A Comparative Application of Environmental Indices , 2004 .

[24]  Influenza di alcuni fattori ambientali sulla composizione delle cenosi macrobentoniche dei corsi d'acqua planiziali minori , 2003 .

[25]  M. Barbour,et al.  A Framework for Biological Criteria for Florida Streams Using Benthic Macroinvertebrates , 1996, Journal of the North American Benthological Society.

[26]  Andrea Buffagni,et al.  The Development of a System to Assess the Ecological Quality of Streams Based on Macroinvertebrates – Design of the Sampling Programme within the AQEM Project , 2003 .

[27]  Peter Haase,et al.  The STAR project: context, objectives and approaches , 2006, Hydrobiologia.

[28]  Urbanization gradients in streams of Anchorage, Alaska: a comparison of multivariate and multimetric approaches to classification , 2000 .

[29]  R. Thorne,et al.  The response of benthic macroinvertebrates to pollution in developing countries : a multimetric system of bioassessment , 1997 .

[30]  M. T. Furse,et al.  The performance of a new biological water quality score system based on macroinvertebrates over a wide range of unpolluted running-water sites , 1983 .

[31]  Pier Francesco Ghetti,et al.  Indice Biotico Esteso (E.B.I.). I macroinvertebrati nel controllo della qualità degli ambienti di acque correnti. Manuale di Applicazione. , 1997 .

[32]  James R. Karr,et al.  Assessing biological integrity in running waters : a method and its rationale , 1986 .

[33]  Assessment Methodology for Southern Siliceous Basins in Portugal , 2004 .

[34]  Michael T. Barbour,et al.  Evaluation of EPA's rapid bioassessment benthic metrics: Metric redundancy and variability among reference stream sites , 1992 .

[35]  Claude E. Shannon,et al.  A mathematical theory of communication , 1948, MOCO.

[36]  Andrea Buffagni,et al.  Preliminary testing of River Habitat Survey features for the aims of the WFD hydro-morphological assessment: an overview from the STAR Project , 2006, Hydrobiologia.

[37]  James R. Karr,et al.  A Benthic Index of Biotic Integrity (B-IBI) for Rivers of the Tennessee Valley , 1994 .

[38]  M. Lafont,et al.  A practical concept for the ecological assessment of aquatic ecosystems: application on the River Dore in France , 2001, Aquatic Ecology.