Stream biomonitoring using macroinvertebrates around the globe: a comparison of large-scale programs

Water quality agencies and scientists are increasingly adopting standardized sampling methodologies because of the challenges associated with interpreting data derived from dissimilar protocols. Here, we compare 13 protocols for monitoring streams from different regions and countries around the globe. Despite the spatially diverse range of countries assessed, many aspects of bioassessment structure and protocols were similar, thereby providing evidence of key characteristics that might be incorporated in a global sampling methodology. Similarities were found regarding sampler type, mesh size, sampling period, subsampling methods, and taxonomic resolution. Consistent field and laboratory methods are essential for merging data sets collected by multiple institutions to enable large-scale comparisons. We discuss the similarities and differences among protocols and present current trends and future recommendations for monitoring programs, especially for regions where large-scale protocols do not yet exist. We summarize the current state in one of these regions, Latin America, and comment on the possible development path for these techniques in this region. We conclude that several aspects of stream biomonitoring need additional performance evaluation (accuracy, precision, discriminatory power, relative costs), particularly when comparing targeted habitat (only the commonest habitat type) versus site-wide sampling (multiple habitat types), appropriate levels of sampling and processing effort, and standardized indicators to resolve dissimilarities among biomonitoring methods. Global issues such as climate change are creating an environment where there is an increasing need to have universally consistent data collection, processing and storage to enable large-scale trend analysis. Biomonitoring programs following standardized methods could aid international data sharing and interpretation.

[1]  R. Norris,et al.  Design and implementation of rapid assessment approaches for water resource monitoring using benthic macroinvertebrates , 1995 .

[2]  D. Buss,et al.  Using Baetidae Species as Biological Indicators of Environmental Degradation in a Brazilian River Basin , 2007, Environmental monitoring and assessment.

[3]  Michael T. Barbour,et al.  Subsampling of Benthic Samples: A Defense of the Fixed-Count Method , 1996, Journal of the North American Benthological Society.

[4]  John L Stoddard,et al.  Setting expectations for the ecological condition of streams: the concept of reference condition. , 2005, Ecological applications : a publication of the Ecological Society of America.

[5]  Vincent H. Resh,et al.  Taxonomy and stream ecology—The benefits of genus- and species-level identifications , 2001, Journal of the North American Benthological Society.

[6]  S. Jähnig,et al.  Limiting factors and thresholds for macroinvertebrate assemblages in European rivers: Empirical evidence from three datasets on water quality, catchment urbanization, and river restoration , 2012 .

[7]  S. Fenoglio,et al.  Benthic macroinvertebrate communities as indicators of river environment quality: an experience in Nicaragua. , 2002, Revista de biologia tropical.

[8]  M. Callisto,et al.  Use of the BEAST model for biomonitoring water quality in a neotropical basin , 2009, Hydrobiologia.

[9]  G. Hose,et al.  Reproducibility of AUSRIVAS rapid bioassessments using macroinvertebrates , 2004, Journal of the North American Benthological Society.

[10]  Sung-Cheol Koh,et al.  Evaluation of stream ecosystem health and species association based on multi-taxa (benthic macroinvertebrates, algae, and microorganisms) patterning with different levels of pollution , 2013, Ecol. Informatics.

[11]  Karen J. Esler,et al.  Bioassessment of the ecological integrity of river ecosystems using aquatic macroinvertebrates: an overview with a focus on South Africa , 2006 .

[12]  Peter Davies,et al.  Development of a national river bioassessment system (AUSRIVAS) in Australia. , 2000 .

[13]  T. Chon,et al.  Ecological informatics approach to screening of integrity metrics based on benthic macroinvertebrates in streams , 2011 .

[14]  Robert M. Hughes,et al.  A process for creating multimetric indices for large-scale aquatic surveys , 2008, Journal of the North American Benthological Society.

[15]  J. Stoddard,et al.  EMAP-Surface Waters: a multiassemblage, probability survey of ecological integrity in the U.S.A. , 2000, Hydrobiologia.

[16]  Mike T. Furse,et al.  Biological assessment of river quality: development of AUSRIVAS models and outputs. , 2000 .

[17]  Jonathan G. Kennen,et al.  Revised Protocols for Sampling Algal, Invertebrate, and Fish Communities as Part of the National Water-Quality Assessment Program , 2002 .

[18]  J. Nessimian,et al.  Influence of water chemistry and environmental degradation on macroinvertebrate assemblages in a river basin in south-east Brazil , 2002, Hydrobiologia.

[19]  A. Schmidt‐Kloiber,et al.  The effect of taxonomic resolution on the assessment of ecological water quality classes , 2004, Hydrobiologia.

[20]  Kazumi Tanida,et al.  Freshwater biomonitoring with macroinvertebrates in East Asia , 2007 .

[21]  P. Kaufmann,et al.  Assessing the ecological condition of streams in a southeastern Brazilian basin using a probabilistic monitoring design , 2014, Environmental Monitoring and Assessment.

[22]  James R. Karr,et al.  Applying an Index of Biotic Integrity Based on Stream-Fish Communities: Considerations in Sampling and Interpretation , 1986 .

[23]  J. Karr,et al.  Restoring life in running waters : better biological monitoring , 1998 .

[24]  J. Hudson A DIAMOND ANNIVERSARY , 1979 .

[25]  Young-Seuk Park,et al.  Evaluation of subsampling efforts in estimating community indices and community structures , 2013, Ecol. Informatics.

[26]  Richard H. Norris,et al.  DEVELOPMENT AND EVALUATION OF PREDICTIVE MODELS FOR MEASURING THE BIOLOGICAL INTEGRITY OF STREAMS , 2000 .

[27]  V. Resh,et al.  Analytical approaches used in stream benthic macroinvertebrate biomonitoring programs of State agencies in the United States , 2013 .

[28]  Didier Pont,et al.  A Predictive Index of Biotic Integrity Model for Aquatic-Vertebrate Assemblages of Western U.S. Streams , 2009 .

[29]  A. S. Melo Effects of taxonomic and numeric resolution on the ability to detect ecological patterns at a local scale using stream macroinvertebrates , 2005 .

[30]  H. Dallas A PRELIMINARY EVALUATION OF ASPECTS OF SASS (SOUTH AFRICAN SCORING SYSTEM) FOR THE RAPID BIOASSESSMENT OF WATER QUALITY IN RIVERS, WITH PARTICULAR REFERENCE TO THE INCORPORATION OF SASS IN A NATIONAL BIOMONITORING PROGRAMME , 1997 .

[31]  G. Friedrich,et al.  A saprobic index for biological assessment of river water quality in Brazil (Minas Gerais and Rio de Janeiro states) , 2010, Environmental monitoring and assessment.

[32]  Richard K. Johnson Bioassessment of Freshwater Ecosystems: Using the Reference Condition Approach , 2005 .

[33]  Thierry Oberdorff,et al.  Macroinvertebrate-based multimetric predictive models for evaluating the human impact on biotic condition of Bolivian streams , 2011 .

[34]  James M. Omernik,et al.  Ecoregions of the Conterminous United States: Evolution of a Hierarchical Spatial Framework , 2014, Environmental Management.

[35]  C. Hawkins Quantifying biological integrity by taxonomic completeness: its utility in regional and global assessments. , 2006, Ecological applications : a publication of the Ecological Society of America.

[36]  M. Barbour,et al.  A Framework for Biological Criteria for Florida Streams Using Benthic Macroinvertebrates , 1996, Journal of the North American Benthological Society.

[37]  T. Reynoldson,et al.  The Reference Condition: A Comparison of Multimetric and Multivariate Approaches to Assess Water-Quality Impairment Using Benthic Macroinvertebrates , 1997, Journal of the North American Benthological Society.

[38]  Andrea Buffagni,et al.  Bringing European river quality into line: an exercise to intercalibrate macro-invertebrate classification methods , 2011, Hydrobiologia.

[39]  C. Humphrey,et al.  AUSRIVAS: operator sample processing errors and temporal variability - implications for model sensitivity , 2000 .

[40]  P. Verdonschot,et al.  Testing the European stream typology of the Water Framework Directive for macroinvertebrates , 2004, Hydrobiologia.

[41]  Stanley V. Gregory,et al.  Electrofishing Effort Requirements for Assessing Species Richness and Biotic Integrity in Western Oregon Streams , 2003 .

[42]  R. Bailey,et al.  Does taxonomic resolution affect the multivariate description of the structure of freshwater benthic macroinvertebrate communities , 1997 .

[43]  Michael T. Barbour,et al.  Rapid bioassessment protocols for use in streams and rivers , 1989 .

[44]  F. Chris JonesF.C. Jones,et al.  Taxonomic sufficiency: The influence of taxonomic resolution on freshwater bioassessments using benthic macroinvertebrates , 2008 .

[45]  W. Hilsenhoff,et al.  An Improved Biotic Index of Organic Stream Pollution , 2017, The Great Lakes Entomologist.

[46]  R. Hughes,et al.  Evaluating performance of macroinvertebrate-based adjusted and unadjusted multi-metric indices (MMI) using multi-season and multi-year samples , 2014 .

[47]  V. Resh,et al.  After site selection and before data analysis: sampling, sorting, and laboratory procedures used in stream benthic macroinvertebrate monitoring programs by USA state agencies , 2001, Journal of the North American Benthological Society.

[48]  Joseph M. Culp,et al.  Comparison of benthic macroinvertebrate communities by two methods: Kick- and U-net sampling , 2010, Hydrobiologia.

[49]  J. Stark,et al.  A biotic index for New Zealand's soft‐bottomed streams , 2007 .

[50]  R. Death,et al.  Biological assessment of rivers in the Manawatu‐Wanganui region of New Zealand using a predictive macroinvertebrate model , 2003 .

[51]  Towards a protocol for stream macroinvertebrate sampling in China , 2013, Environmental Monitoring and Assessment.

[52]  Robert C. Bailey,et al.  Biological guidelines for freshwater sediment based on BEnthic Assessment of SedimenT (the BEAST) using a multivariate approach for predicting biological state , 1995 .

[53]  R. Hughes,et al.  Towards rapid bioassessment of wadeable streams in Brazil: Development of the Guapiaçu-Macau Multimetric Index (GMMI) based on benthic macroinvertebrates , 2011 .

[54]  Il’ja Krno,et al.  Influence of macroinvertebrate sample size on bioassessment of streams , 2006 .

[55]  Bruce R. Forsberg,et al.  Deforestation and sewage effects on aquatic macroinvertebrates in urban streams in Manaus, Amazonas, Brazil , 2006, Hydrobiologia.

[56]  M. Parsons,et al.  The effect of habitat‐specific sampling on biological assessment of water quality using a predictive model , 1996 .

[57]  J. L. Nessimian,et al.  Insetos aquáticos na Amazônia brasileira: taxonomia, biologia e ecologia. , 2014 .

[58]  J. Stark SQMCI: A biotic index for freshwater macroinvertebrate coded‐abundance data , 1998 .

[59]  J. Stoddard,et al.  Development and Evaluation of a Macroinvertebrate Biotic Integrity Index (MBII) for Regionally Assessing Mid-Atlantic Highlands Streams , 2003, Environmental management.

[60]  Keith M. Somers,et al.  Rapid Biological Assessments: How Many Animals Are Enough? , 1998, Journal of the North American Benthological Society.

[61]  Donald J. Baird,et al.  Beyond taxonomy: a review of macroinvertebrate trait‐based community descriptors as tools for freshwater biomonitoring , 2010 .

[62]  L. Barmuta,et al.  Influence of sample quantification and taxonomic resolution on the ordination of macroinvertebrate communities from running waters in Victoria, Australia , 1995 .

[63]  M. Callisto,et al.  Development of a benthic multimetric index for biomonitoring of a neotropical watershed. , 2011, Brazilian journal of biology = Revista brasleira de biologia.

[64]  Curtis J. Richardson,et al.  Evaluating Subsampling Approaches and Macroinvertebrate Taxonomic Resolution for Wetland Bioassessment , 2002, Journal of the North American Benthological Society.

[65]  D. Buss,et al.  Rapid Bioassessment Protocols using benthic macroinvertebrates in Brazil: evaluation of taxonomic sufficiency , 2010, Journal of the North American Benthological Society.

[66]  I. Kwak,et al.  Relationships between three major stream assemblages and their environmental factors in multiple spatial scales , 2011 .

[67]  J. Omernik Ecoregions of the Conterminous United States , 1987 .

[68]  P. Haase,et al.  Testing different sorting techniques in macroinvertebrate samples from running waters , 2004 .

[69]  J. Harding,et al.  The SingScore : a macroinvertebrate biotic index The Singscore : a macroinvertebrate biotic index for assessing the health of Singapore ’ s streams and canals , 2014 .

[70]  John R. Leathwick,et al.  Quantifying relationships between land-use gradients and structural and functional indicators of stream ecological integrity , 2012 .

[71]  R. Bailey,et al.  Bioassessment of Freshwater Ecosystems using the Reference Condition Approach: Comparing Established and New Methods with Common Data Sets , 2014, Freshwater Science.

[72]  W. Hilsenhoff Use of arthropods to evaluate water quality of streams [Wisconsin] , 1977 .

[73]  D. Pont,et al.  Ecological assessment of running waters: Do macrophytes, macroinvertebrates, diatoms and fish show similar responses to human pressures? , 2012 .

[74]  Robert M. Hughes,et al.  Defining quantitative stream disturbance gradients and the additive role of habitat variation to explain macroinvertebrate taxa richness , 2013 .

[75]  R. Hughes,et al.  Electrofishing Distance Needed to Estimate Consistent Index of Biotic Integrity (IBI) Scores in Raftable Oregon Rivers , 2007 .

[76]  R. Hughes,et al.  Sampling effort affects multivariate comparisons of stream assemblages , 2002, Journal of the North American Benthological Society.

[77]  Robert M. Hughes,et al.  Acquiring data for large aquatic resource surveys: the art of compromise among science, logistics, and reality , 2008, Journal of the North American Benthological Society.

[78]  Biological quality of waters from an impacted tropical watershed (middle Rio Doce basin, southeast Brazil), using benthic macroinvertebrate communities as an indicator , 2001, Hydrobiologia.

[79]  R. Brinkhurst,et al.  The Sampling Problem , 1974 .

[80]  M. L. Miserendino,et al.  Assessing Urban Impacts on Water Quality, Benthic Communities and Fish in Streams of the Andes Mountains, Patagonia (Argentina) , 2008 .

[81]  Variance partitioning of stream diatom, fish, and invertebrate indicators of biological condition , 2012, Freshwater Science.

[82]  D. Courtemanch,et al.  Commentary on the Subsampling Procedures Used for Rapid Bioassessments , 1996, Journal of the North American Benthological Society.

[83]  M. T. Furse,et al.  The performance of a new biological water quality score system based on macroinvertebrates over a wide range of unpolluted running-water sites , 1983 .

[84]  The problem of using fixed-area subsampling methods to estimate macroinvertebrate richness: a case study with Neotropical stream data , 2013, Environmental Monitoring and Assessment.

[85]  G. Helfman,et al.  Stream biodiversity: the ghost of land use past. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[86]  N H Tarras-Wahlberg,et al.  Environmental impacts and metal exposure of aquatic ecosystems in rivers contaminated by small scale gold mining: the Puyango River basin, southern Ecuador. , 2001, The Science of the total environment.

[87]  D. F. Baptista,et al.  Adaptation of the Indice Biotico Esteso (IBE) for water quality assessment in rivers of Serra do Mar, Rio de Janeiro State, Brazil , 2008 .

[88]  Pier Francesco Ghetti,et al.  Indice Biotico Esteso (E.B.I.). I macroinvertebrati nel controllo della qualità degli ambienti di acque correnti. Manuale di Applicazione. , 1997 .

[89]  B. M. Weigel,et al.  Macroinvertebrate-based index of biotic integrity for protection of streams in west-central Mexico , 2002, Journal of the North American Benthological Society.

[90]  Gorazd Urbanič,et al.  Effect of fixed-fraction subsampling on macroinvertebrate bioassessment of rivers , 2010, Environmental monitoring and assessment.

[91]  David P. Larsen,et al.  Variability in stream macroinvertebrates at multiple spatial scales , 2001 .

[92]  Soon-Jin Hwang,et al.  Effects of land use on benthic macroinvertebrate communities: Comparison of two mountain streams in Korea , 2011 .

[93]  Wayne S. Davis,et al.  Biological assessment and criteria : tools for water resource planning and decision making , 1995 .

[94]  R. Norris,et al.  Using the reference condition maintains the integrity of a bioassessment program in a changing climate , 2010, Journal of the North American Benthological Society.

[95]  Il’ja Krno,et al.  Influence of seasonal variation on bioassessment of streams using macroinvertebrates , 2006 .

[96]  C. Hawkins,et al.  The comparability of bioassessments: a review of conceptual and methodological issues1 , 2011, Journal of the North American Benthological Society.

[97]  Lester L. Yuan,et al.  Condition of stream ecosystems in the US: an overview of the first national assessment , 2008, Journal of the North American Benthological Society.

[98]  J. Karr Assessment of Biotic Integrity Using Fish Communities , 1981 .

[99]  H. Dallas Seasonal variability of macroinvertebrate assemblages in two regions of South Africa: implications for aquatic bioassessment , 2004 .

[100]  Young-Seuk Park,et al.  Hierarchical community classification and assessment of aquatic ecosystems using artificial neural networks. , 2004, The Science of the total environment.

[101]  Q. Cai,et al.  Characterizing macroinvertebrate communities across China: Large-scale implementation of a self-organizing map , 2012 .

[102]  J. Wright,et al.  The influence of seasonal and taxonomic factors on the ordination and classification of running‐water sites in Great Britain and on the prediction of their macro‐invertebrate communities , 1984 .

[103]  B. Statzner,et al.  Developments in aquatic insect biomonitoring: a comparative analysis of recent approaches. , 2006, Annual review of entomology.

[104]  Astrid Schmidt-Kloiber,et al.  Effects of sampling and sub-sampling variation using the STAR-AQEM sampling protocol on the precision of macroinvertebrate metrics , 2006 .

[105]  Peter Calow,et al.  The Rivers Handbook , 1993 .

[106]  Yin-Phan Tsang,et al.  Regional fish community indicators of landscape disturbance to catchments of the conterminous United States , 2013 .

[107]  David M. Rosenberg,et al.  Comparison of models predicting invertebrate assemblages for biomonitoring in the Fraser River catchment, British Columbia , 2001 .

[108]  L. Casatti,et al.  A multimetric index based on fish fauna for the evaluation of the biotic integrity of streams at a mesohabitat scale , 2012 .

[109]  Susan K. Jackson,et al.  The biological condition gradient: a descriptive model for interpreting change in aquatic ecosystems. , 2006, Ecological applications : a publication of the Ecological Society of America.

[110]  M. Barbour,et al.  Rapid bioassessment protocols for use in streams and wadeable rivers: periphyton , 1999 .

[111]  B. Statzner,et al.  Reproductive traits, habitat use and templet theory: a synthesis of world-wide data on aquatic insects , 1997 .

[112]  Peter Davies,et al.  The Sustainable Rivers Audit: assessing river ecosystem health in the Murray Darling Basin, Australia , 2010 .

[113]  Determining subsampling effort for the development of a rapid bioassessment protocol using benthic macroinvertebrates in streams of Southeastern Brazil , 2011, Environmental monitoring and assessment.

[114]  D. Buss,et al.  Application of Rapid Bioassessment Protocols (RBP) for benthic macroinvertebrates in Brazil: comparison between sampling techniques and mesh sizes. , 2008, Neotropical entomology.

[115]  Alan T. Herlihy,et al.  Effect of sampling different habitat types in regional macroinvertebrate bioassessment surveys , 2006, Journal of the North American Benthological Society.

[116]  William W. Taylor,et al.  A Hierarchical Spatial Framework and Database for the National River Fish Habitat Condition Assessment , 2011 .

[117]  T. R. Whittier,et al.  Macroinvertebrate tolerance values and an assemblage tolerance index (ATI) for western USA streams and rivers , 2010, Journal of the North American Benthological Society.

[118]  Lester L. Yuan,et al.  Striving for consistency in a national assessment: the challenges of applying a reference-condition approach at a continental scale , 2008, Journal of the North American Benthological Society.

[119]  J. Stoddard,et al.  Selecting reference sites for stream biological assessments: best professional judgment or objective criteria , 2007, Journal of The North American Benthological Society.

[120]  D. M. Rosenberg,et al.  Freshwater biomonitoring and benthic macroinvertebrates. , 1994 .

[121]  Reliable sample sizes for estimating similarity among macroinvertebrate assemblages in tropical streams , 2010 .

[122]  C. Coning,et al.  Report to the Water Research Commission , 2004 .

[123]  J. Karr,et al.  The effect of fixed-count subsampling on macroinvertebrate biomonitoring in small streams. , 2000 .

[124]  F. M. Chutter,et al.  AN EMPIRICAL BIOTIC INDEX OF THE QUALITY OF WATER IN SOUTH AFRICAN STREAMS AND RIVERS , 1972 .

[125]  A. Rodrigues Capítulo,et al.  Use of benthic macroinvertebrates to assess the biological status of Pampean streams in Argentina , 2001, Aquatic Ecology.

[126]  Soon-Jin Hwang,et al.  A Multimetric Benthic Macroinvertebrate Index for the Assessment of Stream Biotic Integrity in Korea , 2012, International journal of environmental research and public health.

[127]  Il’ja Krno,et al.  Influence of macroinvertebrate sample size on bioassessment of streams , 2006, Hydrobiologia.

[128]  J. Nessimian,et al.  A multimetric index based on benthic macroinvertebrates for evaluation of Atlantic Forest streams at Rio de Janeiro State, Brazil , 2006, Hydrobiologia.

[129]  B. Autrey,et al.  A Comparison of Single and Multiple Habitat Protocols for Collecting Macroinvertebrates in Wadeable Streams 1 , 2008 .

[130]  B. Statzner,et al.  Species traits and environmental constraints: entomological research and the history of ecological theory. , 2001, Annual review of entomology.

[131]  J. Metcalfe,et al.  Biological water quality assessment of running waters based on macroinvertebrate communities: history and present status in Europe. , 1989, Environmental pollution.

[132]  Mike T. Furse,et al.  A preliminary classification of running‐water sites in Great Britain based on macro‐invertebrate species and the prediction of community type using environmental data , 1984 .

[133]  Yixin Zhang,et al.  Catchment-scale effects of forestry practices on benthic invertebrate communities in Pacific coastal streams. , 2009 .

[134]  S. Swanson,et al.  Assessment of Changes in Stream and Riparian Conditions of the Marys River Basin, Nevada 1 , 2008 .

[135]  C. Dickens,et al.  The South African Scoring System (SASS) Version 5 Rapid Bioassessment Method for Rivers , 2002 .

[136]  A. Mackey,et al.  An evaluation of sampling strategies for qualitative surveys of macro-invertebrates in rivers, using pond nets , 1984 .

[137]  J. Nessimian,et al.  Substrate specificity, environmental degradation and disturbance structuring macroinvertebrate assemblages in neotropical streams , 2004, Hydrobiologia.

[138]  B. Kilgour,et al.  An Evaluation of Rapid Bioassessment Protocols for Stream Benthic Invertebrates in Southern Ontario, Canada , 2007 .

[139]  J. Jones,et al.  Ecological monitoring and assessment of pollution in rivers , 2010 .

[140]  Mike T. Furse,et al.  RIVPACS models for predicting the expected macroinvertebrate fauna and assessing the ecological quality of rivers , 2003 .

[141]  T. Reynoldson,et al.  Implications of seasonal variation for biomonitoring with predictive models in the Fraser River catchment, British Columbia , 2001 .

[142]  Peter Goethals,et al.  Multimetric Macroinvertebrate Index Flanders (MMIF) for biological assessment of rivers and lakes in Flanders (Belgium) , 2010 .

[143]  David W. Willis,et al.  Standard Methods for Sampling North American Freshwater Fishes , 2009 .

[144]  D. Jacobsen The effect of organic pollution on the macroinvertebrate fauna of Ecuadorian highland streams , 1998 .

[145]  Robert C. Bailey,et al.  Biological assessment of freshwater ecosystems using a reference condition approach: comparing predicted and actual benthic invertebrate communities in Yukon streams , 1998 .

[146]  R. Clarke,et al.  Errors and uncertainty in bioassessment methods – major results and conclusions from the STAR project and their application using STARBUGS , 2006, Hydrobiologia.

[147]  D. Goffaux,et al.  Assessing river biotic condition at a continental scale: a European approach using functional metrics and fish assemblages , 2006 .

[148]  Christian K. Feld,et al.  Cook book for the development of a Multimetric Index for biological condition of aquatic ecosystems: Experiences from the European AQEM and STAR projects and related initiatives , 2006, Hydrobiologia.

[149]  M. Winterbourn,et al.  Guide to the aquatic insects of New Zealand. 3rd edition. , 1981 .

[150]  J. M. Hellawell Biological indicators of freshwater pollution and environmental management , 1986 .

[151]  C. J. Walsh A multivariate method for determining optimal subsample size in the analysis of macroinvertebrate samples , 1997 .

[152]  Steven G. Paulsen,et al.  EMAP-Surface Waters: a multiassemblage, probability survey of ecological integrity in the U.S.A. , 2000, Hydrobiologia.

[153]  D. Ellis Taxonomic sufficiency in pollution assessment , 1985 .