Volunteer Biological Monitoring: Can It Accurately Assess the Ecological Condition of Streams?

Government agencies have begun to use biological monitoring data collected by volunteers for official purposes, but questions have been raised regarding the validity of conclusions about ecological condition. We conducted a 2-yr study that assessed, modified, and validated the Virginia Save-Our-Streams (SOS) program, a popular volunteer monitoring program that emphasizes benthic macroinvertebrates. The study design consisted of sampling sites using accepted professional methods concurrently with volunteers using the SOS protocol. In addition, sites previously sampled by volunteers were re-sampled using professional methods. The numerical results from volunteer and professional samples were not correlated (r = 0.46) and at times produced different conclusions about ecological condition (65% agreement). The Virginia SOS protocol consistently overrated ecological condition. We determined that the reason for the inaccuracy was the simplistic numerical analysis in the volunteer protocol, which was based solely on presence of taxa. We developed a quantitative multimetric index that was appropriate for use by volunteers, and the SOS sampling protocol was modified to obtain counts of macroinvertebrates in the various taxa. The modified SOS protocol was then evaluated with a different set of concurrent samples taken by volunteers and professionals. The modified SOS protocol proved feasible for volunteers, and the new multimetric index correlated well with a professional multimetric index (r = 0.6923). The conclusions about ecological condition reached by the volunteer and professional protocols agreed very closely (96%). This study demonstrated that volunteer biological monitoring programs can provide reliable informa- tion about ecological condition, but every protocol needs to be validated by standard quantitative methods.

[1]  David L. Penrose,et al.  Volunteer Monitoring of Benthic Macroinvertebrates: Regulatory Biologists' Perspectives , 1995, Journal of the North American Benthological Society.

[2]  Charles P. Hawkins,et al.  Effects of Sampling Area and Subsampling Procedure on Comparisons of Taxa Richness among Streams , 1996, Journal of the North American Benthological Society.

[3]  James R. Karr,et al.  Regional Applications of an Index of Biotic Integrity for Use in Water Resource Management , 1988 .

[4]  Quality Assurance Testing for a Large Scale Volunteer Monitoring Program: The Acid Rain Monitoring Project , 1994 .

[5]  S. K. Evans,et al.  Effective and scientifically sound bioassessment: Opinions and corroboration from academe , 1997 .

[6]  F. Ramsey,et al.  The statistical sleuth : a course in methods of data analysis , 2002 .

[7]  D. Courtemanch,et al.  Commentary on the Subsampling Procedures Used for Rapid Bioassessments , 1996, Journal of the North American Benthological Society.

[8]  John Cairns,et al.  Biological monitoring: Part IIA—receiving system functional methods, relationships and indices , 1982 .

[9]  Gary G. Koch,et al.  Categorical Data Analysis Using The SAS1 System , 1995 .

[10]  Richard H. Norris,et al.  Biological Monitoring: The Dilemma of Data Analysis , 1995, Journal of the North American Benthological Society.

[11]  April Rasala Lehman,et al.  A Guide to Statistical and Data Analysis Using JMP and JMP IN Software , 1999 .

[12]  M. Barbour The re‐invention of biological assessment in the U.S. , 1997 .

[13]  D. M. Rosenberg,et al.  Freshwater biomonitoring and benthic macroinvertebrates. , 1994 .

[14]  A. Herlihy,et al.  The Dilemma of Sampling Streams for Macroinvertebrate Richness , 1998, Journal of the North American Benthological Society.

[15]  M. Barbour,et al.  A Framework for Biological Criteria for Florida Streams Using Benthic Macroinvertebrates , 1996, Journal of the North American Benthological Society.

[16]  H. J. Arnold Introduction to the Practice of Statistics , 1990 .

[17]  W. Hilsenhoff,et al.  An Improved Biotic Index of Organic Stream Pollution , 2017, The Great Lakes Entomologist.

[18]  Michael T. Barbour,et al.  Subsampling of Benthic Samples: A Defense of the Fixed-Count Method , 1996, Journal of the North American Benthological Society.

[19]  E. Ziegel Introduction to the Practice of Statistics (2nd ed.) , 1994 .

[20]  Michael T. Barbour,et al.  Rapid bioassessment protocols for use in streams and rivers , 1989 .

[21]  Keith M. Somers,et al.  Rapid Biological Assessments: How Many Animals Are Enough? , 1998, Journal of the North American Benthological Society.