The Sequential Probability Ratio Test: An efficient alternative to exact binomial testing for Clean Water Act 303(d) evaluation.

The United States's Clean Water Act stipulates in section 303(d) that states must identify impaired water bodies for which total maximum daily loads (TMDLs) of pollution inputs into water bodies are developed. Decision-making procedures about how to list, or delist, water bodies as impaired, or not, per Clean Water Act 303(d) differ across states. In states such as California, whether or not a particular monitoring sample suggests that water quality is impaired can be regarded as a binary outcome variable, and California's current regulatory framework invokes a version of the exact binomial test to consolidate evidence across samples and assess whether the overall water body complies with the Clean Water Act. Here, we contrast the performance of California's exact binomial test with one potential alternative, the Sequential Probability Ratio Test (SPRT). The SPRT uses a sequential testing framework, testing samples as they become available and evaluating evidence as it emerges, rather than measuring all the samples and calculating a test statistic at the end of the data collection process. Through simulations and theoretical derivations, we demonstrate that the SPRT on average requires fewer samples to be measured to have comparable Type I and Type II error rates as the current fixed-sample binomial test. Policymakers might consider efficient alternatives such as SPRT to current procedure.

[1]  Keying Ye,et al.  Evaluating water quality using power priors to incorporate historical information , 2006 .

[2]  B. Turnbull,et al.  Group Sequential Methods with Applications to Clinical Trials , 1999 .

[3]  L Jay Field,et al.  Comparison of national and regional sediment quality guidelines for classifying sediment toxicity in California , 2012, Integrated environmental assessment and management.

[4]  J. Froines,et al.  UNITED STATES ENVIRONMENTAL PROTECTION AGENCY , 1995 .

[5]  Robert D. Gibbons A statistical approach for performing water quality impairment assessments , 2003 .

[6]  G B McBride,et al.  Confidence of compliance: a Bayesian approach for percentile standards. , 2001, Water research.

[7]  Arturo A Keller,et al.  Assessing the US Clean Water Act 303(d) listing process for determining impairment of a waterbody. , 2008, Journal of environmental management.

[8]  Leonard A. Shabman,et al.  Implications of Applying Statistically Based Procedures for Water Quality Assessment , 2003 .

[9]  Timothy O'Riordan,et al.  The precautionary principle: A legal and policy history , 2004 .

[10]  Jay Bartroff,et al.  Sequential Experimentation in Clinical Trials: Design and Analysis , 2012 .

[11]  Steven M Bay,et al.  Transitioning sediment quality assessment into regulations: Challenges and solutions in implementing California's sediment quality objectives. , 2012, Integrated environmental assessment and management.

[12]  David J. Gillett,et al.  Southern California Bight regional monitoring , 2016 .

[13]  J. Andel Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[14]  Song S Qian,et al.  Combining model results and monitoring data for water quality assessment. , 2007, Environmental science & technology.

[15]  Philip J. Landrigan,et al.  The precautionary principle: protecting public health, the environment and the future of our children , 2004 .

[16]  Steven M Bay,et al.  Framework for interpreting sediment quality triad data , 2012, Integrated environmental assessment and management.