Global sensitivity analysis in wastewater applications: A comprehensive comparison of different methods

Three global sensitivity analysis (GSA) methods are applied and compared to assess the most relevant processes occurring in wastewater treatment systems. In particular, the Standardised Regression Coefficients, Morris Screening and Extended-FAST methods are applied to a complex integrated membrane bioreactor (MBR) model considering 21 model outputs and 79 model factors. The three methods are applied with numerical settings as suggested in literature. The main objective considered is to classify important factors (factors prioritisation) as well as non-influential factors (factors fixing). The performance is assessed by comparing the most reliable method (Extended-FAST), by means of proposed criteria, with the two other methods. In particular, similarity to results obtained from Extended-FAST is assessed for sensitivity indices, for the ranking of sensitivity indices, for the classification into important/non-influential factors and for the method's ability to detect interaction among factors and to provide results in a reasonable time. It was found that the computationally less expensive SRC method was applied outside its range of applicability (R^2) = (0.3-0.6) < 0.7. Still, the SRC produced a ranking of important factors similar to Extended-FAST. For some variables significant interactions among the factors were revealed by computing the total effect indices S"T"i using Extended-FAST. This means that to obtain reliable variance decomposition and to detect and quantify interactions among the factors, the use of the Extended-FAST is recommended. Regarding the comparison between Morris screening and Extended-FAST a poor agreement was found. In particular, the Morris screening overestimated the number of both important and non-influential factors compared to Extended-FAST for the analysed case study.

[1]  Giorgio Mannina,et al.  Biological Nutrient Removal and Fouling Phenomena in a University of Cape Town Membrane Bioreactor Treating High Nitrogen Loads , 2013 .

[2]  C. Fortuin,et al.  Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. I Theory , 1973 .

[3]  A. Saltelli,et al.  A quantitative model-independent method for global sensitivity analysis of model output , 1999 .

[4]  Lin Chen,et al.  Sensitivity and uncertainty analyses of an extended ASM3-SMP model describing membrane bioreactor operation , 2012 .

[5]  A. Saltelli,et al.  Importance measures in global sensitivity analysis of nonlinear models , 1996 .

[6]  Gianni Bellocchi,et al.  Comparison of sensitivity analysis techniques: A case study with the rice model WARM , 2010 .

[7]  M. B. Beck,et al.  On the problem of model validation for predictive exposure assessments , 1997 .

[8]  Harvey M. Wagner,et al.  Global Sensitivity Analysis , 1995, Oper. Res..

[9]  Ulf Jeppsson,et al.  Dynamic influent pollutant disturbance scenario generation using a phenomenological modelling approach , 2011, Environ. Model. Softw..

[10]  E Morgenroth,et al.  Comparing global sensitivity analysis for a biofilm model for two-step nitrification using the qualitative screening method of Morris or the quantitative variance-based Fourier Amplitude Sensitivity Test (FAST). , 2007, Water science and technology : a journal of the International Association on Water Pollution Research.

[11]  X. Y. Sun,et al.  Three complementary methods for sensitivity analysis of a water quality model , 2012, Environ. Model. Softw..

[12]  Giorgio Mannina,et al.  Uncertainty assessment of a membrane bioreactor model using the GLUE methodology , 2010 .

[13]  I. Sobol Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[14]  K. Shuler,et al.  A STUDY OF THE SENSITIVITY OF COUPLED REACTION SYSTEMS TO UNCERTAINTIES IN RATE COEFFICIENTS . II , 2014 .

[15]  Gürkan Sin,et al.  Global sensitivity analysis in wastewater treatment plant model applications: prioritizing sources of uncertainty. , 2011, Water research.

[16]  J Ferrer,et al.  Application of the Morris method for screening the influential parameters of fuzzy controllers applied to wastewater treatment plants. , 2011, Water science and technology : a journal of the International Association on Water Pollution Research.

[17]  Stefan Weijers,et al.  A procedure for selecting best identifiable parameters in calibrating activated sludge model no. 1 to full-scale plant data , 1997 .

[18]  Bernard De Baets,et al.  Global sensitivity analysis of biochemical, design and operational parameters of the Benchmark Simulation Model no. 2 , 2008 .

[19]  Peter A. Vanrolleghem,et al.  A practical protocol for calibration of nutrient removal wastewater treatment models , 2011 .

[20]  José Ferrer,et al.  An improved sampling strategy based on trajectory design for application of the Morris method to systems with many input factors , 2012, Environ. Model. Softw..

[21]  Ingmar Nopens,et al.  Assessing the convergence of LHS Monte Carlo simulations of wastewater treatment models. , 2011, Water science and technology : a journal of the International Association on Water Pollution Research.

[22]  Saltelli Andrea,et al.  Global Sensitivity Analysis: The Primer , 2008 .

[23]  Willy Bauwens,et al.  Sobol' sensitivity analysis of a complex environmental model , 2011, Environ. Model. Softw..

[24]  K. Shuler,et al.  Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. II Applications , 1973 .

[25]  Giorgio Mannina,et al.  An integrated model for physical-biological wastewater organic removal in a submerged membrane bioreactor: Model development and parameter estimation , 2008 .

[26]  Joseph A. C. Delaney Sensitivity analysis , 2018, The African Continental Free Trade Area: Economic and Distributional Effects.

[27]  Holger R. Maier,et al.  Sensitivity and Uncertainty , 2008 .

[28]  Jing Yang,et al.  Convergence and uncertainty analyses in Monte-Carlo based sensitivity analysis , 2011, Environ. Model. Softw..

[29]  Ingmar Nopens,et al.  Modelling the production and degradation of soluble microbial products (SMP) in membrane bioreactors (MBR). , 2008, Water research.

[30]  Marc B. Neumann,et al.  Biological nitrogen and phosphorus removal in membrane bioreactors: model development and parameter estimation , 2013, Bioprocess and Biosystems Engineering.

[31]  Mogens Henze,et al.  Activated sludge models ASM1, ASM2, ASM2d and ASM3 , 2015 .

[32]  Giorgio Mannina,et al.  Separate and combined sewer systems: a long-term modelling approach. , 2009, Water science and technology : a journal of the International Association on Water Pollution Research.

[33]  Marco Ratto,et al.  Global Sensitivity Analysis , 2008 .

[34]  Andrea Saltelli,et al.  An effective screening design for sensitivity analysis of large models , 2007, Environ. Model. Softw..

[35]  Marc B Neumann,et al.  Comparison of sensitivity analysis methods for pollutant degradation modelling: a case study from drinking water treatment. , 2012, The Science of the total environment.

[36]  A. Saltelli,et al.  Sensitivity analysis for chemical models. , 2005, Chemical reviews.

[37]  Peter Reichert,et al.  Practical identifiability of ASM2d parameters--systematic selection and tuning of parameter subsets. , 2002, Water research.

[38]  Bernard De Baets,et al.  Uncertainty analysis of WWTP control strategies made feasible , 2012 .

[39]  Giorgio Mannina,et al.  Hybrid moving bed biofilm reactors: an effective solution for upgrading a large wastewater treatment plant. , 2009, Water science and technology : a journal of the International Association on Water Pollution Research.

[40]  Willy Bauwens,et al.  Multi-variable sensitivity and identifiability analysis for a complex environmental model in view of integrated water quantity and water quality modeling. , 2012, Water science and technology : a journal of the International Association on Water Pollution Research.

[41]  Giorgio Mannina,et al.  An integrated model for biological and physical process simulation in membrane bioreactors (MBRs) , 2011 .

[42]  S Winkler,et al.  Activated sludge modelling: development and potential use of a practical applications database. , 2011, Water science and technology : a journal of the International Association on Water Pollution Research.

[43]  Stefano Tarantola,et al.  Sensitivity Analysis in Practice , 2002 .

[44]  Giorgio Mannina,et al.  Evaluation of biomass activity and wastewater characterization in a UCT-MBR pilot plant by means of respirometric techniques , 2011 .

[45]  Lluís Corominas,et al.  Assessing the use of activated sludge process design guidelines in wastewater treatment plant projects: A methodology based on global sensitivity analysis , 2012, Environ. Model. Softw..

[46]  Peter A Vanrolleghem,et al.  Variance-based sensitivity analysis for wastewater treatment plant modelling. , 2014, The Science of the total environment.

[47]  Max D. Morris,et al.  Factorial sampling plans for preliminary computational experiments , 1991 .