A global and efficient multi-objective auto-calibration and uncertainty estimation method for water quality catchment models

Catchment water quality models have many parameters, several output variables and a complex structure leading to multiple minima in the objective function. General uncertainty/optimization methods based on random sampling (e.g. GLUE) or local methods (e.g. PEST) are often not applicable for theoretical or practical reasons. This paper presents “ParaSol”, a method that performs optimization and uncertainty analysis for complex models such as distributed water quality models. Optimization is done by adapting the Shuffled Complex Evolution algorithm (SCE-UA) to account for multi-objective problems and for large numbers of parameters. The simulations performed by the SCE-UA are used further for uncertainty analysis and thereby focus the uncertainty analysis on solutions near the optimum/optima. Two methods have been developed that select “good” results out of these simulations based on an objective threshold. The first method is based on χ 2 statistics to delineate the confidence regions around the optimum/optima and the second method uses Bayesian statistics to define high probability regions. The ParaSol method was applied to a simple bucket model and to a Soil and Water Assessment Tool (SWAT) model of Honey Creek, OH, USA. The bucket model case showed the success of the method in finding the minimum and the applicability of the statistics under importance sampling. Both cases showed that the confidence regions are very small when the χ 2 statistics are used and even smaller when using the Bayesian statistics. By comparing the ParaSol uncertainty results to those derived from 500,000 Monte Carlo simulations it was shown that the SCE-UA sampling used for ParaSol was more effective and efficient, as none of the Monte Carlo samples were close to the minimum or even within the confidence region defined by ParaSol.

[1]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[2]  J. J. McKeown.  Non-Linear Parameter Estimation , 1972 .

[3]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[4]  S. Sorooshian,et al.  Stochastic parameter estimation procedures for hydrologie rainfall‐runoff models: Correlated and heteroscedastic error cases , 1980 .

[5]  Willy Bauwens,et al.  Multiobjective autocalibration for semidistributed water quality models , 2003 .

[6]  M. Trosset,et al.  Bayesian recursive parameter estimation for hydrologic models , 2001 .

[7]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[8]  George Kuczera,et al.  Confronting input uncertainty in environmental modelling | NOVA. The University of Newcastle's Digital Repository , 2003 .

[9]  G. C. Tiao,et al.  Bayesian inference in statistical analysis , 1973 .

[10]  Otto Richter,et al.  Non-linear parameter estimation in pesticide degradation , 1992 .

[11]  R. Srinivasan,et al.  A global sensitivity analysis tool for the parameters of multi-variable catchment models , 2006 .

[12]  J. Nash,et al.  River flow forecasting through conceptual models part I — A discussion of principles☆ , 1970 .

[13]  John R. Williams,et al.  A modeling approach to determining the relationship between erosion and soil productivity [EPIC, Erosion-Productivity Impact Calculator, mathematical models] , 1984 .

[14]  P. E. O'connell,et al.  River flow forecasting through conceptual models part III - The Ray catchment at Grendon Underwood , 1970 .

[15]  D. Legates,et al.  Evaluating the use of “goodness‐of‐fit” Measures in hydrologic and hydroclimatic model validation , 1999 .

[16]  S. Sorooshian,et al.  Effective and efficient global optimization for conceptual rainfall‐runoff models , 1992 .

[17]  Günter Blöschl,et al.  Spatial Modelling of Catchment Dynamics , 2004 .

[18]  S. Sorooshian,et al.  Calibration of watershed models , 2003 .

[19]  T. Bayes.  An essay towards solving a problem in the doctrine of chances , 2003 .

[20]  Soroosh Sorooshian,et al.  Toward improved calibration of hydrologic models: Multiple and noncommensurable measures of information , 1998 .

[21]  John R. Williams,et al.  Flood Routing With Variable Travel Time or Variable Storage Coefficients , 1969 .

[22]  Keith Beven,et al.  Prophecy, reality and uncertainty in distributed hydrological modelling , 1993 .

[23]  Soroosh Sorooshian,et al.  Comment on: Bayesian recursive parameter estimation for hydrologic models. Authors' reply , 2003 .

[24]  Jeffrey G. Arnold,et al.  Automatic calibration of a distributed catchment model , 2001 .

[25]  W. G. Knisel,et al.  CREAMS: a field scale model for Chemicals, Runoff, and Erosion from Agricultural Management Systems [USA] , 1980 .

[26]  S. Sorooshian,et al.  Effective and efficient algorithm for multiobjective optimization of hydrologic models , 2003 .

[27]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[28]  Keith Beven,et al.  The future of distributed models: model calibration and uncertainty prediction. , 1992 .

[29]  K. Beven,et al.  Bayesian Estimation of Uncertainty in Runoff Prediction and the Value of Data: An Application of the GLUE Approach , 1996 .

[30]  Soroosh Sorooshian,et al.  Multi-objective global optimization for hydrologic models , 1998 .

[31]  John R. Williams,et al.  LARGE AREA HYDROLOGIC MODELING AND ASSESSMENT PART I: MODEL DEVELOPMENT 1 , 1998 .

[32]  S. Sorooshian,et al.  Automatic calibration of conceptual rainfall-runoff models: sensitivity to calibration data , 1996 .

[33]  Henrik Madsen,et al.  Parameter estimation in distributed hydrological catchment modelling using automatic calibration with multiple objectives , 2003 .