Linking statistical bias description to multiobjective model calibration

[1] In the absence of model deficiencies, simulation results at the correct parameter values lead to an unbiased description of observed data with remaining deviations due to observation errors only. However, this ideal cannot be reached in the practice of environmental modeling, because the required simplified representation of the complex reality by the model and errors in model input lead to errors that are reflected in biased model output. This leads to two related problems: First, ignoring bias of output in the statistical model description leads to bias in parameter estimates, model predictions and, in particular, in the quantification of their uncertainty. Second, as there is no objective choice of how much bias to accept in which output variable, it is not possible to design an “objective” model calibration procedure. The first of these problems has been addressed by introducing a statistical (Bayesian) description of bias, the second by suggesting the use of multiobjective calibration techniques that cannot easily be used for uncertainty analysis. We merge the ideas of these two approaches by using the prior of the statistical bias description to quantify the importance of multiple calibration objectives. This leads to probabilistic inference and prediction while still taking multiple calibration objectives into account. The ideas and technical details of the suggested approach are outlined and a didactical example as well as an application to environmental data are provided to demonstrate its practical feasibility and computational efficiency.

[1]  Soroosh Sorooshian,et al.  Multi-objective global optimization for hydrologic models , 1998 .

[2]  P. Reichert AQUASIM-a tool for simulation and data analysis of aquatic systems , 1994 .

[3]  George Kuczera,et al.  Understanding predictive uncertainty in hydrologic modeling: The challenge of identifying input and structural errors , 2010 .

[4]  S. Sorooshian,et al.  Effective and efficient algorithm for multiobjective optimization of hydrologic models , 2003 .

[5]  P Reichert A standard interface between simulation programs and systems analysis software. , 2006, Water science and technology : a journal of the International Association on Water Pollution Research.

[6]  M. B. Beck,et al.  On the identification of model structure in hydrological and environmental systems , 2007 .

[7]  Michael Goldstein,et al.  Bayesian Forecasting for Complex Systems Using Computer Simulators , 2001 .

[8]  S. Sorooshian,et al.  Multiple Criteria Global Optimization for Watershed Model Calibration , 2013 .

[9]  Peter Reichert,et al.  A generic framework for deriving process stoichiometry in environmental models , 2010, Environ. Model. Softw..

[10]  George Kuczera,et al.  Bayesian analysis of input uncertainty in hydrological modeling: 2. Application , 2006 .

[11]  P Reichert,et al.  River Water Quality Model no. 1 (RWQM1): II. Biochemical process equations. , 2001, Water science and technology : a journal of the International Association on Water Pollution Research.

[12]  Dave Higdon,et al.  Combining Field Data and Computer Simulations for Calibration and Prediction , 2005, SIAM J. Sci. Comput..

[13]  George Kuczera,et al.  Bayesian analysis of input uncertainty in hydrological modeling: 1. Theory , 2006 .

[14]  Peter Reichert,et al.  Analyzing input and structural uncertainty of nonlinear dynamic models with stochastic, time‐dependent parameters , 2009 .

[15]  D. Kavetski,et al.  Towards a Bayesian total error analysis of conceptual rainfall-runoff models: Characterising model error using storm-dependent parameters , 2006 .

[16]  C. Diks,et al.  Improved treatment of uncertainty in hydrologic modeling: Combining the strengths of global optimization and data assimilation , 2005 .

[17]  Keith Beven,et al.  Multivariate seasonal period model rejection within the generalised likelihood uncertainty estimation procedure. , 2013 .

[18]  George Kuczera,et al.  Toward a reliable decomposition of predictive uncertainty in hydrological modeling: Characterizing rainfall errors using conditional simulation , 2011 .

[19]  Soroosh Sorooshian,et al.  Toward improved calibration of hydrologic models: Multiple and noncommensurable measures of information , 1998 .

[20]  Hoshin Vijai Gupta,et al.  Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling , 2009 .

[21]  D Borchardt,et al.  River Water Quality Model no. 1 (RWQM1): I. Modelling approach. , 2001, Water science and technology : a journal of the International Association on Water Pollution Research.

[22]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[23]  George Kuczera,et al.  Estimation of runoff-routing model parameters using incompatible storm data. , 1990 .

[24]  Peter Reichert,et al.  Variability of photosynthesis‐irradiance curves and ecosystem respiration in a small river , 2000 .

[25]  D. Ratkowsky,et al.  A suitable parameterization of the Michaelis-Menten enzyme reaction. , 1986, The Biochemical journal.

[26]  H. Künsch,et al.  Practical identifiability analysis of large environmental simulation models , 2001 .

[27]  Peter Reichert,et al.  Gas exchange at river cascades: field experiments and model calculations , 1993 .

[28]  Demetris Koutsoyiannis,et al.  One decade of multi-objective calibration approaches in hydrological modelling: a review , 2010 .

[29]  H. Gupta,et al.  Correcting the mathematical structure of a hydrological model via Bayesian data assimilation , 2011 .

[30]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[31]  S. Sorooshian,et al.  Shuffled complex evolution approach for effective and efficient global minimization , 1993 .

[32]  James O. Berger,et al.  A Framework for Validation of Computer Models , 2007, Technometrics.

[33]  M. Berg Stickstoffdynamik in der Glatt , 1991 .

[34]  Soroosh Sorooshian,et al.  Toward improved calibration of hydrologic models: Combining the strengths of manual and automatic methods , 2000 .

[35]  P Reichert,et al.  River Water Quality Model no. 1 (RWQM1): III. Biochemical submodel selection. , 2001, Water science and technology : a journal of the International Association on Water Pollution Research.

[36]  Henrik Madsen,et al.  Comparison of different automated strategies for calibration of rainfall-runoff models , 2002 .

[37]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[38]  Henrik Madsen,et al.  Automatic calibration of a conceptual rainfall-runoff model using multiple objectives. , 2000 .

[39]  Bruce A. Robinson,et al.  Treatment of uncertainty using ensemble methods: Comparison of sequential data assimilation and Bayesian model averaging , 2007 .

[40]  Peter Reichert,et al.  Estimating stream metabolism from oxygen concentrations: Effect of spatial heterogeneity , 2009 .