A robust objective function for calibration of groundwater models in light of deficiencies of model structure and observations

Abstract. Groundwater models require parameter optimization based on the minimization of objective functions describing, for example, the residual between observed and simulated groundwater head. At larger scales, constraining these models requires large datasets of groundwater head observations, due to the size of the inverse problem. These observations are typically only available from databases comprised of varying quality data from a variety of sources and will be associated with unknown observational uncertainty. At the same time the model structure, especially the hydrogeological description, will inevitably be a simplification of the complex natural system. As a result, calibration of groundwater models often results in parameter compensation for model structural deficiency. This problem can be amplified by the application of common squared error-based performance criteria, which are most sensitive to the largest errors. We assume that the residuals that remain large during the optimization process likely do so because of either model structural error or observation error. Based on this assumption it is desirable to design an objective function that is less sensitive to these large residuals of low probability, and instead favours the majority of observations that can fit the given model structure. We suggest a Continuous Ranked Probability Score (CRPS) based objective function that limits the influence of large residuals in the optimization process as the metric puts more emphasis on the position of the residual along the cumulative distribution function than on the magnitude of the residual. The CRPS-based objective function was applied in two regional scale coupled surface-groundwater models and compared to calibrations using conventional sum of absolute and squared errors. The optimization tests illustrated that the novel CRPS-based objective function successfully limited the dominance of large residuals in the optimization process and consistently reduced overall bias. Furthermore, it highlighted areas in the model where the structural model should be revisited.

[1]  R. Therrien,et al.  Semi-automated filtering of data outliers to improve spatial analysis of piezometric data , 2015, Hydrogeology Journal.

[2]  Simon Stisen,et al.  Assessment of regional inter-basin groundwater flow using both simple and highly parameterized optimization schemes , 2019, Hydrogeology Journal.

[3]  Juliane Mai,et al.  Combining satellite data and appropriate objective functions for improved spatial pattern performance of a distributed hydrologic model , 2017 .

[4]  John Doherty,et al.  Quantifying the predictive consequences of model error with linear subspace analysis , 2014 .

[5]  David J. Dahlstrom Calibration and Uncertainty Analysis for Complex Environmental Models , 2015 .

[6]  Hoshin Vijai Gupta,et al.  Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling , 2009 .

[7]  Massimiliano Zappa,et al.  How can expert knowledge increase the realism of conceptual hydrological models? A case study based on the concept of dominant runoff process in the Swiss Pre-Alps , 2018, Hydrology and Earth System Sciences.

[8]  Dmitri Kavetski,et al.  Signature‐Domain Calibration of Hydrological Models Using Approximate Bayesian Computation: Empirical Analysis of Fundamental Properties , 2018, Water Resources Research.

[9]  E. Poeter,et al.  Inverse Models: A Necessary Next Step in Ground‐Water Modeling , 1997 .

[10]  A. Comunian,et al.  A conceptual framework for discrete inverse problems in geophysics , 2019, 1901.07937.

[11]  Simon Stisen,et al.  Stakeholder driven update and improvement of a national water resources model , 2013, Environ. Model. Softw..

[12]  J. Garibaldi,et al.  A new accuracy measure based on bounded relative error for time series forecasting , 2017, PloS one.

[13]  George Kuczera,et al.  Understanding predictive uncertainty in hydrologic modeling: The challenge of identifying input and structural errors , 2010 .

[14]  M. Marietta,et al.  Pilot Point Methodology for Automated Calibration of an Ensemble of conditionally Simulated Transmissivity Fields: 1. Theory and Computational Experiments , 1995 .

[16]  Yuqiong Liu,et al.  Reconciling theory with observations: elements of a diagnostic approach to model evaluation , 2008 .

[17]  Wolfgang Nowak,et al.  The comprehensive differential split-sample test: A stress-test for hydrological model robustness under climate variability , 2019, Journal of Hydrology.

[18]  Jenný Brynjarsdóttir,et al.  Learning about physical parameters: the importance of model discrepancy , 2014 .

[19]  Lynn W. Gelhar,et al.  Stochastic subsurface hydrology from theory to applications , 1986 .

[20]  M. C. Hill Methods and guidelines for effective model calibration; with application to UCODE, a computer code for universal inverse modeling, and MODFLOWP, a computer code for inverse modeling with MODFLOW , 1998 .

[21]  András Bárdossy,et al.  Geostatistical methods for detection of outliers in groundwater quality spatial fields , 1990 .

[22]  Jina Jeong,et al.  Identifying outliers of non-Gaussian groundwater state data based on ensemble estimation for long-term trends , 2017 .

[23]  R. McCuen,et al.  Evaluation of the Nash-Sutcliffe Efficiency Index , 2006 .