Process consistency in models: The importance of system signatures, expert knowledge, and process complexity

Hydrological models frequently suffer from limited predictive power despite adequate calibration performances. This can indicate insufficient representations of the underlying processes. Thus, ways are sought to increase model consistency while satisfying the contrasting priorities of increased model complexity and limited equifinality. In this study, the value of a systematic use of hydrological signatures and expert knowledge for increasing model consistency was tested. It was found that a simple conceptual model, constrained by four calibration objective functions, was able to adequately reproduce the hydrograph in the calibration period. The model, however, could not reproduce a suite of hydrological signatures, indicating a lack of model consistency. Subsequently, testing 11 models, model complexity was increased in a stepwise way and counter-balanced by “prior constraints,” inferred from expert knowledge to ensure a model which behaves well with respect to the modeler's perception of the system. We showed that, in spite of unchanged calibration performance, the most complex model setup exhibited increased performance in the independent test period and skill to better reproduce all tested signatures, indicating a better system representation. The results suggest that a model may be inadequate despite good performance with respect to multiple calibration objectives and that increasing model complexity, if counter-balanced by prior constraints, can significantly increase predictive performance of a model and its skill to reproduce hydrological signatures. The results strongly illustrate the need to balance automated model calibration with a more expert-knowledge-driven strategy of constraining models.

[1]  Vijay P. Singh,et al.  The NWS River Forecast System - catchment modeling. , 1995 .

[2]  Jeffrey J. McDonnell,et al.  Scale effects on headwater catchment runoff timing, flow sources, and groundwater‐streamflow relations , 2004 .

[3]  E. Toth,et al.  Calibration of hydrological models in the spectral domain: An opportunity for scarcely gauged basins? , 2007 .

[4]  Victor Koren,et al.  Using SSURGO data to improve Sacramento Model a priori parameter estimates , 2006 .

[5]  Hubert H. G. Savenije,et al.  On the calibration of hydrological models in ungauged basins: A framework for integrating hard and soft hydrological information , 2009 .

[6]  Keith Beven,et al.  Uniqueness of place and process representations in hydrological modelling , 2000 .

[7]  Hubert H. G. Savenije,et al.  A framework to assess the realism of model structures using hydrological signatures , 2012 .

[8]  Dmitri Kavetski,et al.  Catchment properties, function, and conceptual model representation: is there a correspondence? , 2014 .

[9]  Kevin J. McGuire,et al.  Topographic controls on shallow groundwater dynamics: implications of hydrologic connectivity between hillslopes and riparian zones in a till mantled catchment , 2010 .

[10]  Ming Ye,et al.  Towards a comprehensive assessment of model structural adequacy , 2012 .

[11]  Martyn P. Clark,et al.  Framework for Understanding Structural Errors (FUSE): A modular framework to diagnose differences between hydrological models , 2008 .

[12]  Hubert H. G. Savenije,et al.  HESS Opinions "Topography driven conceptual modelling (FLEX-Topo)" , 2010 .

[13]  Thorsten Wagener.  Evaluation of catchment models , 2003 .

[14]  Sabine Attinger,et al.  The effects of spatial discretization and model parameterization on the prediction of extreme runoff characteristics , 2010 .

[15]  Hoshin Vijai Gupta,et al.  A process‐based diagnostic approach to model evaluation: Application to the NWS distributed hydrologic model , 2008 .

[16]  Jeffrey J. McDonnell,et al.  On the dialog between experimentalist and modeler in catchment hydrology: Use of soft data for multicriteria model calibration , 2002 .

[17]  Doerthe Tetzlaff,et al.  What can flux tracking teach us about water age distribution patterns and their temporal dynamics , 2012 .

[18]  K. Beven,et al.  Bayesian Estimation of Uncertainty in Runoff Prediction and the Value of Data: An Application of the GLUE Approach , 1996 .

[19]  S. P. Neuman,et al.  Estimation of Aquifer Parameters Under Transient and Steady State Conditions: 1. Maximum Likelihood Method Incorporating Prior Information , 1986 .

[20]  Chantal Gascuel-Odoux,et al.  Seasonal and interannual variations of nitrate and chloride in stream waters related to spatial and temporal patterns of groundwater concentrations in agricultural catchments , 2004 .

[21]  Keith Beven,et al.  Using interactive recession curve analysis to specify a general catchment storage model , 1997 .

[22]  Tg Chapman,et al.  Baseflow Separation - Comparison of Numerical Methods with Tracer Experiments , 1996 .

[23]  J. Kirchner.  Getting the right answers for the right reasons: Linking measurements, analyses, and models to advance the science of hydrology , 2006 .

[24]  Reto Knutti,et al.  Should we believe model predictions of future climate change? , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[25]  Denis A. Hughes,et al.  A review of 40 years of hydrological science and practice in southern Africa using the Pitman rainfall-runoff model , 2013 .

[26]  Soroosh Sorooshian,et al.  A framework for development and application of hydrological models , 2001, Hydrology and Earth System Sciences.

[27]  George Kuczera,et al.  Understanding predictive uncertainty in hydrologic modeling: The challenge of identifying input and structural errors , 2010 .

[28]  Keith Beven,et al.  On red herrings and real herrings: disinformation and information in hydrological inference , 2011 .

[29]  M. Sivapalan,et al.  Process controls of water balance variability in a large semi-arid catchment: downward approach to hydrological model development , 2001 .

[30]  Dmitri Kavetski,et al.  Pursuing the method of multiple working hypotheses for hydrological modeling , 2011 .

[31]  Mohammadali Tarrahi,et al.  Assessing the performance of the ensemble Kalman filter for subsurface flow data integration under variogram uncertainty , 2011 .

[32]  Jeroen P. van der Sluijs,et al.  A framework for dealing with uncertainty due to model structure error , 2004 .

[33]  Cédric Legout,et al.  Solute transfer in the unsaturated zone-groundwater continuum of a headwater catchment , 2007 .

[34]  Hubert H. G. Savenije,et al.  Learning from model improvement: On the contribution of complementary data to process understanding , 2008 .

[35]  Wesley W. Wallender,et al.  Multi-criteria optimization of a regional spatially-distributed subsurface water flow model , 2005 .

[36]  Kevin Bishop,et al.  Simulating interactions between saturated and unsaturated storage in a conceptual runoff model , 2003 .

[37]  Véronique Beaujouan,et al.  Effect on nitrate concentration in stream water of agricultural practices in small catchments in Brittany: I. Annual nitrogen budgets , 2002 .

[38]  Keith Beven,et al.  APPLICATION OF A GENERALIZED TOPMODEL TO THE SMALL RINGELBACH CATCHMENT, VOSGES, FRANCE , 1996 .

[39]  Soroosh Sorooshian,et al.  Application of temporal streamflow descriptors in hydrologic model parameter estimation , 2005 .

[40]  Hubert H. G. Savenije,et al.  A strategy for “constraint-based” parameter specification for environmental models , 2013 .

[41]  Hoshin Vijai Gupta,et al.  Large-sample hydrology: a need to balance depth with breadth , 2013 .

[42]  Chantal Gascuel-Odoux,et al.  Modelling the effect of physical and chemical characteristics of shallow aquifers on water and nitrate transport in small agricultural catchments , 2006 .

[43]  H. Savenije,et al.  Interactive comment on "HESS Opinions "The art of hydrology"1" by H. H. G. Savenije , 2009 .

[44]  Hoshin Vijai Gupta,et al.  Regionalization of constraints on expected watershed response behavior for improved predictions in ungauged basins , 2007 .

[45]  S. L. Markstrom,et al.  The modular modeling system (MMS) — The physical process modeling component of a database-centered decision support system for water and power management , 1996 .

[46]  Vazken Andréassian,et al.  On the ambiguous interpretation of the Turc‐Budyko nondimensional graph , 2012 .

[47]  Jan Seibert,et al.  Teaching hydrological modeling with a user-friendly catchment-runoff-model software package , 2012 .

[48]  Hubert H. G. Savenije,et al.  Testing the realism of a topography driven model (FLEX-Topo) in the nested catchments of the Upper Heihe, China , 2013 .

[49]  H. Hersbach.  Decomposition of the Continuous Ranked Probability Score for Ensemble Prediction Systems , 2000 .

[50]  Sabine Attinger,et al.  Implications of distributed hydrologic model parameterization on water fluxes at multiple scales and locations , 2013 .

[51]  Dmitri Kavetski,et al.  Elements of a flexible approach for conceptual hydrological modeling: 2. Application and experimental insights , 2011 .

[52]  Younes Alila,et al.  Subsurface flow velocities in a hillslope with lateral preferential flow , 2009 .

[53]  K. Eckhardt.  How to construct recursive digital filters for baseflow separation , 2005 .

[54]  Soroosh Sorooshian,et al.  Toward improved calibration of hydrologic models: Multiple and noncommensurable measures of information , 1998 .

[55]  Patrick M. Reed,et al.  Multiobjective sensitivity analysis to understand the information content in streamflow observations for distributed watershed modeling , 2009 .

[56]  Hubert H. G. Savenije,et al.  HESS Opinions "The art of hydrology" , 2008 .

[57]  Doerthe Tetzlaff,et al.  Towards a simple dynamic process conceptualization in rainfall–runoff models using multi-criteria calibration and tracers in temperate, upland catchments , 2009 .

[58]  S. Attinger,et al.  Multiscale parameter regionalization of a grid‐based hydrologic model at the mesoscale , 2010 .

[59]  J. Doherty,et al.  A hybrid regularized inversion methodology for highly parameterized environmental models , 2005 .

[60]  Hubert H. G. Savenije,et al.  Using expert knowledge to increase realism in environmental system models can dramatically reduce the need for calibration , 2013 .

[61]  Victor Koren,et al.  Use of soil moisture observations to improve parameter consistency in watershed calibration , 2008 .

[62]  Hoshin V. Gupta,et al.  Hydrologic consistency as a basis for assessing complexity of monthly water balance models for the continental United States , 2011 .

[63]  Keith Beven,et al.  Calibration of hydrological models using flow-duration curves , 2010 .

[64]  John C. Schaake,et al.  The US MOPEX data set. , 2006 .

[65]  Yuqiong Liu,et al.  Reconciling theory with observations: elements of a diagnostic approach to model evaluation , 2008 .

[66]  Keith Beven,et al.  So how much of your error is epistemic? Lessons from Japan and Italy , 2013 .

[67]  Praveen Kumar,et al.  Ecohydrologic process networks: 2. Analysis and characterization , 2009 .

[68]  H. Savenije,et al.  Hydrology and Earth System Sciences Hydrological Landscape Classification: Investigating the Performance of Hand Based Landscape Classifications in a Central European Meso-scale Catchment , 2022 .

[69]  Hubert H. G. Savenije,et al.  On the value of combined event runoff and tracer analysis to improve understanding of catchment functioning in a data-scarce semi-arid area , 2011 .

[70]  Patrick Durand,et al.  How to model shallow water‐table depth variations: the case of the Kervidy‐Naizin catchment, France , 2005 .

[71]  Jim E Freer,et al.  Hydrological Dynamics of the Panola Mountain Research Watershed, Georgia , 2003 .

[72]  V. Klemeš,et al.  Operational Testing of Hydrological Simulation Models , 2022 .

[73]  Behnam Jafarpour.  Wavelet Reconstruction of Geologic Facies From Nonlinear Dynamic Flow Measurements , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[74]  Kevin Bishop,et al.  Groundwater dynamics along a hillslope: A test of the steady state hypothesis , 2003 .

[75]  J. Nash,et al.  River flow forecasting through conceptual models part I — A discussion of principles☆ , 1970 .

[76]  Hoshin Vijai Gupta,et al.  Model identification for hydrological forecasting under uncertainty , 2005 .

[77]  H. Savenije.  Hydrology and Earth System Sciences Hess Opinions " Topography Driven Conceptual Modelling (flex-topo) " , 2022 .

[78]  Robert E. Criss,et al.  Do Nash values have value? Discussion and alternate proposals , 2008 .

[79]  Günter Blöschl,et al.  Spatio-temporal variability of event runoff coefficients , 2006 .

[80]  W. Bastiaanssen,et al.  Constraining model parameters on remotely sensed evaporation: Justification for distribution in ungauged basins? , 2008 .

[81]  Keith Beven,et al.  On hypothesis testing in hydrology , 2001 .

[82]  P. Matgen,et al.  Understanding catchment behavior through stepwise model concept improvement , 2008 .

[83]  V. Singh,et al.  The HBV model. , 1995 .

[84]  Jim Freer,et al.  Towards a limits of acceptability approach to the calibration of hydrological models : Extending observation error , 2009 .

[85]  Praveen Kumar,et al.  Typology of hydrologic predictability , 2011 .

[86]  Julien Lerat,et al.  Crash testing hydrological models in contrasted climate conditions: An experiment on 216 Australian catchments , 2012 .

[87]  Christopher J. Duffy,et al.  Parameter estimation of a physically based land surface hydrologic model using the ensemble Kalman filter: A synthetic experiment , 2014 .

[88]  Thorsten Wagener,et al.  Convergence of approaches toward reducing uncertainty in predictions in ungauged basins , 2011 .

[89]  Vazken Andréassian,et al.  How can rainfall‐runoff models handle intercatchment groundwater flows? Theoretical study based on 1040 French catchments , 2007 .

[90]  R. Moore.  The probability-distributed principle and runoff production at point and basin scales , 1985 .

[91]  S. P. Neuman,et al.  Maximum likelihood Bayesian averaging of uncertain model predictions , 2003 .

[92]  Thibault Mathevet,et al.  Hydrology and Earth System Sciences Hess Opinions " Crash Tests for a Standardized Evaluation of Hydrological Models " , 2022 .

[93]  Thibault Mathevet,et al.  All that glitters is not gold: the case of calibrating hydrological models , 2012 .

[94]  Hubert H. G. Savenije,et al.  Model complexity control for hydrologic prediction , 2008 .

[95]  K. Beven,et al.  Toward a generalization of the TOPMODEL concepts:Topographic indices of hydrological similarity , 1996 .

[96]  Hoshin Vijai Gupta,et al.  A spatial regularization approach to parameter estimation for a distributed watershed model , 2008 .

[97]  A. Thomsen,et al.  WATBAL: A Semi-Distributed, Physically Based Hydrological Modelling System , 1986 .

[98]  M. Budyko,et al.  Climate and life , 1975 .

[99]  J. McDonnell,et al.  A decade of Predictions in Ungauged Basins (PUB)—a review , 2013 .

[100]  Keith Beven,et al.  A dynamic TOPMODEL , 2001 .

[101]  Hubert H. G. Savenije,et al.  An approach to identify time consistent model parameters: sub-period calibration , 2013 .

[102]  Dmitri Kavetski,et al.  Elements of a flexible approach for conceptual hydrological modeling: 1. Motivation and theoretical development , 2011 .

[103]  Keith Beven,et al.  Multivariate seasonal period model rejection within the generalised likelihood uncertainty estimation procedure. , 2013 .

[104]  Ying Fan,et al.  River basins as groundwater exporters and importers: Implications for water cycle and climate modeling , 2009 .

[105]  M. Sivapalan,et al.  Catchment classification: Empirical analysis of hydrologic similarity based on catchment function in the eastern USA , 2011 .

[106]  Vivek K. Arora,et al.  The use of the aridity index to assess climate change effect on annual runoff , 2002 .

[107]  Jean-Michel Vouillamoz,et al.  Magnetic Resonance Sounding Applied to Aquifer Characterization , 2004, Ground water.

[108]  C. Perrin,et al.  Improvement of a parsimonious model for streamflow simulation , 2003 .

[109]  Chantal Gascuel-Odoux,et al.  Role of water table dynamics on stream nitrate export and concentration in agricultural headwater catchment (France) , 2008 .

[110]  Praveen Kumar,et al.  Ecohydrologic process networks: 1. Identification , 2009 .

[111]  J. E. Freera,et al.  Constraining dynamic TOPMODEL responses for imprecise water table information using fuzzy rule based performance measures , 2004 .

[112]  W. Yeh.  Review of Parameter Identification Procedures in Groundwater Hydrology: The Inverse Problem , 1986 .

[113]  Demetris Koutsoyiannis,et al.  One decade of multi-objective calibration approaches in hydrological modelling: a review , 2010 .

[114]  Keith Beven,et al.  A manifesto for the equifinality thesis , 2006 .

[115]  Martyn P. Clark,et al.  Diagnostic evaluation of multiple hypotheses of hydrological behaviour in a limits‐of‐acceptability framework for 24 UK catchments , 2014 .

[116]  Anthony J. Jakeman,et al.  Ten iterative steps in development and evaluation of environmental models , 2006, Environ. Model. Softw..

[117]  P. E. O'connell,et al.  IAHS Decade on Predictions in Ungauged Basins (PUB), 2003–2012: Shaping an exciting future for the hydrological sciences , 2003 .