Autocalibration experiments using machine learning and high performance computing

Using as example the Soil and Water Assessment Tool (SWAT) model and a Southern Ontario Canada watershed, we conduct a set of experiments on calibration using a manual approach, a parallelized version of the shuffled complex evolution (SCE), Generalized Likelihood Uncertainty Estimation (GLUE), Sequential Uncertainty Fitting (SUFI-2) and compare to a simple parallel search on a finite set of gridded input parameter values invoking the probably approximately correct (PAC) learning hypothesis. We derive an estimation of the error in fitting and a prior estimate of the probability of success, based on the PAC hypothesis. We conclude that from the equivalent effort expended on initial setup for the other named algorithms we can already find directly a good parameter set for calibration. We further note that, in this algorithm, simultaneous co-calibration of flow and chemistry (total nitrogen and total phosphorous) is more likely to produce acceptable results, as compared to flow first, even with a simple weighted multiobjective approach. This approach is especially suited to a parallel, distributed or cloud computational environment.

[1]  G. Benoy,et al.  Integrated Land and Water Scenarios of the Raisin River Watershed Using the SWAT Model , 2009 .

[2]  S. Sorooshian,et al.  Shuffled complex evolution approach for effective and efficient global minimization , 1993 .

[3]  Leslie G. Valiant,et al.  A theory of the learnable , 1984, CACM.

[4]  Raghavan Srinivasan,et al.  A parallelization framework for calibration of hydrological models , 2012, Environ. Model. Softw..

[5]  D. Legates,et al.  Evaluating the use of “goodness‐of‐fit” Measures in hydrologic and hydroclimatic model validation , 1999 .

[6]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[7]  Keith Beven,et al.  The future of distributed models: model calibration and uncertainty prediction. , 1992 .

[8]  R. Srinivasan,et al.  A global sensitivity analysis tool for the parameters of multi-variable catchment models , 2006 .

[9]  Shuguang Liu,et al.  Automating calibration, sensitivity and uncertainty analysis of complex models using the R package Flexible Modeling Environment (FME): SWAT as an example , 2012, Environ. Model. Softw..

[10]  Markiyan Sloboda,et al.  Autocalibration of Environmental Process Models Using a PAC Learning Hypothesis , 2011, ISESS.

[11]  K. Abbaspour,et al.  Estimating Uncertain Flow and Transport Parameters Using a Sequential Uncertainty Fitting Procedure , 2004 .

[12]  George Kuczera,et al.  Monte Carlo assessment of parameter uncertainty in conceptual catchment models: the Metropolis algorithm , 1998 .

[13]  S. Russel and P. Norvig,et al.  “Artificial Intelligence – A Modern Approach”, Second Edition, Pearson Education, 2003. , 2015 .

[14]  L. S. Shapley,et al.  College Admissions and the Stability of Marriage , 2013, Am. Math. Mon..

[15]  Vimal Sharma,et al.  Parallel Shuffled Complex Evolution Algorithm for Calibration of Hydrological Models , 2006, 20th International Symposium on High-Performance Computing in an Advanced Collaborative Environment (HPCS'06).