Metamodel-assisted analysis of an integrated model composition: An example using linked surface water - groundwater models

Integrated modelling is a promising approach to simulate processes operating within complex environmental systems. It is possible, however, that this integration may lead to computationally expensive compositions. In order to retain the process fidelity without loss of accuracy, the use of Kriging metamodels is proposed to perform Monte Carlo simulation and sensitivity analysis, in lieu of compositions developed using the model linking standard OpenMI. Results from the Monte Carlo simulation showed that the metamodels were in a good agreement with the original responses. However, metamodels provided a less accurate approximation of the original output distribution for the composition which involved a stronger non-linear behaviour. The fast runtimes of the metamodels allowed for increased computational budgets leading to an accurate screening of the important parameters for an Elementary Effects Test. Overall, Kriging metamodels provided significant computational savings without compromising the quality of the outcomes, even using small training data sets.

[1]  Andy J. Keane,et al.  Engineering Design via Surrogate Modelling - A Practical Guide , 2008 .

[2]  Andrea Castelletti,et al.  Emulation techniques for the reduction and sensitivity analysis of complex environmental models , 2012, Environ. Model. Softw..

[3]  Christos Makropoulos,et al.  An integrated, multi-modelling approach for the assessment of water quality: lessons from the Pinios River case in Greece , 2010 .

[4]  Vassilios A. Tsihrintzis,et al.  Quantifying roughness coefficient uncertainty in urban flooding simulations through a simplified methodology , 2017 .

[5]  Holger R. Maier,et al.  A systematic approach to determining metamodel scope for risk-based optimization and its application to water distribution system design , 2015, Environ. Model. Softw..

[6]  Andrea Saltelli,et al.  An effective screening design for sensitivity analysis of large models , 2007, Environ. Model. Softw..

[7]  Wei Gong,et al.  An evaluation of adaptive surrogate modeling based optimization with two benchmark problems , 2014, Environ. Model. Softw..

[8]  Emanuele Borgonovo,et al.  Model emulation and moment-independent sensitivity analysis: An application to environmental modelling , 2012, Environ. Model. Softw..

[9]  Dan Cornford,et al.  Managing uncertainty in integrated environmental modelling: The UncertWeb framework , 2013, Environ. Model. Softw..

[10]  Anthony J. Jakeman,et al.  A review of surrogate models and their application to groundwater modeling , 2015 .

[11]  Christopher R. Jackson,et al.  User's manual for the groundwater flow model ZOOMQ3D , 2004 .

[12]  Biagio Ciuffo,et al.  Combining screening and metamodel-based methods: An efficient sequential approach for the sensitivity analysis of model outputs , 2015, Reliab. Eng. Syst. Saf..

[13]  Barbara S. Minsker,et al.  Optimal groundwater remediation design using an Adaptive Neural Network Genetic Algorithm , 2006 .

[14]  Micha Werner,et al.  Reduction of Monte-Carlo simulation runs for uncertainty estimation in hydrological modelling , 2003 .

[15]  J. Yazdi,et al.  Adaptive surrogate modeling for optimization of flood control detention dams , 2014, Environ. Model. Softw..

[16]  J. Antenucci,et al.  A multiobjective response surface approach for improved water quality planning in lakes and reservoirs , 2010 .

[17]  Suzanne A. Pierce,et al.  Modelling with stakeholders e Next generation , 2015 .

[18]  Christine A. Shoemaker,et al.  Watershed calibration using multistart local optimization and evolutionary optimization with radial basis function approximation , 2007 .

[19]  Scott D. Peckham,et al.  A component-based approach to integrated modeling in the geosciences: The design of CSDMS , 2013, Comput. Geosci..

[20]  Bryan A. Tolson,et al.  Review of surrogate modeling in water resources , 2012 .

[21]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[22]  Indranil Pan,et al.  Robust optimization of well location to enhance hysteretical trapping of CO2: Assessment of various uncertainty quantification methods and utilization of mixed response surface surrogates , 2015 .

[23]  Demetris Koutsoyiannis,et al.  Holistic versus monomeric strategies for hydrological modelling of human-modified hydrosystems , 2010 .

[24]  Ming Ye,et al.  Global sensitivity analysis in hydrological modeling: Review of concepts, methods, theoretical framework, and applications , 2015 .

[25]  D. Krige A statistical approach to some basic mine valuation problems on the Witwatersrand, by D.G. Krige, published in the Journal, December 1951 : introduction by the author , 1951 .

[26]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[27]  Michael N. Fienen,et al.  Evaluating the sources of water to wells: Three techniques for metamodeling of a groundwater flow model , 2016, Environ. Model. Softw..

[28]  Alexander Y. Sun,et al.  Development of multi-metamodels to support surface water quality management and decision making , 2014, Environmental Earth Sciences.

[29]  Marco Bianchi,et al.  Combining multiple lower-fidelity models for emulating complex model responses for CCS environmental risk assessment , 2016 .

[30]  Dimitri Solomatine,et al.  A novel approach to parameter uncertainty analysis of hydrological models using neural networks , 2009 .

[31]  Max D. Morris,et al.  Factorial sampling plans for preliminary computational experiments , 1991 .

[32]  Timothy W. Simpson,et al.  On the Use of Kriging Models to Approximate Deterministic Computer Models , 2004, DAC 2004.

[33]  Quillon Harpham,et al.  Towards standard metadata to support models and interfaces in a hydro-meteorological model chain , 2015 .

[34]  Quillon Harpham,et al.  Using OpenMI and a Model MAP to Integrate WaterML2 and NetCDF Data Sources into Flood Modeling of Genoa, Italy , 2016 .

[35]  Mohammad Rajabi,et al.  Polynomial chaos expansions for uncertainty propagation and moment independent sensitivity analysis of seawater intrusion simulations , 2015 .

[36]  Quillon Harpham,et al.  The FluidEarth 2 implementation of OpenMI 2.0 , 2014 .

[37]  Jack P. C. Kleijnen,et al.  Kriging Metamodeling in Simulation: A Review , 2007, Eur. J. Oper. Res..

[38]  Xiaosheng Qin,et al.  Uncertainty analysis of flood inundation modelling using GLUE with surrogate models in stochastic sampling , 2015 .

[39]  Hiroyuki Yokomizo,et al.  Meta-models as a straightforward approach to the sensitivity analysis of complex models , 2013, Population Ecology.

[40]  Dongbin Xiu,et al.  The Wiener-Askey Polynomial Chaos for Stochastic Differential Equations , 2002, SIAM J. Sci. Comput..

[41]  Christos Makropoulos,et al.  A Surrogate Based Optimization Approach for the Development of Uncertainty-Aware Reservoir Operational Rules: the Case of Nestos Hydrosystem , 2015, Water Resources Management.

[42]  Bryan A. Tolson,et al.  Numerical assessment of metamodelling strategies in computationally intensive optimization , 2012, Environ. Model. Softw..

[43]  Stefano Nativi,et al.  Environmental model access and interoperability: The GEO Model Web initiative , 2013, Environ. Model. Softw..

[44]  Rui Zou,et al.  Multiple-pattern parameter identification and uncertainty analysis approach for water quality modeling , 2009 .

[45]  Christos Makropoulos,et al.  Surrogate-enhanced evolutionary annealing simplex algorithm for effective and efficient optimization of water resources problems on a budget , 2016, Environ. Model. Softw..

[46]  Rommel G. Regis,et al.  Surrogate-based pumping optimization of coastal aquifers under limited computational budgets , 2018 .

[47]  Jim W. Hall,et al.  Sensitivity analysis of environmental models: A systematic review with practical workflow , 2014, Environ. Model. Softw..

[48]  Jon C. Helton,et al.  Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models , 2009, Reliab. Eng. Syst. Saf..

[49]  A. Mantoglou,et al.  Physics-based and data-driven surrogate models for pumping optimization of coastal aquifers. , 2017 .

[50]  M. D. McKay,et al.  A comparison of three methods for selecting values of input variables in the analysis of output from a computer code , 2000 .

[51]  J. B. Gregersen,et al.  OpenMI: Open modelling interface , 2007 .

[52]  Lei Wang,et al.  Integrated Environmental Modeling applied at the basin scale: linking different types of models using the OpenMI standard to improve simulation of groundwater processes in the Thames Basin, UK. , 2013 .

[53]  Andy J. Keane,et al.  Recent advances in surrogate-based optimization , 2009 .

[54]  Richard C. Peralta,et al.  Optimal design of aquifer cleanup systems under uncertainty using a neural network and a genetic algorithm , 1999 .

[55]  Domenico Baù,et al.  Stochastic management of pump-and-treat strategies using surrogate functions , 2006 .

[56]  Vasileios Christelis,et al.  Pumping Optimization of Coastal Aquifers Assisted by Adaptive Metamodelling Methods and Radial Basis Functions , 2016, Water Resources Management.

[57]  Mary C. Hill,et al.  Integrated environmental modeling: A vision and roadmap for the future , 2013, Environ. Model. Softw..

[58]  Francesca Pianosi,et al.  A Matlab toolbox for Global Sensitivity Analysis , 2015, Environ. Model. Softw..

[59]  Anthony M. Castronova,et al.  Models as web services using the Open Geospatial Consortium (OGC) Web Processing Service (WPS) standard , 2013, Environ. Model. Softw..

[60]  Andrew Barkwith,et al.  Couplers for linking environmental models: scoping study and potential next steps , 2014 .

[61]  Christos Makropoulos,et al.  Multiobjective optimisation on a budget: Exploring surrogate modelling for robust multi-reservoir rules generation under hydrological uncertainty , 2015, Environ. Model. Softw..

[62]  Raphael T. Haftka,et al.  Surrogate-based Analysis and Optimization , 2005 .