Parallel Inverse Modeling and Uncertainty Quantification for Computationally Demanding Groundwater-Flow Models Using Covariance Matrix Adaptation

AbstractThis study investigates the performance of the covariance matrix adaptation-evolution strategy (CMA-ES), a stochastic optimization method, in solving groundwater inverse problems. The objectives of the study are to evaluate the computational efficiency of the parallel CMA-ES and to investigate the use of the empirically estimated covariance matrix in quantifying model prediction uncertainty due to parameter estimation uncertainty. First, the parallel scaling with increasing number of processors up to a certain limit is discussed for synthetic and real-world groundwater inverse problems. Second, through the use of the empirically estimated covariance matrix of parameters from the CMA-ES, the study adopts the Monte Carlo simulation technique to quantify model prediction uncertainty. The study shows that the parallel CMA-ES is an efficient and powerful method for solving the groundwater inverse problem for computationally demanding groundwater flow models and for deriving covariances of estimated par...

[1]  Christian L. Müller,et al.  Exploring the common concepts of adaptive MCMC and Covariance Matrix Adaptation schemes , 2010, Theory of Evolutionary Algorithms.

[2]  F. Tsai,et al.  Indicator geostatistics for reconstructing Baton Rouge aquifer-fault hydrostratigraphy, Louisiana, USA , 2013, Hydrogeology Journal.

[3]  H. Haario,et al.  An adaptive Metropolis algorithm , 2001 .

[4]  Henrik Madsen,et al.  Parameter estimation in distributed hydrological modelling: comparison of global and local optimisation techniques , 2007 .

[5]  L. Shawn Matott,et al.  Calibration of complex subsurface reaction models using a surrogate-model approach , 2008 .

[6]  Christian L. Müller,et al.  Gaussian Adaptation as a unifying framework for continuous black-box optimization and adaptive Monte Carlo sampling , 2010, IEEE Congress on Evolutionary Computation.

[7]  Peter Bayer,et al.  Optimization of concentration control by evolution strategies: Formulation, application, and assessment of remedial solutions , 2007 .

[8]  Michael Finkel,et al.  Algorithmic funnel‐and‐gate system design optimization , 2007 .

[9]  Frank T.-C. Tsai,et al.  Constructive epistemic modeling of groundwater flow with geological structure and boundary condition uncertainty under the Bayesian paradigm , 2014 .

[10]  Ming Ye,et al.  Analysis of regression confidence intervals and Bayesian credible intervals for uncertainty quantification , 2012 .

[11]  Gholam Reza Rakhshandehroo,et al.  Inverse modeling of variable-density groundwater flow in a semi-arid area in Iran using a genetic algorithm , 2010 .

[12]  Frank T.-C. Tsai,et al.  Hierarchical Bayesian model averaging for hydrostratigraphic modeling: Uncertainty segregation and comparative evaluation , 2013 .

[13]  D. Solomatine,et al.  Automatic calibration of groundwater models using global optimization techniques , 1999 .

[14]  Tiangang Cui,et al.  Bayesian calibration of a large‐scale geothermal reservoir model by a new adaptive delayed acceptance Metropolis Hastings algorithm , 2011 .

[15]  J. Vrugt,et al.  Inverse Modeling of Subsurface Flow and Transport Properties: A Review with New Developments , 2008 .

[16]  Keiichiro Yasuda,et al.  Dynamic parameter tuning of particle swarm optimization , 2006 .

[17]  Nikolaus Hansen,et al.  Evaluating the CMA Evolution Strategy on Multimodal Test Functions , 2004, PPSN.

[18]  Fan Zhang,et al.  Application of a hybrid MPI/OpenMP approach for parallel groundwater model calibration using multi-core computers , 2010, Comput. Geosci..

[19]  Bernard De Baets,et al.  Calibration of a water and energy balance model: Recursive parameter estimation versus particle swarm optimization , 2009 .

[20]  Q. Kang,et al.  Optimization and uncertainty assessment of strongly nonlinear groundwater models with high parameter dimensionality , 2010 .

[21]  George Kuczera,et al.  Calibration of conceptual hydrological models revisited: 2. Improving optimisation and analysis , 2006 .

[22]  Heikki Haario,et al.  Adaptive proposal distribution for random walk Metropolis algorithm , 1999, Comput. Stat..

[23]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[24]  Marco Dorigo,et al.  Ant colony optimization for continuous domains , 2008, Eur. J. Oper. Res..

[25]  P. Bayer,et al.  Evolutionary algorithms for the optimization of advective control of contaminated aquifer zones , 2004 .

[26]  E. Chamberlain Depositional environments of Upper Meiocene through Pleistocene siliciclastic sediments, Baton Rouge aquifer system, southeastern Louisiana , 2012 .

[27]  Tunc Aldemir,et al.  A comparison of the Covariance Matrix Adaptation Evolution Strategy and the Levenberg–Marquardt method for solving multidimensional inverse transport problems , 2011 .

[28]  F. Tsai,et al.  A Combinatorial Optimization Scheme for Parameter Structure Identification in Ground Water Modeling , 2003, Ground water.

[29]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[30]  Peter M. A. Sloot,et al.  Application of parallel computing to stochastic parameter estimation in environmental models , 2006, Comput. Geosci..

[31]  Peter Bayer,et al.  Computationally efficient stochastic optimization using multiple realizations , 2008 .

[32]  Yan Jiang,et al.  Improved particle swarm algorithm for hydrological parameter optimization , 2010, Appl. Math. Comput..

[33]  Christopher J. Duffy,et al.  Parameterization for distributed watershed modeling using national data and evolutionary algorithm , 2012, Comput. Geosci..

[34]  Tyler Smith,et al.  Bayesian methods in hydrologic modeling: A study of recent advancements in Markov chain Monte Carlo techniques , 2008 .

[35]  Dimitrios K. Karpouzos,et al.  A multipopulation genetic algorithm to solve the inverse problem in hydrogeology , 2001 .

[36]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[37]  Michael de Paly,et al.  Optimization of high‐reliability‐based hydrological design problems by robust automatic sampling of critical model realizations , 2010 .

[38]  Charles E. Augarde,et al.  Simulation-based calibration of geotechnical parameters using parallel hybrid moving boundary particle swarm optimization , 2009 .

[39]  Yong Tang,et al.  Parallelization strategies for rapid and robust evolutionary multiobjective optimization in water resources applications , 2007 .

[40]  Christophe Andrieu,et al.  A tutorial on adaptive MCMC , 2008, Stat. Comput..

[41]  John Doherty,et al.  Parameter estimation and uncertainty analysis for a watershed model , 2007, Environ. Model. Softw..

[42]  Johannes Cullmann,et al.  Towards a more representative parametrisation of hydrologic models via synthesizing the strengths of Particle Swarm Optimisation and Robust Parameter Estimation , 2011 .

[43]  Godfrey A. Walters,et al.  Groundwater optimization and parameter estimation by genetic algorithm and dual reciprocity boundary element method , 1996 .

[44]  P. A. Hsieh,et al.  Documentation of a computer program to simulate horizontal-flow barriers using the U.S. Geological Survey's modular three-dimensional finite-difference ground-water flow model , 1993 .

[45]  Brian E. Skahill,et al.  More efficient PEST compatible model independent model calibration , 2009, Environ. Model. Softw..

[46]  George Kuczera,et al.  Bayesian analysis of input uncertainty in hydrological modeling: 1. Theory , 2006 .

[47]  Isao Ono,et al.  Theoretical Foundation for CMA-ES from Information Geometry Perspective , 2012, Algorithmica.

[48]  A. W. Harbaugh MODFLOW-2005 : the U.S. Geological Survey modular ground-water model--the ground-water flow process , 2005 .

[49]  Bryan A. Tolson,et al.  An efficient framework for hydrologic model calibration on long data periods , 2013 .

[50]  Pascal Côté,et al.  Comparison of Stochastic Optimization Algorithms in Hydrological Model Calibration , 2014 .

[51]  Frank T.-C. Tsai,et al.  Global‐local optimization for parameter structure identification in three‐dimensional groundwater modeling , 2003 .

[52]  B. V. Babu,et al.  Modified differential evolution (MDE) for optimization of non-linear chemical processes , 2006, Comput. Chem. Eng..

[53]  R. R. Meyer,et al.  Geology and ground-water resources of the Baton Rouge area, Louisiana , 1955 .

[54]  Heikki Haario,et al.  DRAM: Efficient adaptive MCMC , 2006, Stat. Comput..

[55]  Chang Wook Ahn,et al.  On the practical genetic algorithms , 2005, GECCO '05.