Bayesian inverse problem and optimization with iterative spatial resampling

Measurements are often unable to uniquely characterize the subsurface at a desired modeling resolution. In particular, inverse problems involving the characterization of hydraulic properties are typically ill‐posed since they generally present more unknowns than data. In a Bayesian context, solutions to such problems consist of a posterior ensemble of models that fit the data (up to a certain precision specified by a likelihood function) and that are a subset of a prior distribution. Two possible approaches for this problem are Markov chain Monte Carlo (McMC) techniques and optimization (calibration) methods. Both frameworks rely on a perturbation mechanism to steer the search for solutions. When the model parameters are spatially dependent variable fields obtained using geostatistical realizations, such as hydraulic conductivity or porosity, it is not trivial to incur perturbations that respect the prior spatial model. To overcome this problem, we propose a general transition kernel (iterative spatial resampling, ISR) that preserves any spatial model produced by conditional simulation. We also present a stochastic stopping criterion for the optimizations inspired from importance sampling. In the studied cases, this yields posterior distributions reasonably close to the ones obtained by a rejection sampler, but with a greatly reduced number of forward model runs. The technique is general in the sense that it can be used with any conditional geostatistical simulation method, whether it generates continuous or discrete variables. Therefore it allows sampling of different priors and conditioning to a variety of data types. Several examples are provided based on either multi‐Gaussian or multiple‐point statistics.

[1]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[2]  Alex Fraser,et al.  Simulation of Genetic Systems by Automatic Digital Computers I. Introduction , 1957 .

[3]  J. S. F. Barker,et al.  Simulation of Genetic Systems by Automatic Digital Computers , 1958 .

[4]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[5]  M. Boucher,et al.  Interpretation of Interference Tests in a Well Field Using Geostatistical Techniques to Fit the Permeability Distribution in a Reservoir Model , 1984 .

[6]  A. R. Jones The micromap computer-assisted cartography package , 1985 .

[7]  S. P. Neuman,et al.  Estimation of aquifer parameters under transient and steady-state conditions: 2 , 1986 .

[8]  W. Yeh Review of Parameter Identification Procedures in Groundwater Hydrology: The Inverse Problem , 1986 .

[9]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[10]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[11]  R. M. Srivastava,et al.  Multivariate Geostatistics: Beyond Bivariate Moments , 1993 .

[12]  P. R. Ballin,et al.  Quantifying the Impact of Geological Uncertainty on Reservoir Performing Forecasts , 1993 .

[13]  Albert Tarantola,et al.  Monte Carlo sampling of solutions to inverse problems , 1995 .

[14]  J. Besag,et al.  On conditional and intrinsic autoregressions , 1995 .

[15]  M. Marietta,et al.  Pilot Point Methodology for Automated Calibration of an Ensemble of conditionally Simulated Transmissivity Fields: 1. Theory and Computational Experiments , 1995 .

[16]  P. Kitanidis Quasi‐Linear Geostatistical Theory for Inversing , 1995 .

[17]  P. Patrick Wang,et al.  Parameter structure identification using tabu search and simulated annealing , 1996 .

[18]  D. Oliver,et al.  Markov chain Monte Carlo methods for conditioning a permeability field to pressure data , 1997 .

[19]  Patrick J. F. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 2003 .

[20]  A. Sahuquillo,et al.  Stochastic simulation of transmissivity fields conditional to both transmissivity and piezometric data—I. Theory , 1997 .

[21]  Mansoor Shafi,et al.  Quick Simulation: A Review of Importance Sampling Techniques in Communications Systems , 1997, IEEE J. Sel. Areas Commun..

[22]  Lehua Pan,et al.  A hybrid global optimization method for inverse estimation of hydraulic parameters: Annealing‐Simplex Method , 1998 .

[23]  Håkon Tjelmeland,et al.  Markov Random Fields with Higher‐order Interactions , 1998 .

[24]  D. A. Zimmerman,et al.  A comparison of seven geostatistically based inverse approaches to estimate transmissivities for modeling advective transport by groundwater flow , 1998 .

[25]  L. Hu Gradual Deformation and Iterative Calibration of Gaussian-Related Stochastic Models , 2000 .

[26]  Benoit Noetinger,et al.  Gradual Deformation and Iterative Calibration of Sequential Stochastic Simulations , 2001 .

[27]  Velimir V. Vesselinov,et al.  Three‐dimensional numerical inversion of pneumatic cross‐hole tests in unsaturated fractured tuff: 1. Methodology and borehole effects , 2001 .

[28]  Dimitrios K. Karpouzos,et al.  A multipopulation genetic algorithm to solve the inverse problem in hydrogeology , 2001 .

[29]  Benoît Nœtinger,et al.  Optimization with the Gradual Deformation Method , 2002 .

[30]  Sebastien Strebelle,et al.  Conditional Simulation of Complex Geological Structures Using Multiple-Point Statistics , 2002 .

[31]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[32]  John Doherty,et al.  Ground Water Model Calibration Using Pilot Points and Regularization , 2003, Ground water.

[33]  Jef Caers,et al.  History Matching Under Training-Image-Based Geological Model Constraints , 2003 .

[34]  Xavier Emery,et al.  Testing the correctness of the sequential algorithm for simulating Gaussian random fields , 2004 .

[35]  Dean S. Oliver,et al.  Experimental Assessment of Gradual Deformation Method , 2004 .

[36]  S. Subbeya,et al.  Prediction under uncertainty in reservoir modeling , 2004 .

[37]  P. Bayer,et al.  Evolutionary algorithms for the optimization of advective control of contaminated aquifer zones , 2004 .

[38]  Harrie-Jan Hendricks Franssen,et al.  Joint estimation of transmissivities and recharges—application: stochastic characterization of well capture zones , 2004 .

[39]  P. Renard,et al.  Dealing with spatial heterogeneity , 2005 .

[40]  M. Le Ravalec-Dupin,et al.  On Some Controversial Issues of Geostatistical Simulation , 2005 .

[41]  Andres Alcolea,et al.  Inverse problem in hydrogeology , 2005 .

[42]  Andres Alcolea,et al.  Pilot points method incorporating prior information for solving the groundwater flow inverse problem , 2006 .

[43]  A. Journel,et al.  The Necessity of a Multiple-Point Prior Model , 2007 .

[44]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[45]  J. Caers,et al.  The Probability Perturbation Method: A New Look at Bayesian Inverse Modeling , 2006 .

[46]  S. P. Neuman,et al.  Inverse stochastic moment analysis of steady state flow in randomly heterogeneous media , 2006 .

[47]  P. Reed,et al.  Hydrology and Earth System Sciences Discussions Comparing Sensitivity Analysis Methods to Advance Lumped Watershed Model Identification and Evaluation , 2022 .

[48]  M. Le Ravalec-Dupin,et al.  Combining the Pilot Point and Gradual Deformation Methods for Calibrating Permeability Models to Dynamic Data , 2007 .

[49]  Satomi Suzuki,et al.  Hybridization of the probability perturbation method with gradient information , 2007 .

[50]  Jef Caers,et al.  Comparing the Gradual Deformation with the Probability Perturbation Method for Solving Inverse Problems , 2007 .

[51]  Jef Caers,et al.  Representing Spatial Uncertainty Using Distances and Kernels , 2009 .

[52]  Heidi Kjønsberg MARKOV MESH SIMULATIONS WITH DATA CONDITIONING THROUGH INDICATOR KRIGING , 2008 .

[53]  L. Y. Hu,et al.  Multiple‐point geostatistics for modeling subsurface heterogeneity: A comprehensive review , 2008 .

[54]  Jianlin Fu,et al.  Preserving spatial structure for inverse stochastic simulation using blocking Markov chain Monte Carlo method , 2008 .

[55]  S. Gorelick,et al.  Identifying discrete geologic structures that produce anomalous hydraulic response: An inverse modeling approach , 2008 .

[56]  Philippe Renard,et al.  Reducing the impact of a desalination plant using stochastic modeling and optimization techniques , 2009 .

[57]  P. Kitanidis,et al.  Geostatistical inversing for large-contrast transmissivity fields , 2009 .

[58]  Carlos Llopis-Albert,et al.  Gradual conditioning of non-Gaussian transmissivity fields to flow and mass transport data: 1. Theory , 2009 .

[59]  J. Gómez-Hernández,et al.  Uncertainty assessment and data worth in groundwater flow and mass transport modeling using a blocking Markov chain Monte Carlo method. , 2009 .

[60]  Alexandre Boucher,et al.  Applied Geostatistics with SGeMS: A User's Guide , 2009 .

[61]  Philippe Renard,et al.  Truncated Plurigaussian Simulations to Characterize Aquifer Heterogeneity , 2009, Ground water.

[62]  Carlos Llopis-Albert,et al.  Gradual conditioning of non-Gaussian transmissivity fields to flow and mass transport data: 3. Application to the Macrodispersion Experiment (MADE-2) site, on Columbus Air Force Base in Mississippi (USA) , 2009 .

[63]  H. H. Franssen,et al.  A comparison of seven methods for the inverse modelling of groundwater flow. Application to the characterisation of well catchments , 2009 .

[64]  Mickaele Le Ravalec-Dupin,et al.  Pilot Block Method Methodology to Calibrate Stochastic Permeability Fields to Dynamic Data , 2010 .

[65]  Gregoire Mariethoz,et al.  The Direct Sampling method to perform multiple‐point geostatistical simulations , 2010 .

[66]  Grégoire Mariethoz,et al.  A general parallelization strategy for random path based geostatistical simulation methods , 2010, Comput. Geosci..

[67]  G. Mariéthoz,et al.  Reconstruction of Incomplete Data Sets or Images Using Direct Sampling , 2010 .

[68]  Philippe Renard,et al.  Blocking Moving Window algorithm: Conditioning multiple‐point simulations to hydrogeological data , 2010 .

[69]  P. Kitanidis,et al.  Parameter estimation in nonlinear environmental problems , 2010 .

[70]  G. Mariéthoz,et al.  An Improved Parallel Multiple-point Algorithm Using a List Approach , 2011 .

[71]  Horst Langer,et al.  Pattern recognition of volcanic tremor data on Mt. Etna (Italy) with KKAnalysis - A software program for unsupervised classification , 2011, Comput. Geosci..