Solution of inverse problems with limited forward solver evaluations: a Bayesian perspective

Solving inverse problems based on computationally demanding forward models is ubiquitously difficult since one is necessarily limited to just a few observations of the response surface. The usual practice is to replace the response surface with a surrogate. However, this approach induces additional uncertainties on the posterior distributions. The main contribution of this work is the reformulation of the Bayesian solution of the inverse problem when the expensive forward model is replaced by the surrogate. We derive three approximations of the reformulated solution with increasing complexity and fidelity. We demonstrate numerically that the proposed approximations capture theuncertaintyofthesolutionoftheinverseprobleminducedbythefactthatthe forward model is replaced by a finite number of simulations. We demonstrate our approach in two different problems: locating the contamination source of a diffusive process and inferring the permeability field of an oil reservoir based on measurements of the oil-cut curves.

[1]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[2]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[3]  L. Dake.  Fundamentals of Reservoir Engineering , 1983 .

[4]  R. Ghanem,et al.  Stochastic Finite Elements: A Spectral Approach , 1990 .

[5]  T. C. Haas,et al.  Lognormal and Moving Window Methods of Estimating Acid Deposition , 1990 .

[6]  Alexander J. Smola,et al.  Sparse Greedy Gaussian Process Regression , 2000, NIPS.

[7]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[8]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[9]  P. Moral,et al.  Sequential Monte Carlo samplers , 2002, cond-mat/0212648.

[10]  Neil D. Lawrence,et al.  Fast Sparse Gaussian Process Methods: The Informative Vector Machine , 2002, NIPS.

[11]  Neil D. Lawrence,et al.  Fast Forward Selection to Speed Up Sparse Gaussian Process Regression , 2003, AISTATS.

[12]  Albert Tarantola,et al.  Inverse problem theory - and methods for model parameter estimation , 2004 .

[13]  E. Somersalo,et al.  Statistical and computational inverse problems , 2004 .

[14]  Carl E. Rasmussen,et al.  A Unifying View of Sparse Approximate Gaussian Process Regression , 2005, J. Mach. Learn. Res..

[15]  Zoubin Ghahramani,et al.  Sparse Gaussian Processes using Pseudo-inputs , 2005, NIPS.

[16]  Nicolas Le Roux,et al.  The Curse of Highly Variable Functions for Local Kernel Machines , 2005, NIPS.

[17]  Edwin V. Bonilla,et al.  Multi-task Gaussian Process Prediction , 2007, NIPS.

[18]  Knut-Andreas Lie,et al.  An Introduction to the Numerics of Flow in Porous Media using Matlab , 2007, Geometric Modelling, Numerical Simulation, and Optimization.

[19]  Habib N. Najm,et al.  Stochastic spectral methods for efficient Bayesian solution of inverse problems , 2005, J. Comput. Phys..

[20]  Knut-Andreas Lie,et al.  Modelling of Multiscale Structures in Flow Simulations for Petroleum Reservoirs , 2007, Geometric Modelling, Numerical Simulation, and Optimization.

[21]  D. Higdon,et al.  Computer Model Calibration Using High-Dimensional Output , 2008 .

[22]  Neil D. Lawrence,et al.  Sparse Convolved Gaussian Processes for Multi-output Regression , 2008, NIPS.

[23]  Y. Marzouk,et al.  A stochastic collocation approach to Bayesian inference in inverse problems , 2009 .

[24]  Phaedon-Stelios Koutsourelakis,et al.  A multi-resolution, non-parametric, Bayesian framework for identification of spatially-varying model parameters , 2008, J. Comput. Phys..

[25]  Nicholas Zabaras,et al.  An efficient Bayesian inference approach to inverse problems based on an adaptive sparse grid collocation method , 2009 .

[26]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[27]  A. O'Hagan,et al.  Bayesian emulation of complex multi-output and dynamic computer models , 2010 .

[28]  Nicholas Zabaras,et al.  A Bayesian approach to multiscale inverse problems using the sequential Monte Carlo method , 2011 .

[29]  Ilias Bilionis,et al.  Free energy computations by minimization of Kullback-Leibler divergence: An efficient adaptive biasing potential method for sparse representations , 2010, J. Comput. Phys..

[30]  A. Neishtadt,et al.  On quantum averaging, quantum KAM, and quantum diffusion , 2012, 1208.4819.

[31]  Ilias Bilionis,et al.  Multi-output separable Gaussian process: Towards an efficient, fully Bayesian paradigm for uncertainty quantification , 2013, J. Comput. Phys..

[32]  Philippe Renard,et al.  Distance-based Kriging relying on proxy simulations for inverse conditioning , 2013 .