Non‐linear model reduction for uncertainty quantification in large‐scale inverse problems

We present a model reduction approach to the solution of large‐scale statistical inverse problems in a Bayesian inference setting. A key to the model reduction is an efficient representation of the non‐linear terms in the reduced model. To achieve this, we present a formulation that employs masked projection of the discrete equations; that is, we compute an approximation of the non‐linear term using a select subset of interpolation points. Further, through this formulation we show similarities among the existing techniques of gappy proper orthogonal decomposition, missing point estimation, and empirical interpolation via coefficient‐function approximation. The resulting model reduction methodology is applied to a highly non‐linear combustion problem governed by an advection–diffusion‐reaction partial differential equation (PDE). Our reduced model is used as a surrogate for a finite element discretization of the non‐linear PDE within the Markov chain Monte Carlo sampling employed by the Bayesian inference approach. In two spatial dimensions, we show that this approach yields accurate results while reducing the computational cost by several orders of magnitude. For the full three‐dimensional problem, a forward solve using a reduced model that has high fidelity over the input parameter space is more than two million times faster than the full‐order finite element model, making tractable the solution of the statistical inverse problem that would otherwise require many years of CPU time. Copyright © 2009 John Wiley & Sons, Ltd.

[1]  Daniela Calvetti,et al.  Introduction to Bayesian Scientific Computing: Ten Lectures on Subjective Computing , 2007 .

[2]  Douglas N. Arnold,et al.  Unified Analysis of Discontinuous Galerkin Methods for Elliptic Problems , 2001, SIAM J. Numer. Anal..

[3]  Khosro Shahbazi,et al.  An explicit expression for the penalty parameter of the interior penalty method , 2022 .

[4]  Albert Tarantola,et al.  Inverse problem theory - and methods for model parameter estimation , 2004 .

[5]  T. Hughes,et al.  Streamline upwind/Petrov-Galerkin formulations for convection dominated flows with particular emphasis on the incompressible Navier-Stokes equations , 1990 .

[6]  Habib N. Najm,et al.  Stochastic spectral methods for efficient Bayesian solution of inverse problems , 2005, J. Comput. Phys..

[7]  John Red-Horse,et al.  Propagation of probabilistic uncertainty in complex physical systems using a stochastic finite element approach , 1999 .

[8]  N. Nguyen,et al.  An ‘empirical interpolation’ method: application to efficient reduced-basis discretization of partial differential equations , 2004 .

[9]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[10]  Albert Tarantola,et al.  Probabilistic Approach to Inverse Problems , 2002 .

[11]  Faming Liang,et al.  Statistical and Computational Inverse Problems , 2006, Technometrics.

[12]  Yalchin Efendiev,et al.  Preconditioning Markov Chain Monte Carlo Simulations Using Coarse-Scale Models , 2006, SIAM J. Sci. Comput..

[13]  K. Willcox,et al.  Aerodynamic Data Reconstruction and Inverse Design Using Proper Orthogonal Decomposition , 2004 .

[14]  N. Nguyen,et al.  EFFICIENT REDUCED-BASIS TREATMENT OF NONAFFINE AND NONLINEAR PARTIAL DIFFERENTIAL EQUATIONS , 2007 .

[15]  J. Peraire,et al.  A ‘best points’ interpolation method for efficient approximation of parametrized functions , 2008 .

[16]  K. Willcox Unsteady Flow Sensing and Estimation via the Gappy Proper Orthogonal Decomposition , 2004 .

[17]  Siep Weiland,et al.  Missing Point Estimation in Models Described by Proper Orthogonal Decomposition , 2004, IEEE Transactions on Automatic Control.

[18]  David Galbally,et al.  Nonlinear model reduction for uncertainty quantification in large-scale inverse problems : application to nonlinear convection-diffusion-reaction equation , 2008 .

[19]  E. Somersalo,et al.  Approximation errors and model reduction with an application in optical diffusion tomography , 2006 .

[20]  Lawrence Sirovich,et al.  Karhunen–Loève procedure for gappy data , 1995 .

[21]  Jacob K. White,et al.  A trajectory piecewise-linear approach to model order reduction and fast simulation of nonlinear circuits and micromachined devices , 2001, IEEE/ACM International Conference on Computer Aided Design. ICCAD 2001. IEEE/ACM Digest of Technical Papers (Cat. No.01CH37281).

[22]  Karen Willcox,et al.  Model Reduction for Large-Scale Systems with High-Dimensional Parametric Input Space , 2008, SIAM J. Sci. Comput..

[23]  Chi-Wang Shu,et al.  Runge–Kutta Discontinuous Galerkin Methods for Convection-Dominated Problems , 2001, J. Sci. Comput..

[24]  E. Somersalo,et al.  Statistical inverse problems: discretization, model reduction and inverse crimes , 2007 .

[25]  Vipin Kumar,et al.  Parallel Multilevel series k-Way Partitioning Scheme for Irregular Graphs , 1999, SIAM Rev..

[26]  Vipin Kumar,et al.  Parallel Multilevel k-way Partitioning Scheme for Irregular Graphs , 1996, Proceedings of the 1996 ACM/IEEE Conference on Supercomputing.

[27]  L. Sirovich Turbulence and the dynamics of coherent structures. I. Coherent structures , 1987 .

[28]  Nicholas Zabaras,et al.  Using Bayesian statistics in the estimation of heat source in radiation , 2005 .

[29]  Fabio Nobile,et al.  A Stochastic Collocation Method for Elliptic Partial Differential Equations with Random Input Data , 2007, SIAM Rev..

[30]  X. Bombois,et al.  Accelerating large-scale non-linear models for monitoring and control using spatial and temporal correlations , 2004, Proceedings of the 2004 American Control Conference.