An Application of Random Projection to Parameter Estimation in Partial Differential Equations

In this article, we use a dimension reduction technique called random projection to reduce the computational cost of estimating unknown parameters in models based on partial differential equations (PDEs). In this setting, the repeated numerical solution of the discrete PDE model dominates the cost of parameter estimation. In turn, the size of the discretized PDE corresponds directly to the number of physical experiments. As the number of experiments grows, parameter estimation becomes prohibitively expensive. In order to reduce this cost, we develop an algorithmic technique based on random projection that solves the parameter estimation problem using a much smaller number of so-called encoded experiments. Encoded experiments amount to nothing more than random sums of physical experiments. Using this construction, we provide a lower bound for the required number of encoded experiments. This bound holds in a probabilistic sense and is independent of the number of physical experiments. Finally, we demonstrat...

[1]  Felix J. Herrmann,et al.  Seismic Waveform Inversion by Stochastic Optimization , 2011 .

[2]  Anatoly Baumstein,et al.  Fast Full Wave Seismic Inversion using Source Encoding. , 2009 .

[3]  T. Steihaug The Conjugate Gradient Method and Trust Regions in Large Scale Optimization , 1983 .

[4]  Uri M. Ascher,et al.  Adaptive and Stochastic Algorithms for Electrical Impedance Tomography and DC Resistivity Problems with Piecewise Constant Solutions and Many Measurements , 2012, SIAM J. Sci. Comput..

[5]  Philipp Birken,et al.  Numerical Linear Algebra , 2011, Encyclopedia of Parallel Computing.

[6]  Jared Tanner,et al.  Explorer Compressed Sensing : How Sharp Is the Restricted Isometry Property ? , 2011 .

[7]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[8]  Eldad Haber,et al.  An Effective Method for Parameter Estimation with PDE Constraints with Multiple Right-Hand Sides , 2012, SIAM J. Optim..

[9]  Alexander Shapiro,et al.  Stochastic Approximation approach to Stochastic Programming , 2013 .

[10]  Benard Okelo A Concise Introduction to Tensor Products and Elementary Operators , 2011 .

[11]  Dimitris Achlioptas,et al.  Database-friendly random projections , 2001, PODS.

[12]  Sivan Toledo,et al.  Randomized algorithms for estimating the trace of an implicit symmetric positive semi-definite matrix , 2011, JACM.

[13]  M. Hutchinson A stochastic estimator of the trace of the influence matrix for laplacian smoothing splines , 1989 .

[14]  R. DeVore,et al.  A Simple Proof of the Restricted Isometry Property for Random Matrices , 2008 .

[15]  W. B. Johnson,et al.  Extensions of Lipschitz mappings into Hilbert space , 1984 .