A Sketched Finite Element Method for Elliptic Models

Abstract We consider a sketched implementation of the finite element method for elliptic partial differential equations on high-dimensional models. Motivated by applications in real-time simulation and prediction we propose an algorithm that involves projecting the finite element solution onto a low-dimensional subspace and sketching the reduced equations using randomised sampling. We show that a sampling distribution based on the leverage scores of a tall matrix associated with the discrete Laplacian operator, can achieve nearly optimal performance and a significant speedup. We derive an expression of the complexity of the algorithm in terms of the number of samples that are necessary to meet an error tolerance specification with high probability, and an upper bound for the distance between the sketched and the high-dimensional solutions. Our analysis shows that the projection not only reduces the dimension of the problem but also regularises the reduced system against sketching error. Our numerical simulations suggest speed improvements of two orders of magnitude in exchange for a small loss in the accuracy of the prediction.

[1]  D. Bertsekas,et al.  Journal of Computational and Applied Mathematics Projected Equation Methods for Approximate Solution of Large Linear Systems , 2022 .

[2]  A. Cohen,et al.  Model Reduction and Approximation: Theory and Algorithms , 2017 .

[3]  J. Hesthaven,et al.  Certified Reduced Basis Methods for Parametrized Partial Differential Equations , 2015 .

[4]  Anthony Nouy,et al.  Low-rank methods for high-dimensional approximation and model order reduction , 2015, 1511.01554.

[5]  Petros Drineas,et al.  Fast Monte Carlo Algorithms for Matrices I: Approximating Matrix Multiplication , 2006, SIAM J. Comput..

[6]  S. Vavasis.  Stable finite elements for problems with wild coefficients , 1996 .

[7]  David P. Woodruff.  Sketching as a Tool for Numerical Linear Algebra , 2014, Found. Trends Theor. Comput. Sci..

[8]  Arnold Neumaier,et al.  Solving Ill-Conditioned and Singular Linear Systems: A Tutorial on Regularization , 1998, SIAM Rev..

[9]  Nicholas J. Higham,et al.  Detecting the causes of ill-conditioning in structural finite element models , 2014 .

[10]  Barry Lee,et al.  Finite elements and fast iterative solvers: with applications in incompressible fluid dynamics , 2006, Math. Comput..

[11]  Martin J. Wainwright,et al.  Iterative Hessian Sketch: Fast and Accurate Solution Approximation for Constrained Least-Squares , 2014, J. Mach. Learn. Res..

[12]  Andrew M. Stuart,et al.  Iterative updating of model error for Bayesian inversion , 2017, 1707.04246.

[13]  David P. Woodruff,et al.  Fast approximation of matrix coherence and statistical leverage , 2011, ICML.

[14]  W. D. Evans,et al.  PARTIAL DIFFERENTIAL EQUATIONS , 1941 .

[15]  Peter Richtárik,et al.  Linearly Convergent Randomized Iterative Methods for Computing the Pseudoinverse , 2016, 1612.06255.

[16]  Maryam Fazel,et al.  Iterative reweighted algorithms for matrix rank minimization , 2012, J. Mach. Learn. Res..

[17]  A. Quarteroni,et al.  Reduced Basis Methods for Partial Differential Equations: An Introduction , 2015 .

[18]  Nathan Halko,et al.  Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions , 2009, SIAM Rev..

[19]  Catherine E. Powell,et al.  An Introduction to Computational Stochastic PDEs , 2014 .

[20]  Vasudeva Varma,et al.  Computational Advertising: Techniques for Targeting Relevant Ads , 2014 .

[21]  Dimitri P. Bertsekas,et al.  A Quasi Monte Carlo Method for Large-Scale Inverse Problems , 2012 .

[22]  Sivan Toledo,et al.  Effective Stiffness: Generalizing Effective Resistance Sampling to Finite Element Matrices , 2011, ArXiv.

[23]  Petros Drineas,et al.  Effective Resistances, Statistical Leverage, and Applications to Linear Equation Solving , 2010, ArXiv.

[24]  Peter Richtárik,et al.  Randomized Iterative Methods for Linear Systems , 2015, SIAM J. Matrix Anal. Appl..

[25]  Konstantinos Panagiotou,et al.  Efficient Sampling Methods for Discrete Distributions , 2012, ICALP.

[26]  Joel A. Tropp,et al.  An Introduction to Matrix Concentration Inequalities , 2015, Found. Trends Mach. Learn..

[27]  Weizhang Huang,et al.  Conditioning of finite element equations with arbitrary anisotropic meshes , 2012, Math. Comput..

[28]  Dirk Hartmann,et al.  Model Order Reduction a Key Technology for Digital Twins , 2018 .

[29]  Anders Logg,et al.  Efficient compilation of a class of variational forms , 2007, TOMS.

[30]  Richard Peng,et al.  Uniform Sampling for Matrix Approximation , 2014, ITCS.