A well-conditioned direct PinT algorithm for first- and second-order evolutionary equations

In this paper, we propose a direct parallel-in-time (PinT) algorithm for timedependent problems with firstor second-order derivative. We use a second-order boundary value method as the time integrator that leads to a tridiagonal time discretization matrix. Instead of solving the corresponding all-at-once system iteratively, we diagonalize the time discretization matrix, which yields a direct parallel implementation across all time levels. A crucial issue on this methodology is how the condition number of the eigenvector matrix V grows as n is increased, where n is the number of time levels. A large condition number leads to large roundoff error in the diagonalization procedure, which could seriously pollute the numerical accuracy. Based on a novel connection between the characteristic equation and the Chebyshev polynomials, we present explicit formulas for computing V and V −1, by which we prove that Cond2(V ) = O(n2). This implies that the diagonalization process is well-conditioned and the roundoff error only increases moderately as n grows and thus, compared to other direct PinT algorithms, a much larger n can be used to yield satisfactory parallelism. Numerical results on parallel machine are given to support our findings, where over 60 times speedup is achieved with 256 cores.

[1]  Robert Speck,et al.  A parallel implementation of a diagonalization-based parallel-in-time integrator , 2021, ArXiv.

[2]  Yvon Maday,et al.  Parallelization in time through tensor-product space–time solvers , 2008 .

[3]  L. Brugnano,et al.  Solving differential problems by multistep initial and boundary value methods , 1998 .

[4]  Martin J. Gander,et al.  A Direct Time Parallel Solver by Diagonalization for the Wave Equation , 2019, SIAM J. Sci. Comput..

[5]  Israel Gohberg,et al.  Fast inversion of Chebyshev--Vandermonde matrices , 1994 .

[6]  L. Fox,et al.  A NOTE ON THE NUMERICAL INTEGRATION OF FIRST-ORDER DIFFERENTIAL EQUATIONS , 1954 .

[7]  Lothar Reichel,et al.  Chebyshev-Vandermonde systems , 1991 .

[8]  Charbel Farhat,et al.  Time‐parallel implicit integrators for the near‐real‐time prediction of linear structural dynamic responses , 2006 .

[9]  Andrew J. Wathen,et al.  Preconditioning and Iterative Solution of All-at-Once Systems for Evolutionary Partial Differential Equations , 2018, SIAM J. Sci. Comput..

[10]  Rolf Krause,et al.  Explicit Parallel-in-time Integration of a Linear Acoustic-Advection System , 2012, ArXiv.

[11]  Martin Neumüller,et al.  Time-Parallel Iterative Solvers for Parabolic Evolution Equations , 2018, SIAM J. Sci. Comput..

[12]  Rolf Krause,et al.  Convergence of Parareal for the Navier-Stokes equations depending on the Reynolds number , 2013, ArXiv.

[13]  Shu-Lin Wu Convergence Analysis of the Parareal-Euler Algorithm for Systems of ODEs with Complex Eigenvalues , 2016, J. Sci. Comput..

[14]  Israel Gohberg,et al.  The Fast Generalized Parker-Traub Algorithm for Inversion of Vandermonde and Related Matrices , 1997, J. Complex..

[15]  Robert D. Falgout,et al.  Parallel time integration with multigrid , 2013, SIAM J. Sci. Comput..

[16]  L. Fox,et al.  BOUNDARY-VALUE TECHNIQUES FOR THE NUMERICAL SOLUTION OF INITIAL-VALUE PROBLEMS IN ORDINARY DIFFERENTIAL EQUATIONS , 1957 .

[17]  P. Deuflhard Newton Methods for Nonlinear Problems: Affine Invariance and Adaptive Algorithms , 2011 .

[18]  J. G. Verwer,et al.  Boundary value techniques for initial value problems in ordinary differential equations , 1983 .

[19]  Richard Tsai,et al.  A stable parareal-like method for the second order wave equation , 2020, J. Comput. Phys..

[20]  Donato Trigiante,et al.  Parallel implementation of BVM methods , 1993 .

[21]  David L. Chopp Introduction to High Performance Scientific Computing , 2019 .

[22]  Stefan Güttel,et al.  A spectral-in-time Newton–Krylov method for nonlinear PDE-constrained optimization , 2021 .

[23]  A. Wathen,et al.  A note on parallel preconditioning for all-at-once evolutionary PDEs , 2018, ETNA - Electronic Transactions on Numerical Analysis.

[24]  Victor Eijkhout,et al.  Introduction to High Performance Scientific Computing , 2015 .

[25]  Daniel Ruprecht,et al.  Wave propagation characteristics of Parareal , 2017, Comput. Vis. Sci..

[26]  Michael L. Minion,et al.  TOWARD AN EFFICIENT PARALLEL IN TIME METHOD FOR PARTIAL DIFFERENTIAL EQUATIONS , 2012 .

[27]  Xiaoying Dai,et al.  Stable Parareal in Time Method for First- and Second-Order Hyperbolic Systems , 2012, SIAM J. Sci. Comput..

[28]  Fredi Tröltzsch,et al.  On the optimal control of the Schlögl-model , 2013, Comput. Optim. Appl..

[29]  Jan S. Hesthaven,et al.  On the Use of Reduced Basis Methods to Accelerate and Stabilize the Parareal Method , 2014 .

[30]  Martin J. Gander,et al.  Time Parallelization for Nonlinear Problems Based on Diagonalization , 2017 .

[31]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[32]  Nicholas J. Higham,et al.  Fast Solution of Vandermonde-Like Systems Involving Orthogonal Polynomials , 1988 .

[33]  Nicholas J. Higham,et al.  INVERSE PROBLEMS NEWSLETTER , 1991 .

[34]  Jun Liu,et al.  A Fast Block α-Circulant Preconditoner for All-at-Once Systems From Wave Equations , 2020, SIAM J. Matrix Anal. Appl..

[35]  Xue-lei Lin,et al.  A Separable Preconditioner for Time-Space Fractional Caputo-Riesz Diffusion Equations , 2018, Numerical Mathematics: Theory, Methods and Applications.

[36]  Lothar Reichel,et al.  Fast inversion of vandermonde-like matrices involving orthogonal polynomials , 1993 .