Increased space-parallelism via time-simultaneous Newton-multigrid methods for nonstationary nonlinear PDE problems

We discuss how “parallel-in-space & simultaneous-in-time” Newton-multigrid approaches can be designed which improve the scaling behavior of the spatial parallelism by reducing the latency costs. The idea is to solve many time steps at once and therefore solving fewer but larger systems. These large systems are reordered and interpreted as a space-only problem leading to multigrid algorithm with semi-coarsening in space and line smoothing in time direction. The smoother is further improved by embedding it as a preconditioner in a Krylov subspace method. As a prototypical application, we concentrate on scalar partial differential equations (PDEs) with up to many thousands of time steps which are discretized in time, resp., space by finite difference, resp., finite element methods. For linear PDEs, the resulting method is closely related to multigrid waveform relaxation and its theoretical framework. In our parabolic test problems the numerical behavior of this multigrid approach is robust w.r.t. the spatial and temporal grid size and the number of simultaneously treated time steps. Moreover, we illustrate how corresponding time-simultaneous fixed-point and Newton-type solvers can be derived for nonlinear nonstationary problems that require the described solution of linearized problems in each outer nonlinear step. As the main result, we are able to generate much larger problem sizes to be treated by a large number of cores so that the combination of the robustly scaling multigrid solvers together with a larger degree of parallelism allows a faster solution procedure for nonstationary problems.

[1]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[2]  Henk A. van der Vorst,et al.  Bi-CGSTAB: A Fast and Smoothly Converging Variant of Bi-CG for the Solution of Nonsymmetric Linear Systems , 1992, SIAM J. Sci. Comput..

[3]  Y. Saad,et al.  GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems , 1986 .

[4]  Ulrich Langer,et al.  Parallel and Robust Preconditioning for Space-Time Isogeometric Analysis of Parabolic Evolution Problems , 2018, SIAM J. Sci. Comput..

[5]  Stefan Vandewalle,et al.  Numerical experiments with nonlinear multigrid waveform relaxation on a parallel processor , 1991 .

[6]  Stefan Vandewalle,et al.  Multigrid Waveform Relaxation on Spatial Finite Element Meshes: The Discrete-Time Case , 1996, SIAM J. Sci. Comput..

[7]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[8]  Alexander Ostermann,et al.  Multi-grid dynamic iteration for parabolic equations , 1987 .

[9]  Thomas A. Manteuffel,et al.  Multigrid Reduction in Time for Nonlinear Parabolic Problems: A Case Study , 2017, SIAM J. Sci. Comput..

[10]  Graham Horton,et al.  A Space-Time Multigrid Method for Parabolic Partial Differential Equations , 1995, SIAM J. Sci. Comput..

[11]  Michael L. Minion,et al.  TOWARD AN EFFICIENT PARALLEL IN TIME METHOD FOR PARTIAL DIFFERENTIAL EQUATIONS , 2012 .

[12]  Rolf Krause,et al.  A massively space-time parallel N-body solver , 2012, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis.

[13]  Wolfgang Hackbusch,et al.  Parabolic multi-grid methods , 1985 .

[14]  Robert D. Falgout,et al.  Multilevel Convergence Analysis of Multigrid-Reduction-in-Time , 2018, SIAM J. Sci. Comput..

[15]  Martin Neumüller,et al.  Combining Space-Time Multigrid Techniques with Multilevel Monte Carlo Methods for SDEs , 2017 .

[16]  C. Lohmann On the solvability and iterative solution of algebraic flux correction problems for convection-reaction equations , 2019 .

[17]  Tobias Weinzierl,et al.  A Geometric Space-Time Multigrid Algorithm for the Heat Equation , 2012 .

[18]  Martin J. Gander,et al.  50 Years of Time Parallel Time Integration , 2015 .

[19]  G. Meurant Least Squares Problems , 2018, Explorations in Numerical Analysis.

[20]  D. Kuzmin,et al.  High-resolution FEM-TVD schemes based on a fully multidimensional flux limiter , 2004 .

[21]  Stefan Vandewalle,et al.  Multigrid Waveform Relaxation for Anisotropic Partial Differential Equations , 2002, Numerical Algorithms.

[22]  Martin J. Gander,et al.  Analysis of a New Space-Time Parallel Multigrid Algorithm for Parabolic Problems , 2014, SIAM J. Sci. Comput..

[23]  J. Lions,et al.  Résolution d'EDP par un schéma en temps « pararéel » , 2001 .

[24]  Christoph Lohmann,et al.  Physics-Compatible Finite Element Methods for Scalar and Tensorial Advection Problems , 2019 .

[25]  Graham Horton,et al.  Fourier mode analysis of the multigrid waveform relaxation and time-parallel multigrid methods , 2005, Computing.

[26]  Miss A.O. Penney (b) , 1974, The New Yale Book of Quotations.

[27]  Robert D. Falgout,et al.  Parallel time integration with multigrid , 2013, SIAM J. Sci. Comput..

[28]  S. Turek,et al.  A Time-Simultaneous Multigrid Method for Parabolic Evolution Equations , 2019, ENUMATH.

[29]  Stefan Vandewalle,et al.  Space-time Concurrent Multigrid Waveform Relaxation , 1994 .

[30]  Shlomo Ta'asan,et al.  On the Multigrid Waveform Relaxation Method , 1995, SIAM J. Sci. Comput..