Data-driven time parallelism via forecasting

This work proposes a data-driven method for enabling the efficient, stable time-parallel numerical solution of systems of ordinary differential equations (ODEs). The method assumes that low-dimensional bases that accurately capture the time evolution of the state are available. The method adopts the parareal framework for time parallelism, which is defined by an initialization method, a coarse propagator, and a fine propagator. Rather than employing usual approaches for initialization and coarse propagation, we propose novel data-driven techniques that leverage the available time-evolution bases. The coarse propagator is defined by a forecast (proposed in Ref. [12]) applied locally within each coarse time interval, which comprises the following steps: (1) apply the fine propagator for a small number of time steps, (2) approximate the state over the entire coarse time interval using gappy POD with the local time-evolution bases, and (3) select the approximation at the end of the time interval as the propagated state. We also propose both local-forecast and global-forecast initialization. The method is particularly well suited for POD-based reduced-order models (ROMs). In this case, spatial parallelism quickly saturates, as the ROM dynamical system is low dimensional; thus, time parallelism is needed to enable lower wall times. Further, the time-evolution bases can be extracted from the (readily available) right singular vectors arising during POD computation. In addition to performing analyses related to the method's accuracy, speedup, stability, and convergence, we also numerically demonstrate the method's performance. Here, numerical experiments on ROMs for a nonlinear convection-reaction problem demonstrate the method's ability to realize near-ideal speedups; global-forecast initialization with a local-forecast coarse propagator leads to the best performance.

[1]  Yvon Maday,et al.  A Parareal in Time Semi-implicit Approximation of the Navier-Stokes Equations , 2005 .

[2]  Youngsoo Choi,et al.  Space-time least-squares Petrov-Galerkin projection for nonlinear model reduction , 2017, SIAM J. Sci. Comput..

[3]  Jan S. Hesthaven,et al.  On the Use of Reduced Basis Methods to Accelerate and Stabilize the Parareal Method , 2014 .

[4]  Bernard Haasdonk,et al.  Reduced Basis Approximation for Nonlinear Parametrized Evolution Equations based on Empirical Operator Interpolation , 2012, SIAM J. Sci. Comput..

[5]  Joachim Stadel,et al.  A Parallel Integration Method for Solar System Dynamics , 1997 .

[6]  Stefan Engblom,et al.  Parallel in Time Simulation of Multiscale Stochastic Chemical Kinetics , 2008, Multiscale Model. Simul..

[7]  Alok Choudhary,et al.  Synergistic Challenges in Data-Intensive Science and Exascale Computing: DOE ASCAC Data Subcommittee Report , 2013 .

[8]  Danny C. Sorensen,et al.  Nonlinear Model Reduction via Discrete Empirical Interpolation , 2010, SIAM J. Sci. Comput..

[9]  L Sirovich,et al.  The Karhunen-lo Eve Procedure for Gappy Data , 1995 .

[10]  Alfredo Bellen,et al.  Parallel algorithms for initial-value problems for difference and differential equations , 1989 .

[11]  Martin Neumüller,et al.  Space-Time Methods: Fast Solvers and Applications , 2013 .

[12]  RewieÅ ski,et al.  A trajectory piecewise-linear approach to model order reduction of nonlinear dynamical systems , 2003 .

[13]  Raf Vandebril,et al.  A New Truncation Strategy for the Higher-Order Singular Value Decomposition , 2012, SIAM J. Sci. Comput..

[14]  Y. Maday,et al.  A “Parareal” Time Discretization for Non-Linear PDE’s with Application to the Pricing of an American Put , 2002 .

[15]  Robert D. Falgout,et al.  Parallel time integration with multigrid , 2014 .

[16]  Charbel Farhat,et al.  Time‐decomposed parallel time‐integrators: theory and feasibility studies for fluid, structure, and fluid–structure applications , 2003 .

[17]  Kevin Carlberg,et al.  Decreasing the temporal complexity for nonlinear, implicit reduced-order models by forecasting , 2012, 1209.5455.

[18]  ParabolicProblemsMartin J. Gander Overlapping Schwarz for Parabolic Problems , 2007 .

[19]  Jürg Nievergelt,et al.  Parallel methods for integrating ordinary differential equations , 1964, CACM.

[20]  W. Miranker,et al.  Parallel methods for the numerical integration of ordinary differential equations , 1967 .

[21]  Y Maday,et al.  Parallel-in-time molecular-dynamics simulations. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  Adel Blouza,et al.  PARALLEL IN TIME ALGORITHMS WITH REDUCTION METHODS FOR SOLVING CHEMICAL KINETICS , 2010 .

[23]  Charbel Farhat,et al.  A time‐parallel implicit method for accelerating the solution of non‐linear structural dynamics problems , 2009 .

[24]  Patrick H. Worley,et al.  Parallelizing Across Time When Solving Time-Dependent Partial Differential Equations , 1991, PPSC.

[25]  Michael L. Minion,et al.  TOWARD AN EFFICIENT PARALLEL IN TIME METHOD FOR PARTIAL DIFFERENTIAL EQUATIONS , 2012 .

[26]  Michael L. Minion,et al.  A HYBRID PARAREAL SPECTRAL DEFERRED CORRECTIONS METHOD , 2010 .

[27]  Alexander Ostermann,et al.  Multi-grid dynamic iteration for parabolic equations , 1987 .

[28]  Martin J. Gander,et al.  Analysis of the Parareal Time-Parallel Time-Integration Method , 2007, SIAM J. Sci. Comput..

[29]  Charbel Farhat,et al.  The GNAT method for nonlinear model reduction: Effective implementation and application to computational fluid dynamics and turbulent flows , 2012, J. Comput. Phys..

[30]  Yvon Maday Parareal in time algorithm for kinetic systems based on model reduction , 2007 .

[31]  David E. Worley A time-stepping algorithm for parallel computers , 1990 .

[32]  S. Vandewalle Parallel multigrid waveform relaxation for parabolic problems , 1993 .

[33]  Yvon Maday,et al.  Parallel in time algorithms for quantum control: Parareal time discretization scheme , 2003 .

[34]  Michal Rewienski,et al.  A trajectory piecewise-linear approach to model order reduction of nonlinear dynamical systems , 2003 .

[35]  Graham Horton,et al.  A Space-Time Multigrid Method for Parabolic Partial Differential Equations , 1995, SIAM J. Sci. Comput..

[36]  David E Womble A Time-Stepping Algorithm for Parallel Computers , 1990, SIAM J. Sci. Comput..

[37]  Charbel Farhat,et al.  Time‐parallel implicit integrators for the near‐real‐time prediction of linear structural dynamic responses , 2006 .

[38]  Rolf Krause,et al.  Explicit Parallel-in-time Integration of a Linear Acoustic-Advection System , 2012, ArXiv.

[39]  David Guibert,et al.  Adaptive Parareal for Systems of ODEs , 2007 .

[40]  Allan S. Nielsen Feasibility study of the parareal algorithm , 2012 .

[41]  Harbir Antil,et al.  Galerkin v. least-squares Petrov-Galerkin projection in nonlinear model reduction , 2015, J. Comput. Phys..

[42]  Dongwoo Sheen,et al.  A parallel method for time discretization of parabolic equations based on Laplace transformation and quadrature , 2003 .

[43]  Yvon Maday,et al.  Parallelization in time through tensor-product space–time solvers , 2008 .

[44]  Wolfgang Hackbusch,et al.  Parabolic multi-grid methods , 1985 .

[45]  C. Farhat,et al.  Efficient non‐linear model reduction via a least‐squares Petrov–Galerkin projection and compressive tensor approximations , 2011 .

[46]  N. Nguyen,et al.  An ‘empirical interpolation’ method: application to efficient reduced-basis discretization of partial differential equations , 2004 .

[47]  J. G. Verwer,et al.  Boundary value techniques for initial value problems in ordinary differential equations , 1983 .

[48]  Martin J. Gander,et al.  50 Years of Time Parallel Time Integration , 2015 .