Modified Parareal Algorithm for Solving Time-Dependent Differential Equations

Parallel algorithms are implemented to compute the solutions of partial differential equations and ordinary differential equations of complex dynamical systems to achieve near real-time solutions. One of the parallel algorithms widely implemented is the Parareal algorithm to solve time-dependent differential equations for various scientific applications. Parareal algorithm has shown promising speedups in achieving near real-time solutions using accelerators. However, it has been observed that the sequential predictorcorrector step of the Parareal algorithm impacts the computational performance. This paper analyses the Parareal algorithm and proposes modification to the predictor-corrector step of the Parareal algorithm to exploit data parallelism more and reduce the computation time. The modified algorithm is implemented to solve two systems of interdependent ODEs. The numerical accuracy and performance analysis of the modified algorithm is shown to be same as the original Parareal. The performance analysis of the modified algorithm on two accelerator computing architectures: Intel Xeon Phi CPU and Graphical processing units with OpenMP, OpenACC, and CUDA programming models are presented. The modified algorithm demonstrates performance improvement ranging from 1.2x-2x with respect to the original Parareal algorithm.

[1]  Yvon Maday,et al.  Parallel in time algorithms for quantum control: Parareal time discretization scheme , 2003 .

[2]  Y. Maday,et al.  A “Parareal” Time Discretization for Non-Linear PDE’s with Application to the Pricing of an American Put , 2002 .

[3]  Suresh Muknahallipatna,et al.  Performance Analysis of Accelerator Architectures and Programming Models for Parareal Algorithm Solutions of Ordinary Differential Equations , 2021 .

[4]  Giovanni Samaey,et al.  A Micro-Macro Parareal Algorithm: Application to Singularly Perturbed Ordinary Differential Equations , 2012, SIAM J. Sci. Comput..

[5]  Aleksandar D. Dimitrovski,et al.  Applying reduced generator models in the coarse solver of parareal in time parallel power system simulation , 2016, 2016 IEEE PES Innovative Smart Grid Technologies Conference Europe (ISGT-Europe).

[6]  Allan S. Nielsen.  Feasibility study of the parareal algorithm , 2012 .

[7]  Gurunath Gurrala,et al.  Parareal in Time for Dynamic Simulations of Power Systems , 2015 .

[8]  Liping He.  THE REDUCED BASIS TECHNIQUE AS A COARSE SOLVER FOR PARAREAL IN TIME SIMULATIONS , 2010 .

[9]  Charbel Farhat,et al.  Time‐decomposed parallel time‐integrators: theory and feasibility studies for fluid, structure, and fluid–structure applications , 2003 .

[10]  Colin B. Macdonald,et al.  Parallel High-Order Integrators , 2010, SIAM J. Sci. Comput..

[11]  Andrew G. Gerber,et al.  Acceleration of unsteady hydrodynamic simulations using the parareal algorithm , 2017, J. Comput. Sci..

[12]  Zakaria Belhachmi,et al.  A fully parallel in time and space algorithm for simulating the electrical activity of a neural tissue , 2016, Journal of Neuroscience Methods.

[13]  Suresh Muknahallipatna,et al.  Graphical Processing Unit Based Time-Parallel Numerical Method for Ordinary Differential Equations , 2020, Journal of Computer and Communications.

[14]  Robert D. Falgout,et al.  A Multigrid-in-Time Algorithm for Solving Evolution Equations in Parallel , 2012 .

[15]  Michael L. Minion,et al.  A HYBRID PARAREAL SPECTRAL DEFERRED CORRECTIONS METHOD , 2010 .

[16]  J. Lions,et al.  Résolution d'EDP par un schéma en temps « pararéel » , 2001 .