Time-parallel solution of linear partial differential equations on the Intel Touchstone Delta supercomputer

The paper presents the implementation of a new class of massively parallel algorithms for solving certain time-dependent partial differential equations (PDEs) on massively parallel supercomputers. Such PDEs are usually solved numerically, by discretization in time and space, and by applying a time-stepping procedure to data and algorithms potentially parallelized in the spatial domain. In a radical departure from such a strictly sequential temporal paradigm, we have developed a concept of time-parallel algorithms, which allows the marching in time to be fully parallelized. This is achieved by using a set of transformations based on eigenvalue-eigenvector decomposition of the matrices involved in the discrete formalism. Our time-parallel algorithms possess a highly decoupled structure, and can therefore be efficiently implemented on emerging, massively parallel, high-performance supercomputers, with a minimum of communication and synchronization overhead. We have successfully carried out a proof-of-concept demonstration of the basic ideas using a two-dimensional heat equation example implemented on the Intel Touchstone Delta supercomputer. Our results indicate that linear, and even superlinear, speed-up can be achieved and maintained for a very large number of processor nodes.

[1]  A. B. Rami Shani,et al.  Matrices: Methods and Applications , 1992 .

[2]  Alberto L. Sangiovanni-Vincentelli,et al.  The Waveform Relaxation Method for Time-Domain Analysis of Large Scale Integrated Circuits , 1982, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[3]  Amir Fijany Time Parallel Algorithms for Solution of Linear Parabolic PDEs , 1993, 1993 International Conference on Parallel Processing - ICPP'93.

[4]  J. Gillis,et al.  Matrix Iterative Analysis , 1961 .

[5]  Ralf Knirsch,et al.  A time-parallel multigrid-extrapolation method for parabolic partial differential equations , 1992, Parallel Comput..

[6]  Harold S. Stone,et al.  A Parallel Algorithm for the Efficient Solution of a General Class of Recurrence Equations , 1973, IEEE Transactions on Computers.

[7]  Amir Fijany,et al.  Fast Time and Space Parallel Algorithms for Solution of Parabolic Partial Differential Equations , 1993 .

[8]  A. Zinober Matrices: Methods and Applications , 1992 .

[9]  Garry H. Rodrigue,et al.  Preconditioned Time-Differencing For the Parallel Solution of the Heat Equation , 1989, PPSC.

[10]  Joel H. Saltz,et al.  Towards developing robust algorithms for solving partial differential equations on MIMD machines , 1988, Parallel Comput..

[11]  J. M. Coulson,et al.  Heat Transfer , 2018, Finite Element Method for Solids and Structures.

[12]  David E. Worley A time-stepping algorithm for parallel computers , 1990 .

[13]  Stefan Vandewalle,et al.  Efficient Parallel Algorithms for Solving Initial-Boundary Value and Time-Periodic Parabolic Partial Differential Equations , 1992, SIAM J. Sci. Comput..

[14]  Marián Slodička Parabolic partial differential equations with memory , 1984 .

[15]  David E Womble A Time-Stepping Algorithm for Parallel Computers , 1990, SIAM J. Sci. Comput..

[16]  Yousef Saad,et al.  On the parallel solution of parabolic equations , 1989, ICS '89.