Low-Synch Gram-Schmidt with Delayed Reorthogonalization for Krylov Solvers

The parallel strong-scaling of Krylov iterative methods is largely determined by the number of global reductions required at each iteration. The GMRES and Krylov-Schur algorithms compute the Arnoldi expansion for nonsymmetric matrices. The underlying algorithm is “left-looking” and processes one column at a time. Thus, at least one global reduction is required per iteration. The usual method for generating the orthogonal Krylov basis for the Krylov-Schur algorithm is classical Gram Schmidt applied twice (CGS2), requiring three global reductions per iteration. A new variant of CGS2 that requires only one reduction per iteration is applied to the Arnoldi-QR iteration. Strong-scaling results are presented for finding eigenvalue-pairs of nonsymmetric matrices. A preliminary attempt to derive a similar parallel method (one reduction per Arnoldi iteration with a robust orthogonalization scheme) was presented by Hernandez et al. [1]. Unlike our approach, their method is not forward stable for eigenvalues.