论文信息 - Exploiting the capabilities of modern GPUs for dense matrix computations

Exploiting the capabilities of modern GPUs for dense matrix computations

We present several algorithms to compute the solution of a linear system of equations on a graphics processor (GPU), as well as general techniques to improve their performance, such as padding and hybrid GPU‐CPU computation. We compare single and double precision performance of a modern GPU with unified architecture, and show how iterative refinement with mixed precision can be used to regain full accuracy in the solution of linear systems, exploiting the potential of the processor for single precision arithmetic. Experimental results on a GTX280 using CUBLAS 2.0, the implementation of BLAS for NVIDIA® GPUs with unified architecture, illustrate the performance of the different algorithms and techniques proposed. Copyright © 2009 John Wiley & Sons, Ltd.

[1] Robert A. van de Geijn,et al. FLAME: Formal Linear Algebra Methods Environment , 2001, TOMS.

[2] Robert A. van de Geijn,et al. The science of deriving dense linear algebra algorithms , 2005, TOMS.

[3] James Demmel,et al. Benchmarking GPUs to tune dense linear algebra , 2008, 2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis.

[4] David S. Watkins,et al. Fundamentals of matrix computations , 1991 .

[5] David S. Watkins,et al. Fundamentals of Matrix Computations: Watkins/Fundamentals of Matrix Computations , 2005 .

[6] Dinesh Manocha,et al. LU-GPU: Efficient Algorithms for Solving Dense Linear Systems on Graphics Hardware , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[7] Julien Langou,et al. Mixed Precision Iterative Refinement Techniques for the Solution of Dense Linear Systems , 2007, Int. J. High Perform. Comput. Appl..

[8] Rafael Mayo,et al. Solving Dense Linear Systems on Graphics Processors , 2008, Euro-Par.

[9] Rafael Mayo,et al. Attaining High Performance in General-Purpose Computations on Current Graphics Processors , 2008, VECPAR.

[10] Dianne P. O'Leary,et al. Cholesky decomposition and linear programming on a GPU , 2006 .

[11] Rafael Mayo,et al. Evaluation and tuning of the Level 3 CUBLAS for graphics processors , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.