Mixed CUDA、MPI and OpenMP in Three Mode Parallel Programming

Using CUDA + MPI + OpenMP parallel programming model of the three to achieve the coarse-grained parallelbetween nodes,node fine-grained parallelism as well as within the GPU as a parallel computing devices CUDA programming model.This new three parallel hybrid programming way SMP cluster provides a more efficient parallel strategy.This article discusses the three parallel programming environment to build fast and multi-granular hybrid parallel programmingmethod,and in a number of nodes in the cluster environment,the completion of testing.