Experimental Study of Six Different Implementations of Parallel Matrix Multiplication on Heterogeneous Computational Clusters of Multicore Processors

Two strategies of distribution of computations can be used to implement parallel solvers for dense linear algebra problems for Heterogeneous Computational Clusters of Multicore Processors (HCoMs). These strategies are called Heterogeneous Process Distribution Strategy (HPS) and Heterogeneous Data Distribution Strategy (HDS). They are not novel and have been researched thoroughly. However, the advent of multicores necessitates enhancements to them. In this paper, we present these enhancements. Our study is based on experiments using six applications to perform Parallel Matrix-matrix Multiplication (PMM) on an HCoM employing the two distribution strategies.

[1]  Alexey L. Lastovetsky,et al.  On performance analysis of heterogeneous parallel algorithms , 2004, Parallel Comput..

[2]  Yves Robert,et al.  Matrix Multiplication on Heterogeneous Platforms , 2001, IEEE Trans. Parallel Distributed Syst..

[3]  Alexey L. Lastovetsky,et al.  Heterogeneous Distribution of Computations Solving Linear Algebra Problems on Networks of Heterogeneous Computers , 2001, J. Parallel Distributed Comput..

[4]  Alexey Lastovetsky,et al.  Experimental Study of Six Different Parallel Matrix-Matrix Multiplication Applications for Heterogeneous Computational Clusters of Multicore Processors , 2009 .

[5]  Alexey L. Lastovetsky,et al.  Parallel solvers for dense linear systems for heterogeneous computational clusters , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[6]  Alexey Lastovetsky,et al.  A parallel language and its programming system for heterogeneous networks , 2000 .

[7]  Alexey L. Lastovetsky.  Scientific Programming for Heterogeneous Systems - Bridging the Gap between Algorithms and Applications , 2006, International Symposium on Parallel Computing in Electrical Engineering (PARELEC'06).

[8]  Alexey L. Lastovetsky,et al.  Heterogeneous PBLAS: Optimization of PBLAS for Heterogeneous Computational Clusters , 2008, 2008 International Symposium on Parallel and Distributed Computing.

[9]  J. Dongarra,et al.  The Impact of Multicore on Computational Science Software , 2007 .

[10]  Alexey L. Lastovetsky,et al.  Adaptive parallel computing on heterogeneous networks with mpC , 2002, Parallel Comput..

[11]  Alexey L. Lastovetsky,et al.  HeteroMPI: Towards a message-passing library for heterogeneous networks of computers , 2006, J. Parallel Distributed Comput..

[12]  Alexey L. Lastovetsky,et al.  Scalable Dense Factorizations for Heterogeneous Computational Clusters , 2008, 2008 International Symposium on Parallel and Distributed Computing.

[13]  Alexey L. Lastovetsky,et al.  A parallel language and its programming system for heterogeneous networks , 2000, Concurr. Pract. Exp..