Toward scalable algorithms for orthogonal shared-memory parallel computers

The problem of developing scalable and near-optimal algorithms for orthogonal shared-memory multiprocessing systems with a multidimensional access (MDA) memory array is considered. An orthogonal shared-memory system consists of 2/sup n/ processors and 2/sup m/ memory modules accessed in any one of m possible access modes. Data stored in memory modules are available to processors under a mapping rule that allows conflict-free data reads and writes for any given access mode. Scalable algorithms are presented for two well-known computational problems, namely, matrix multiplication and the fast Fourier transform (FFT). A complete analysis of the algorithms based on computational time and the access modes needed is also presented. The algorithms scale very well onto higher dimensional MDA architectures but are not always optimal. This reveals a tradeoff between the scalability of an algorithm and its optimality in the MDA computational model.<<ETX>>

[1]  Yiming Ma,et al.  Analysis and Applications of the Orthogonal Access Multiprocessor , 1989, J. Parallel Distributed Comput..

[2]  Kai Hwang,et al.  Computer architecture and parallel processing , 1984, McGraw-Hill Series in computer organization and architecture.

[3]  Isaac D. Scherson,et al.  Definition and analysis of a class of spanning bus orthogonal multiprocessing systems , 1990, CSC '90.

[4]  Isaac D. Scherson,et al.  Orthogonal Graphs and the Analysis and Construction, of a Class of Multistage Interconnection Networks , 1990, ICPP.

[5]  Dharma P. Agrawal,et al.  Generalized Hypercube and Hyperbus Structures for a Computer Network , 1984, IEEE Transactions on Computers.

[6]  Kai Hwang,et al.  Generalization of orthogonal multiprocessor for massively parallel computation , 1988, Proceedings., 2nd Symposium on the Frontiers of Massively Parallel Computation.

[7]  Kenneth E. Batcher The Multidimensional Access Memory in STARAN , 1977, IEEE Transactions on Computers.

[8]  Kai Hwang,et al.  An Orthogonal Multiprocessor for Parallel Scientific Computations , 1989, IEEE Trans. Computers.