Compiler techniques for increasing CU/PE overlap in SIMD machines

Conceptually, an SIMD machine has the capability to overlap operation of the control unit (CU) with the operation of the processing elements (PEs). Computation of a single program is most efficient when the work load of the CU and the PEs is balanced. Load balancing between the CU and PEs is accomplished by migrating certain computations (e.g., PE-common array index calculations, loop index variable manipulation) from the PEs to the CU and vice versa. The goal of this research is to develop some of the techniques needed for the automatic specification of CU/PE overlap at compile time. As a proof of concept, the ELP compiler has been modified to support experimentation with CU/PE overlap.<<ETX>>

[1]  John R. Nickolls,et al.  The design of the MasPar MP-1: a cost effective massively parallel computer , 1990, Digest of Papers Compcon Spring '90. Thirty-Fifth IEEE Computer Society International Conference on Intellectual Leverage.

[2]  Howard Jay Siegel,et al.  Modeling Overlapped Operation between the Control Unit and Processing Elements in an SIMD Machine , 1991, J. Parallel Distributed Comput..

[3]  Howard Jay Siegel,et al.  Predicting Performance and Selecting Modes of Parallelism: A Case Study Using Cyclic Reduction on Three Parallel Machines , 1993, J. Parallel Distributed Comput..

[4]  Richard M. Brown,et al.  The ILLIAC IV Computer , 1968, IEEE Transactions on Computers.

[5]  L. W. Tucker,et al.  Architecture and applications of the Connection Machine , 1988, Computer.

[6]  T. Blank,et al.  A Grimm collection of MIMD fairy tales , 1992, [Proceedings 1992] The Fourth Symposium on the Frontiers of Massively Parallel Computation.

[7]  Tom Blank,et al.  The MasPar MP-1 architecture , 1990, Digest of Papers Compcon Spring '90. Thirty-Fifth IEEE Computer Society International Conference on Intellectual Leverage.

[8]  G. Jack Lipovski,et al.  Parallel computing - theory and comparisons , 1987 .

[9]  D. J. Hunt.  AMT DAP—a processor array in a workstation environment , 1989 .

[10]  Howard Jay Siegel,et al.  Data Management and Control-Flow Aspects of an SIMD/SPMD Parallel Language/Compiler , 1993, IEEE Trans. Parallel Distributed Syst..