Shared memory NUMA programming on I-WAY

The performance of the Global Array shared-memory non-uniform memory-access programming model is explored on the I-WAY, wide-area network distributed supercomputer environment. The Global Array model is extended by introducing a concept of mirrored arrays. Latencies and bandwidths for remote memory access are studied, and the performance of a large application from computational chemistry is evaluated using both fully distributed and also mirrored arrays. Excellent performance can be obtained with mirroring if even modest (0.5 MB/s) network bandwidth is available.

[1]  Guy L. Steele,et al.  The High Performance Fortran Handbook , 1993 .

[2]  Robert J. Harrison,et al.  Portable tools and applications for parallel computers , 1991 .

[3]  Alan L. Cox,et al.  TreadMarks: shared memory computing on networks of workstations , 1996 .

[4]  Scott Pakin,et al.  High Performance Messaging on Workstations: Illinois Fast Messages (FM) for Myrinet , 1995, Proceedings of the IEEE/ACM SC95 Conference.

[5]  Robert J. Harrison,et al.  Global Arrays: a portable "shared-memory" programming model for distributed memory computers , 1994, Proceedings of Supercomputing '94.

[6]  Rick Stevens,et al.  Toward high‐performance computational chemistry: II. A scalable self‐consistent field program , 1996 .

[7]  David E. Bernholdt,et al.  Parallel computational chemistry made easier: The development of NWChem , 1995 .

[8]  Masato Oguchi,et al.  A proposal for a DSM architecture suitable for a widely distributed environment and its evaluation , 1995, Proceedings of the Fourth IEEE International Symposium on High Performance Distributed Computing.

[9]  Nicholas Carriero,et al.  Linda in context , 1989, CACM.

[10]  James C. French,et al.  Legion: The Next Logical Step Toward a Nationwide Virtual Computer , 1994 .

[11]  Warren Smith,et al.  Software infrastructure for the I-WAY high-performance distributed computing experiment , 1996, Proceedings of 5th IEEE International Symposium on High Performance Distributed Computing.

[12]  Robert J. Harrison,et al.  The global array programming model for high performance scientific computing , 1995 .