论文信息 - Maximizing Application Performance in a Multi-core, NUMA-Aware Compute Cluster by Multi-level Tuning

Maximizing Application Performance in a Multi-core, NUMA-Aware Compute Cluster by Multi-level Tuning

Achieving good application performance on a modern compute cluster of multi-core, multi-socket, NUMA-aware systems can be challenging. In this paper, we use VASP, a popular ab-initio quantum-mechanical MD simulation software, to investigate the various levels of the software, hardware, and network tuning that boosts performance on a Dell PowerEdge R815 HPC cluster with AMD “Interlagos” and “Abu-Dhabi” processors. We implement code changes with the free software stack that supports FMA and AVX CPU instructions on the Bulldozer/Piledriver architecture. We analyze the MPI communications by profiling, compare the scalability performance of different interconnects, and discuss various MPI tuning parameters show effects of the advanced features that are crucial to the scalability performance of InfiniBand, including MXM and SRQ, which optimize the network resources for MPI communications. We investigate the importance of the MPI process placement, and introduce a process allocation tool that facilitates the affinity grouping on a multicore architecture.

[1] G. Kresse,et al. Ab initio molecular dynamics for liquid metals. , 1993 .

[2] G. Kresse,et al. Efficiency of ab-initio total energy calculations for metals and semiconductors using a plane-wave basis set , 1996 .

[3] Hafner,et al. Ab initio molecular-dynamics simulation of the liquid-metal-amorphous-semiconductor transition in germanium. , 1994, Physical review. B, Condensed matter.

[4] Samuel Williams,et al. Performance Tuning of Scientific Applications , 2010 .

[5] Tong Liu,et al. The co-design architecture for exascale systems, a novel approach for scalable designs , 2012, Computer Science - Research and Development.

[6] Tong Liu,et al. The Impact of Inter-Node Latency versus Intra-Node Latency on HPC Applications , 2011 .

[7] Galen M. Shipman,et al. Infiniband scalability in Open MPI , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[8] Kresse,et al. Efficient iterative schemes for ab initio total-energy calculations using a plane-wave basis set. , 1996, Physical review. B, Condensed matter.