14.9 TFLOPS Three-Dimensional Fluid Simulation for Fusion Science with HPF on the Earth Simulator

We succeeded in getting 14.9 TFLOPS performance when running a plasma simulation code IMPACT-3D parallelized with High Performance Fortran on 512 nodes of the Earth Simulator. The theoretical peak performance of the 512 nodes is 32 TFLOPS, which means 45% of the peak performance was obtained with HPF.IMPACT-3D is an implosion analysis code using TVD scheme, which performs three-dimensional compressible and inviscid Eulerian fluid computation with the explicit 5-point stencil scheme for spatial differentiation and the fractional time step for time integration. The mesh size is 2048x2048x4096, and the third dimension was distributed for the parallelization. The HPF system used in the evaluation is HPF/ES, developed for the Earth Simulator by enhancing NEC HPF/SX V2 mainly in communication scalability. Shift communications were manually tuned to get best performance by using HPF/JA extensions, which was designed to give the users more control over sophisticated parallelization and communication optimizations.

[1]  Takao Mizuno,et al.  Parallelization Methods for Three-Dimensional Fluid Code using High Performance Fortran , 2003 .

[2]  Message P Forum,et al.  MPI: A Message-Passing Interface Standard , 1994 .

[3]  N. Miyanaga,et al.  Fast heating of ultrahigh-density plasma as a step towards laser fusion ignition , 2001, Nature.

[4]  Rice UniversityCORPORATE,et al.  High performance Fortran language specification , 1993 .

[5]  T. Mizuno,et al.  Compatibility comparison and performance evaluation for Japanese HPF compilers using scientific applications , 2002, Concurr. Comput. Pract. Exp..

[6]  Hiroshi Ohta,et al.  Techniques for compiling and implementing all NAS parallel benchmarks in HPF , 2002, Concurr. Comput. Pract. Exp..

[7]  Kenji Suehiro,et al.  Implementation and evaluation of HPF/SX V2 , 2002, Concurr. Comput. Pract. Exp..

[8]  Peter R. Jones,et al.  Implementation and Evaluation , 1995 .

[9]  K. Nishihara,et al.  Rayleigh--Taylor instability on the pusher--fuel contact surface of stagnating targets , 1990 .

[10]  Jong-Deok Choi,et al.  Global communication analysis and optimization , 1996, PLDI '96.

[11]  G. Roth,et al.  Compiling Stencils in High Performance Fortran , 1997, ACM/IEEE SC 1997 Conference (SC'97).

[12]  Nishihara,et al.  Three-dimensional Rayleigh-Taylor instability of spherical systems. , 1990, Physical review letters.

[13]  Ivan Catton,et al.  Three-dimensional Rayleigh-Taylor instability Part 2. Experiment , 1988, Journal of Fluid Mechanics.

[14]  Tatsuki Ogino.  Three‐dimensional global MHD simulation code for the Earth's magnetosphere using HPF/JA , 2002, Concurr. Comput. Pract. Exp..

[15]  Hiroshi Ohta,et al.  HPF/JA: extensions of High Performance Fortran for accelerating real‐world applications , 2002, Concurr. Comput. Pract. Exp..