0.374 Pflop/s trillion-particle kinetic modeling of laser plasma interaction on roadrunner

We demonstrate the outstanding performance and scalability of the VPIC kinetic plasma modeling code on the heterogeneous IBM Roadrunner supercomputer at Los Alamos National Laboratory. VPIC is a three-dimensional, relativistic, electromagnetic, particle-in-cell (PIC) code that self-consistently evolves a kinetic plasma. VPIC simulations of laser plasma interaction were conducted at unprecedented fidelity and scale-up to 1.0 times 1012 particles on as many as 136 times 106 voxels-to model accurately the particle trapping physics occurring within a laser-driven hohlraum in an inertial confinement fusion experiment. During a parameter study of laser reflectivity as a function of laser intensity under experimentally realizable hohlraum conditions, we measured sustained performance exceeding 0.374 Pflop/s (s.p.) with the inner loop itself achieving 0.488 Pflop/s (s.p.). Given the increasing importance of data motion limitations, it is notable that this was measured in a PIC calculation-a technique that typically requires more data motion per computation than other techniques (such as dense matrix calculations, molecular dynamics N-body calculations and Monte-Carlo calculations) often used to demonstrate supercomputer performance. This capability opens up the exciting possibility of using VPIC to model, from first-principles, an issue critical to the success of the multi-billion dollar DOE/NNSA National Ignition Facility.

[1]  William Daughton,et al.  Nonlinear backward stimulated Raman scattering from electron beam acoustic modes in the kinetic regime , 2006 .

[2]  Federico D. Sacerdoti,et al.  Scalable Algorithms for Molecular Dynamics Simulations on Commodity Clusters , 2006, ACM/IEEE SC 2006 Conference (SC'06).

[3]  J. Cary,et al.  VORPAL: a versatile plasma simulation code , 2004 .

[4]  K. Bowers,et al.  Ultrahigh performance three-dimensional electromagnetic relativistic kinetic plasma simulationa) , 2008 .

[5]  Dan Winske,et al.  Modeling ion interpenetration, stagnation, and thermalization in colliding plasmas , 1996 .

[6]  John P. Verboncoeur,et al.  An object-oriented electromagnetic PIC code , 1995 .

[7]  Pavel M. Lushnikov,et al.  How much laser power can propagate through fusion plasma , 2005 .

[8]  C. Birdsall,et al.  Plasma Physics via Computer Simulation , 2018 .

[9]  K. Yee Numerical solution of initial boundary value problems involving maxwell's equations in isotropic media , 1966 .

[10]  H. Peter Hofstee,et al.  Introduction to the Cell multiprocessor , 2005, IBM J. Res. Dev..

[11]  D. S. Montgomery,et al.  Recent Trident single hot spot experiments: Evidence for kinetic effects, and observation of Langmuir decay instability cascade , 2002 .

[12]  A. B. Langdon,et al.  On the dominant and subdominant behavior of stimulated Raman and Brillouin scattering driven by nonuniform laser beams , 1998 .

[13]  K. Bowers,et al.  Saturation of backward stimulated scattering of a laser beam in the kinetic regime. , 2007, Physical review letters.

[14]  R. Higdon Absorbing boundary conditions for difference approximations to the multi-dimensional wave equation , 1986 .

[15]  Thomas J. T. Kwan,et al.  Methods of Monte Carlo electron transport in particle-in-cell codes , 1985 .

[16]  G. E. Sasser,et al.  3-D ICEPIC simulations of the relativistic klystron oscillator , 2000 .

[17]  B. M. Marder,et al.  A method for incorporating Gauss' lasw into electromagnetic pic codes , 1987 .

[18]  John D. Villasenor,et al.  Rigorous charge conservation for local electromagnetic field solvers , 1992 .

[19]  Kevin J. Bowers,et al.  Accelerating a paricle -in-cell simulation using a hybrid counting sort , 2001 .

[20]  R. W. Hockney,et al.  Body-fitted electromagnetic PIC software for use on parallel computers , 1995 .

[21]  Michael P Eastwood,et al.  A common, avoidable source of error in molecular dynamics integrators. , 2007, The Journal of chemical physics.

[22]  J. Dongarra,et al.  Exploiting the Performance of 32 bit Floating Point Arithmetic in Obtaining 64 bit Accuracy (Revisiting Iterative Refinement for Linear Systems) , 2006, ACM/IEEE SC 2006 Conference (SC'06).

[23]  William Daughton,et al.  Fully Kinetic 3D Simulations of Collisionless Reconnection in Large-Scale Pair Plasmas , 2007 .

[24]  L. Yin,et al.  Observation of a transition from fluid to kinetic nonlinearities for langmuir waves driven by stimulated Raman backscatter. , 2005, Physical review letters.

[25]  Edward I. Moses,et al.  Experiments and multiscale simulations of|[nbsp]|laser propagation through ignition-scale|[nbsp]|plasmas , 2007 .

[26]  R W Hockney,et al.  Computer Simulation Using Particles , 1966 .

[27]  William Daughton,et al.  Saturation of backward stimulated scattering of laser in kinetic regime: Wavefront bowing, trapped particle modulational instability, and trapped particle self-focusing of plasma waves , 2008 .

[28]  C. Labaune,et al.  Laser-driven fusion: Incoherent light on the road to ignition , 2007 .