Magnetohydrodynamic with Adaptively Embedded Particle-in-Cell model: MHD-AEPIC

Space plasma simulations have seen an increase in the use of magnetohydrodynamic (MHD) with embedded Particle-in-Cell (PIC) models. This combined MHD-EPIC algorithm simulates some regions of interest using the kinetic PIC method while employing the MHD description in the rest of the domain. The MHD models are highly efficient and their fluid descriptions are valid for most part of the computational domain, thus making large-scale global simulations feasible. However, in practical applications, the regions where the kinetic effects are critical can be changing, appearing, disappearing and moving in the computational domain. If a static PIC region is used, this requires a much larger PIC domain than actually needed, which can increase the computational cost dramatically. To address the problem, we have developed a new method that is able to dynamically change the region of the computational domain where a PIC model is applied. We have implemented this new MHD with Adaptively Embedded PIC (MHD-AEPIC) algorithm using the BATS-R-US Hall MHD and the Adaptive Mesh Particle Simulator (AMPS) as the semi-implicit PIC models. We describe the algorithm and present a test case of two merging flux ropes to demonstrate its accuracy. The implementation uses dynamic allocation/deallocation of memory and load balancing for efficient parallel execution. We evaluate the performance of MHD-AEPIC compared to MHDEPIC and the scaling properties of the model to large number of computational cores.

[1]  R. Grauer,et al.  Multiphysics Simulations of Collisionless Plasmas , 2018, Front. Phys..

[2]  Luc Mieussens,et al.  A multiscale kinetic-fluid solver with dynamic localization of kinetic effects , 2009, J. Comput. Phys..

[3]  K. McClements,et al.  Two-fluid simulations of driven reconnection in the Mega-Ampere Spherical Tokamak , 2013, 1308.2855.

[4]  V. Tenishev,et al.  A Global Kinetic Model for Cometary Comae: The Evolution of the Coma of the Rosetta Target Comet Churyumov-Gerasimenko throughout the Mission , 2008 .

[5]  William M. Farrell,et al.  AMITIS: A 3D GPU-Based Hybrid-PIC Model for Space and Plasma Physics , 2017 .

[6]  P. Browning.  Introduction to Plasma Physics: With Space and Laboratory Applications , 2005 .

[7]  Rony Keppens,et al.  Two-way coupling of magnetohydrodynamic simulations with embedded particle-in-cell simulations , 2017, Comput. Phys. Commun..

[8]  Quentin F. Stout,et al.  Adaptive numerical algorithms in space weather modeling , 2012, J. Comput. Phys..

[9]  Moulay D. Tidriri,et al.  Coupling Boltzmann and Navier-Stokes Equations by Friction , 1996 .

[10]  S. Markidis,et al.  Extended magnetohydrodynamics with embedded particle‐in‐cell simulation of Ganymede's magnetosphere , 2014 .

[11]  Gábor Tóth,et al.  Gauss's Law satisfying Energy-Conserving Semi-Implicit Particle-in-Cell method , 2018, J. Comput. Phys..

[12]  V. Tenishev,et al.  Hot oxygen corona at Mars and the photochemical escape of oxygen: Improved description of the thermosphere, ionosphere, and exosphere , 2015 .

[13]  Axel Klar,et al.  An adaptive domain decomposition procedure for Boltzmann and Euler equations , 1998 .

[14]  Stefano Markidis,et al.  Scaling the Ion Inertial Length and Its Implications for Modeling Reconnection in Global Simulations , 2017 .

[15]  S. Markidis,et al.  Global Three‐Dimensional Simulation of Earth's Dayside Reconnection Using a Two‐Way Coupled Magnetohydrodynamics With Embedded Particle‐in‐Cell Model: Initial Results , 2017, 1704.03803.

[16]  J. Waite,et al.  An approach to numerical simulation of the gas distribution in the atmosphere of Enceladus , 2010 .

[17]  Florian Holderied,et al.  MHD-kinetic hybrid code based on structure-preserving finite elements with particles-in-cell , 2021, J. Comput. Phys..

[18]  Stefano Markidis,et al.  Two-way coupling of a global Hall magnetohydrodynamics model with a local implicit particle-in-cell model , 2014, J. Comput. Phys..

[19]  V. Tenishev,et al.  Kinetic modeling of sodium in the lunar exosphere , 2013 .

[20]  Zhaohui Huang,et al.  Large Scale GPU Accelerated PPMLR-MHD Simulations for Space Weather Forecast , 2016, 2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid).

[21]  Rainer Grauer,et al.  Coupled Vlasov and two-fluid codes on GPUs , 2014, J. Comput. Phys..

[22]  Giovanni Lapenta,et al.  Particle simulations of space weather , 2012, J. Comput. Phys..

[23]  K. Kormann,et al.  GEMPIC: geometric electromagnetic particle-in-cell methods , 2016, Journal of Plasma Physics.

[24]  C. Russell,et al.  Reconnection in the Martian Magnetotail: Hall‐MHD With Embedded Particle‐in‐Cell Simulations , 2018 .

[25]  Bhaskar Chaudhury,et al.  A Novel Implementation of 2D3V Particle-in-Cell (PIC) Algorithm for Kepler GPU Architecture , 2017, 2017 IEEE 24th International Conference on High Performance Computing (HiPC).

[26]  Erwin Laure,et al.  The Fluid-Kinetic Particle-in-Cell method for plasma simulations , 2013, J. Comput. Phys..

[27]  Tamas I. Gombosi,et al.  Hall magnetohydrodynamics on block-adaptive grids , 2008, J. Comput. Phys..

[28]  Giovanni Lapenta,et al.  Exactly energy conserving semi-implicit particle in cell formulation , 2016, J. Comput. Phys..

[29]  V. Tenishev,et al.  NUMERICAL SIMULATION OF DUST IN A COMETARY COMA: APPLICATION TO COMET 67P/CHURYUMOV-GERASIMENKO , 2011 .

[30]  C. Munz,et al.  Hyperbolic divergence cleaning for the MHD equations , 2002 .

[31]  Kanya Kusano,et al.  Multi-scale plasma simulation by the interlocking of magnetohydrodynamic model and particle-in-cell kinetic model , 2007, J. Comput. Phys..