Performance of parallel simulators on peta-scale platforms for coupled multi-physics modelling of CO2 geologic sequestration

Abstract Powerful numerical codes for modeling complex coupled processes of physics and chemistry have been developed for predicting the fate of CO 2 in reservoirs. However, they are often computationally demanding for solving highly non-linear models in sufficient spatial and temporal resolutions. In this study, two parallel simulators were implemented and optimized on two supercomputers with a thousand to tens of thousands of processors. The two simulators were: a parallel simulator of multi-phase flow TOUGH2-MP, and a parallelized in-house version of chemically reactive transport simulator TOUGHREACT. The optimization efforts including solver replacements were rewarded by twice to several tens of times speedup of calculations. The performance measurement confirmed that the simulators exhibit excellent scalability showing almost linear speedup up to more than 20,000 processors, and allow performing simulations at high resolutions with multi-million grids in a practical time. The paper is concluded with a demonstrative simulation of a highly non-linear process of dissolution-diffusion-convection that requires high spatial and temporal resolutions.

[1]  Kengo Nakajima Large-scale Simulations of 3D Groundwater Flow using Parallel Geometric Multigrid Method , 2013 .

[2]  Lincoln Paterson,et al.  Role of Convective Mixing in the Long-Term Storage of Carbon Dioxide in Deep Saline Formations , 2005 .

[3]  Kengo Nakajima Three-level hybrid vs. flat MPI on the Earth Simulator: parallel iterative solvers for finite-element method , 2005 .

[4]  Kengo Nakajima,et al.  Numerical Simulation of Long-Term Fate of CO2 Stored in Deep Reservoir Rocks on Massively Parallel Vector Supercomputer , 2012, VECPAR.

[5]  G E Hammond,et al.  Evaluating the performance of parallel subsurface simulators: An illustrative example with PFLOTRAN , 2014, Water resources research.

[6]  Karsten Pruess,et al.  TOUGHREACT User's Guide: A Simulation Program for Non-isothermal Multiphase Reactive geochemical Transport in Variable Saturated Geologic Media , 2004 .

[7]  Hajime Yamamoto,et al.  Investigation of gridding effects for numerical simulations of CO2 geologic sequestration , 2011 .

[8]  Karsten Pruess,et al.  Numerical modeling of injection and mineral trapping of CO2 with H2S and SO2 in a Sandstone Formation , 2007 .

[9]  Martin J. Blunt,et al.  Design of carbon dioxide storage in aquifers , 2009 .

[10]  Michael Andrew Christie,et al.  Tenth SPE Comparative Solution Project: a comparison of upscaling techniques , 2001 .

[11]  Kenzi Karasaki,et al.  Numerical investigation for the impact of CO2 geologic sequestration on regional groundwater flow , 2009 .

[12]  Pascal Audigane,et al.  CO2 injection modeling in large scale heterogeneous aquifers , 2011 .

[13]  K. Pruess ECO2N: A TOUGH2 Fluid Property Module for Mixtures of Water, NaCl, and CO2 , 2005 .