THC-MP: High performance numerical simulation of reactive transport and multiphase flow in porous media

The numerical simulation of multiphase flow and reactive transport in the porous media on complex subsurface problem is a computationally intensive application. To meet the increasingly computational requirements, this paper presents a parallel computing method and architecture. Derived from TOUGHREACT that is a well-established code for simulating subsurface multi-phase flow and reactive transport problems, we developed a high performance computing THC-MP based on massive parallel computer, which extends greatly on the computational capability for the original code. The domain decomposition method was applied to the coupled numerical computing procedure in the THC-MP. We designed the distributed data structure, implemented the data initialization and exchange between the computing nodes and the core solving module using the hybrid parallel iterative and direct solver. Numerical accuracy of the THC-MP was verified through a CO2 injection-induced reactive transport problem by comparing the results obtained from the parallel computing and sequential computing (original code). Execution efficiency and code scalability were examined through field scale carbon sequestration applications on the multicore cluster. The results demonstrate successfully the enhanced performance using the THC-MP on parallel computing facilities. An efficient parallel version of TOUGHREACT computing package for the simulating reactive transport process was developed.Simulation of large scale problems for CO2 geological storage were performed on distributed memory computing facilities.Hybrid parallel linear solving design for the core numerical solving module was proposed.Implementation of the parallel computing significantly improves computing performance of the applications on large models.

[1]  Karsten Pruess,et al.  TOUGHREACT User's Guide: A Simulation Program for Non-isothermal Multiphase Reactive Geochemical Transport in Variably Saturated Geologic Media, V1.2.1 , 2008 .

[2]  Chin-Fu Tsang Introductory editorial to the special issue on the DECOVALEX-THMC project , 2009 .

[3]  S. Wang,et al.  Numerical simulation of multiphase flows of CO2 storage in saline aquifers in Daqingzijing oilfield, China , 2011, Clean Technologies and Environmental Policy.

[4]  C. Steefel,et al.  Reactive transport modeling: An essential tool and a new research approach for the Earth sciences , 2005 .

[5]  Wei Zhang,et al.  Long-term variations of CO2 trapped in different mechanisms in deep saline formations: A case study of the Songliao Basin, China , 2009 .

[6]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[7]  Eduardo F. D'Azevedo,et al.  HBGC123D: a high-performance computer model of coupled hydrogeological and biogeochemical processes , 2001 .

[8]  Junqi Huang,et al.  An assembly model for simulation of large-scale ground water flow and transport. , 2008, Ground water.

[9]  Fan Zhang,et al.  Application of a hybrid MPI/OpenMP approach for parallel groundwater model calibration using multi-core computers , 2010, Comput. Geosci..

[10]  Quanlin Zhou,et al.  Dynamic displacement and non-equilibrium dissolution of supercritical CO2 in low-permeability sandstone: An experimental study , 2013 .

[11]  Scott R. Charlton,et al.  PHAST Version 2?A Program for Simulating Groundwater Flow, Solute Transport, and Multicomponent Geochemical Reactions , 2014 .

[12]  Yu-Shu Wu,et al.  An efficient parallel-computing method for modeling nonisothermal multiphase flow and multicomponent transport in porous and fractured media , 2002 .

[13]  Jared D. McLaughlin Parallel Processing of Reactive Transport Models Using OpenMP , 2008 .

[14]  T. Narasimhan,et al.  AN INTEGRATED FINITE DIFFERENCE METHOD FOR ANALYZING FLUID FLOW IN POROUS MEDIA , 1976 .

[15]  Yanhua Shuai,et al.  Geochemical characterization of secondary microbial gas occurrence in the Songliao Basin, NE China , 2011 .

[16]  Brian McPherson,et al.  Impacts of hydrological heterogeneities on caprock mineral alteration and containment of CO2 in geological storage sites , 2014 .

[17]  William Gropp,et al.  Efficient Management of Parallelism in Object-Oriented Numerical Software Libraries , 1997, SciTools.

[18]  Yang Gou,et al.  Simulation of CO2 plume movement in multilayered saline formations through multilayer injection technology in the Ordos Basin, China , 2013, Environmental Earth Sciences.

[19]  Carl I. Steefel Reactive transport modeling of multicomponent cation exchange at the laboratory and field scale , 2004 .

[20]  Wenqing Wang,et al.  OpenGeoSys: an open-source initiative for numerical simulation of thermo-hydro-mechanical/chemical (THM/C) processes in porous media , 2012, Environmental Earth Sciences.

[21]  Gudmundur S. Bodvarsson,et al.  A modeling approach for analysis of coupled multiphase fluid flow, heat transfer, and deformation in fractured porous rock , 2002 .

[22]  K. Pruess,et al.  Numerical simulation of CO2 disposal by mineral trapping in deep aquifers , 2004 .

[23]  Karsten Pruess,et al.  ECO2N – A fluid property module for the TOUGH2 code for studies of CO2 storage in saline aquifers , 2007 .

[24]  Gour-Tsyh Yeh,et al.  A Model for Simulating Transport of Reactive Multispecies Components: Model Development and Demonstration , 1991 .

[25]  Karsten Pruess,et al.  TOUGH2_MP: A PARALLEL VERSION OF TOUGH2 , 2003 .

[26]  Erik Elmroth,et al.  High Performance Computations for Large Scale Simulations of Subsurface Multiphase Fluid and Heat Flow , 2004, The Journal of Supercomputing.

[27]  John N. Shadid,et al.  Parallel sparse matrix vector multiply software for matrices with data locality , 1998 .

[28]  Karsten Pruess,et al.  TOUGHREACT Version 2.0: A simulator for subsurface reactive transport under non-isothermal multiphase flow conditions , 2011, Comput. Geosci..

[29]  Karsten Pruess,et al.  The TOUGH Codes—A Family of Simulation Tools for Multiphase Flow and Transport Processes in Permeable Media , 2003 .

[30]  Chuan Lu,et al.  PFLOTRAN: Reactive Flow & Transport Code for Use on Laptops to Leadership-Class Supercomputers , 2012 .

[31]  Yu-Shu Wu,et al.  Parallel computing simulation of fluid flow in the unsaturated zone of Yucca Mountain, Nevada. , 2003, Journal of contaminant hydrology.

[32]  Huidong Yang,et al.  Genesis of authigene carbonate minerals in the Upper Cretaceous reservoir, Honggang Anticline, Songliao Basin: A natural analog for mineral trapping of natural CO2 storage , 2011 .

[33]  Hamdi A. Tchelepi,et al.  A fully-coupled flow-reactive-transport formulation based on element conservation, with application to CO2 storage simulations , 2012 .

[34]  Guomin Li,et al.  A Parallel PCG Solver for MODFLOW , 2009, Ground water.

[35]  Chuan Lu,et al.  Simulating subsurface flow and transport on ultrascale computers using PFLOTRAN , 2007 .

[36]  K. Pruess,et al.  MODELING MULTIPHASE NON-ISOTHERMAL FLUID FLOW AND REACTIVE GEOCHEMICAL TRANSPORT IN VARIABLY SATURATED FRACTURED ROCKS: 1. METHODOLOGY , 2001 .

[37]  Van Genuchten,et al.  A closed-form equation for predicting the hydraulic conductivity of unsaturated soils , 1980 .

[38]  Ming-Hsu Li,et al.  Numerical modeling of coupled fluid flow and thermal and reactive biogeochemical transport in porous and fractured media , 2010 .

[39]  Erik Elmroth On Grid Partitioning for a High-Performance Groundwater Simulation Software , 2000 .