RockGPT: reconstructing three-dimensional digital rocks from single two-dimensional slice with deep learning

Random reconstruction of three-dimensional (3D) digital rocks from two-dimensional (2D) slices is crucial for elucidating the microstructure of rocks and its effects on pore-scale flow in terms of numerical modeling, since massive samples are usually required to handle intrinsic uncertainties. Despite remarkable advances achieved by traditional process-based methods, statistical approaches and recently famous deep learning-based models, few works have focused on producing several kinds of rocks with one trained model and allowing the reconstructed samples to satisfy certain given properties, such as porosity. To fill this gap, we propose a new framework, named RockGPT, which is composed of VQ-VAE and conditional GPT, to synthesize 3D samples based on a single 2D slice from the perspective of video generation. The VQ-VAE is utilized to compress high-dimensional input video, i.e., the sequence of continuous rock slices, to discrete latent codes and reconstruct them. In order to obtain diverse reconstructions, the discrete latent codes are modeled using conditional GPT in an autoregressive manner, while incorporating conditional information from a given slice, rock type, and porosity. We conduct two experiments on five kinds of rocks, and the results demonstrate that RockGPT can produce different kinds of rocks with the same model, and the reconstructed samples can successfully meet certain specified porosities. In a broader sense, through leveraging the proposed conditioning scheme, RockGPT constitutes an effective way to build a general model to produce multiple kinds of rocks simultaneously that also satisfy user-defined properties.

[1]  David M. Loveless,et al.  Nanometer‐scale characterization of microscopic pores in shale kerogen by image analysis and pore‐scale modeling , 2013 .

[2]  Fan Zhang,et al.  Slice-to-voxel stochastic reconstructions on porous media with hybrid deep generative model , 2021 .

[3]  Colin Raffel,et al.  Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer , 2019, J. Mach. Learn. Res..

[4]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[5]  Pejman Tahmasebi,et al.  Multiple-point geostatistical modeling based on the cross-correlation functions , 2012, Computational Geosciences.

[6]  Johannes E. Schindelin,et al.  Fiji: an open-source platform for biological-image analysis , 2012, Nature Methods.

[7]  Anthony R. Kovscek,et al.  RockFlow: Fast Generation of Synthetic Source Rock Images Using Generative Flow Models , 2020, Energies.

[8]  Wing Kam Liu,et al.  Computational microstructure characterization and reconstruction: Review of the state-of-the-art techniques , 2018, Progress in Materials Science.

[9]  J. Quiblier A new three-dimensional modeling technique for studying porous media , 1984 .

[10]  Tim Salimans,et al.  Axial Attention in Multidimensional Transformers , 2019, ArXiv.

[11]  Deniz Ertas,et al.  Pore Architecture and Connectivity in Gas Shale , 2015 .

[12]  Pejman Tahmasebi,et al.  Enhancing multiple‐point geostatistical modeling: 2. Iterative simulation and multiple distance function , 2016 .

[13]  A. Safekordi,et al.  A multiple-point statistics algorithm for 3D pore space reconstruction from 2D images , 2011 .

[14]  Pierre M. Adler,et al.  Flow in simulated porous media , 1990 .

[15]  Yu Wu,et al.  Developing Real-Time Streaming Transformer Transducer for Speech Recognition on Large-Scale Dataset , 2020, ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Steve Kench,et al.  Generating three-dimensional structures from a two-dimensional slice with generative adversarial network-based dimensionality expansion , 2021, Nature Machine Intelligence.

[17]  Rudolf Hilfer,et al.  Continuum reconstruction of the pore scale microstructure for Fontainebleau sandstone , 2010 .

[18]  Pejman Tahmasebi,et al.  Enhancing multiple‐point geostatistical modeling: 1. Graph theory and pattern adjustment , 2016 .

[19]  Alec Radford,et al.  Improving Language Understanding by Generative Pre-Training , 2018 .

[20]  Pejman Tahmasebi,et al.  MS-CCSIM: Accelerating pattern-based geostatistical simulation of categorical variables using a multi-scale search in Fourier space , 2014, Comput. Geosci..

[21]  M. Sahimi,et al.  Three-Dimensional Stochastic Characterization of Shale SEM Images , 2015, Transport in Porous Media.

[22]  Ali Q. Raeini,et al.  Generalized network modeling: Network extraction as a coarse-scale discretization of the void space of porous media. , 2017, Physical review. E.

[23]  Dongxiao Zhang,et al.  Multiscale pore structure and its effect on gas transport in organic‐rich shale , 2017 .

[24]  Yang Jiao,et al.  Direct extraction of spatial correlation functions from limited x-ray tomography data for microstructural quantification , 2018, Materials Characterization.

[25]  Xianghui Xiao,et al.  An Integrated Method for Upscaling Pore-Network Characterization and Permeability Estimation: Example from the Mississippian Barnett Shale , 2015, Transport in Porous Media.

[26]  Xuanjing Huang,et al.  Mask Attention Networks: Rethinking and Strengthen Transformer , 2021, NAACL.

[27]  Martin J. Blunt,et al.  Coupled generative adversarial and auto-encoder neural networks to reconstruct three-dimensional multi-scale porous media , 2020 .

[28]  Geoffrey E. Hinton,et al.  Layer Normalization , 2016, ArXiv.

[29]  Martin J. Blunt,et al.  Reconstruction of three-dimensional porous media using generative adversarial neural networks , 2017, Physical review. E.

[30]  Ian J. Goodfellow,et al.  NIPS 2016 Tutorial: Generative Adversarial Networks , 2016, ArXiv.

[31]  Stefan Zaefferer,et al.  Anisotropic distribution of the micro residual stresses in lath martensite revealed by FIB ring-core milling technique , 2018 .

[32]  Jaakko Lehtinen,et al.  Progressive Growing of GANs for Improved Quality, Stability, and Variation , 2017, ICLR.

[33]  Nam Soo Kim,et al.  Reformer-TTS: Neural Speech Synthesis with Reformer Network , 2020, INTERSPEECH.

[34]  R. M. Srivastava,et al.  Multivariate Geostatistics: Beyond Bivariate Moments , 1993 .

[35]  Oriol Vinyals,et al.  Neural Discrete Representation Learning , 2017, NIPS.

[36]  Ilya Sutskever,et al.  Generating Long Sequences with Sparse Transformers , 2019, ArXiv.

[37]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[38]  Mark Chen,et al.  Generative Pretraining From Pixels , 2020, ICML.

[39]  Shiyu Chang,et al.  TransGAN: Two Transformers Can Make One Strong GAN , 2021, ArXiv.

[40]  Gábor Janiga,et al.  Calculation of the permeability in porous media using the Lattice Boltzmann method , 2016 .

[41]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[42]  S. Bakke,et al.  3-D Pore-Scale Modelling of Sandstones and Flow Simulations in the Pore Networks , 1997 .

[43]  Yang Li,et al.  An end-to-end three-dimensional reconstruction framework of porous media from a single two-dimensional image based on deep learning , 2020 .

[44]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[45]  Alex Graves,et al.  Conditional Image Generation with PixelCNN Decoders , 2016, NIPS.

[46]  Pieter Abbeel,et al.  VideoGPT: Video Generation using VQ-VAE and Transformers , 2021, ArXiv.

[47]  Nan You,et al.  3D Carbonate Digital Rock Reconstruction Using Progressive Growing GAN , 2021, Journal of Geophysical Research: Solid Earth.

[48]  XiaoHai He,et al.  Reconstruction of three-dimensional porous media from a single two-dimensional image using three-step sampling. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[49]  Sebastien Strebelle,et al.  Conditional Simulation of Complex Geological Structures Using Multiple-Point Statistics , 2002 .

[50]  Dongxiao Zhang,et al.  Digital Rock Reconstruction with User-Defined Properties Using Conditional Generative Adversarial Networks , 2022, Transport in Porous Media.

[51]  Georg Heigold,et al.  An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , 2021, ICLR.

[52]  M. Doube,et al.  BoneJ2 - refactoring established research software , 2021, Wellcome open research.