Accurate and Fast reconstruction of Porous Media from Extremely Limited Information Using Conditional Generative Adversarial Network

Porous media are ubiquitous in both nature and engineering applications. Therefore, their modeling and understanding is of vital importance. In contrast to direct acquisition of three-dimensional (3D) images of this type of medium, obtaining its subregion (s) such as 2D images or several small areas can be feasible. Therefore, reconstructing whole images from limited information is a primary technique in these types of cases. Given data in practice cannot generally be determined by users and may be incomplete or only partially informed, thus making existing reconstruction methods inaccurate or even ineffective. To overcome this shortcoming, in this study we propose a deep-learning-based framework for reconstructing full images from their much smaller subareas. In particular, conditional generative adversarial network is utilized to learn the mapping between the input (a partial image) and output (a full image). To ensure the reconstruction accuracy, two simple but effective objective functions are proposed and then coupled with the other two functions to jointly constrain the training procedure. Because of the inherent essence of this ill-posed problem, a Gaussian noise is introduced for producing reconstruction diversity, thus enabling the network to provide multiple candidate outputs. Our method is extensively tested on a variety of porous materials and validated by both visual inspection and quantitative comparison. It is shown to be accurate, stable, and even fast (∼0.08 s for a 128×128 image reconstruction). The proposed approach can be readily extended by, for example, incorporating user-defined conditional data and an arbitrary number of object functions into reconstruction, while being coupled with other reconstruction methods.

[1]  V V Mourzenko,et al.  Trace analysis for fracture networks with anisotropic orientations and heterogeneous distributions. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Chao Ren,et al.  CISRDCNN: Super-resolution of compressed images using deep convolutional neural networks , 2017, Neurocomputing.

[3]  Marina V Karsanina,et al.  Hierarchical Optimization: Fast and Robust Multiscale Stochastic Reconstructions with Rescaled Correlation Functions. , 2018, Physical review letters.

[4]  K. Moffett,et al.  Remote Sens , 2015 .

[5]  Ronaldo I. Borja,et al.  Quantifying the heterogeneity of shale through statistical combination of imaging across scales , 2017, Acta Geotechnica.

[6]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..

[7]  S. Torquato,et al.  Reconstructing random media , 1998 .

[8]  Clayton V. Deutsch,et al.  Multiple-Point Statistics for Training Image Selection , 2007 .

[9]  Pejman Tahmasebi,et al.  Image-based velocity estimation of rock using Convolutional Neural Networks , 2019, Neural Networks.

[10]  G. Vetrovec DES , 2021, Encyclopedia of Systems and Control.

[11]  Xiaohai He,et al.  Markov prior-based block-matching algorithm for superdimension reconstruction of porous media. , 2018, Physical review. E.

[12]  XiaoHai He,et al.  Reconstruction of three-dimensional porous media from a single two-dimensional image using three-step sampling. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Ahmed H. Elsheikh,et al.  Parametric generation of conditional geological realizations using generative neural networks , 2018, Computational Geosciences.

[14]  Xiaohai He,et al.  Single Image Super-Resolution via Adaptive Transform-Based Nonlocal Self-Similarity Modeling and Learning-Based Gradient Regularization , 2017, IEEE Transactions on Multimedia.

[15]  Yang Ju,et al.  3D numerical reconstruction of well-connected porous structure of rock using fractal algorithms , 2014 .

[16]  M. Blunt,et al.  Pore space reconstruction using multiple-point statistics , 2005 .

[17]  Eric Laloy,et al.  Training‐Image Based Geostatistical Inversion Using a Spatial Generative Adversarial Neural Network , 2017, ArXiv.

[18]  Xiaohai He,et al.  Super-dimension-based three-dimensional nonstationary porous medium reconstruction from single two-dimensional image , 2019, Journal of Petroleum Science and Engineering.

[19]  S. Torquato Random Heterogeneous Materials , 2002 .

[20]  Xiaohai He,et al.  Evaluating the morphological completeness of a training image. , 2017, Physical review. E.

[21]  Eric Laloy,et al.  Inversion using a new low-dimensional representation of complex binary geological media based on a deep neural network , 2017, 1710.09196.

[22]  Marcel Utz,et al.  Efficient reconstruction of multiphase morphologies from correlation functions. , 2001 .

[23]  Muhammad Sahimi,et al.  Flow and Transport in Porous Media and Fractured Rock: From Classical Methods to Modern Approaches , 1995 .

[24]  G. Mariéthoz,et al.  Reconstruction of Incomplete Data Sets or Images Using Direct Sampling , 2010 .

[25]  S. Torquato,et al.  Reconstructing random media. II. Three-dimensional media from two-dimensional cuts , 1998 .

[26]  Xiaohai He,et al.  Pattern density function for reconstruction of three-dimensional porous media from a single two-dimensional image. , 2016, Physical review. E.

[27]  Yang Jiao,et al.  Direct extraction of spatial correlation functions from limited x-ray tomography data for microstructural quantification , 2018, Materials Characterization.

[28]  Gregoire Mariethoz,et al.  The Direct Sampling method to perform multiple‐point geostatistical simulations , 2010 .

[29]  M. Sahimi,et al.  Three-Dimensional Stochastic Characterization of Shale SEM Images , 2015, Transport in Porous Media.

[30]  S. Torquato,et al.  Lineal-path function for random heterogeneous materials. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[31]  J. Thovert,et al.  Grain reconstruction of porous media: application to a low-porosity Fontainebleau sandstone. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[32]  Pejman Tahmasebi,et al.  Enhancing multiple‐point geostatistical modeling: 1. Graph theory and pattern adjustment , 2016 .

[33]  Aytekin Gel,et al.  Classification of particle height in a hopper bin from limited discharge data using convolutional neural network models , 2018, Powder Technology.

[34]  Zhibin Pan,et al.  Correlation-driven direct sampling method for geostatistical simulation and training image evaluation. , 2019, Physical review. E.

[35]  P. Stroeven,et al.  Local porosity analysis of pore structure in cement paste , 2005 .

[36]  Gisbert Schneider,et al.  Deep Learning in Drug Discovery , 2016, Molecular informatics.

[37]  Martin J. Blunt,et al.  Stochastic Reconstruction of an Oolitic Limestone by Generative Adversarial Networks , 2017, Transport in Porous Media.

[38]  W Chen,et al.  Characterization and reconstruction of 3D stochastic microstructures via supervised learning , 2016, Journal of microscopy.

[39]  Pejman Tahmasebi,et al.  HYPPS: A hybrid geostatistical modeling algorithm for subsurface modeling , 2017 .

[40]  Christoph H. Arns,et al.  Three-dimensional porous structure reconstruction based on structural local similarity via sparse representation on micro-computed-tomography images , 2018, Physical Review E.

[41]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[42]  M. Sahimi,et al.  Cross-correlation function for accurate reconstruction of heterogeneous media. , 2013, Physical Review Letters.

[43]  Wei Chen,et al.  Stochastic microstructure characterization and reconstruction via supervised learning , 2016 .

[44]  Truong Q. Nguyen,et al.  Enhanced Non-Local Total Variation Model and Multi-Directional Feature Prediction Prior for Single Image Super Resolution , 2019, IEEE Transactions on Image Processing.

[45]  Pejman Tahmasebi,et al.  Segmentation of digital rock images using deep convolutional autoencoder networks , 2019, Comput. Geosci..

[46]  Pierre M. Adler,et al.  Flow in simulated porous media , 1990 .

[47]  Heping Xie,et al.  3-D Reconstruction Method for Complex Pore Structures of Rocks Using a Small Number of 2-D X-Ray Computed Tomography Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Pejman Tahmasebi,et al.  Data mining and machine learning for identifying sweet spots in shale reservoirs , 2017, Expert Syst. Appl..

[49]  T. Tang,et al.  A pixel selection rule based on the number of different‐phase neighbours for the simulated annealing reconstruction of sandstone microstructure , 2009, Journal of microscopy.

[50]  Hilfer,et al.  Local-porosity theory for flow in porous media. , 1992, Physical review. B, Condensed matter.

[51]  Qizhi Teng,et al.  Improved multipoint statistics method for reconstructing three-dimensional porous media from a two-dimensional image via porosity matching. , 2018, Physical review. E.

[52]  Yang Jiao,et al.  Dynamic reconstruction of heterogeneous materials and microstructure evolution. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[53]  Martin J. Blunt,et al.  Reconstruction of three-dimensional porous media using generative adversarial neural networks , 2017, Physical review. E.

[54]  Max Yi Ren,et al.  Microstructure Representation and Reconstruction of Heterogeneous Materials via Deep Belief Network for Computational Material Design , 2016, ArXiv.

[55]  Pejman Tahmasebi,et al.  Reconstruction of three-dimensional porous media using a single thin section. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[56]  Grégoire Mariethoz,et al.  Improving in situ data acquisition using training images and a Bayesian mixture model , 2016, Comput. Geosci..

[57]  Dirk Mallants,et al.  Improving pattern reconstruction using directional correlation functions , 2014 .

[58]  Zhi Xu,et al.  Stable-phase method for hierarchical annealing in the reconstruction of porous media images. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[59]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[60]  V. A. Eremin,et al.  Degradation kinetics of LSM–YSZ cathode materials for SOFC , 2018 .

[61]  Tao Wu,et al.  Reconstruction of three-dimensional anisotropic media based on analysis of morphological completeness , 2019, Computational Materials Science.

[62]  S. Torquato,et al.  Random Heterogeneous Materials: Microstructure and Macroscopic Properties , 2005 .

[63]  Chao Ren,et al.  Dictionary optimization and constraint neighbor embedding-based dictionary mapping for superdimension reconstruction of porous media. , 2019, Physical review. E.

[64]  F. Stillinger,et al.  A superior descriptor of random textures and its predictive capacity , 2009, Proceedings of the National Academy of Sciences.

[65]  F. Stillinger,et al.  Modeling heterogeneous materials via two-point correlation functions. II. Algorithmic details and applications. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[66]  Pejman Tahmasebi,et al.  Enhancing multiple‐point geostatistical modeling: 2. Iterative simulation and multiple distance function , 2016 .

[67]  Qizhi Teng,et al.  Accelerating multi-point statistics reconstruction method for porous media via deep learning , 2018, Acta Materialia.

[68]  Yang Li,et al.  Reconstruction of three-dimensional heterogeneous media from a single two-dimensional section via co-occurrence correlation function , 2018 .

[69]  Kirill M. Gerke,et al.  Improving stochastic reconstructions by weighting correlation functions in an objective function , 2015 .

[70]  Gang Yang,et al.  Missing Information Reconstruction of Remote Sensing Data: A Technical Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[71]  Christoph H. Arns,et al.  Porous Structure Reconstruction Using Convolutional Neural Networks , 2018, Mathematical Geosciences.

[72]  Irina S. Dolinskaya,et al.  Incomplete information imputation in limited data environments with application to disaster response , 2018, Eur. J. Oper. Res..

[73]  Hao Liang,et al.  Accelerating simulation for the multiple-point statistics algorithm using vector quantization. , 2018, Physical review. E.

[74]  Marc Secanell,et al.  Stochastic reconstruction using multiple correlation functions with different-phase-neighbor-based pixel selection. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[75]  Wing Kam Liu,et al.  Computational microstructure characterization and reconstruction: Review of the state-of-the-art techniques , 2018, Progress in Materials Science.

[76]  Pierre M. Adler,et al.  Real Porous Media: Local Geometry and Macroscopic Properties , 1998 .

[77]  S. Torquato,et al.  Chord-length distribution function for two-phase random media. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[78]  B. M. Fulk MATH , 1992 .

[79]  Salvatore Torquato,et al.  Two‐point cluster function for continuum percolation , 1988 .

[80]  Daniel M. Tetzlaff,et al.  Stationarity Scores on Training Images for Multipoint Geostatistics , 2009 .

[81]  Yang Ju,et al.  Multi-thread parallel algorithm for reconstructing 3D large-scale porous structures , 2017, Comput. Geosci..