Accelerating geostatistical modeling using geostatistics-informed machine Learning

Abstract Ordinary Kriging (OK) is a popular geostatistical algorithm for spatial interpolation and estimation. The computational complexity of OK changes quadratically and cubically for memory and speed, respectively, given the number of data. Therefore, it is computationally intensive and also challenging to process a large set of data, especially in three-dimensional (3D) cases. This paper develops a geostatistics-informed machine learning (GIML) model to improve the efficiency of OK by reducing the number of points required to be estimated using OK. Specifically, only a very few of the unknown points are estimated by OK to get the weights and estimations, which are used as the training dataset. Moreover, the governing equations of OK are used to guide our proposed machine learning to better reproduce the spatial distributions. Our results show that the proposed GIML can reduce the computational time of OK by at least one order of magnitude. The effectiveness of the GIML is evaluated and compared using a 2D case. Furthermore, we demonstrate its efficiency and robustness by considering a different number of training samples on various 3D simulation grids.

[1]  D. Grana,et al.  Petrophysical characterization of deep saline aquifers for CO2 storage using ensemble smoother and deep convolutional autoencoder , 2020 .

[2]  Francisco J. Jiménez-Hornero,et al.  Using general-purpose computing on graphics processing units (GPGPU) to accelerate the ordinary kriging algorithm , 2014, Comput. Geosci..

[3]  Heung-Il Suk,et al.  Deep Learning in Medical Image Analysis. , 2017, Annual review of biomedical engineering.

[4]  Peyman Mostaghimi,et al.  Digital Rock Segmentation for Petrophysical Analysis With Reduced User Bias Using Convolutional Neural Networks , 2020, Water Resources Research.

[5]  Weichang Li,et al.  Seismic facies classification using supervised convolutional neural networks and semisupervised generative adversarial networks , 2020 .

[6]  Pejman Tahmasebi,et al.  Hybrid geological modeling: Combining machine learning and multiple-point statistics , 2020, Comput. Geosci..

[7]  N. Cressie,et al.  Statistics for Spatial Data. , 1992 .

[8]  Pejman Tahmasebi,et al.  Accelerating geostatistical simulations using graphics processing units (GPU) , 2012, Comput. Geosci..

[9]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[10]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[11]  M. Sahimi,et al.  Machine learning in geo- and environmental sciences: From small to large scale , 2020, Advances in Water Resources.

[12]  Muhammad Sahimi,et al.  Linking Morphology of Porous Media to Their Macroscopic Permeability by Deep Learning , 2020, Transport in Porous Media.

[13]  Peyman Mostaghimi,et al.  Boosting Resolution and Recovering Texture of 2D and 3D Micro‐CT Images with Deep Learning , 2019, Water Resources Research.

[14]  Clayton D. Scott,et al.  Robust kernel density estimation , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[15]  Pejman Tahmasebi,et al.  Segmentation of digital rock images using deep convolutional autoencoder networks , 2019, Comput. Geosci..

[16]  David W. S. Wong,et al.  An adaptive inverse-distance weighting spatial interpolation technique , 2008, Comput. Geosci..

[17]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..

[18]  Dan Cornford,et al.  Parallel Geostatistics for Sparse and Dense Datasets , 2010 .

[19]  A. Gelfand,et al.  Gaussian predictive process models for large spatial data sets , 2008, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[20]  Jacques Rivoirard,et al.  Continuity for Kriging with Moving Neighborhood , 2011 .

[21]  Lutz Prechelt,et al.  Early Stopping - But When? , 2012, Neural Networks: Tricks of the Trade.

[22]  M. Sahimi,et al.  Quantifying accuracy of stochastic methods of reconstructing complex materials by deep learning. , 2020, Physical review. E.

[23]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[24]  Louis J. Durlofsky,et al.  A deep-learning-based surrogate model for data assimilation in dynamic subsurface flow problems , 2019, J. Comput. Phys..

[25]  Timothy C. Coburn,et al.  Geostatistics for Natural Resources Evaluation , 2000, Technometrics.

[26]  Muhammad Sahimi,et al.  Enhancing images of shale formations by a hybrid stochastic and deep learning algorithm , 2019, Neural Networks.

[27]  D. Nychka,et al.  Covariance Tapering for Interpolation of Large Spatial Datasets , 2006 .

[28]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Jean-Paul Chilès,et al.  Fifty Years of Kriging , 2018 .

[30]  Martin J. Blunt,et al.  Reconstruction of three-dimensional porous media using generative adversarial neural networks , 2017, Physical review. E.

[31]  Pejman Tahmasebi,et al.  Image-based velocity estimation of rock using Convolutional Neural Networks , 2019, Neural Networks.

[32]  Anuj Karpatne,et al.  Physics-guided Neural Networks (PGNN): An Application in Lake Temperature Modeling , 2017, ArXiv.

[33]  Michael L. Stein,et al.  The screening effect in Kriging , 2002 .

[34]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[35]  N. Cressie,et al.  Fixed rank kriging for very large spatial data sets , 2008 .

[36]  Penelope A. Hancock,et al.  Spatial interpolation of large climate data sets using bivariate thin plate smoothing splines , 2006, Environ. Model. Softw..

[37]  George E. Karniadakis,et al.  Hidden Fluid Mechanics: A Navier-Stokes Informed Deep Learning Framework for Assimilating Flow Visualization Data , 2018, ArXiv.

[38]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[39]  Pejman Tahmasebi,et al.  Structural adjustment for accurate conditioning in large-scale subsurface systems , 2017 .

[40]  Tao Bai,et al.  Efficient and data-driven prediction of water breakthrough in subsurface systems using deep long short-term memory machine learning , 2020, Computational Geosciences.

[41]  M. Sahimi,et al.  Phase transitions, percolation, fracture of materials, and deep learning. , 2020, Physical review. E.

[42]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[43]  L. Durlofsky,et al.  Deep-learning-based surrogate model for reservoir simulation with time-varying well controls , 2020, Journal of Petroleum Science and Engineering.

[44]  Mingliang Liu,et al.  Time-lapse seismic history matching with an iterative ensemble smoother and deep convolutional autoencoder , 2020 .