A Deep-Learning-Based Geological Parameterization for History Matching Complex Models

A new low-dimensional parameterization based on principal component analysis (PCA) and convolutional neural networks (CNN) is developed to represent complex geological models. The CNN–PCA method is inspired by recent developments in computer vision using deep learning. CNN–PCA can be viewed as a generalization of an existing optimization-based PCA (O-PCA) method. Both CNN–PCA and O-PCA entail post-processing a PCA model to better honor complex geological features. In CNN–PCA, rather than use a histogram-based regularization as in O-PCA, a new regularization involving a set of metrics for multipoint statistics is introduced. The metrics are based on summary statistics of the nonlinear filter responses of geological models to a pre-trained deep CNN. In addition, in the CNN–PCA formulation presented here, a convolutional neural network is trained as an explicit transform function that can post-process PCA models quickly. CNN–PCA is shown to provide both unconditional and conditional realizations that honor the geological features present in reference SGeMS geostatistical realizations for a binary channelized system. Flow statistics obtained through simulation of random CNN–PCA models closely match results for random SGeMS models for a demanding case in which O-PCA models lead to significant discrepancies. Results for history matching are also presented. In this assessment CNN–PCA is applied with derivative-free optimization, and a subspace randomized maximum likelihood method is used to provide multiple posterior models. Data assimilation and significant uncertainty reduction are achieved for existing wells, and physically reasonable predictions are also obtained for new wells. Finally, the CNN–PCA method is extended to a more complex nonstationary bimodal deltaic fan system, and is shown to provide high-quality realizations for this challenging example.

[1]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[2]  Ahmed H. Elsheikh,et al.  Parametrization and generation of geological models with generative adversarial networks , 2017, 1708.01810.

[3]  Alexandre Boucher,et al.  Applied Geostatistics with SGeMS: A User's Guide , 2009 .

[4]  Leon A. Gatys,et al.  Texture Synthesis Using Convolutional Neural Networks , 2015, NIPS.

[5]  Vivek K. Goyal,et al.  Compressed History Matching: Exploiting Transform-Domain Sparsity for Regularization of Nonlinear Dynamic Data Integration Problems , 2010 .

[6]  Sebastien Strebelle,et al.  Conditional Simulation of Complex Geological Structures Using Multiple-Point Statistics , 2002 .

[7]  Paul Switzer,et al.  Filter-Based Classification of Training Image Patterns for Spatial Simulation , 2006 .

[8]  Albert C. Reynolds,et al.  History matching with parametrization based on the SVD of a dimensionless sensitivity matrix , 2009 .

[9]  Dean S. Oliver,et al.  Multiple Realizations of the Permeability Field From Well Test Data , 1996 .

[10]  Eric Laloy,et al.  Training‐Image Based Geostatistical Inversion Using a Spatial Generative Adversarial Neural Network , 2017, ArXiv.

[11]  Leon A. Gatys,et al.  Image Style Transfer Using Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[13]  Roussos Dimitrakopoulos,et al.  High-order Statistics of Spatial Random Fields: Exploring Spatial Cumulants for Modeling Complex Non-Gaussian and Non-linear Phenomena , 2009 .

[14]  C. W. Harper,et al.  A FORTRAN IV program for comparing ranking algorithms in quantitative biostratigraphy , 1984 .

[15]  Marco Aurélio Cavalcanti Pacheco,et al.  History Matching Channelized Facies Models Using Ensemble Smoother With A Deep Learning Parameterization , 2018, ECMOR XVI - 16th European Conference on the Mathematics of Oil Recovery.

[16]  S. Weiland,et al.  Low-dimensional tensor representations for the estimation of petrophysical reservoir parameters , 2017 .

[17]  Christoph H. Arns,et al.  Porous Structure Reconstruction Using Convolutional Neural Networks , 2018, Mathematical Geosciences.

[18]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[19]  Dean S. Oliver,et al.  Reparameterization Techniques for Generating Reservoir Descriptions Conditioned to Variograms and Well-Test Pressure Data , 1996 .

[20]  Jing Ping,et al.  History matching of fracture distributions by ensemble Kalman filter combined with vector based level set parameterization , 2013 .

[21]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[22]  Salvatore Torquato,et al.  Two‐point cluster function for continuum percolation , 1988 .

[23]  Martin J. Blunt,et al.  Conditioning of three-dimensional generative adversarial networks for pore and reservoir-scale models , 2018, ArXiv.

[24]  Eric Laloy,et al.  Inversion using a new low-dimensional representation of complex binary geological media based on a deep neural network , 2017, 1710.09196.

[25]  Louis J. Durlofsky,et al.  Regularized kernel PCA for the efficient parameterization of complex geological models , 2016, J. Comput. Phys..

[26]  Alexandre A. Emerick,et al.  Investigation on Principal Component Analysis Parameterizations for History Matching Channelized Facies Models with Ensemble-Based Data Assimilation , 2016, Mathematical Geosciences.

[27]  Haibin Chang,et al.  History matching of facies distribution with the EnKF and level set parameterization , 2010, J. Comput. Phys..

[28]  Roland N. Horne,et al.  A Multiresolution Approach to Reservoir Parameter Estimation Using Wavelet Analysis , 2000 .

[29]  P. Kitanidis Parameter Uncertainty in Estimation of Spatial Functions: Bayesian Analysis , 1986 .

[30]  Eulogio Pardo-Igúzquiza,et al.  CONNEC3D: a computer program for connectivity analysis of 3D random set models☆ , 2003 .

[31]  Behnam Jafarpour,et al.  A distance transform for continuous parameterization of discrete geologic facies for subsurface flow model calibration , 2017 .

[32]  Louis J. Durlofsky,et al.  Data assimilation and uncertainty assessment for complex geological models using a new PCA-based parameterization , 2015, Computational Geosciences.

[33]  Louis J. Durlofsky,et al.  Generalized Field-Development Optimization With Derivative-Free Procedures , 2014 .

[34]  Marco Aurélio Cavalcanti Pacheco,et al.  Integration of Ensemble Data Assimilation and Deep Learning for History Matching Facies Models , 2017 .

[35]  Lorenzo Torresani,et al.  Learning Spatiotemporal Features with 3D Convolutional Networks , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[36]  L. Durlofsky,et al.  Efficient real-time reservoir management using adjoint-based optimal control and model updating , 2006 .

[37]  L. Durlofsky,et al.  Kernel Principal Component Analysis for Efficient, Differentiable Parameterization of Multipoint Geostatistics , 2008 .

[38]  Ahmed H. Elsheikh,et al.  Parametric generation of conditional geological realizations using generative neural networks , 2018, Computational Geosciences.

[39]  T. Mukerji,et al.  Robust scheme for inversion of seismic and production data for reservoir facies modeling , 2009 .

[40]  Chaohui Chen,et al.  Assisted History Matching of Channelized Models by Use of Pluri-Principal-Component Analysis , 2016 .

[41]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[42]  Louis J. Durlofsky,et al.  A New Differentiable Parameterization Based on Principal Component Analysis for the Low-Dimensional Representation of Complex Geological Models , 2014, Mathematical Geosciences.

[43]  Léon Bottou,et al.  Wasserstein Generative Adversarial Networks , 2017, ICML.

[44]  D. Oliver,et al.  Conditioning Truncated Pluri-Gaussian Models to Facies Observations in Ensemble-Kalman-Based Data Assimilation , 2015, Mathematical Geosciences.

[45]  Richard Wilfred Rwechungura,et al.  Application of Particle Swarm Optimization for Parameter Estimation Integrating Production and Time Lapse Seismic Data , 2011 .

[46]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[47]  Martin J. Blunt,et al.  Reconstruction of three-dimensional porous media using generative adversarial neural networks , 2017, Physical review. E.