Deep Convolutional Encoder‐Decoder Networks for Uncertainty Quantification of Dynamic Multiphase Flow in Heterogeneous Media

Surrogate strategies are used widely for uncertainty quantification of groundwater models in order to improve computational efficiency. However, their application to dynamic multiphase flow problems is hindered by the curse of dimensionality, the saturation discontinuity due to capillarity effects, and the time-dependence of the multi-output responses. In this paper, we propose a deep convolutional encoder-decoder neural network methodology to tackle these issues. The surrogate modeling task is transformed to an image-to-image regression strategy. This approach extracts high-level coarse features from the high-dimensional input permeability images using an encoder, and then refines the coarse features to provide the output pressure/saturation images through a decoder. A training strategy combining a regression loss and a segmentation loss is proposed in order to better approximate the discontinuous saturation field. To characterize the high-dimensional time-dependent outputs of the dynamic system, time is treated as an additional input to the network that is trained using pairs of input realizations and of the corresponding system outputs at a limited number of time instances. The proposed method is evaluated using a geological carbon storage process-based multiphase flow model with a 2500-dimensional stochastic permeability field. With a relatively small number of training data, the surrogate model is capable of accurately characterizing the spatio-temporal evolution of the pressure and discontinuous CO2 saturation fields and can be used efficiently to compute the statistics of the system responses.

[1]  Baskar Ganapathysubramanian,et al.  Sparse grid collocation schemes for stochastic natural convection problems , 2007, J. Comput. Phys..

[2]  Satish Karra,et al.  Efficient Monte Carlo With Graph-Based Subsurface Flow and Transport Models , 2018 .

[3]  P. Kitanidis Persistent questions of heterogeneity, uncertainty, and scale in subsurface flow and transport , 2015 .

[4]  Dongxiao Zhang,et al.  Probabilistic collocation method for flow in porous media: Comparisons with other stochastic methods , 2007 .

[5]  Katherine J. Evans,et al.  An efficient Bayesian data-worth analysis using a multilevel Monte Carlo method , 2018 .

[6]  D. Mallants,et al.  Efficient posterior exploration of a high‐dimensional groundwater model from two‐stage Markov chain Monte Carlo simulation and polynomial chaos expansion , 2013 .

[7]  Lingzao Zeng,et al.  An adaptive Gaussian process‐based method for efficient Bayesian experimental design in groundwater contaminant source identification problems , 2016 .

[8]  Heng Li,et al.  An efficient stochastic approach for flow in porous media via sparse polynomial chaos expansion constructed by feature selection , 2017 .

[9]  Guang Lin,et al.  An efficient, high-order probabilistic collocation method on sparse grids for three-dimensional flow and solute transport in randomly heterogeneous porous media , 2009 .

[10]  Ilias Bilionis,et al.  Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantification , 2018, J. Comput. Phys..

[11]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[12]  Xiang Ma,et al.  An adaptive hierarchical sparse grid collocation algorithm for the solution of stochastic differential equations , 2009, J. Comput. Phys..

[13]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Van Genuchten,et al.  A closed-form equation for predicting the hydraulic conductivity of unsaturated soils , 1980 .

[16]  Ahmed H. Elsheikh,et al.  A machine learning approach for efficient uncertainty quantification using multiscale methods , 2017, J. Comput. Phys..

[17]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[18]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[19]  Dongxiao Zhang,et al.  Probabilistic collocation method for strongly nonlinear problems: 1. Transform by location , 2013 .

[20]  Nicholas Zabaras,et al.  Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification , 2018, J. Comput. Phys..

[21]  Eric Darve,et al.  Smoothing‐based compressed state Kalman filter for joint state‐parameter estimation: Applications in reservoir characterization and CO2 storage monitoring , 2017 .

[22]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[23]  Dongxiao Zhang,et al.  Stochastic analysis of unsaturated flow with probabilistic collocation method , 2009 .

[24]  Ahmed H. Elsheikh,et al.  Parametrization and generation of geological models with generative adversarial networks , 2017, 1708.01810.

[25]  Ming Ye,et al.  An adaptive sparse‐grid high‐order stochastic collocation method for Bayesian inference in groundwater reactive transport modeling , 2013 .

[26]  Alberto Guadagnini,et al.  Convergence assessment of numerical Monte Carlo simulations in groundwater hydrology , 2004 .

[27]  Florian Müller,et al.  Probabilistic collocation and lagrangian sampling for advective tracer transport in randomly heterogeneous porous media , 2011 .

[28]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[29]  D. Crevillén-García,et al.  Gaussian process modelling for uncertainty quantification in convectively-enhanced dissolution processes in porous media , 2017 .

[30]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Benjamin Peherstorfer,et al.  Optimal Model Management for Multifidelity Monte Carlo Estimation , 2016, SIAM J. Sci. Comput..

[32]  C. Webster,et al.  An improved multilevel Monte Carlo method for estimating probability distribution functions in stochastic oil reservoir simulations , 2016 .

[33]  Curtis M. Oldenburg,et al.  CO 2 migration and pressure evolution in deep saline aquifers , 2015 .

[34]  Hamdi A. Tchelepi,et al.  A two-stage adaptive stochastic collocation method on nested sparse grids for multiphase flow in randomly heterogeneous porous media , 2017, J. Comput. Phys..

[35]  Bryan A. Tolson,et al.  Review of surrogate modeling in water resources , 2012 .

[36]  Abdullah Cihan,et al.  Pressure Buildup and Brine Migration During CO2 Storage in Multilayered Aquifers , 2012, Ground water.

[37]  Chaopeng Shen,et al.  A Transdisciplinary Review of Deep Learning Research and Its Relevance for Water Resources Scientists , 2017, Water Resources Research.

[38]  K. Pruess,et al.  TOUGH2 User's Guide Version 2 , 1999 .

[39]  Anthony J. Jakeman,et al.  A review of surrogate models and their application to groundwater modeling , 2015 .

[40]  Francesco Visin,et al.  A guide to convolution arithmetic for deep learning , 2016, ArXiv.

[41]  Eric Laloy,et al.  Inversion using a new low-dimensional representation of complex binary geological media based on a deep neural network , 2017, 1710.09196.

[42]  Sally M. Benson,et al.  Carbon Dioxide Capture and Storage , 2008 .

[43]  Dongxiao Zhang,et al.  Probabilistic collocation method for strongly nonlinear problems: 2. Transform by displacement , 2014 .

[44]  Dongbin Xiu,et al.  The Wiener-Askey Polynomial Chaos for Stochastic Differential Equations , 2002, SIAM J. Sci. Comput..

[45]  Y. Mualem A New Model for Predicting the Hydraulic Conductivity , 1976 .

[46]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[47]  K. Pruess ECO2N: A TOUGH2 Fluid Property Module for Mixtures of Water, NaCl, and CO2 , 2005 .

[48]  Guannan Zhang,et al.  A Taylor Expansion‐Based Adaptive Design Strategy for Global Surrogate Modeling With Applications in Groundwater Modeling , 2017 .

[49]  John Salvatier,et al.  Theano: A Python framework for fast computation of mathematical expressions , 2016, ArXiv.

[50]  Eric Laloy,et al.  Training‐Image Based Geostatistical Inversion Using a Spatial Generative Adversarial Neural Network , 2017, ArXiv.

[51]  Xiang Ma,et al.  An adaptive high-dimensional stochastic model representation technique for the solution of stochastic partial differential equations , 2010, J. Comput. Phys..

[52]  Cheng Chen,et al.  Efficient Bayesian experimental design for contaminant source identification , 2015, Water Resources Research.

[53]  M. Celia,et al.  Status of CO2 storage in deep saline aquifers with emphasis on modeling approaches and practical simulations , 2015 .

[54]  Liang Tian,et al.  Gaussian process emulators for quantifying uncertainty in CO2 spreading predictions in heterogeneous media , 2017, Comput. Geosci..

[55]  Dongxiao Zhang,et al.  An efficient, high-order perturbation approach for flow in random porous media via Karhunen-Loève and polynomial expansions , 2004 .

[56]  Dongbin Xiu,et al.  High-Order Collocation Methods for Differential Equations with Random Inputs , 2005, SIAM J. Sci. Comput..