Well Log Generation via Ensemble Long Short‐Term Memory (EnLSTM) Network

In this study, we propose an ensemble long short-term memory (EnLSTM) network, which can be trained on a small dataset and process sequential data. The EnLSTM is built by combining the ensemble neural network (ENN) and the cascaded long short-term memory (C-LSTM) network to leverage their complementary strengths. In order to resolve the issues of over-convergence and disturbance compensation associated with training failure owing to the nature of small-data problems, model parameter perturbation and high-fidelity observation perturbation methods are introduced. The EnLSTM is compared with commonly-used models on a published dataset, and proven to be the state-of-the-art model in generating well logs with a mean-square-error (MSE) reduction of 34%. In the case study, 12 well logs that cannot be measured while drilling are generated based on logging-while-drilling (LWD) data. The EnLSTM is capable to reduce cost and save time in practice.

[1]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[2]  Massimiliano Pontil,et al.  Leave One Out Error, Stability, and Generalization of Voting Combinations of Classifiers , 2004, Machine Learning.

[3]  Eko Didik Widianto,et al.  Reservoir Characterization for site Selection in the Gundih CCS Project, Indonesia☆ , 2014 .

[4]  Dongxiao Zhang,et al.  Physics-Constrained Deep Learning of Geomechanical Logs , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Zhiqing Xu,et al.  Characteristics of the fault-related rocks, fault zones and the principal slip zone in the Wenchuan Earthquake Fault Scientific Drilling Project Hole-1 (WFSD-1) , 2013 .

[6]  Ning Liu,et al.  Inverse Theory for Petroleum Reservoir Characterization and History Matching , 2008 .

[7]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[8]  Dean S. Oliver,et al.  History Matching of Three-Phase Flow Production Data , 2001 .

[9]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[10]  Suman Jana,et al.  DeepTest: Automated Testing of Deep-Neural-Network-Driven Autonomous Cars , 2017, 2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE).

[11]  Xianhong Xie,et al.  A partitioned update scheme for state‐parameter estimation of distributed hydrologic models based on the ensemble Kalman filter , 2013 .

[12]  Bernard Widrow,et al.  Neural networks: applications in industry, business and science , 1994, CACM.

[13]  Hamidreza M. Nick,et al.  Heat recovery from multiple-fracture enhanced geothermal systems: The effect of thermoelastic fracture interactions , 2018, Renewable Energy.

[14]  Di Chai,et al.  Pseudo Density Log Generation Using Artificial Neural Network , 2016 .

[15]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[16]  Younghee Kim,et al.  Assessing whether the 2017 Mw 5.4 Pohang earthquake in South Korea was an induced event , 2018, Science.

[17]  Chaofeng Li,et al.  Identifying organic-rich Marcellus Shale lithofacies by support vector machine classifier in the Appalachian basin , 2014, Comput. Geosci..

[18]  Dongxiao Zhang,et al.  Synthetic well logs generation via Recurrent Neural Networks , 2018, Petroleum Exploration and Development.

[19]  Haibin Chang,et al.  Ensemble Neural Networks (ENN): A gradient-free stochastic method , 2019, Neural Networks.

[20]  S. Kostek,et al.  Sonic Compressional Measurements While Drilling , 1994 .

[21]  A. Reynolds,et al.  Iterative Forms of the Ensemble Kalman Filter , 2006 .

[22]  Richard D. Braatz,et al.  Standard representation and unified stability analysis for dynamic artificial neural network models , 2018, Neural Networks.

[23]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[24]  Ursula Iturrarán-Viveros,et al.  Artificial Neural Networks applied to estimate permeability, porosity and intrinsic attenuation using seismic attributes and well-log data , 2014 .

[25]  Salaheldin Elkatatny,et al.  New Computational Artificial Intelligence Models for Generating Synthetic Formation Bulk Density Logs While Drilling , 2020, Sustainability.

[26]  Seyedalireza Khatibi,et al.  Well Log Based Geomechanical and Petrophysical Analysis of the Bakken Formation , 2017 .

[27]  Roseane M. Misságia,et al.  Artificial neural networks to support petrographic classification of carbonate-siliciclastic rocks using well logs and textural information , 2015 .

[28]  U. Rajendra Acharya,et al.  Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals , 2017, Comput. Biol. Medicine.

[29]  You‐Kuan Zhang.  Stochastic Methods for Flow in Porous Media: Coping with Uncertainties , 2001 .

[30]  J. Schmittbuhl,et al.  Large scale hydro-thermal circulation in the deep geothermal reservoir of Soultz-sous-Forêts (France) , 2019, Geothermics.

[31]  Siddharth Misra,et al.  Generation of synthetic dielectric dispersion logs in organic-rich shale formations using neural-network models , 2019, GEOPHYSICS.

[32]  Upendra K. Singh,et al.  Fuzzy inference system for identification of geological stratigraphy off Prydz Bay, East Antarctica , 2011 .

[33]  D. Oliver,et al.  Levenberg–Marquardt forms of the iterative ensemble smoother for efficient history matching and uncertainty quantification , 2013, Computational Geosciences.

[34]  Kamel Baddari,et al.  Prediction of natural fracture porosity from well log data by means of fuzzy ranking and an artificial neural network in Hassi Messaoud oil field, Algeria , 2014 .

[35]  Jon Roberts,et al.  Synthetic Well Log Generation Using Machine Learning Techniques , 2018 .

[36]  Mehdi Rahmati,et al.  Estimation of the non records logs from existing logs using artificial neural networks , 2017 .

[37]  G. Beutler,et al.  Reservoir characterization of a CO2 storage aquifer: The Upper Triassic Stuttgart Formation in the Northeast German Basin , 2010 .

[38]  P. H. Nelson,et al.  Permeability Prediction From Well Logs Using Multiple Regression , 1986 .

[39]  Haibin Chang,et al.  Surrogate model based iterative ensemble smoother for subsurface flow data assimilation , 2017 .

[40]  Arman Melkumyan,et al.  Automated recognition of stratigraphic marker shales from geophysical logs in iron ore deposits , 2015, Comput. Geosci..