A lithological sequence classification method with well log via SVM-assisted bi-directional GRU-CRF neural network

ABSTRACT When available core samples are limited, logging data becomes important in the lithology classification. For different lithologies, the distribution of logging data usually overlap each other, which increases the solution multiplicity of a single spatial point. The modeling of lithologic sequences depending on the vertical spatial relationship can reduce this multiplicity. To improve the modeling ability of sequences, we propose a lithological sequence classification algorithm modeled by bi-directional Gated Recurrent Units and Conditional Random Field layer (Bi-GRU-CRF) referring the proposed Artificial Neural Networks and Hidden Markov Models (ANN-HMM) hybrid framework. However, due to the limited training data and the difference of lithologic sequences, unlike the point-based algorithms, the generalization performance of the sequence-based algorithms can be significantly reduced. For this problem, we concatenate the probability output vector of Support Vector Machine (SVM) with original data as input to Bi-GRU-CRF, and the overall structure is named SVM+Bi-GRU-CRF. In the cross-validation with field data, whenever the sequences of training and test dataset are similar or dissimilar, SVM+Bi-GRU-CRF can generally achieve the best results comparing with all point-based and other sequence-based algorithms. Furthermore, the applicable conditions of this algorithm are discussed in three aspects: the relationship between the algorithm and data, the function of each module, and the influence of step size parameters. This work is progressed in three designed experiments with two groups of comparative synthetic datasets, which are generated with Gaussian Mixture Models (GMMs). Finally, a convictive and comprehensive evaluation of SVM+Bi-GRU-CRF is given out.

[1]  Charles L. Karr,et al.  Determination of lithology from well logs using a neural network , 1992 .

[2]  Eric C. Grunsky,et al.  Predictive lithological mapping of Canada's North using Random Forest classification applied to geophysical and geochemical data , 2015, Comput. Geosci..

[3]  Andrew McCallum,et al.  An Introduction to Conditional Random Fields for Relational Learning , 2007 .

[4]  H. Omre,et al.  Inversion of well logs into facies accounting for spatial dependencies and convolution effects , 2015 .

[5]  Nam Pham,et al.  Missing well log prediction using convolutional long short-term memory network , 2020 .

[6]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[7]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[8]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[9]  Weon Shik Han,et al.  A novel data assimilation methodology for predicting lithology based on sequence labeling algorithms , 2014 .

[10]  Jiagen Hou,et al.  Lithology identification using well logs: A method by integrating artificial neural networks and sedimentary patterns , 2019, Journal of Petroleum Science and Engineering.

[11]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[12]  Runhai Feng,et al.  Lithofacies classification based on a hybrid system of artificial neural networks and hidden Markov models , 2020 .

[13]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[14]  I. D. Gates,et al.  On the Capability of Support Vector Machines to Classify Lithology from Well Logs , 2010 .

[15]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[16]  Mou Da Lithological identification of volcanic rocks from SVM well logging data:Case study in the eastern depression of Liaohe Basin , 2015 .

[17]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.