ADDCNN: An Attention-Based Deep Dilated Convolutional Neural Network for Seismic Facies Analysis With Interpretable Spatial–Spectral Maps

With the dramatic growth and complexity of seismic data, manual seismic facies analysis has become a significant challenge. Machine learning and deep learning (DL) models have been widely adopted to assist geophysical interpretations in recent years. Although acceptable results can be obtained, the uninterpretable nature of DL (which also has a nickname “alchemy”) does not improve the geological or geophysical understandings on the relationships between the observations and background sciences. This article proposes a noble interpretable DL model based on 3-D (spatial–spectral) attention maps of seismic facies features. Besides regular data-augmentation techniques, the high-resolution spectral analysis technique is employed to generate multispectral seismic inputs. We propose a trainable soft attention mechanism-based deep dilated convolutional neural network (ADDCNN) to improve the automatic seismic facies analysis. Furthermore, the dilated convolution operation in the ADDCNN generates accurate and high-resolution results in an efficient way. With the attention mechanism, not only the facies-segmentation accuracy is improved but also the subtle relations between the geological depositions and the seismic spectral responses are revealed by the spatial–spectral attention maps. Experiments are conducted, where all major metrics, such as classification accuracy, computational efficiency, and optimization performance, are improved while the model complexity is reduced.

[1]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[2]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Fangyu Li,et al.  Seismic attribute selection for unsupervised seismic facies analysis using user guided data-adaptive weights , 2018 .

[4]  Yi Hong,et al.  CompNet: Complementary Segmentation Network for Brain MRI Extraction , 2018, MICCAI.

[5]  Yangkang Chen,et al.  Automatic microseismic event picking via unsupervised machine learning , 2020, Geophysical Journal International.

[6]  Loïc Le Folgoc,et al.  Attention U-Net: Learning Where to Look for the Pancreas , 2018, ArXiv.

[7]  Xu Zhou,et al.  Facies Identification Based on Multikernel Relevance Vector Machine , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Xishuang Dong,et al.  A scalable deep learning platform for identifying geologic features from seismic attributes , 2017 .

[9]  Jing Zhang,et al.  Characterizing a turbidite system in Canterbury Basin, New Zealand, using seismic attributes and distance-preserving self-organizing maps , 2016 .

[10]  Yangkang Chen,et al.  Fast waveform detection for microseismic imaging using unsupervised machine learning , 2018 .

[11]  Takashi Matsubara,et al.  Data Augmentation Using Random Image Cropping and Patching for Deep CNNs , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Fangyu Li,et al.  Constraining self-organizing map facies analysis with stratigraphy: An approach to increase the credibility in automatic seismic facies classification , 2017 .

[13]  Hao Wu,et al.  Semiautomatic first-arrival picking of microseismic events by using the pixel-wise convolutional image segmentation method , 2019, GEOPHYSICS.

[14]  Emmanuelle Gouillart,et al.  scikit-image: image processing in Python , 2014, PeerJ.

[15]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[16]  Wen-kai Lu,et al.  Supervised seismic facies analysis based on image segmentation , 2018 .

[17]  Paolo Ruffo,et al.  3D hydrocarbon migration by percolation technique in an alternate sand–shale environment described by a seismic facies classified volume , 2009 .

[18]  X. Janson,et al.  Improving three-dimensional high-order seismic-stratigraphic interpretation for reservoir model construction: An example of geostatistical and seismic forward modeling of Permian San Andres shelf–Grayburg platform mixed clastic–carbonate strata , 2019, AAPG Bulletin.

[19]  Philip H. S. Torr,et al.  Learn To Pay Attention , 2018, ICLR.

[20]  Licheng Jiao,et al.  CNN-Based Multilayer Spatial–Spectral Feature Fusion and Sample Augmentation With Local and Nonlocal Constraints for Hyperspectral Image Classification , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Jie Chen,et al.  Model Interpretation: A Unified Derivative-based Framework for Nonparametric Regression and Supervised Machine Learning , 2018, ArXiv.

[22]  Pierre Alliez,et al.  Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Bo Zhang,et al.  Brittleness evaluation of resource plays by integrating petrophysical and seismic data analysis , 2015 .

[24]  Kurt J. Marfurt,et al.  Spectral decomposition and spectral balancing of seismic data , 2016 .

[25]  Jose Clemente,et al.  ASIS: Autonomous Seismic Imaging System With In Situ Data Analytics and Renewable Energy , 2020, IEEE Systems Journal.

[26]  Fangyu Li,et al.  Coherence attribute at different spectral scales , 2014 .

[27]  Tao Zhao,et al.  Performance Evaluation of Complex Neural Networks in Reservoir Characterization: Applied to Boonsville 3-D Seismic Data , 2013 .

[28]  Thiab Taha,et al.  2D Multi-Spectral Convolutional Encoder-Decoder Model for Geobody Segmentation , 2018, 2018 International Conference on Computational Science and Computational Intelligence (CSCI).

[29]  S. Fomel,et al.  SaltSeg: Automatic 3D salt segmentation using a deep convolutional neural network , 2019, Interpretation.

[30]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[31]  Maarten V. de Hoop,et al.  Machine learning for data-driven discovery in solid Earth geoscience , 2019, Science.

[32]  Michaël Gharbi,et al.  Convolutional neural network for earthquake detection and location , 2017, Science Advances.

[33]  Min Bai,et al.  Automatic Waveform Classification and Arrival Picking Based on Convolutional Neural Network , 2019, Earth and Space Science.

[34]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[35]  Tao Zhao,et al.  Seismic facies classification using different deep convolutional neural networks , 2018, SEG Technical Program Expanded Abstracts 2018.

[36]  Liang Chen,et al.  Attention-Gated Networks for Improving Ultrasound Scan Plane Detection , 2018, MICCAI 2018.

[37]  Yue Wu,et al.  DeepDetect: A Cascaded Region-Based Densely Connected Network for Seismic Event Detection , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Quanshi Zhang,et al.  Visual interpretability for deep learning: a survey , 2018, Frontiers of Information Technology & Electronic Engineering.

[39]  Elizabeth A. Holm,et al.  In defense of the black box , 2019, Science.

[40]  Jianzhong Zhang,et al.  Synchrosqueezing S-Transform and Its Application in Seismic Spectral Decomposition , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Sergey Fomel,et al.  FaultNet3D: Predicting Fault Probabilities, Strikes, and Dips With a Single Convolutional Neural Network , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[43]  Liu Fangyu,et al.  Hydrocarbon detection for cavern carbonate reservoir using low-and-high-frequency anomalies in spectral decomposition , 2012 .

[44]  Bo Zhang,et al.  Depositional sequence characterization based on seismic variational mode decomposition , 2017 .

[45]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[46]  Vikram Jayaram,et al.  A comparison of classification techniques for seismic facies recognition , 2015 .

[47]  Bo Zhang,et al.  Improving Interpretability of Deep Neural Networks with Semantic Information , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Fangyu Li,et al.  Semisupervised multiattribute seismic facies analysis , 2016 .

[49]  Yangkang Chen,et al.  Deep learning for seismic lithology prediction , 2018 .

[50]  Yangkang Chen,et al.  Automatic high-resolution microseismic event detection via supervised machine learning , 2019, Geophysical Journal International.

[51]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[52]  Georg Fuchs,et al.  Pixel-Level Deep Segmentation: Artificial Intelligence Quantifies Muscle on Computed Tomography for Body Morphometric Analysis , 2017, Journal of Digital Imaging.

[53]  A. Abubakar,et al.  This is the title of an example SEG abstract using Microsoft Word 11-point bold type , 2018 .

[54]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Sergey Fomel,et al.  FaultSeg3D: Using synthetic data sets to train an end-to-end convolutional neural network for 3D seismic fault segmentation , 2019, GEOPHYSICS.

[56]  Guangmin Hu,et al.  Unsupervised seismic facies analysis via deep convolutional autoencoders , 2018 .

[57]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Arthur E. Barnes,et al.  Investigation of Methods For Unsupervised Classification of Seismic Data , 2002 .