Self-Attention Fully Convolutional DenseNets for Automatic Salt Segmentation

3-D salt segmentation is important for many research topics spanning from exploration geophysics to structural geology. In seismic exploration, 3-D salt segmentation is directly related to the velocity modeling building that affects many processing steps, such as seismic migration and full waveform inversion. Manually picking the salt boundary becomes prohibitively time-consuming when the data size is too large. Here, we develop a highly generalized fully convolutional DenseNet for automatic salt segmentation. A squeeze-and-excitation network is used as a self-attention mechanism for guiding the proposed network to extract the most significant information related to the salt signals and discard the others. The proposed framework is a supervised technique and shows robust performance when applied to a new dataset using transfer learning and a small amount of training data. We test the robustness of the proposed framework on the Kaggle TGS salt segmentation dataset. To demonstrate the generalization ability of the framework, we further apply the trained model to an independent dataset synthesized from the 3-D SEAM model. We apply transfer learning to finely tune the trained model from the TGS dataset using only a small percentage of data from the 3-D SEAM dataset and obtain satisfactory results.

[1]  Yangkang Chen,et al.  A fully unsupervised and highly generalized deep learning approach for random noise suppression , 2021, Geophysical Prospecting.

[2]  Yangkang Chen,et al.  Statistics-Guided Dictionary Learning for Automatic Coherent Noise Suppression , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Liuqing Yang,et al.  Deep learning reservoir porosity prediction based on multilayer long short-term memory network , 2020 .

[4]  Yangkang Chen,et al.  Self-training and learning the waveform features of microseismic data using an adaptive dictionary , 2020 .

[5]  Wei Liu,et al.  Multi-channel convolutional neural network workflow for automatic salt interpretation , 2019, SEG Technical Program Expanded Abstracts 2019.

[6]  S. Fomel,et al.  SaltSeg: Automatic 3D salt segmentation using a deep convolutional neural network , 2019, Interpretation.

[7]  Min Bai,et al.  Automatic Waveform Classification and Arrival Picking Based on Convolutional Neural Network , 2019, Earth and Space Science.

[8]  Silvio Savarese,et al.  Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Yangkang Chen,et al.  Fast waveform detection for microseismic imaging using unsupervised machine learning , 2018 .

[10]  Yangkang Chen,et al.  Deep learning for seismic lithology prediction , 2018 .

[11]  Tao Zhao,et al.  Seismic facies classification using different deep convolutional neural networks , 2018, SEG Technical Program Expanded Abstracts 2018.

[12]  Wenlong Wang,et al.  Automatic Salt Detection with Machine Learning , 2018, 80th EAGE Conference and Exhibition 2018.

[13]  Gang Sun,et al.  Squeeze-and-Excitation Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  Denes Vigh,et al.  Deep learning prior models from seismic images for full-waveform inversion , 2017 .

[15]  Z. Koren,et al.  Wavefield separation via principle component analysis and deep learning in the local angle domain , 2017 .

[16]  Anne H. Schistad Solberg,et al.  Salt Classification Using Deep Learning , 2017 .

[17]  Vadim Sokolov,et al.  Deep Learning: A Bayesian Perspective , 2017, ArXiv.

[18]  David M. Cole,et al.  A comparison of popular neural network facies-classification schemes , 2017 .

[19]  Xishuang Dong,et al.  A scalable deep learning platform for identifying geologic features from seismic attributes , 2017 .

[20]  Tomaso Poggio,et al.  Automated fault detection without seismic processing , 2017 .

[21]  Yoshua Bengio,et al.  The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[22]  Xinming Wu Methods to compute salt likelihoods and extract salt boundaries from 3D seismic images , 2016 .

[23]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  German Larrazabal,et al.  Salt body detection from seismic data via sparse representation , 2016 .

[25]  Amin Asjad,et al.  A new approach for salt dome detection using a 3D multidirectional edge detector , 2015, Applied Geophysics.

[26]  Ghassan AlRegib,et al.  Noise-robust detection and tracking of salt domes in postmigrated volumes using texture, tensors, and subspace learning , 2015, 1812.11109.

[27]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[28]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[29]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[30]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[31]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[32]  Graham W. Taylor,et al.  Deconvolutional networks , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Michael Fehler,et al.  SEG Advanced Modeling (SEAM): Phase I first year update , 2008 .

[35]  Robert G. Clapp,et al.  Application of image segmentation to tracking 3D salt boundaries , 2007 .

[36]  X. Zhou,et al.  Enhanced Automatic Segmentation of Salt Bodies from Seismic Images Using Wavelet Convolutional Neural Networks , 2020 .

[37]  Amir Adler,et al.  Deep-learning tomography , 2018 .

[38]  Zhen Wang,et al.  Deep Convolutional Neural Networks for Seismic Salt-Body Delineation , 2018, 2018 AAPG Annual Convention & Exhibition.

[39]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..