Semi-Supervised Segmentation of Salt Bodies in Seismic Images using an Ensemble of Convolutional Neural Networks

Seismic image analysis plays a crucial role in a wide range of industrial applications and has been receiving significant attention. One of the essential challenges of seismic imaging is detecting subsurface salt structure which is indispensable for identification of hydrocarbon reservoirs and drill path planning. Unfortunately, exact identification of large salt deposits is notoriously difficult and professional seismic imaging often requires expert human interpretation of salt bodies. Convolutional neural networks (CNNs) have been successfully applied in many fields, and several attempts have been made in the field of seismic imaging. But the high cost of manual annotations by geophysics experts and scarce publicly available labeled datasets hinder the performance of the existing CNN-based methods. In this work, we propose a semi-supervised method for segmentation (delineation) of salt bodies in seismic images which utilizes unlabeled data for multi-round self-training. To reduce error amplification during self-training we propose a scheme which uses an ensemble of CNNs. We show that our approach outperforms state-of-the-art on the TGS Salt Identification Challenge dataset and is ranked the first among the 3234 competing methods.

[1]  Yu Zeng,et al.  Automatic Seismic Salt Interpretation with Deep Convolutional Neural Networks , 2018, ICISDM.

[2]  Panayiotis E. Pintelas,et al.  An Ensemble SSL Algorithm for Efficient Chest X-Ray Image Classification , 2018, J. Imaging.

[3]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Pengfei Xiong,et al.  Pyramid Attention Network for Semantic Segmentation , 2018, BMVC.

[5]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[6]  Vikram Jayaram,et al.  A comparison of classification techniques for seismic facies recognition , 2015 .

[7]  Gregory Shakhnarovich,et al.  Learning Representations for Automatic Colorization , 2016, ECCV.

[8]  Xinming Wu Methods to compute salt likelihoods and extract salt boundaries from 3D seismic images , 2016 .

[9]  Alexei A. Efros,et al.  Unsupervised Visual Representation Learning by Context Prediction , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[10]  Lizhe Wang,et al.  A semi-supervised generative framework with deep learning features for high-resolution remote sensing image scene classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[11]  Björn Ommer,et al.  CliqueCNN: Deep Unsupervised Exemplar Learning , 2016, NIPS.

[12]  Indranil Pan,et al.  Seismic facies analysis using machine learning , 2018, Geophysics.

[13]  Jian-Huang Lai,et al.  Deep Growing Learning , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Eldad Haber,et al.  Multi-resolution neural networks for tracking seismic horizons from few training images , 2018, Interpretation.

[15]  Tamir Hegazy,et al.  Texture Attributes for Detecting Salt Bodies in Seismic Data , 2014 .

[16]  David Yarowsky,et al.  Unsupervised Word Sense Disambiguation Rivaling Supervised Methods , 1995, ACL.

[17]  Ming-Hsuan Yang,et al.  Unsupervised Representation Learning by Sorting Sequences , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[18]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[19]  Matthew B. Blaschko,et al.  The Lovasz-Softmax Loss: A Tractable Surrogate for the Optimization of the Intersection-Over-Union Measure in Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[20]  Sotiris B. Kotsiantis,et al.  Self-Trained LMT for Semisupervised Learning , 2015, Comput. Intell. Neurosci..

[21]  Alexandr A. Kalinin,et al.  Albumentations: fast and flexible image augmentations , 2018, Inf..

[22]  Nassir Navab,et al.  Recalibrating Fully Convolutional Networks With Spatial and Channel “Squeeze and Excitation” Blocks , 2018, IEEE Transactions on Medical Imaging.

[23]  Anne H. Schistad Solberg,et al.  Convolutional neural networks for automated seismic interpretation , 2018, The Leading Edge.

[24]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Björn Ommer,et al.  Deep Unsupervised Similarity Learning Using Partially Ordered Sets , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Björn Ommer,et al.  Deep unsupervised learning of visual similarities , 2018, Pattern Recognit..

[27]  Ioannis E. Livieris A New Ensemble Self-labeled Semi-supervised Algorithm , 2019, Informatica.

[28]  Gregory Shakhnarovich,et al.  Self-Supervised Relative Depth Learning for Urban Scene Understanding , 2017, ECCV.

[29]  Paolo Favaro,et al.  Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles , 2016, ECCV.

[30]  Francisco Herrera,et al.  Self-labeled techniques for semi-supervised learning: taxonomy, software and empirical study , 2015, Knowledge and Information Systems.

[31]  Dong-Hyun Lee,et al.  Pseudo-Label : The Simple and Efficient Semi-Supervised Learning Method for Deep Neural Networks , 2013 .

[32]  Jee-Hyong Lee,et al.  Deep Neural Network Self-training Based on Unsupervised Learning and Dropout , 2017, Int. J. Fuzzy Log. Intell. Syst..

[33]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[34]  Jitendra Malik,et al.  Hypercolumns for object segmentation and fine-grained localization , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Alexei A. Efros,et al.  Context Encoders: Feature Learning by Inpainting , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  A. S. Eve APPLIED GEOPHYSICS. , 1928, Science.

[37]  Björn Ommer,et al.  Improving Spatiotemporal Self-Supervision by Deep Reinforcement Learning , 2018, ECCV.

[38]  Wenlong Wang,et al.  Automatic Salt Detection with Machine Learning , 2018, 80th EAGE Conference and Exhibition 2018.

[39]  Alexey Shvets,et al.  TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation , 2018, Computer-Aided Analysis of Gastrointestinal Videos.

[40]  Yide Wang,et al.  Progressive Semisupervised Learning of Multiple Classifiers , 2018, IEEE Transactions on Cybernetics.

[41]  Zhen Wang,et al.  Real-time seismic-image interpretation via deconvolutional neural network , 2018, SEG Technical Program Expanded Abstracts 2018.

[42]  Frank Hutter,et al.  SGDR: Stochastic Gradient Descent with Warm Restarts , 2016, ICLR.

[43]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[44]  M. Lüthje,et al.  Deep-learning seismic facies on state-of-the-art CNN architectures , 2018, SEG Technical Program Expanded Abstracts 2018.

[45]  Zhi-Hua Zhou,et al.  SETRED: Self-training with Editing , 2005, PAKDD.

[46]  Durga Toshniwal,et al.  SFA-GTM: Seismic Facies Analysis Based on Generative Topographic Map and RBF , 2018, ArXiv.

[47]  Mikhail Karchevskiy,et al.  Automatic salt deposits segmentation: A deep learning approach , 2018, ArXiv.

[48]  G. AlRegib,et al.  Multi-attribute k-means clustering for salt-boundary delineation from three-dimensional seismic data , 2018, Geophysical Journal International.

[49]  I. Jones,et al.  Seismic imaging in and around salt bodies , 2014 .

[50]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[51]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[52]  Ioannis Pitas,et al.  A texture-based approach to the segmentation of seismic images , 1992, Pattern Recognit..