Can learning from natural image denoising be used for seismic data interpolation?

We propose a convolutional neural network (CNN) denoising based method for seismic data interpolation. It provides a simple and efficient way to break though the lack problem of geophysical training labels that are often required by deep learning methods. The new method consists of two steps: (1) Train a set of CNN denoisers from natural image clean-noisy pairs to learn denoising; (2) Integrate the trained CNN denoisers into project onto convex set (POCS) framework to perform seismic data interpolation. The method alleviates the demanding of seismic big data with similar features as applications of end-to-end deep learning on seismic data interpolation. Additionally, the proposed method is flexible for many cases of traces missing because missing cases are not involved in the training step, and thus it is of plug-and-play nature. These indicate the high generalizability of our approach and the reduction of the need of the problem-specific training. Primary results on synthetic and field data show promising interpolation performances of the presented CNN-POCS method in terms of signal-to-noise ratio, de-aliasing and weak-feature reconstruction, in comparison with traditional $f$-$x$ prediction filtering and curvelet transform based POCS methods.

[1]  Jianwei Ma,et al.  What can machine learning do for seismic data processing? An interpolation application , 2017 .

[2]  Gerlind Plonka-Hoch,et al.  The Curvelet Transform , 2010, IEEE Signal Processing Magazine.

[3]  Stephen Alwon,et al.  Generative adversarial networks in seismic data processing , 2018, SEG Technical Program Expanded Abstracts 2018.

[4]  Guochang Liu,et al.  Irregular seismic data reconstruction based on exponential threshold model of POCS method , 2010 .

[5]  Mauricio D. Sacchi,et al.  Interpolation and denoising of high-dimensional seismic data by learning a tight frame , 2015 .

[6]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Lynn Burroughs,et al.  Rank-Reduction-Based Trace Interpolation , 2010 .

[8]  Stanley Osher,et al.  Monte Carlo data-driven tight frame for seismic data recovery , 2016 .

[9]  R. Abma,et al.  3D interpolation of irregular data with a POCS algorithm , 2006 .

[10]  Donald Geman,et al.  Nonlinear image recovery with half-quadratic regularization , 1995, IEEE Trans. Image Process..

[11]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[12]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[14]  Xiaoqun Zhang,et al.  Image Reconstruction by Splitting Deep Learning Regularization from Iterative Inversion , 2018, MICCAI.

[15]  Mauricio D. Sacchi,et al.  A fast reduced-rank interpolation method for prestack seismic volumes that depend on four spatial dimensions , 2013 .

[16]  Benfeng Wang,et al.  Simultaneous seismic data interpolation and denoising with a new adaptive method based on dreamlet transform , 2015 .

[17]  Kede Ma,et al.  Waterloo Exploration Database: New Challenges for Image Quality Assessment Models. , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[18]  Jianwei Ma,et al.  Three-dimensional irregular seismic data reconstruction via low-rank matrix completion , 2013 .

[19]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[20]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[21]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[22]  Yangkang Chen,et al.  Deep learning for seismic lithology prediction , 2018 .

[23]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Jinghuai Gao,et al.  Curvelet-based POCS interpolation of nonuniformly sampled seismic records , 2012 .

[25]  Ning Zhang,et al.  Deep-learning-based seismic data interpolation: A preliminary result , 2019, GEOPHYSICS.

[26]  Karen O. Egiazarian,et al.  Image restoration by sparse 3D transform-domain collaborative filtering , 2008, Electronic Imaging.

[27]  Jean-Michel Morel,et al.  A Nonlocal Bayesian Image Denoising Algorithm , 2013, SIAM J. Imaging Sci..

[28]  Jianwei Ma,et al.  Deep learning for denoising , 2018 .

[29]  Wenlong Wang,et al.  Automatic Salt Detection with Machine Learning , 2018, 80th EAGE Conference and Exhibition 2018.

[30]  E. Candès,et al.  New tight frames of curvelets and optimal representations of objects with piecewise C2 singularities , 2004 .

[31]  Yangkang Chen,et al.  Dealiased Seismic Data Interpolation Using Seislet Transform With Low-Frequency Constraint , 2015, IEEE Geoscience and Remote Sensing Letters.

[32]  G. Plonka,et al.  Seismic data interpolation and denoising by learning a tensor tight frame , 2017 .

[33]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[34]  Jianwei Ma,et al.  Velocity model building with a modified fully convolutional network , 2018, SEG Technical Program Expanded Abstracts 2018.

[35]  Jianwei Ma,et al.  Seismic data restoration via data-driven tight frame , 2014 .

[36]  M. Jacobsen,et al.  Image Restoration , 2000 .

[37]  Xishuang Dong,et al.  A scalable deep learning platform for identifying geologic features from seismic attributes , 2017 .

[38]  Felix J. Herrmann,et al.  Non-parametric seismic data recovery with curvelet frames , 2008 .

[39]  Yu Geng,et al.  Dreamlet-based interpolation using POCS method , 2014 .

[40]  Mauricio D. Sacchi,et al.  Convergence improvement and noise attenuation considerations for beyond alias projection onto convex sets reconstruction , 2013 .

[41]  Mauricio D. Sacchi,et al.  f-x adaptive seismic-trace interpolation , 2009 .

[42]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[43]  Lei Zhang,et al.  Waterloo Exploration Database: New Challenges for Image Quality Assessment Models , 2017, IEEE Transactions on Image Processing.

[44]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[45]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[46]  Yang Liu,et al.  Seislet transform and seislet frame , 2010 .

[47]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[48]  Stanley H. Chan,et al.  Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications , 2016, IEEE Transactions on Computational Imaging.

[49]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  S. Spitz Seismic trace interpolation in the F-X domain , 1991 .

[51]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[52]  Yunjin Chen,et al.  Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Wangmeng Zuo,et al.  Learning Deep CNN Denoiser Prior for Image Restoration , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[54]  Xiaohan Chen,et al.  Plug-and-Play Methods Provably Converge with Properly Trained Denoisers , 2019, ICML.

[55]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[56]  Mauricio D. Sacchi,et al.  Beyond alias hierarchical scale curvelet interpolation of regularly and irregularly sampled seismic data , 2010 .

[57]  Lei Zhang,et al.  FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising , 2017, IEEE Transactions on Image Processing.

[58]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[59]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[60]  Ricardo Vilalta,et al.  Supervised Learning to Detect Salt Body , 2015 .