Data-Driven Seismic Waveform Inversion: A Study on the Robustness and Generalization

Full-waveform inversion is an important and widely used method to reconstruct subsurface velocity images. Waveform inversion is a typical nonlinear and ill-posed inverse problem. Existing physics-driven computational methods for solving waveform inversion suffer from the cycle-skipping and local-minima issues, and do not mention that solving waveform inversion is computationally expensive. In recent years, data-driven methods become a promising way to solve the waveform-inversion problem. However, most deep-learning frameworks suffer from the generalization and overfitting issue. In this article, we developed a real-time data-driven technique and we call it VelocityGAN, to reconstruct accurately the subsurface velocities. Our VelocityGAN is built on a generative adversarial network (GAN) and trained end to end to learn a mapping function from the raw seismic waveform data to the velocity image. Different from other encoder–decoder-based data-driven seismic waveform-inversion approaches, our VelocityGAN learns regularization from data and further imposes the regularization to the generator so that inversion accuracy is improved. We further develop a transfer-learning strategy based on VelocityGAN to alleviate the generalization issue. A series of experiments is conducted on the synthetic seismic reflection data to evaluate the effectiveness, efficiency, and generalization of VelocityGAN. We not only compare it with the existing physics-driven approaches and data-driven frameworks but also conduct several transfer-learning experiments. The experimental results show that VelocityGAN achieves the state-of-the-art performance among the baselines and can improve the generalization results to some extent.

[1]  Leon A. Gatys,et al.  A Neural Algorithm of Artistic Style , 2015, ArXiv.

[2]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Lianjie Huang,et al.  Acoustic- and elastic-waveform inversion using a modified total-variation regularization scheme , 2014 .

[4]  A. Abubakar,et al.  Simultaneous multifrequency inversion of full-waveform seismic data , 2009 .

[5]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  A. Fichtner Full Seismic Waveform Modelling and Inversion , 2011 .

[7]  L. Demanet,et al.  Low-frequency extrapolation with deep learning , 2018, SEG Technical Program Expanded Abstracts 2018.

[8]  Winston Lewis,et al.  Regularization And Full-waveform Inversion: A Two-step Approach , 2010 .

[9]  Aria Abubakar,et al.  Retrieving Low Wavenumber Information in FWI: An Overview of the Cycle-Skipping Phenomenon and Solutions , 2018, IEEE Signal Processing Magazine.

[10]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.

[11]  Jiri Matas,et al.  DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[12]  Jianwei Ma,et al.  Velocity model building with a modified fully convolutional network , 2018, SEG Technical Program Expanded Abstracts 2018.

[13]  Shusen Wang,et al.  Efficient Data-Driven Geologic Feature Detection from Pre-stack Seismic Measurements using Randomized Machine-Learning Algorithm , 2017, Geophysical Journal International.

[14]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  M. McVay,et al.  Sinkhole detection using 2D full seismic waveform tomography , 2013 .

[16]  Aggelos K. Katsaggelos,et al.  Using Deep Neural Networks for Inverse Problems in Imaging: Beyond Analytical Methods , 2018, IEEE Signal Processing Magazine.

[17]  Sirui Tan,et al.  An efficient finite-difference method with high-order accuracy in both time and space domains for modelling scalar-wave propagation , 2014 .

[18]  Mauricio D. Sacchi,et al.  Full Waveform Inversion with Total Variation Regularization , 2011 .

[19]  Jean Virieux,et al.  An overview of full-waveform inversion in exploration geophysics , 2009 .

[20]  Youzuo Lin,et al.  InversionNet: An Efficient and Accurate Data-Driven Full Waveform Inversion , 2018, IEEE Transactions on Computational Imaging.

[21]  D. Peter,et al.  Low-Frequency Data Extrapolation Using a Feed-Forward ANN , 2018, 80th EAGE Conference and Exhibition 2018.

[22]  Lianjie Huang,et al.  Quantifying subsurface geophysical properties changes using double-difference seismic-waveform inversion with a modified total-variation regularization scheme , 2015 .

[23]  A. Guitton Blocky regularization schemes for Full‐Waveform Inversion ★ , 2012 .

[24]  Yi Luo,et al.  Velocity Model Building From Waveform Tomography of Band Limited Reflection Seismic Data , 2013 .

[25]  Chao Yang,et al.  A Survey on Deep Transfer Learning , 2018, ICANN.

[26]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[27]  R. Plessix A review of the adjoint-state method for computing the gradient of a functional with geophysical applications , 2006 .

[28]  Monica Maceira,et al.  Double-difference traveltime tomography with edge-preserving regularization and a priori interfaces , 2015 .

[29]  Albert Tarantola,et al.  Inverse problem theory - and methods for model parameter estimation , 2004 .

[30]  Ming-Hsuan Yang,et al.  Learning a Discriminative Prior for Blind Image Deblurring , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[31]  Amir Adler,et al.  Deep-learning tomography , 2018 .

[32]  Jiebo Luo,et al.  Boundary-based Image Forgery Detection by Fast Shallow CNN , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[33]  Yongdong Zhang,et al.  DR2-Net: Deep Residual Reconstruction Network for Image Compressive Sensing , 2017, Neurocomputing.

[34]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[35]  Sunwoong Lee,et al.  Preconditioning Full Waveform Inversion With Phase-encoded Hessian , 2010 .

[36]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[37]  C. Bunks,et al.  Multiscale seismic waveform inversion , 1995 .

[38]  Wei Zhang,et al.  Unsplit complex frequency-shifted PML implementation using auxiliary differential equations for seismic wave modeling , 2010 .

[39]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[40]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[41]  Jonas Adler,et al.  Learned Primal-Dual Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[42]  Eran Treister,et al.  Full Waveform Inversion Guided by Travel Time Tomography , 2016, SIAM J. Sci. Comput..

[43]  Fabio Rocca,et al.  SEG/EAEG 3-D modeling project: 2nd update , 1994 .

[44]  Lianjie Huang,et al.  A wave-energy-based precondition approach to full-waveform inversion in the time domain , 2012 .

[45]  Rob Fergus,et al.  Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-scale Convolutional Architecture , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[46]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Alan Richardson,et al.  Seismic Full-Waveform Inversion Using Deep Learning Tools and Techniques , 2018, 1801.07232.

[48]  Rob Fergus,et al.  Depth Map Prediction from a Single Image using a Multi-Scale Deep Network , 2014, NIPS.

[49]  Bernt Schiele,et al.  Generative Adversarial Text to Image Synthesis , 2016, ICML.

[50]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[51]  D. Vígh,et al.  Comparisons For Waveform Inversion, Time Domain Or Frequency Domain? , 2008 .

[52]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[53]  D. Hale,et al.  Quasi-Newton full-waveform inversion with a projected Hessian matrix , 2012 .

[54]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[55]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[56]  D. Hale,et al.  Image-guided sparse-model full waveform inversion , 2012 .

[57]  Nagiza F. Samatova,et al.  Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data , 2016, IEEE Transactions on Knowledge and Data Engineering.

[58]  Thomas Pock,et al.  Learning a variational network for reconstruction of accelerated MRI data , 2017, Magnetic resonance in medicine.

[59]  O. Ghattas,et al.  Algorithmic strategies for full waveform inversion: 1D experiments , 2009 .

[60]  Ping Wang,et al.  Full-waveform inversion for salt: A coming of age , 2019, The Leading Edge.

[61]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[62]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[63]  Lianjie Huang,et al.  Double-difference elastic-waveform inversion with prior information for time-lapse monitoring , 2013 .

[64]  Jiebo Luo,et al.  How to Become Instagram Famous: Post Popularity Prediction with Dual-Attention , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[65]  Jianwei Ma,et al.  Deep-learning inversion: a next generation seismic velocity-model building method , 2019, GEOPHYSICS.

[66]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[67]  T. Leeuwen,et al.  Fast randomized full-waveform inversion with compressive sensing , 2012 .

[68]  Lianjie Huang,et al.  Building Subsurface Velocity Models with Sharp Interfaces Using Interface-Guided Seismic Full-Waveform Inversion , 2017, Pure and Applied Geophysics.

[69]  Jun Yu,et al.  Coupled Deep Autoencoder for Single Image Super-Resolution , 2017, IEEE Transactions on Cybernetics.