InversionNet: An Efficient and Accurate Data-Driven Full Waveform Inversion

Full-waveform inversion problems are usually formulated as optimization problems, where the forward-wave propagation operator $f$ maps the subsurface velocity structures to seismic signals. The existing computational methods for solving full-waveform inversion are not only computationally expensive, but also yields low-resolution results because of the ill-posedness and cycle skipping issues of full-waveform inversion. To resolve those issues, we employ machine-learning techniques to solve the full-waveform inversion. Specifically, we focus on applying the convolutional neural network~(CNN) to directly derive the inversion operator $f^{-1}$ so that the velocity structure can be obtained without knowing the forward operator $f$. We build a convolutional neural network with an encoder-decoder structure to model the correspondence from seismic data to subsurface velocity structures. Furthermore, we employ the conditional random field~(CRF) on top of the CNN to generate structural predictions by modeling the interactions between different locations on the velocity model. Our numerical examples using synthetic seismic reflection data show that the propose CNN-CRF model significantly improve the accuracy of the velocity inversion while the computational time is reduced.

[1]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[2]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[3]  Denes Vigh,et al.  Deep learning prior models from seismic images for full-waveform inversion , 2017 .

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[6]  Jean Virieux,et al.  An overview of full-waveform inversion in exploration geophysics , 2009 .

[7]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[9]  Rob Fergus,et al.  Restoring an Image Taken through a Window Covered with Dirt or Rain , 2013, 2013 IEEE International Conference on Computer Vision.

[10]  Lianjie Huang,et al.  A wave-energy-based precondition approach to full-waveform inversion in the time domain , 2012 .

[11]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[12]  O. Ghattas,et al.  Algorithmic strategies for full waveform inversion: 1D experiments , 2009 .

[13]  Nicu Sebe,et al.  Multi-scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Aggelos K. Katsaggelos,et al.  Using Deep Neural Networks for Inverse Problems in Imaging: Beyond Analytical Methods , 2018, IEEE Signal Processing Magazine.

[15]  Rob Fergus,et al.  Depth Map Prediction from a Single Image using a Multi-Scale Deep Network , 2014, NIPS.

[16]  Zoran Obradovic,et al.  Continuous Conditional Random Fields for Regression in Remote Sensing , 2010, ECAI.

[17]  Peter M. Shearer,et al.  Introduction to Seismology: Preface to the second edition , 2009 .

[18]  Zhigang Zhang,et al.  Ultrasound waveform tomography with the total-variation regularization for detection of small breast tumors , 2012, Medical Imaging.

[19]  Winston Lewis,et al.  Regularization And Full-waveform Inversion: A Two-step Approach , 2010 .

[20]  Alan Richardson,et al.  Seismic Full-Waveform Inversion Using Deep Learning Tools and Techniques , 2018, 1801.07232.

[21]  David L. Alumbaugh,et al.  The use of predictive analytics for hydrocarbon exploration in the Denver-Julesburg Basin , 2017 .

[22]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[23]  Lianjie Huang,et al.  Ultrasound waveform tomography with a modified total-variation regularization scheme , 2013, Medical Imaging.

[24]  D. Vígh,et al.  Comparisons For Waveform Inversion, Time Domain Or Frequency Domain? , 2008 .

[25]  H. Sebastian Seung,et al.  Natural Image Denoising with Convolutional Networks , 2008, NIPS.

[26]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Guosheng Lin,et al.  Deep convolutional neural fields for depth estimation from a single image , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[29]  Yongdong Zhang,et al.  DR2-Net: Deep Residual Reconstruction Network for Image Compressive Sensing , 2017, Neurocomputing.

[30]  C. Bunks,et al.  Multiscale seismic waveform inversion , 1995 .

[31]  David,et al.  Randomization in Characterizing the Subsurface , 2018 .

[32]  Yann LeCun,et al.  Learning Fast Approximations of Sparse Coding , 2010, ICML.

[33]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[34]  Lianjie Huang,et al.  Double-difference elastic-waveform inversion with prior information for time-lapse monitoring , 2013 .

[35]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[36]  Vibhav Vineet,et al.  Conditional Random Fields as Recurrent Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[37]  Zoran Obradovic,et al.  Continuous Conditional Random Fields for Efficient Regression in Large Fully Connected Graphs , 2013, AAAI.

[38]  D. Hale,et al.  Quasi-Newton full-waveform inversion with a projected Hessian matrix , 2012 .

[39]  Jun Yu,et al.  Coupled Deep Autoencoder for Single Image Super-Resolution , 2017, IEEE Transactions on Cybernetics.

[40]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[41]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  A. Guitton Blocky regularization schemes for Full‐Waveform Inversion ★ , 2012 .

[43]  Rob Fergus,et al.  Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-scale Convolutional Architecture , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[44]  Alan L. Yuille,et al.  Towards unified depth and semantic prediction from a single image , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Kurt Hornik,et al.  Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks , 1990, Neural Networks.

[46]  M. McVay,et al.  Sinkhole detection using 2D full seismic waveform tomography , 2013 .

[47]  Shusen Wang,et al.  Towards real-time geologic feature detection from seismic measurements using a randomized machine-learning algorithm , 2017 .

[48]  A. Abubakar,et al.  Simultaneous multifrequency inversion of full-waveform seismic data , 2009 .

[49]  Yi Luo,et al.  Velocity Model Building From Waveform Tomography of Band Limited Reflection Seismic Data , 2013 .

[50]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[51]  D. Hale,et al.  Image-guided sparse-model full waveform inversion , 2012 .

[52]  Sunwoong Lee,et al.  Preconditioning Full Waveform Inversion With Phase-encoded Hessian , 2010 .