Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loop

This paper investigates unsupervised learning of Full-Waveform Inversion (FWI), which has been widely used in geophysics to estimate subsurface velocity maps from seismic data. This problem is mathematically formulated by a second order partial differential equation (PDE), but is hard to solve. Moreover, acquiring velocity map is extremely expensive, making it impractical to scale up a supervised approach to train the mapping from seismic data to velocity maps with convolutional neural networks (CNN).We address these difficulties by integrating PDE and CNN in a loop, thus shifting the paradigm to unsupervised learning that only requires seismic data. In particular, we use finite difference to approximate the forward modeling of PDE as a differentiable operator (from velocity map to seismic data) and model its inversion by CNN (from seismic data to velocity map). Hence, we transform the supervised inversion task into an unsupervised seismic data reconstruction task. We also introduce a new large-scale dataset OpenFWI, to establish a more challenging benchmark for the community. Experiment results show that our model (using seismic data alone) yields comparable accuracy to the supervised counterpart (using both seismic data and velocity map). Furthermore, it outperforms the supervised model when involving more seismic data. Figure 1: Schematic illustration of our proposed method, which comprises a CNN to learn an inverse mapping and a differentiable operator to approximate the forward modeling of PDE.

[1]  A. Guitton Blocky regularization schemes for Full‐Waveform Inversion ★ , 2012 .

[2]  Frank Hutter,et al.  Decoupled Weight Decay Regularization , 2017, ICLR.

[3]  Lianjie Huang,et al.  Quantifying subsurface geophysical properties changes using double-difference seismic-waveform inversion with a modified total-variation regularization scheme , 2015 .

[4]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[5]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[6]  Lianjie Huang,et al.  Acoustic- and elastic-waveform inversion using a modified total-variation regularization scheme , 2014 .

[7]  A. Abubakar,et al.  Simultaneous multifrequency inversion of full-waveform seismic data , 2009 .

[8]  G. Schuster,et al.  Transmission + reflection anisotropic wave‐equation traveltime and waveform inversion , 2018, Geophysical Prospecting.

[9]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[10]  C. Tsogka,et al.  Application of the perfectly matched absorbing layer model to the linear elastodynamic problem in anisotropic heterogeneous media , 2001 .

[11]  B. Wohlberg,et al.  Multiscale Data-Driven Seismic Full-Waveform Inversion With Field Data Study , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Tapan Mukerji,et al.  Prestack and poststack inversion using a physics-guided convolutional neural network , 2019, Interpretation.

[13]  Amir Adler,et al.  Deep-learning tomography , 2018 .

[14]  K. Innanen,et al.  Physics-guided deep learning for seismic inversion with hybrid training and uncertainty analysis , 2021, GEOPHYSICS.

[15]  James Theiler,et al.  Physics-Consistent Data-Driven Waveform Inversion With Adaptive Data Augmentation , 2020, IEEE Geoscience and Remote Sensing Letters.

[16]  C. Bunks,et al.  Multiscale seismic waveform inversion , 1995 .

[17]  Yue Wu,et al.  InversionNet: An Efficient and Accurate Data-Driven Full Waveform Inversion , 2020, IEEE Transactions on Computational Imaging.

[18]  Ghassan Al-Regib,et al.  Semi-supervised Sequence Modeling for Elastic Impedance Inversion , 2019, Interpretation.

[19]  Winston Lewis,et al.  Regularization And Full-waveform Inversion: A Two-step Approach , 2010 .

[20]  T. Nissen‐Meyer,et al.  Deep learning for fast simulation of seismic waves in complex media , 2019, Solid Earth.

[21]  Lianjie Huang,et al.  Building Subsurface Velocity Models with Sharp Interfaces Using Interface-Guided Seismic Full-Waveform Inversion , 2017, Pure and Applied Geophysics.

[22]  Jean Virieux,et al.  An overview of full-waveform inversion in exploration geophysics , 2009 .

[23]  O. Ghattas,et al.  Algorithmic strategies for full waveform inversion: 1D experiments , 2009 .

[24]  Tomaso Poggio,et al.  Deep Learning for Seismic Inverse Problems: Toward the Acceleration of Geophysical Analysis Workflows , 2021, IEEE Signal Processing Magazine.

[25]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[26]  Albert Tarantola,et al.  Inverse problem theory - and methods for model parameter estimation , 2004 .

[27]  Xinfei Yan,et al.  Well-Logging Constrained Seismic Inversion Based on Closed-Loop Convolutional Neural Network , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[29]  Eran Treister,et al.  Full Waveform Inversion Guided by Travel Time Tomography , 2016, SIAM J. Sci. Comput..

[30]  Peng Jiang,et al.  Deep-Learning Inversion of Seismic Data , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Zhongping Zhang,et al.  Data-Driven Seismic Waveform Inversion: A Study on the Robustness and Generalization , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Monica Maceira,et al.  Double-difference traveltime tomography with edge-preserving regularization and a priori interfaces , 2015 .

[33]  Jianwei Ma,et al.  Deep-learning inversion: a next generation seismic velocity-model building method , 2019, GEOPHYSICS.

[34]  Yanghua Wang Frequencies of the Ricker wavelet , 2015 .

[35]  Gerard T. Schuster,et al.  An efficient multiscale method for time-domain waveform tomography , 2009 .