Multilayer Perceptron and Bayesian Neural Network-Based Elastic Implicit Full Waveform Inversion

We introduce and analyze the elastic implicit full waveform inversion (EIFWI) of seismic data, which uses neural networks to generate elastic models and perform full waveform inversion. EIFWI carries out inversion by linking two main networks: a neural network that generates elastic models and a recurrent neural network to perform the modeling. The approach is distinct from conventional waveform inversion in two key ways. First, it reduces reliance on accurate initial models relative to conventional FWI. Instead, it invokes general information about the target area, for instance, estimates of means and standard deviations of medium properties in the target area or, alternatively, well-log information in the target area. Second, iterative updating directly affects the weights in the neural network rather than the elastic model. Elastic models can be generated in the first part of the EIFWI process in either of two ways: through the use of a multilayer perceptron (MLP) network or a Bayesian neural network (BNN). Numerical testing is suggestive that the MLP-based EIFWI approach in principle builds accurate models in the absence of an explicit initial model, and the BNN-based EIFWI can give the uncertainty analysis for the prediction results.

[1]  Peng Jiang,et al.  Full waveform inversion based on inversion network reparameterized velocity , 2022, Geophysical Prospecting.

[2]  A. Cohn,et al.  Physics-Driven Self-Supervised Learning System for Seismic Velocity Inversion , 2022, GEOPHYSICS.

[3]  Philippe Dales,et al.  Fleet’s Geode: A Breakthrough Sensor for Real-Time Ambient Seismic Noise Tomography over DtS-IoT , 2022, Sensors.

[4]  Jian Sun,et al.  Implicit Seismic Full Waveform Inversion With Deep Neural Representation , 2022, Journal of Geophysical Research: Solid Earth.

[5]  Mrinal K. Sen,et al.  Elastic-AdjointNet: A physics-guided deep autoencoder to overcome crosstalk effects in multiparameter full-waveform inversion , 2022, Second International Meeting for Applied Geoscience & Energy.

[6]  Jian Sun,et al.  Multilayer perceptron and Bayesian neural network based implicit elastic full-waveform inversion , 2022, Second International Meeting for Applied Geoscience & Energy.

[7]  I. Silvestrov,et al.  Research Note: Signal‐to‐noise ratio computation for challenging land single‐sensor seismic data , 2021, Geophysical Prospecting.

[8]  Lasse Lensu,et al.  Deep Bayesian baseline for segmenting diabetic retinopathy lesions: Advances and challenges , 2021, Comput. Biol. Medicine.

[9]  Z. Ren,et al.  Joint wave-equation traveltime inversion of diving/direct and reflected waves for P- and S-wave velocity macromodel building , 2021, GEOPHYSICS.

[10]  K. Innanen,et al.  Physics-guided deep learning for seismic inversion with hybrid training and uncertainty analysis , 2021, GEOPHYSICS.

[11]  K. Innanen,et al.  Numerical analysis of a deep learning formulation of elastic full waveform inversion with high order total variation regularization in different parameterization , 2021, 2101.08924.

[12]  Eric F Darve,et al.  Integrating Deep Neural Networks with Full-waveform Inversion: Reparametrization, Regularization, and Uncertainty Quantification , 2020, 2012.11149.

[13]  K. Innanen,et al.  Numerical analysis of a deep learning formulation of multi-parameter elastic full waveform inversion , 2020 .

[14]  Wray L. Buntine,et al.  Hands-On Bayesian Neural Networks—A Tutorial for Deep Learning Users , 2020, IEEE Computational Intelligence Magazine.

[15]  K. Innanen,et al.  Parameter crosstalk and leakage between spatially separated unknowns in viscoelastic full-waveform inversion , 2020, GEOPHYSICS.

[16]  Jonathan T. Barron,et al.  Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains , 2020, NeurIPS.

[17]  Pratul P. Srinivasan,et al.  NeRF , 2020, ECCV.

[18]  Ronen Basri,et al.  Frequency Bias in Neural Networks for Input of Non-Uniform Density , 2020, ICML.

[19]  Jian Sun,et al.  A theory-guided deep-learning formulation and optimization of seismic waveform inversion , 2020, GEOPHYSICS.

[20]  Geoffrey E. Hinton,et al.  NASA: Neural Articulated Shape Approximation , 2019, ECCV.

[21]  Tristan Bepler,et al.  Reconstructing continuous distributions of 3D protein structure from cryo-EM images , 2019, ICLR.

[22]  Daniel Peter,et al.  Square-root variable metric based elastic full-waveform inversion—Part 2: uncertainty estimation , 2019, Geophysical Journal International.

[23]  K. Innanen,et al.  Parameter crosstalk and modeling errors in viscoacoustic seismic full-waveform inversion , 2019, GEOPHYSICS.

[24]  C. Tape,et al.  Square-root variable metric based elastic full-waveform inversion – Part 1: theory and validation , 2019, Geophysical Journal International.

[25]  Richard A. Newcombe,et al.  DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Sebastian Nowozin,et al.  Occupancy Networks: Learning 3D Reconstruction in Function Space , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Hao Zhang,et al.  Learning Implicit Fields for Generative Shape Modeling , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Leslie Pack Kaelbling,et al.  Effect of Depth and Width on Local Minima in Deep Learning , 2018, Neural Computation.

[29]  Yoshua Bengio,et al.  Depth with Nonlinearity Creates No Bad Local Minima in ResNets , 2018, Neural Networks.

[30]  Doina Precup,et al.  Exploring Uncertainty Measures in Deep Networks for Multiple Sclerosis Lesion Detection and Segmentation , 2018, MICCAI.

[31]  Yoshua Bengio,et al.  On the Spectral Bias of Neural Networks , 2018, ICML.

[32]  Daniel Soudry,et al.  Exponentially vanishing sub-optimal local minima in multilayer neural networks , 2017, ICLR.

[33]  O. Ghattas,et al.  A Bayesian approach to estimate uncertainty for full-waveform inversion using a priori information from depth migration , 2016 .

[34]  Mrinal K. Sen,et al.  Estimating a starting model for full-waveform inversion using a global optimization method , 2016 .

[35]  David M. Blei,et al.  Variational Inference: A Review for Statisticians , 2016, ArXiv.

[36]  T. Leeuwen,et al.  Resolution analysis by random probing , 2015 .

[37]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[38]  Jeroen Tromp,et al.  Seismic structure of the European upper mantle based on adjoint tomography , 2015 .

[39]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[40]  Jason Yosinski,et al.  Deep neural networks are easily fooled: High confidence predictions for unrecognizable images , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Surya Ganguli,et al.  Identifying and attacking the saddle point problem in high-dimensional non-convex optimization , 2014, NIPS.

[42]  James Martin,et al.  A Stochastic Newton MCMC Method for Large-Scale Statistical Inverse Problems with Application to Seismic Inversion , 2012, SIAM J. Sci. Comput..

[43]  Andreas Fichtner,et al.  Hessian kernels of seismic data functionals based upon adjoint techniques , 2011 .

[44]  Jean Virieux,et al.  An overview of full-waveform inversion in exploration geophysics , 2009 .

[45]  R. Plessix A review of the adjoint-state method for computing the gradient of a functional with geophysical applications , 2006 .

[46]  Qinya Liu,et al.  Tomography, Adjoint Methods, Time-Reversal, and Banana-Doughnut Kernels , 2004 .

[47]  David Barber,et al.  Tractable Variational Structures for Approximating Graphical Models , 1998, NIPS.

[48]  Huaiyu Zhu On Information and Sufficiency , 1997 .

[49]  J. Virieux P-SV wave propagation in heterogeneous media: Velocity‐stress finite‐difference method , 1986 .

[50]  A. Tarantola Inversion of seismic reflection data in the acoustic approximation , 1984 .

[51]  B. Liu,et al.  Well-Log Information-Assisted High-Resolution Waveform Inversion Based on Deep Learning , 2023, IEEE Geoscience and Remote Sensing Letters.

[52]  Yanfei Wang,et al.  Reparameterized full-waveform inversion using deep neural networks , 2021 .

[53]  H T Waaler,et al.  Bayes' Theorem , 2017, Encyclopedia of Machine Learning and Data Mining.

[54]  Gary F. Margrave,et al.  The Hussar low-frequency experiment , 2012 .

[55]  Zoubin Ghahramani Gatsby On Structured Variational Approximations , 1997 .