Accelerating Hessian-free Gauss-Newton full-waveform inversion via l-BFGS preconditioned conjugate-gradient algorithm

ABSTRACTFull-waveform inversion (FWI) has emerged as a powerful strategy for estimating subsurface model parameters by iteratively minimizing the difference between synthetic data and observed data. The Hessian-free (HF) optimization method represents an attractive alternative to Newton-type and gradient-based optimization methods. At each iteration, the HF approach obtains the search direction by approximately solving the Newton linear system using a matrix-free conjugate-gradient (CG) algorithm. The main drawback with HF optimization is that the CG algorithm requires many iterations. In our research, we develop and compare different preconditioning schemes for the CG algorithm to accelerate the HF Gauss-Newton (GN) method. Traditionally, preconditioners are designed as diagonal Hessian approximations. We additionally use a new pseudo diagonal GN Hessian as a preconditioner, making use of the reciprocal property of Green’s function. Furthermore, we have developed an l-BFGS inverse Hessian preconditioning...

[1]  Jorge Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[2]  R. Plessix A review of the adjoint-state method for computing the gradient of a functional with geophysical applications , 2006 .

[3]  Xin Wang,et al.  Time-domain incomplete Gauss-Newton full-waveform inversion of Gulf of Mexico data , 2013 .

[4]  S. Operto,et al.  Which data residual norm for robust elastic frequency-domain full waveform inversion? , 2010 .

[5]  Kristopher A. Innanen,et al.  Seismic AVO and the inverse Hessian in precritical reflection full waveform inversion , 2014 .

[6]  D. Goldfarb A family of variable-metric methods derived by variational means , 1970 .

[7]  R. Plessix,et al.  Frequency-domain finite-difference amplitude-preserving migration , 2004 .

[8]  A. Pica,et al.  Nonliner inversion of seismic reflection data in a laterally invariant medium , 1990 .

[9]  X. Fang,et al.  Estimation of elastic constants for HTI media using Gauss-Newton and full-Newton multiparameter full-waveform inversion , 2016 .

[10]  C. G. Broyden The Convergence of a Class of Double-rank Minimization Algorithms 1. General Considerations , 1970 .

[11]  A. Majda,et al.  Absorbing boundary conditions for the numerical simulation of waves , 1977 .

[12]  Andreas Fichtner,et al.  Hessian kernels of seismic data functionals based upon adjoint techniques , 2011 .

[13]  J. Nocedal Updating Quasi-Newton Matrices With Limited Storage , 1980 .

[14]  Mrinal K. Sen,et al.  Frequency-domain full waveform inversion with plane-wave data , 2013 .

[15]  C. G. Broyden The Convergence of a Class of Double-rank Minimization Algorithms 2. The New Algorithm , 1970 .

[16]  C. Shin,et al.  Weighted pseudo-Hessian for frequency-domain elastic full waveform inversion , 2015 .

[17]  K. Marfurt Accuracy of finite-difference and finite-element modeling of the scalar and elastic wave equations , 1984 .

[18]  Hicks,et al.  Gauss–Newton and full Newton methods in frequency–space seismic waveform inversion , 1998 .

[19]  C. M. Reeves,et al.  Function minimization by conjugate gradients , 1964, Comput. J..

[20]  Anatoly Baumstein Extended Subspace Method for Attenuation of Crosstalk in Multi-Parameter Full Wavefield Inversion , 2014 .

[21]  Tara N. Sainath,et al.  Accelerating Hessian-free optimization for Deep Neural Networks by implicit preconditioning and sampling , 2013, 2013 IEEE Workshop on Automatic Speech Recognition and Understanding.

[22]  C. Bunks,et al.  Multiscale seismic waveform inversion , 1995 .

[23]  R. G. Pratt,et al.  Traveltime tomography in anisotropic media—II. Application , 1992 .

[24]  R. Gerhard Pratt,et al.  Efficient waveform inversion and imaging: A strategy for selecting temporal frequencies , 2004 .

[25]  Laurent Demanet,et al.  Matrix probing: A randomized preconditioner for the wave-equation Hessian , 2011, 1101.3615.

[26]  Mauricio D. Sacchi,et al.  Full waveform inversion with simultaneous sources using the full Newton Method , 2012 .

[27]  Parallel Multiscale Gauss-Newton-Krylov Methods for Inverse Wave Propagation , 2002 .

[28]  Ludovic Métivier,et al.  A guided tour of multiparameter full-waveform inversion with multicomponent data: From theory to practice , 2013 .

[29]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[30]  Ludovic Métivier,et al.  Acoustic Multi-Parameter FWI for the Reconstruction of P-Wave Velocity, Density and Attenuation: Preconditioned Truncated Newton Approach , 2015 .

[31]  The truncated Newton method for Full Waveform Inversion , 2012 .

[32]  Homer F. Walker,et al.  Choosing the Forcing Terms in an Inexact Newton Method , 1996, SIAM J. Sci. Comput..

[33]  L. Demanet,et al.  Approximate inversion of the wave-equation Hessian via randomized matrix probing , 2012 .

[34]  Ludovic Métivier,et al.  Full Waveform Inversion and the Truncated Newton Method , 2013, SIAM J. Sci. Comput..

[35]  Alejandro A. Valenciano Imaging by wave-equation inversion , 2008 .

[36]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[37]  A. Abubakar,et al.  Simultaneous multifrequency inversion of full-waveform seismic data , 2009 .

[38]  D. Shanno Conditioning of Quasi-Newton Methods for Function Minimization , 1970 .

[39]  A. Tarantola A strategy for nonlinear elastic inversion of seismic reflection data , 1986 .

[40]  Jean Virieux,et al.  Crustal seismic imaging from multifold ocean bottom seismometer data by frequency domain full waveform tomography: Application to the eastern Nankai trough , 2006 .

[41]  K. Innanen Reconciling seismic AVO and precritical reflection FWI - Analysis of the inverse Hessian , 2014 .

[42]  S. Nash A survey of truncated-Newton methods , 2000 .

[43]  Kristopher A. Innanen,et al.  Efficient pseudo-Gauss-Newton full-waveform inversion in the τ-p domain , 2015 .

[44]  D. Hale,et al.  Quasi-Newton full-waveform inversion with a projected Hessian matrix , 2012 .

[45]  Yaxun Tang Target-oriented wave-equation least-squares migration/inversion with phase-encoded Hessian , 2009 .

[46]  Qinya Liu,et al.  Tomography, Adjoint Methods, Time-Reversal, and Banana-Doughnut Kernels , 2004 .

[47]  G. H. F. Gardner,et al.  FORMATION VELOCITY AND DENSITY—THE DIAGNOSTIC BASICS FOR STRATIGRAPHIC TRAPS , 1974 .

[48]  J. Pujol The solution of nonlinear inverse problems and the Levenberg-Marquardt method , 2007 .

[49]  A. Tarantola,et al.  Two‐dimensional nonlinear inversion of seismic waveforms: Numerical results , 1986 .

[50]  A. Abubakar,et al.  Preconditioned non‐linear conjugate gradient method for frequency domain full‐waveform seismic inversion , 2011 .

[51]  Timothy A. Davis,et al.  An Unsymmetric-pattern Multifrontal Method for Sparse Lu Factorization , 1993 .

[52]  Changsoo Shin,et al.  Efficient calculation of a partial-derivative wavefield using reciprocity for seismic imaging and inversion , 2001 .

[53]  Laurent Demanet,et al.  Full-waveform inversion with extrapolated low-frequency data , 2016 .

[54]  Iterative Modeling Migration and Inversion (IMMI): Combining Full Waveform Inversion With Standard Inversion Methodology , 2014 .

[55]  S. Operto,et al.  Seismic imaging of complex onshore structures by 2D elastic frequency-domain full-waveform inversion , 2009 .

[56]  Felix J. Herrmann,et al.  Seismic waveform inversion with Gauss‐Newton‐Krylov method , 2009 .

[57]  Changsoo Shin,et al.  Frequency-Domain Elastic Full Waveform Inversion Using the New Pseudo-Hessian Matrix: Experience of Elastic Marmousi-2 Synthetic Data , 2008 .

[58]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[59]  Jean Virieux,et al.  An overview of full-waveform inversion in exploration geophysics , 2009 .

[60]  Ludovic Métivier,et al.  Full waveform inversion and the truncated Newton method: quantitative imaging of complex subsurface structures , 2014 .

[61]  F. Santosa,et al.  Computation of the Hessian for least-squares solutions of inverse problems of reflection seismology , 1988 .

[62]  A. Guitton,et al.  Attenuating crosstalk noise with simultaneous source full waveform inversion ★ , 2012 .

[63]  A. Tarantola Inversion of seismic reflection data in the acoustic approximation , 1984 .

[64]  C. Shin,et al.  Improved amplitude preservation for prestack depth migration by inverse scattering theory , 2001 .

[65]  Yibo Wang,et al.  Limited-memory BFGS based least-squares pre-stack Kirchhoff depth migration , 2015 .

[66]  R. G. Pratt,et al.  Traveltime tomography in anisotropic media—I. Theory , 1992 .

[67]  Ludovic Métivier,et al.  The SEISCOPE optimization toolbox: A large-scale nonlinear optimization library based on reverse communication , 2016 .

[68]  W. Symes,et al.  Approximate Constant Density Acoustic Inverse Scattering Using Dip-Dependent Scaling , 2009 .

[69]  S. Nash Preconditioning of Truncated-Newton Methods , 1985 .

[70]  Wenyuan Liao,et al.  Accelerating Hessian-free Gauss-Newton full-waveform inversion via improved preconditioning strategies , 2016 .

[71]  C. Shin,et al.  An optimal 9-point, finite-difference, frequency-space, 2-D scalar wave extrapolator , 1996 .

[72]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[73]  R. Fletcher,et al.  A New Approach to Variable Metric Algorithms , 1970, Comput. J..