Global Optimization Methods in Geophysical Inversion

Part 1 Preliminary statistics: random variables random nunmbers probability probability distribution, distribution function and density function joint and marginal probability distributions mathematical expectation, moments, variances and covariances conditional probability Monte Carlo integration importance sampling stochastic processes Markov chains homogeneous, inhomogeneous, irreducible and aperiodic Markov chains the limiting probability. Part 2 Direct, linear and iterative-linear inverse methods: direct inversion methods model based inversion methods linear/linearized inverse methods iterative linear methods for quasi-linear problems Bayesian formulation solution using probabilistic formulation. Part 3 Monte Carlo methods: enumerative or grid search techniques Monte Carlo inversion hybrid Monte Carlo-linear inversion directed Monte Carlo methods. Part 4 Simulated annealing methods: metropolis algorithm heat bath algorithm simulated annealing without rejected moves fast simulated annealing very fast simulated reannealing mean field annealing using SA in geophysical inversion. Part 5 Genetic algorithms: a classical GA schemata and the fundamental theorem of genetic algorithms problems combining elements of SA into a new GA a mathematical model of a GA multimodal fitness functions, genetic drift, GA with sharing, and repeat (parallel) GA uncertainty estimates evolutionary programming - a variant of GA. Part 6 Geophysical applications of SA and GA: 1-D seismic waveform inversion pre-stack migration velocity estimation inversion of resistivity sounding data for 1-D earth models inversion of resistivity profiling data for 2-D earth models inversion of magnetotelluric sounding data for 1-D earth models stochastic reservoir modelling seismic deconvolution by mean field annealing and Hopfield network. Part 7 Uncertainty estimation: methods of numerical integration simulated annealing - the Gibbs' sampler genetic algorithm - the parallel Gibbs' sampler numerical examples.

[1]  V. A. Morozov,et al.  Methods for Solving Incorrectly Posed Problems , 1984 .

[2]  N. Metropolis,et al.  The Monte Carlo method. , 1949 .

[3]  D. Oldenburg,et al.  Magnetotelluric appraisal using simulated annealing , 1991 .

[4]  Jeffrey Horn,et al.  Finite Markov Chain Analysis of Genetic Algorithms with Niching , 1993, ICGA.

[5]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[6]  O. Koefoed,et al.  Geosounding Principles: Resistivity Sounding Measurements , 1980 .

[7]  K. Fuchs,et al.  Computation of Synthetic Seismograms with the Reflectivity Method and Comparison with Observations , 1971 .

[8]  Robert L. Parker,et al.  Inverse Theory with Grossly Inadequate Data , 1972 .

[9]  Albert Tarantola,et al.  Monte Carlo sampling of solutions to inverse problems , 1995 .

[10]  Roel Snieder,et al.  To Bayes or not to Bayes , 1997 .

[11]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Mrinal K. Sen,et al.  Nonlinear multiparameter optimization using genetic algorithms; inversion of plane-wave seismograms , 1991 .

[13]  S. S. Wilks,et al.  Probability, statistics and truth , 1939 .

[14]  D. Oldenburg.  One-dimensional inversion of natural source magnetotelluric observations , 1979 .

[15]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[16]  Sheldon M. Ross.  Introduction to Probability Models. , 1995 .

[17]  Kenneth J. Supowit,et al.  Simulated Annealing Without Rejected Moves , 1986, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[18]  H. Szu.  Fast simulated annealing , 1987 .

[19]  T. Bayes.  An essay towards solving a problem in the doctrine of chances , 2003 .

[20]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[21]  H. Jeffreys,et al.  Theory of probability , 1896 .

[22]  J. Wang,et al.  Subsurface imaging using magnetotelluric data , 1988 .

[23]  G. Backus,et al.  Inference from Inadequate and Inaccurate Data, III. , 1970, Proceedings of the National Academy of Sciences of the United States of America.

[24]  L N Frazer,et al.  Rapid Determination of the Critical Temperature in Simulated Annealing Inversion , 1990, Science.

[25]  Michael I. Miller,et al.  REPRESENTATIONS OF KNOWLEDGE IN COMPLEX SYSTEMS , 1994 .

[26]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[28]  S. Treitel,et al.  A REVIEW OF LEAST-SQUARES INVERSION AND ITS APPLICATION TO GEOPHYSICAL PROBLEMS* , 1984 .

[29]  Alastair D. McAulay,et al.  Prestack inversion with plane-layer point source modeling , 1985 .

[30]  T. Ulrych,et al.  MINIMUM ENTROPY DECONVOLUTION WITH AN EXPONENTIAL TRANSFORMATION , 1979 .

[31]  G. Backus,et al.  The Resolving Power of Gross Earth Data , 1968 .

[32]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[33]  T. J. Clarke,et al.  Full reconstruction of a layered elastic medium from P-SV slant-stack data , 1984 .

[34]  Bernard C. Levy,et al.  Application of the Schur algorithm to the inverse problem for a layered acoustic medium , 1984 .

[35]  Lester Ingber,et al.  Simulated annealing: Practice versus theory , 1993 .

[36]  Donald V. Helmberger,et al.  Source Estimation from Broadband Regional Seismograms , 1994 .

[37]  Richard M. Friedberg,et al.  A Learning Machine: Part I , 1958, IBM J. Res. Dev..

[38]  Irshad R. Mufti,et al.  FINITE‐DIFFERENCE RESISTIVITY MODELING FOR ARBITRARILY SHAPED TWO‐DIMENSIONAL STRUCTURES , 1976 .

[39]  A Tikhonov,et al.  Solution of Incorrectly Formulated Problems and the Regularization Method , 1963 .

[40]  Mrinal K. Sen,et al.  Nonlinear one-dimensional seismic waveform inversion using simulated annealing , 1991 .

[41]  J. Spall.  Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[42]  Mrinal K. Sen,et al.  Non‐linear inversion of resistivity profiling data for some regular geometrical bodies , 1995 .

[43]  Bruce E. Rosen,et al.  Genetic Algorithms and Very Fast Simulated Reannealing: A comparison , 1992 .

[44]  Arthur B. Weglein,et al.  The sensitivity of Born inversion to the choice of reference velocity: A simple example , 1983 .

[45]  Mrinal K. Sen,et al.  Seismic waveform inversion using global optimization , 1992 .

[46]  Joel Franklin,et al.  Well-posed stochastic extensions of ill-posed linear problems☆ , 1970 .

[47]  Mrinal K. Sen,et al.  Genetic inversion of AVO , 1992 .

[48]  L. Cagniard.  Basic theory of the magneto-telluric method of geophysical prospecting , 1953 .

[49]  Carsten Peterson,et al.  Neural Networks and NP-complete Optimization Problems; A Performance Study on the Graph Bisection Problem , 1988, Complex Syst..

[50]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[51]  Andre G. Journel,et al.  New method for reservoir mapping , 1990 .

[52]  Douglas W. McCowan,et al.  Edge effects in cylindrical slant stacks , 1986 .

[53]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[54]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[55]  Paul L. Stoffa,et al.  Quantitative detection of methane hydrate through high-resolution seismic velocity analysis , 1994 .

[56]  C. Chapman,et al.  Automatic 1-D waveform inversion of marine seismic refraction data , 1988 .

[57]  J. Vidale,et al.  Tomography without rays , 1993, Bulletin of the Seismological Society of America.

[58]  B. Kennett,et al.  Earthquake location genetic algorithms for teleseisms , 1992 .

[59]  L. Ingber.  Very fast simulated re-annealing , 1989 .

[60]  Klaus Mosegaard,et al.  INVERSION OF POST-STACK SEISMIC DATA USING SIMULATED ANNEALING1 , 1991 .

[61]  Andrzej Cichocki,et al.  Neural networks for optimization and signal processing , 1993 .

[62]  Awi Federgruen,et al.  Ergodicity in Parametric Nonstationary Markov Chains: An Application to Simulated Annealing Methods , 1987, Oper. Res..

[63]  T. Bayes,et al.  Studies in the History of Probability and Statistics: IX. Thomas Bayes's Essay Towards Solving a Problem in the Doctrine of Chances , 1958 .

[64]  Kris Vasudevan,et al.  APPLICATION OF THE GENETIC ALGORITHM TO RESIDUAL STATICS ESTIMATION , 1991 .

[65]  R. Parker.  Understanding Inverse Theory , 1977 .

[66]  A. Duijndam.  BAYESIAN ESTIMATION IN SEISMIC INVERSION. PART I: PRINCIPLES1 , 1988 .

[67]  Mrinal K. Sen,et al.  Rapid sampling of model space using genetic algorithms: examples from seismic waveform inversion , 1992 .

[68]  W. Menke.  Geophysical data analysis : discrete inverse theory , 1984 .

[69]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[70]  A. Tarantola.  Inverse problem theory : methods for data fitting and model parameter estimation , 1987 .

[71]  A. Duijndam.  BAYESIAN ESTIMATION IN SEISMIC INVERSION. PART II: UNCERTAINTY ANALYSIS1 , 1988 .

[72]  Bernard C. Levy,et al.  A layer-stripping solution of the inverse problem for a one-dimensional elastic medium , 1985 .

[73]  J. Scales,et al.  Global optimization methods for multimodal inverse problems , 1992 .

[74]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[75]  S Forrest,et al.  Genetic algorithms , 1996, CSUR.

[76]  Paul L. Stoffa,et al.  Deepwater high-resolution expanding spread and split spread seismic profiles in the Nankai Trough , 1992 .

[77]  Carsten Peterson,et al.  A Mean Field Theory Learning Algorithm for Neural Networks , 1987, Complex Syst..

[78]  R. Wiggins,et al.  Monte Carlo inversion of body‐wave observations , 1969 .

[79]  Per Christian Hansen,et al.  Analysis of Discrete Ill-Posed Problems by Means of the L-Curve , 1992, SIAM Rev..

[80]  Teresa Reginska,et al.  A Regularization Parameter in Discrete Ill-Posed Problems , 1996, SIAM J. Sci. Comput..

[81]  Ken Larner,et al.  Residual statics analysis as a general linear inverse problem: Geophysics , 1976 .

[82]  R. Wiggins.  Minimum entropy deconvolution , 1978 .

[83]  Robert W. Clayton,et al.  A Born-WKBJ inversion method for acoustic reflection data , 1981 .

[84]  Wafik B. Beydoun,et al.  Reference velocity model estimation from prestack waveforms: Coherency optimization by simulated annealing , 1989 .

[85]  Paul L. Stoffa,et al.  Split-Step Fourier Migration , 1990 .

[86]  Frank Press,et al.  Earth models obtained by Monte Carlo inversion. , 1968 .

[87]  H. Engl.  Discrepancy principles for Tikhonov regularization of ill-posed problems leading to optimal convergence rates , 1987 .

[88]  J. Claerbout,et al.  Robust Modeling With Erratic Data , 1973 .

[89]  Guust Nolet,et al.  Resolution Analysis for Discrete Systems , 1978 .

[90]  William R. Walter,et al.  Source parameters of the June 29, 1992 Little Skull Mountain Earthquake from complete regional waveforms at a single station , 1993 .

[91]  M. Hanke.  Regularizing properties of a truncated Newton-CG algorithm for nonlinear inverse problems , 1997 .

[92]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[93]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[94]  David B. Fogel,et al.  System Identification Through Simulated Evolution: A Machine Learning Approach to Modeling , 1991 .

[95]  A. Tarantola,et al.  Inverse problems = Quest for information , 1982 .

[96]  Mrinal K. Sen,et al.  Nonlinear inversion of resistivity sounding data , 1993 .

[97]  Side Jin,et al.  Background velocity inversion with a genetic algorithm , 1993 .

[98]  Malcolm Sambridge,et al.  Earthquake hypocenter location using genetic algorithms , 1993, Bulletin of the Seismological Society of America.

[99]  M. Sambridge,et al.  Genetic algorithms in seismic waveform inversion , 1992 .

[100]  Reuven Y. Rubinstein,et al.  Simulation and the Monte Carlo Method , 1981 .

[101]  Daniel H. Rothman,et al.  Automatic estimation of large residual statics corrections , 1986 .

[102]  Irene A. Stegun,et al.  Handbook of Mathematical Functions. , 1966 .

[103]  Mrinal K. Sen,et al.  2-D MIGRATION VELOCITY ESTIMATION USING A GENETIC ALGORITHM , 1993 .

[104]  Paul L. Stoffa,et al.  Tau-p, a plane wave approach to the analysis of seismic data , 1989 .

[105]  Philip E. Gill,et al.  Practical optimization , 1981 .

[106]  Dan Hampson,et al.  AVO inversion, theory and practice , 1991 .

[107]  W. Scheider,et al.  Dipmeter analysis by a Monte Carlo technique , 1990 .

[108]  Carsten Peterson,et al.  A New Method for Mapping Optimization Problems Onto Neural Networks , 1989, Int. J. Neural Syst..

[109]  Mrinal K. Sen,et al.  Hybrid optimization methods for geophysical inversion , 1997 .

[110]  G. Backus,et al.  Uniqueness in the inversion of inaccurate gross Earth data , 1970, Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences.

[111]  Lawrence Davis,et al.  Genetic Algorithms and Simulated Annealing , 1987 .

[112]  T. Schopf.  Models in Paleobiology , 1972 .

[113]  Michael Creutz,et al.  Quarks, Gluons and Lattices , 1984 .

[114]  C. H. Chapman,et al.  Full waveform inversion of reflection data , 1988 .

[115]  David E. Goldberg,et al.  Diploidy and Dominance in Artificial Genetic Search , 1992, Complex Syst..

[116]  Mrinal K. Sen,et al.  Bayesian inference, Gibbs sampler and uncertainty estimation in nonlinear geophysical inversion , 1994 .

[117]  Daniel H. Rothman,et al.  Nonlinear inversion, statistical mechanics, and residual statics estimation , 1985 .

[118]  John G. Kemeny,et al.  Finite Markov Chains. , 1960 .

[119]  D. Mitra,et al.  Convergence and finite-time behavior of simulated annealing , 1986, Advances in Applied Probability.

[120]  Mrinal K. Sen,et al.  Bayesian inference, Gibbs' sampler and uncertainty estimation in geophysical inversion , 1996 .

[121]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[122]  A. Tarantola,et al.  Generalized Nonlinear Inverse Problems Solved Using the Least Squares Criterion (Paper 1R1855) , 1982 .

[123]  Jerry M. Mendel,et al.  Adaptive minimum prediction-error deconvolution and source wavelet estimation using Hopfield neural networks , 1992 .

[124]  Arthur B. Weglein,et al.  Migration and inversion of seismic data , 1985 .

[125]  A. Dey,et al.  Resistivity modeling for arbitrarily shaped three-dimensional structures , 1979 .

[126]  T. Brubaker,et al.  Nonlinear Parameter Estimation , 1979 .

[127]  Paul L. Stoffa,et al.  Direct mapping of seismic data to the domain of intercept time and ray parameter—A plane‐wave decomposition , 1981 .

[128]  D. Jackson.  The use of a priori data to resolve non‐uniqueness in linear inversion , 1979 .

[129]  E. Shalev,et al.  Cubic B-splines: Strategies of translating a simple structure to B-spline parameterization , 1993, Bulletin of the Seismological Society of America.

[130]  J. Hopfield,et al.  Computing with neural circuits: a model. , 1986, Science.

[131]  B. Kennett,et al.  Seismic Wave Propagation in Stratified Media , 1983 .

[132]  D. Jackson.  Interpretation of Inaccurate, Insufficient and Inconsistent Data , 1972 .

[133]  D. Oldenburg,et al.  Inversion of Magnetotelluric Data for a One-Dimensional Conductivity , 1992 .

[134]  Adrian F. M. Smith,et al.  Bayesian Analysis of Constrained Parameter and Truncated Data Problems , 1991 .

[135]  Gunar E. Liepins,et al.  Punctuated Equilibria in Genetic Search , 1991, Complex Syst..

[136]  A. Federgruen,et al.  Simulated annealing methods with general acceptance probabilities , 1987, Journal of Applied Probability.

[137]  A. Girard.  A fast ‘Monte-Carlo cross-validation’ procedure for large least squares problems with noisy data , 1989 .

[138]  Adam M. Dziewonski,et al.  Mapping the lower mantle: Determination of lateral heterogeneity in P velocity up to degree and order 6 , 1984 .

[139]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[140]  J. Hammersley,et al.  Monte Carlo Methods , 1966 .

[141]  W. Gilks,et al.  Adaptive Rejection Sampling for Gibbs Sampling , 1992 .

[142]  J. Louie,et al.  Inversion of seismic reflection traveltimes using a nonlinear optimization scheme , 1993 .

[143]  Emile H. L. Aarts,et al.  Simulated Annealing: Theory and Applications , 1987, Mathematics and Its Applications.

[144]  Dianne P. O'Leary,et al.  The Use of the L-Curve in the Regularization of Discrete Ill-Posed Problems , 1993, SIAM J. Sci. Comput..

[145]  David D. Jackson,et al.  A Bayesian approach to nonlinear inversion , 1985 .

[146]  G. Backus,et al.  Numerical Applications of a Formalism for Geophysical Inverse Problems , 1967 .

[147]  G. C. Tiao,et al.  Bayesian inference in statistical analysis , 1973 .

[148]  W. Press,et al.  Numerical Recipes: The Art of Scientific Computing , 1987 .

[149]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.