Validation of nonlinear inverse algorithms with Markov chain Monte Carlo method

[1] The data processing of remote sensing measurements usually involves solving a nonlinear inverse problem. The error characterization is typically done by assuming linearity around the estimated likelihood point, and a covariance matrix approximating a Gaussian uncertainty is given. However, often the solutions are not Gaussian. We describe here a methodology for validating the traditional error characterization by applying the Markov chain Monte Carlo (MCMC) technique. The validation methodology is applied to the inverse problems of the Global Ozone Monitoring by Occultation of Stars (GOMOS) stellar occultation instrument. The adaptive Metropolis algorithm that is used makes the implementation of the MCMC technique effortless. We demonstrate the approach by using real GOMOS data from two occultations, using a bright and a dim star. It is shown that the covariance matrices that are computed in the operational GOMOS data processing characterize well the error structure of the GOMOS measurements if we assume that noise is Gaussian and no prior information is used. However, we also observe that a significant improvement in retrieved parameters is achieved if a positivity prior is introduced. Such prior information can be correctly modeled with the MCMC technique. The sensitivity of the retrieval on the noise characterization is studied by comparing the results obtained with the operational algorithm with a more robust inversion based on l1 norm. At low altitudes a more robust inversion improves the results. In addition, we demonstrate how the MCMC technique can be used to study the modeling errors in the case of nonlinear problems.

[1]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[2]  Heikki Haario,et al.  Componentwise adaptation for high dimensional MCMC , 2005, Comput. Stat..

[3]  Heikki Haario,et al.  Adaptive proposal distribution for random walk Metropolis algorithm , 1999, Comput. Stat..

[4]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[5]  B. Connor,et al.  Intercomparison of remote sounding instruments , 1999 .

[6]  H. Haario,et al.  Markov chain Monte Carlo methods for high dimensional inversion in remote sensing , 2004 .

[7]  H. Haario,et al.  An adaptive Metropolis algorithm , 2001 .

[8]  David J. Spiegelhalter,et al.  Introducing Markov chain Monte Carlo , 1995 .

[9]  Larry J. Paxton,et al.  Atmospheric remote sensing using a combined extinctive and refractive stellar occultation technique 1. Overview and proof‐of‐concept observations , 2002 .

[10]  L. Tierney Markov Chains for Exploring Posterior Distributions , 1994 .

[11]  Christian P. Robert,et al.  Monte Carlo Statistical Methods , 2005, Springer Texts in Statistics.

[12]  J. Tamminen,et al.  Does a Priori Information Improve the Retrievals of Stellar Occultation Measurements , 2004 .

[13]  Heikki Haario,et al.  Inverse theory for occultation measurements: 1. Spectral inversion , 1993 .

[14]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  J. Tamminen,et al.  Bayesian solution for nonlinear and non‐Gaussian inverse problems by Markov chain Monte Carlo method , 2001 .

[16]  G. Mégie,et al.  Monitoring of ozone trend by stellar occultations: the GOMOS instrument , 1991 .

[17]  Clive D Rodgers,et al.  Inverse Methods for Atmospheric Sounding: Theory and Practice , 2000 .

[18]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[19]  Klaus Mosegaard,et al.  MONTE CARLO METHODS IN GEOPHYSICAL INVERSE PROBLEMS , 2002 .

[20]  George E. P. Box,et al.  Bayesian Inference in Statistical Analysis: Box/Bayesian , 1992 .

[21]  Albert Tarantola,et al.  Monte Carlo sampling of solutions to inverse problems , 1995 .

[22]  J. Burrows,et al.  ATMOSPHERIC REMOTE-SENSING REFERENCE DATA FROM GOME — 2 . TEMPERATURE-DEPENDENT ABSORPTION CROSS SECTIONS OF O 3 IN THE 231 — 794 NM RANGE , 1998 .