Insights into Tikhonov regularization: application to trace gas column retrieval and the efficient calculation of total column averaging kernels

Abstract. Insights are given into Tikhonov regularization and its application to the retrieval of vertical column densities of atmospheric trace gases from remote sensing measurements. The study builds upon the equivalence of the least-squares profile-scaling approach and Tikhonov regularization method of the first kind with an infinite regularization strength. Here, the vertical profile is expressed relative to a reference profile. On the basis of this, we propose a new algorithm as an extension of the least-squares profile scaling which permits the calculation of total column averaging kernels on arbitrary vertical grids using an analytic expression. Moreover, we discuss the effective null space of the retrieval, which comprises those parts of a vertical trace gas distribution which cannot be inferred from the measurements. Numerically the algorithm can be implemented in a robust and efficient manner. In particular for operational data processing with challenging demands on processing time, the proposed inversion method in combination with highly efficient forward models is an asset. For demonstration purposes, we apply the algorithm to CO column retrieval from simulated measurements in the 2.3 μm spectral region and to O3 column retrieval from the UV. These represent ideal measurements of a series of spaceborne spectrometers such as SCIAMACHY, TROPOMI, GOME, and GOME-2. For both spectral ranges, we consider clear-sky and cloudy scenes where clouds are modelled as an elevated Lambertian surface. Here, the smoothing error for the clear-sky and cloudy atmosphere is significant and reaches several percent, depending on the reference profile which is used for scaling. This underlines the importance of the column averaging kernel for a proper interpretation of retrieved column densities. Furthermore, we show that the smoothing due to regularization can be underestimated by calculating the column averaging kernel on a too coarse vertical grid. For both retrievals, this effect becomes negligible for a vertical grid with 20–40 equally thick layers between 0 and 50 km.

[1]  Geoffrey C. Toon,et al.  Tropospheric methane retrieved from ground‐based near‐IR solar absorption spectra , 2003 .

[2]  S. Twomey,et al.  On the Numerical Solution of Fredholm Integral Equations of the First Kind by the Inversion of the Linear System Produced by Quadrature , 1963, JACM.

[3]  T. Blumenstock,et al.  Comparison of ILAS-II and ground-based FTIR measurements of O3 , HNO3 , N2O, and CH4 over Kiruna, Sweden , 2006 .

[4]  J. Brion,et al.  High-resolution laboratory absorption cross section of O3. Temperature effect , 1993 .

[5]  A. N. Tikhonov,et al.  The regularization of ill-posed problems , 1963 .

[6]  K. Ilk.  On the Regularization of Ill-Posed Problems , 1987 .

[7]  T. Borsdorff,et al.  A new method to detect long term trends of methane (CH 4 ) and nitrous oxide (N 2 O) total columns measured within the NDACC ground-based high resolution solar FTIR network , 2011 .

[8]  C. Frankenberg,et al.  New global observations of the terrestrial carbon cycle from GOSAT: Patterns of plant fluorescence with gross primary productivity , 2011, Geophysical Research Letters.

[9]  B. Connor,et al.  Intercomparison of remote sounding instruments , 1999 .

[10]  John P. Burrows,et al.  TROPOSPHERIC NO2 FROM GOME MEASUREMENTS , 2002 .

[11]  M. Buchwitz,et al.  SCIAMACHY: Mission Objectives and Measurement Modes , 1999 .

[12]  C. Rinsland,et al.  Spectroscopic study of the seasonal variation of carbon monoxide vertical distribution above Kitt Peak , 1995 .

[13]  M. Mazière,et al.  Retrieval and characterization of ozone profiles from solar infrared spectra at the Jungfraujoch , 2002 .

[14]  G. Toon,et al.  Atmospheric CO2 retrieved from ground‐based near IR solar spectra , 2002 .

[15]  Peter Bergamaschi,et al.  Satellite chartography of atmospheric methane from SCIAMACHY on board ENVISAT: Analysis of the years 2003 and 2004 , 2006 .

[16]  O. Hasekamp,et al.  Error analysis for CO and CH 4 total column retrievals from SCIAMACHY 2.3 μm spectra , 2008 .

[17]  B. Connor,et al.  Multiyear infrared solar spectroscopic measurements of HCN, CO, C2H6, and C2H2 tropospheric columns above Lauder, New Zealand (45 S Latitude) , 2002 .

[18]  J. Burrows,et al.  TROPOSPHERIC NO 2 FROM GOME MEASUREMENTS , 2002 .

[19]  Ilse Aben,et al.  Methane retrievals from Greenhouse Gases Observing Satellite (GOSAT) shortwave infrared measurements: Performance comparison of proxy and physics retrieval algorithms , 2012 .

[20]  James B. Abshire,et al.  Calibration of the Total Carbon Column Observing Network using aircraft profile data , 2010 .

[21]  Alexander Marshak,et al.  The verisimilitude of the independent pixel approximation used in cloud remote sensing , 1995 .

[22]  Per Christian Hansen,et al.  Analysis of Discrete Ill-Posed Problems by Means of the L-Curve , 1992, SIAM Rev..

[23]  T. Blumenstock,et al.  Quality assessment of O 3 profiles measured by a state-of-the-art ground-based FTIR observing system , 2008 .

[24]  Michael Eisinger,et al.  The Global Ozone Monitoring Experiment (GOME): Mission Concept and First Scientific Results , 1999 .

[25]  Matthew T. DeLand,et al.  Solar Backscatter UV (SBUV) total ozone and profile algorithm , 2012 .

[26]  P. Duchatelet,et al.  Comparisons between ground-based FTIR and MIPAS N 2 O and HNO 3 profiles before and after assimilation in BASCOE , 2006 .

[27]  Justus Notholt,et al.  Latitudinal variations of trace gas concentrations in the free troposphere measured by solar absorption spectroscopy during a ship cruise , 2000 .

[28]  Dianne P. O'Leary,et al.  The Use of the L-Curve in the Regularization of Discrete Ill-Posed Problems , 1993, SIAM J. Sci. Comput..

[29]  P. Duchatelet,et al.  Increased Northern Hemispheric carbon monoxide burden in the troposphere in 2002 and 2003 detected from the ground and from space , 2004 .

[30]  Otto P. Hasekamp,et al.  Ozone profile retrieval from backscattered ultraviolet radiances: The inverse problem solved by regularization , 2001 .

[31]  Laurence S. Rothman,et al.  The HITRAN molecular spectroscopic database: edition of 2000 including updates through 2001 , 2003 .

[32]  T. Clarmann,et al.  Elimination of hidden a priori information from remotely sensed profile data , 2006 .

[33]  Eric S. Kasischke,et al.  A Quantitative Assessment of the 1998 Carbon Monoxide Emission Anomaly in the Northern Hemisphere Based on Total Column and Surface Concentration Measurements , 2004 .

[34]  Henk Eskes,et al.  TROPOMI on the ESA Sentinel-5 Precursor: A GMES mission for global observations of the atmospheric composition for climate, air quality and ozone layer applications , 2012 .

[35]  On seasonality of stratomesospheric CO above midlatitudes: New insight from solar FTIR spectrometry at Zugspitze and Garmisch , 2009 .

[36]  C. Lerot,et al.  The GODFIT algorithm: a direct fitting approach to improve the accuracy of total ozone measurements from GOME , 2010 .

[37]  Akihiko Kuze,et al.  Toward accurate CO_2 and CH_4 observations from GOSAT , 2011 .

[38]  R. Sussmann,et al.  Technical Note: Interference errors in infrared remote sounding of the atmosphere , 2007 .

[39]  P. Hansen.  Rank-Deficient and Discrete Ill-Posed Problems: Numerical Aspects of Linear Inversion , 1987 .

[40]  Henk Eskes,et al.  Averaging kernels for DOAS total-column satellite retrievals , 2003 .

[41]  Heikki Saari,et al.  The ozone monitoring instrument , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Henk Eskes,et al.  Retrieval and validation of ozone columns derived from measurements of SCIAMACHY on Envisat , 2005 .

[43]  David L. Phillips,et al.  A Technique for the Numerical Solution of Certain Integral Equations of the First Kind , 1962, JACM.

[44]  Michael Buchwitz,et al.  Retrieval of CH4, CO, and CO2 total column amounts from SCIAMACHY near-infrared nadir spectra: retrieval algorithm and first results , 2004, SPIE Remote Sensing.

[45]  Ulrich Platt,et al.  Retrieval of CO from SCIAMACHY onboard ENVISAT : detection of strongly polluted areas and seasonal patterns in global CO abundances , 2017 .