Convergence Issues in the Estimation of Interchannel Correlated Observation Errors in Infrared Radiance Data

A posteriori consistency diagnostics have been used in recent years to estimate correlated observation error. These diagnostics provide an estimate of what the observation error covariances should be and could, in turn, be introduced in the assimilation to improve the statistical consistency between the error statistics used in the assimilation and those obtained from observation departures with respect to the background and the analysis. To estimate the observation error covariances, it is often assumed that the background error statistics are optimal, an assumption that is open to criticism. The consequence is that if the background error covariances are in error, then the estimated observation error statistics will adjust accordingly to fit the innovation error covariances. In this paper, the RTTOV radiative transfer model is used as the observation operator. Using controlled experiments, the background error is considered fixed, and it is shown that the iterative procedure to estimate the observation error may require more than one iteration. It is also shown that the underlying matrix equation being solved can be factorized, and the exact solution can be obtained. If the true background error covariances are used in the assimilation, the estimated observation error covariances are then obtained by subtracting the background error covariances from those of the innovations. This can be applied to the full set of assimilated observations. Using the Environment Canada assimilation system, the results for several types of observations indicate that the background error estimation would deserve additional attention.

[1]  Niels Bormann,et al.  Estimates of spatial and interchannel observation‐error characteristics for current sounder radiances for numerical weather prediction. II: Application to AIRS and IASI data , 2010 .

[2]  S. Dance,et al.  On diagnosing observation‐error statistics with local ensemble data assimilation , 2017 .

[3]  F. Rabier,et al.  The potential of high‐density observations for numerical weather prediction: A study with simulated observations , 2003 .

[4]  Nancy Nichols,et al.  Estimating interchannel observation‐error correlations for IASI radiance data in the Met Office system † , 2014 .

[5]  Richard Ménard,et al.  Error covariance estimation methods based on analysis residuals: theoretical foundation and convergence properties derived from simplified observation networks , 2016 .

[6]  Paul Poli,et al.  Diagnosis of observation, background and analysis‐error statistics in observation space , 2005 .

[7]  Elizabeth A. Satterfield,et al.  Accounting for Correlated Observation Error in a Dual-Formulation 4D Variational Data Assimilation System , 2017 .

[8]  Anthony Hollingsworth,et al.  The statistical structure of short-range forecast errors as determined from radiosonde data , 1986 .

[9]  J. Eyre,et al.  Accounting for correlated error in the assimilation of high‐resolution sounder data , 2014 .

[10]  N. Bormann,et al.  Enhancing the impact of IASI observations through an updated observation‐error covariance matrix , 2016 .

[11]  E. Kalnay,et al.  Simultaneous estimation of covariance inflation and observation errors within an ensemble Kalman filter , 2009 .

[12]  Mark Buehner,et al.  Implementation of Deterministic Weather Forecasting Systems Based on Ensemble–Variational Data Assimilation at Environment Canada. Part I: The Global System , 2015 .

[13]  Nicholas J. Higham,et al.  Functions of matrices - theory and computation , 2008 .

[14]  Mark Buehner,et al.  Interchannel error correlation associated with AIRS radiance observations : Inference and impact in data assimilation , 2007 .

[15]  Takemasa Miyoshi,et al.  Estimating and including observation-error correlations in data assimilation , 2013 .

[16]  Niels Bormann,et al.  Estimates of spatial and interchannel observation‐error characteristics for current sounder radiances for numerical weather prediction. I: Methods and application to ATOVS data , 2010 .

[17]  A. Mcnally,et al.  The assimilation of Infrared Atmospheric Sounding Interferometer radiances at ECMWF , 2009 .

[18]  M. Matricardi,et al.  Fast radiative transfer model for simulation of infrared atmospheric sounding interferometer radiances. , 1999, Applied optics.

[19]  Mark Buehner,et al.  Evaluation of new estimates of background- and observation-error covariances for variational assimilation , 2005 .

[20]  Nancy Nichols,et al.  Theoretical insight into diagnosing observation error correlations using observation‐minus‐background and observation‐minus‐analysis statistics , 2016 .

[21]  Nancy Nichols,et al.  On the representation error in data assimilation , 2018 .