Data assimilation with correlated observation errors: experiments with a 1-D shallow water model

Remote sensing observations often have correlated errors, but the correlations are typically ignored in data assimilation for numerical weather prediction. The assumption of zero correlations is often used with data thinning methods, resulting in a loss of information. As operational centres move towards higher-resolution forecasting, there is a requirement to retain data providing detail on appropriate scales. Thus an alternative approach to dealing with observation error correlations is needed. In this article, we consider several approaches to approximating observation error correlation matrices: diagonal approximations, eigendecomposition approximations and Markov matrices. These approximations are applied in incremental variational assimilation experiments with a 1-D shallow water model using synthetic observations. Our experiments quantify analysis accuracy in comparison with a reference or ‘truth’ trajectory, as well as with analyses using the ‘true’ observation error covariance matrix. We show that it is often better to include an approximate correlation structure in the observation error covariance matrix than to incorrectly assume error independence. Furthermore, by choosing a suitable matrix approximation, it is feasible and computationally cheap to include error correlation structure in a variational data assimilation algorithm.

[1]  F. Rabier,et al.  The potential of high‐density observations for numerical weather prediction: A study with simulated observations , 2003 .

[2]  Scott E. Hannon,et al.  The Gastropod Fast Radiative Transfer Model for Advanced Infrared Sounders and Characterization of Its Errors for Radiance Assimilation , 2003 .

[3]  Niels Bormann,et al.  Estimates of spatial and interchannel observation‐error characteristics for current sounder radiances for numerical weather prediction. I: Methods and application to ATOVS data , 2010 .

[4]  Nancy Nichols,et al.  Correlated observation errors in data assimilation , 2008 .

[5]  Nancy Nichols,et al.  A comparison of two methods for developing the linearization of a shallow-water model , 2003 .

[6]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[7]  Danny C. Sorensen,et al.  Deflation Techniques for an Implicitly Restarted Arnoldi Iteration , 1996, SIAM J. Matrix Anal. Appl..

[8]  D. P. DEE,et al.  Bias and data assimilation , 2005 .

[9]  W. Briggs Statistical Methods in the Atmospheric Sciences , 2007 .

[10]  R. S. Seaman,et al.  Absolute and Differential Accuracy of Analyses Achievable with Specified Observational Network Characteristics , 1977 .

[11]  Jean-Noël Thépaut,et al.  The Spatial Structure of Observation Errors in Atmospheric Motion Vectors from Geostationary Satellite Data , 2003 .

[12]  A. Bunse-Gerstner,et al.  The University of Reading Using model reduction methods within incremental 4D-Var , 2006 .

[13]  Nancy Nichols,et al.  An investigation of incremental 4D‐Var using non‐tangent linear models , 2005 .

[14]  Ionel M. Navon,et al.  Impact of non‐smooth observation operators on variational and sequential data assimilation for a limited‐area shallow‐water equation model , 2012 .

[15]  Andrew Collard,et al.  Selection of IASI channels for use in numerical weather prediction , 2007 .

[16]  Niels Bormann,et al.  Estimates of spatial and interchannel observation‐error characteristics for current sounder radiances for numerical weather prediction. II: Application to AIRS and IASI data , 2010 .

[17]  Nancy Nichols,et al.  Inner-Loop Stopping Criteria for Incremental Four-Dimensional Variational Data Assimilation , 2006 .

[18]  R. Bannister A review of forecast error covariance statistics in atmospheric variational data assimilation. II: Modelling the forecast error covariance statistics , 2008 .

[19]  Danny C. Sorensen,et al.  Implicit Application of Polynomial Filters in a k-Step Arnoldi Method , 1992, SIAM J. Matrix Anal. Appl..

[20]  Ross N. Bannister,et al.  A review of forecast error covariance statistics in atmospheric variational data assimilation. I: Characteristics and measurements of forecast error covariances , 2008 .

[21]  Gene H. Golub,et al.  Matrix computations , 1983 .

[22]  Nancy Nichols,et al.  Conditioning of incremental variational data assimilation, with application to the Met Office system , 2011 .

[23]  Nancy Nichols,et al.  Estimating interchannel observation‐error correlations for IASI radiance data in the Met Office system † , 2014 .

[24]  Clive D Rodgers,et al.  Inverse Methods for Atmospheric Sounding: Theory and Practice , 2000 .

[25]  Nancy Nichols,et al.  Observation error correlations in IASI radiance data , 2009 .

[26]  Nancy Nichols,et al.  Using Model Reduction Methods within Incremental Four-Dimensional Variational Data Assimilation , 2008 .

[27]  S. B. Healy,et al.  Use of discrete Fourier transforms in the 1D‐Var retrieval problem , 2005 .

[28]  Nancy Nichols,et al.  Representativity error for temperature and humidity using the Met Office high‐resolution model † , 2014 .

[29]  N. B. Ingleby,et al.  The statistical structure of forecast errors and its representation in The Met. Office Global 3‐D Variational Data Assimilation Scheme , 2001 .

[30]  J. R. Eyre,et al.  The optimal density of atmospheric sounder observations in the Met Office NWP system , 2007 .

[31]  Nancy Nichols,et al.  Correlations of control variables in variational data assimilation , 2011 .

[32]  Philip E. Gill,et al.  Practical optimization , 1981 .

[33]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[34]  P. Courtier,et al.  A strategy for operational implementation of 4D‐Var, using an incremental approach , 1994 .

[35]  A. Kasahara,et al.  Nonlinear shallow fluid flow over an isolated ridge , 1968 .