A lag‐1 smoother approach to system‐error estimation: sequential method

Starting from sequential data assimilation arguments, the present work shows how to use residual statistics from filtering and lag-1 (6 h) smoothing to infer components of the system (model) error covariance matrix that project on to a dense observing network. The residuals relationships involving the system-error covariance matrix are similar to those available to derive background, observation and analysis-error covariance information from filter residual statistics. An illustration of the approach is given for two low-dimensional dynamical systems: a linear damped harmonic oscillator and the nonlinear Lorenz system. The application examples consider the important case of evaluating the ability to estimate the model-error covariance from residual time series obtained from suboptimal filters and smoothers that assume the model to be perfect. The examples show the residuals to contain the necessary information to allow for such estimation. The examples also illustrate the consequences of estimating covariances through time series of residuals (available in practice) instead of multiple realizations from Monte Carlo sampling. A recast of the sequential approach into variational approach language will appear in a companion article.

[1]  C. Nicolis.  Dynamics of model error: The role of unresolved scales revisited , 2004 .

[2]  James A. Hansen,et al.  Efficient Approximate Techniques for Integrating Stochastic Differential Equations , 2006 .

[3]  R. Daley.  The Lagged Innovation Covariance: A Performance Diagnostic for Atmospheric Data Assimilation , 1992 .

[4]  K. Emanuel,et al.  Optimal Sites for Supplementary Weather Observations: Simulation with a Small Model , 1998 .

[5]  Matthew Fisher,et al.  On the equivalence between Kalman smoothing and weak‐constraint four‐dimensional variational data assimilation , 2005, Quarterly Journal of the Royal Meteorological Society.

[6]  A. Hollingsworth,et al.  The verification of objective analyses: Diagnostics of analysis system performance , 1989 .

[7]  Michael Ghil,et al.  Advanced data assimilation in strongly nonlinear dynamical systems , 1994 .

[8]  P. Houtekamer,et al.  A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation , 2001 .

[9]  J. Whitaker,et al.  Evaluating Methods to Account for System Errors in Ensemble Data Assimilation , 2012 .

[10]  Y. Trémolet.  Accounting for an imperfect model in 4D‐Var , 2006 .

[11]  Y. Trémolet.  Model‐error estimation in 4D‐Var , 2007 .

[12]  Michael G. Bosilovich,et al.  Skin Temperature Analysis and Bias Correction in a Coupled Land-Atmosphere Data Assimilation System , 2007 .

[13]  Ricardo Todling,et al.  Suboptimal Schemes for Retrospective Data Assimilation Based on the Fixed-Lag Kalman Smoother , 1998 .

[14]  O. Talagrand,et al.  Diagnosis and tuning of observational error in a quasi‐operational data assimilation setting , 2006 .

[15]  Ricardo Todling,et al.  Comparing Two Approaches for Assessing Observation Impact , 2013 .

[16]  Tim N. Palmer,et al.  Forcing singular vectors and other sensitive model structures , 2003 .

[17]  Paul Poli,et al.  Diagnosis of observation, background and analysis‐error statistics in observation space , 2005 .

[18]  Richard Ménard,et al.  Assimilation of Stratospheric Chemical Tracer Observations Using a Kalman Filter. Part II: χ2-Validated Results and Analysis of Variance and Correlation Dynamics , 2000 .

[19]  B. Farrell,et al.  Distributed Forcing of Forecast and Assimilation Error Systems , 2005 .

[20]  R. Daley.  The Effect of Serially Correlated Observation and Model Error on Atmospheric Data Assimilation , 1992 .

[21]  R. Daley.  Estimating Model-Error Covariances for Application to Atmospheric Data Assimilation , 1992 .

[22]  D. Dee.  On-line Estimation of Error Covariance Parameters for Atmospheric Data Assimilation , 1995 .

[23]  R. Todling,et al.  Data Assimilation in the Presence of Forecast Bias: The GEOS Moisture Analysis , 2000 .

[24]  Michael Ghil,et al.  An efficient algorithm for estimating noise covariances in distributed systems , 1985 .

[25]  M. Cullen.  A demonstration of cycled 4D‐Var in the presence of model error , 2010 .

[26]  Dick Dee,et al.  Maximum-Likelihood Estimation of Forecast and Observation Error Covariance Parameters. Part I: Methodology , 1999 .

[27]  C. Nicolis,et al.  Dynamics of Model Error: Some Generic Features , 2003 .

[28]  Ricardo Todling,et al.  A fixed-lag Kalman smoother for retrospective data assimilation , 1994 .

[29]  Stephen E. Cohn,et al.  An Introduction to Estimation Theory (gtSpecial IssueltData Assimilation in Meteology and Oceanography: Theory and Practice) , 1997 .

[30]  Siegfried D. Schubert,et al.  An Objective Method for Inferring Sources of Model Error , 1996 .

[31]  K.K. Biswas,et al.  An Approach to Fixed-Point Smoothing Problems , 1972, IEEE Transactions on Aerospace and Electronic Systems.