Ensemble Kalman filtering

An ensemble Kalman filter (EnKF) has been implemented at the Canadian Meteorological Centre to provide an ensemble of initial conditions for the medium-range ensemble prediction system. This demonstrates that the EnKF can be used for operational atmospheric data assimilation. We show how the EnKF relates to the Kalman filter. In particular, to make the ensemble approximation feasible, we have to use a fairly small ensemble with many less members than either the number of model coordinates, or the number of independent observations, or the (unknown) dimension of the dynamical system. To nevertheless obtain good results, we must (i) counter the tendency of the ensemble spread to underestimate the true error, and (ii) localize the ensemble covariances. The localization is severe and leads to imbalance in the initial conditions. The operational EnKF is used to investigate to what extent our system respects the underlying hypotheses of both the Kalman filter and its ensemble approximation. In particular, we quantify the imbalance in the initial conditions and the magnitude of the model-error component. The occurrence of imbalance constrains the ways in which time interpolation can be performed and in which parametrized model error can be added. With this study we hope to obtain and provide guidance for further improvements to the EnKF. Copyright © 2005 Royal Meteorological Society

[1]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[2]  T. Hamill,et al.  A Hybrid Ensemble Kalman Filter-3D Variational Analysis Scheme , 2000 .

[3]  P. Houtekamer,et al.  A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation , 2001 .

[4]  Daniel P. Petersen.  Transient Suppression in Optimal Sequential Analysis , 1973 .

[5]  S. Cohn.  Methods of Sequential Estimation for Determining Initial Data in Numerical Weather Prediction , 1982 .

[6]  Andrew C. Lorenc,et al.  The potential of the ensemble Kalman filter for NWP—a comparison with 4D‐Var , 2003 .

[7]  P. Houtekamer,et al.  Ensemble size, balance, and model-error representation in an ensemble Kalman filter , 2002 .

[8]  Arthur Gelb,et al.  Applied Optimal Estimation , 1974 .

[9]  D. Dee.  On-line Estimation of Error Covariance Parameters for Atmospheric Data Assimilation , 1995 .

[10]  Jeffrey L. Anderson.  An Ensemble Adjustment Kalman Filter for Data Assimilation , 2001 .

[11]  H. Jean Thiébaux,et al.  Short‐term systematic errors in global forecasts: their estimation and removal , 1990 .

[12]  Norman A. Phillips,et al.  The spatial statistics of random geostrophic modes and first-guess errors , 1986 .

[13]  R. Daley.  Estimating Model-Error Covariances for Application to Atmospheric Data Assimilation , 1992 .

[14]  P. Courtier,et al.  Assimilation of Simulated Wind Lidar Data with a Kalman Filter , 1993 .

[15]  Peter Jan van Leeuwen,et al.  Comment on ''Data Assimilation Using an Ensemble Kalman Filter Technique'' , 1999 .

[16]  A. Staniforth,et al.  The Operational CMC–MRB Global Environmental Multiscale (GEM) Model. Part II: Results , 1998 .

[17]  P. L. Houtekamer,et al.  A System Simulation Approach to Ensemble Prediction , 1996 .

[18]  P. Houtekamer,et al.  Data Assimilation Using an Ensemble Kalman Filter Technique , 1998 .

[19]  Istvan Szunyogh,et al.  Assessing a local ensemble Kalman filter: perfect model experiments with the National Centers for Environmental Prediction global model , 2005 .

[20]  M. Rienecker,et al.  Initial testing of a massively parallel ensemble Kalman filter with the Poseidon isopycnal ocean general circulation model , 2002 .

[21]  T. Kailath,et al.  An innovations approach to least-squares estimation--Part II: Linear smoothing in additive white noise , 1968 .

[22]  M. Buehner,et al.  Atmospheric Data Assimilation with an Ensemble Kalman Filter: Results with Real Observations , 2005 .

[23]  G. Evensen.  Sequential data assimilation with a nonlinear quasi‐geostrophic model using Monte Carlo methods to forecast error statistics , 1994 .

[24]  P. Courtier,et al.  Extended assimilation and forecast experiments with a four‐dimensional variational assimilation system , 1998 .

[25]  J. Whitaker,et al.  Ensemble Square Root Filters , 2003, Statistical Methods for Climate Scientists.

[26]  D. Pham.  Stochastic Methods for Sequential Data Assimilation in Strongly Nonlinear Systems , 2001 .

[27]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[28]  G. Shutts.  A kinetic energy backscatter algorithm for use in ensemble prediction systems , 2005 .

[29]  S. Cohn,et al.  Applications of Estimation Theory to Numerical Weather Prediction , 1981 .

[30]  Istvan Szunyogh,et al.  A local ensemble Kalman filter for atmospheric data assimilation , 2004 .

[31]  Arlindo da Silva,et al.  Data assimilation in the presence of forecast bias , 1998 .

[32]  J. Hansen,et al.  Implications of Stochastic and Deterministic Filters as Ensemble-Based Data Assimilation Methods in Varying Regimes of Error Growth , 2004 .

[33]  Stephane Laroche.  Evaluation of the operational 4D-Var at the Meteorological Service of Canada , 2005 .

[34]  P. Houtekamer,et al.  An Adaptive Ensemble Kalman Filter , 2000 .

[35]  S. Cohn,et al.  Ooce Note Series on Global Modeling and Data Assimilation Construction of Correlation Functions in Two and Three Dimensions and Convolution Covariance Functions , 2022 .

[36]  R. Daley.  The Lagged Innovation Covariance: A Performance Diagnostic for Atmospheric Data Assimilation , 1992 .

[37]  E. Kalnay,et al.  Four-dimensional ensemble Kalman filtering , 2004 .

[38]  Stephen E. Cohn,et al.  An Introduction to Estimation Theory (gtSpecial IssueltData Assimilation in Meteology and Oceanography: Theory and Practice) , 1997 .

[39]  David L. Williamson,et al.  Normal mode initialization for a multilevel grid-point model , 1981 .

[40]  M. Ghil,et al.  Data assimilation in meteorology and oceanography , 1991 .

[41]  Jeffrey L. Anderson,et al.  A Monte Carlo Implementation of the Nonlinear Filtering Problem to Produce Ensemble Assimilations and Forecasts , 1999 .

[42]  John Derber,et al.  The National Meteorological Center's spectral-statistical interpolation analysis system , 1992 .

[43]  G. Evensen,et al.  Analysis Scheme in the Ensemble Kalman Filter , 1998 .

[44]  D. McLaughlin,et al.  Hydrologic Data Assimilation with the Ensemble Kalman Filter , 2002 .

[45]  Robert N. Miller,et al.  Data assimilation into nonlinear stochastic models , 1999 .

[46]  C. Snyder,et al.  Assimilation of Simulated Doppler Radar Observations with an Ensemble Kalman Filter , 2003 .

[47]  A. Staniforth,et al.  The Operational CMC–MRB Global Environmental Multiscale (GEM) Model. Part I: Design Considerations and Formulation , 1998 .

[48]  Franco Molteni,et al.  On the operational predictability of blocking , 1990 .

[49]  S. Cohn,et al.  Assessing the Effects of Data Selection with the DAO Physical-Space Statistical Analysis System* , 1998 .

[50]  Stephen E. Cohn,et al.  The Behavior of Forecast Error Covariances for a Kalman Filter in Two Dimensions , 1991 .

[51]  T. Palmer,et al.  Stochastic representation of model uncertainties in the ECMWF ensemble prediction system , 2007 .

[52]  A. Hollingsworth,et al.  Monitoring of observation and analysis quality by a data assimilation system , 1986 .

[53]  Luc Fillion,et al.  The impact of a digital filter finalization technique in a global data assimilation system , 1995 .

[54]  Louis J. Wicker,et al.  Wind and Temperature Retrievals in the 17 May 1981 Arcadia, Oklahoma, Supercell: Ensemble Kalman Filter Experiments , 2004 .

[55]  R. Daley.  Atmospheric Data Analysis , 1991 .

[56]  J. Whitaker,et al.  Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter , 2001 .

[57]  Stephen J. Lord,et al.  The New Global Operational Analysis System at the National Meteorological Center , 1991 .

[58]  P. L. Houtekamer,et al.  Increasing the horizontal resolution of ensemble forecasts at CMC , 2003 .

[59]  J. M. Lewis,et al.  The use of adjoint equations to solve a variational adjustment problem with advective constraints , 1985 .

[60]  A. Simmons,et al.  The ECMWF operational implementation of four‐dimensional variational assimilation. I: Experimental results with simplified physics , 2007 .

[61]  Xue Wei,et al.  Reanalysis without Radiosondes Using Ensemble Data Assimilation , 2004 .