An Ensemble Adjustment Kalman Filter for Data Assimilation

Abstract A theory for estimating the probability distribution of the state of a model given a set of observations exists. This nonlinear filtering theory unifies the data assimilation and ensemble generation problem that have been key foci of prediction and predictability research for numerical weather and ocean prediction applications. A new algorithm, referred to as an ensemble adjustment Kalman filter, and the more traditional implementation of the ensemble Kalman filter in which “perturbed observations” are used, are derived as Monte Carlo approximations to the nonlinear filter. Both ensemble Kalman filter methods produce assimilations with small ensemble mean errors while providing reasonable measures of uncertainty in the assimilated variables. The ensemble methods can assimilate observations with a nonlinear relation to model state variables and can also use observations to estimate the value of imprecisely known model parameters. These ensemble filter methods are shown to have significant advantag...

[1]  A. Jazwinski.  Stochastic Processes and Filtering Theory , 1970 .

[2]  F. L. Dimet,et al.  Variational algorithms for analysis and assimilation of meteorological observations: theoretical aspects , 1986 .

[3]  James M. Murphy,et al.  The impact of ensemble forecasts on predictability , 1988 .

[4]  J. Derber.  A Variational Continuous Assimilation Technique , 1989 .

[5]  James M. Murphy,et al.  Assessment of the practical utility of extended range ensemble forecasts , 1990 .

[6]  Timothy W. Barker,et al.  The Relationship between Spread and Forecast Error in Extended-range Forecasts , 1991 .

[7]  Eugenia Kalnay,et al.  Ensemble Forecasting at NMC: The Generation of Perturbations , 1993 .

[8]  R. Errico,et al.  Linearization and adjoint of parameterized moist diabatic processes , 1993 .

[9]  P. Courtier,et al.  Important literature on the use of adjoint, variational methods and the Kalman filter in meteorology , 1993 .

[10]  Eugenia Kalnay,et al.  Operational Ensemble Prediction at the National Meteorological Center: Practical Aspects , 1993 .

[11]  François Bouttier,et al.  The dynamics of error covariances in a barotropic model , 1993 .

[12]  M. Ehrendorfer.  The Liouville Equation and Its Potential Usefulness for the Prediction of Forecast Skill. Part II: Applications , 1994 .

[13]  Edward D. Zaron,et al.  Data Assimilation in Models with Convective Adjustment , 1994 .

[14]  G. Evensen.  Sequential data assimilation with a nonlinear quasi‐geostrophic model using Monte Carlo methods to forecast error statistics , 1994 .

[15]  M. Ehrendorfer.  The Liouville Equation and Its Potential Usefulness for the Prediction of Forecast Skill. Part I: Theory , 1994 .

[16]  Michael Ghil,et al.  Advanced data assimilation in strongly nonlinear dynamical systems , 1994 .

[17]  Solving for the generalized inverse of the Lorenz model , 1995 .

[18]  G. Evensen,et al.  Data assimilation and inverse methods in terms of a probabilistic formulation , 1996 .

[19]  F. Molteni,et al.  The ECMWF Ensemble Prediction System: Methodology and validation , 1996 .

[20]  G. Evensen,et al.  Assimilation of Geosat altimeter data for the Agulhas current using the ensemble Kalman filter with , 1996 .

[21]  Jeffrey L. Anderson.  A Method for Producing and Evaluating Probabilistic Forecasts from Ensemble Model Integrations , 1996 .

[22]  P. L. Houtekamer,et al.  A System Simulation Approach to Ensemble Prediction , 1996 .

[23]  M. Benno Blumenthal,et al.  Reduced space optimal analysis for historical data sets: 136 years of Atlantic sea surface temperatures , 1997 .

[24]  Martin Ehrendorfer,et al.  Optimal Prediction of Forecast Error Covariances through Singular Vectors , 1997 .

[25]  Andrew C. Lorenc,et al.  Development of an Operational Variational Assimilation Scheme (gtSpecial IssueltData Assimilation in Meteology and Oceanography: Theory and Practice) , 1997 .

[26]  E. Kalnay,et al.  Ensemble Forecasting at NCEP and the Breeding Method , 1997 .

[27]  Jeffrey L. Anderson,et al.  The Impact of Dynamical Constraints on the Selection of Initial Conditions for Ensemble Predictions: Low-Order Perfect Model Results , 1997 .

[28]  E. Tziperman,et al.  Using the Adjoint Method With the Ocean Component of Coupled Ocean-Atmosphere Models , 1997 .

[29]  P. L. Houtekamer,et al.  Using ensemble forecasts for model validation , 1997 .

[30]  D. Zupanski.  A General Weak Constraint Applicable to Operational 4DVAR Data Assimilation Systems , 1997 .

[31]  Ying-Hwa Kuo,et al.  The impact of Global Positioning System data on the prediction of an extratropical cyclone: an observing system simulation experiment , 1997 .

[32]  G. Evensen,et al.  Analysis Scheme in the Ensemble Kalman Filter , 1998 .

[33]  T. Palmer,et al.  Singular Vectors, Metrics, and Adaptive Observations. , 1998 .

[34]  K. Emanuel,et al.  Optimal Sites for Supplementary Weather Observations: Simulation with a Small Model , 1998 .

[35]  Robert Vautard,et al.  Four-dimensional variational assimilation and predictability in a quasi-geostrophic model , 1998 .

[36]  P. Houtekamer,et al.  Data Assimilation Using an Ensemble Kalman Filter Technique , 1998 .

[37]  P. Courtier,et al.  Extended assimilation and forecast experiments with a four‐dimensional variational assimilation system , 1998 .

[38]  Craig H. Bishop,et al.  Ensemble Transformation and Adaptive Observations , 1999 .

[39]  T. Palmer,et al.  Analysis and model dependencies in medium‐range ensembles: Two transplant case‐studies , 1999 .

[40]  A. Robinson,et al.  Data Assimilation via Error Subspace Statistical Estimation.Part I: Theory and Schemes , 1999, Monthly Weather Review.

[41]  Pierre Brasseur,et al.  Assimilation of altimetric data in the mid-latitude oceans using the Singular Evolutive Extended Kalman filter with an eddy-resolving, primitive equation model , 1999 .

[42]  Jeffrey L. Anderson,et al.  A Monte Carlo Implementation of the Nonlinear Filtering Problem to Produce Ensemble Assimilations and Forecasts , 1999 .

[43]  Pierre FJ Lermusiaux.  Data Assimilation via Error Subspace Statistical Estimation. , 1999 .

[44]  Peter Jan van Leeuwen,et al.  Comment on ''Data Assimilation Using an Ensemble Kalman Filter Technique'' , 1999 .

[45]  Chris Snyder,et al.  Statistical Design for Adaptive Weather Observations , 1999 .

[46]  T. N. Krishnamurti,et al.  Improved Weather and Seasonal Climate Forecasts from Multimodel Superensemble. , 1999, Science.

[47]  S. Cohn,et al.  Ooce Note Series on Global Modeling and Data Assimilation Construction of Correlation Functions in Two and Three Dimensions and Convolution Covariance Functions , 2022 .

[48]  Jacques Verron,et al.  Assimilation of TOPEX/Poseidon altimetric data in a primitive equation model of the tropical Pacific Ocean during the 1992–1996 El Niño‐Southern Oscillation period , 2000 .

[49]  C. Ziehmann.  Comparison of a single-model EPS with a multi-model ensemble consisting of a few operational models , 2000 .

[50]  Christian L. Keppenne,et al.  Data Assimilation into a Primitive-Equation Model with a Parallel Ensemble Kalman Filter , 2000 .

[51]  P. Houtekamer,et al.  An Adaptive Ensemble Kalman Filter , 2000 .

[52]  D. Richardson.  Skill and relative economic value of the ECMWF ensemble prediction system , 2000 .

[53]  James S. Goerss,et al.  Tropical Cyclone Track Forecasts Using an Ensemble of Dynamical Models , 2000 .

[54]  R. J. Graham,et al.  Joint Medium-Range Ensembles from The Met. Office and ECMWF Systems , 2000 .

[55]  Leonard A. Smith,et al.  Probabilistic noise reduction , 2001 .

[56]  Craig H. Bishop,et al.  Adaptive sampling with the ensemble transform Kalman filter , 2001 .

[57]  P. Houtekamer,et al.  A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation , 2001 .

[58]  J. Whitaker,et al.  Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter , 2001 .