An Adjoint-Based Adaptive Ensemble Kalman Filter

A new hybrid ensemble Kalman filter/four-dimensional variational data assimilation (EnKF/4D-VAR) approach is introduced to mitigate background covariance limitations in the EnKF. The work is based on the adaptive EnKF (AEnKF) method, which bears a strong resemblance to the hybrid EnKF/three-dimensional variational data assimilation (3D-VAR) method. In the AEnKF, the representativeness of the EnKF ensemble is regularly enhanced with new members generated after back projection of the EnKF analysis residuals to state space using a 3D-VAR [or optimal interpolation (OI)] scheme with a preselected background covariance matrix. The idea here is to reformulate the transformation of the residuals as a 4D-VAR problem, constraining the new member with model dynamics and the previous observations. This should provide more information for the estimation of the new member and reduce dependence of the AEnKF on the assumed stationary background covariance matrix. This is done by integrating the analysis residuals backward in time with the adjoint model. Numerical experiments are performed with the Lorenz-96 model under different scenarios to test the new approach and to evaluate its performance with respect to the EnKF and the hybrid EnKF/3D-VAR. The new method leads to the least root-mean-square estimation errors as long as the linear assumption guaranteeing the stability of the adjoint model holds. It is also found to be less sensitive to choices of the assimilation system inputs and parameters.

[1]  J. M. Lewis,et al.  The use of adjoint equations to solve a variational adjustment problem with advective constraints , 1985 .

[2]  F. L. Dimet,et al.  Variational algorithms for analysis and assimilation of meteorological observations: theoretical aspects , 1986 .

[3]  M. Ghil,et al.  Data assimilation in meteorology and oceanography , 1991 .

[4]  R. Daley.  Atmospheric Data Analysis , 1991 .

[5]  John Derber,et al.  The National Meteorological Center's spectral-statistical interpolation analysis system , 1992 .

[6]  P. Courtier,et al.  A strategy for operational implementation of 4D‐Var, using an incremental approach , 1994 .

[7]  G. Evensen.  Sequential data assimilation with a nonlinear quasi‐geostrophic model using Monte Carlo methods to forecast error statistics , 1994 .

[8]  D. S. Sivia,et al.  Data Analysis , 1996, Encyclopedia of Evolutionary Psychological Science.

[9]  Jeffrey L. Anderson.  A Method for Producing and Evaluating Probabilistic Forecasts from Ensemble Model Integrations , 1996 .

[10]  G. Evensen,et al.  Analysis Scheme in the Ensemble Kalman Filter , 1998 .

[11]  K. Emanuel,et al.  Optimal Sites for Supplementary Weather Observations: Simulation with a Small Model , 1998 .

[12]  P. Houtekamer,et al.  Data Assimilation Using an Ensemble Kalman Filter Technique , 1998 .

[13]  G. Evensen,et al.  An ensemble Kalman smoother for nonlinear dynamics , 2000 .

[14]  J. Mahfouf,et al.  The ecmwf operational implementation of four‐dimensional variational assimilation. III: Experimental results and diagnostics with operational configuration , 2000 .

[15]  T. Hamill,et al.  A Hybrid Ensemble Kalman Filter-3D Variational Analysis Scheme , 2000 .

[16]  J. Whitaker,et al.  Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter , 2001 .

[17]  Pierre Brasseur,et al.  Dynamical evolution of the error statistics with the SEEK filter to assimilate altimetric data in eddy‐resolving ocean models , 2001 .

[18]  D. Menemenlis.  Inverse Modeling of the Ocean and Atmosphere , 2002 .

[19]  J. Whitaker,et al.  Ensemble Data Assimilation without Perturbed Observations , 2002 .

[20]  P. Houtekamer,et al.  Ensemble size, balance, and model-error representation in an ensemble Kalman filter , 2002 .

[21]  Dinh-Tuan Pham,et al.  A simplified reduced order Kalman filtering and application to altimetric data assimilation in Tropical Pacific , 2002 .

[22]  J. Whitaker,et al.  Ensemble Square Root Filters , 2003, Statistical Methods for Climate Scientists.

[23]  Andrew C. Lorenc,et al.  The potential of the ensemble Kalman filter for NWP—a comparison with 4D‐Var , 2003 .

[24]  Jérôme Vialard,et al.  Three- and Four-Dimensional Variational Assimilation with a General Circulation Model of the Tropical Pacific Ocean. Part I: Formulation, Internal Diagnostics, and Consistency Checks , 2003 .

[25]  Geir Evensen,et al.  The Ensemble Kalman Filter: theoretical formulation and practical implementation , 2003 .

[26]  E. Kalnay,et al.  Four-dimensional ensemble Kalman filtering , 2004 .

[27]  J. Whitaker,et al.  Accounting for the Error due to Unresolved Scales in Ensemble Data Assimilation: A Comparison of Different Approaches , 2005 .

[28]  Ibrahim Hoteit,et al.  Treating strong adjoint sensitivities in tropical eddy‐permitting variational data assimilation , 2005 .

[29]  Chris Snyder,et al.  A Comparison between the 4DVAR and the Ensemble Kalman Filter Techniques for Radar Data Assimilation , 2005 .

[30]  M. Buehner.  Ensemble‐derived stationary and flow‐dependent background‐error covariances: Evaluation in a quasi‐operational NWP setting , 2005 .

[31]  M. Buehner,et al.  Atmospheric Data Assimilation with an Ensemble Kalman Filter: Results with Real Observations , 2005 .

[32]  Adrian Sandu,et al.  On the Properties of Runge-Kutta Discrete Adjoints , 2006, International Conference on Computational Science.

[33]  T. Hamill,et al.  On the Theoretical Equivalence of Differently Proposed Ensemble 3DVAR Hybrid Analysis Schemes , 2007 .

[34]  Albert C. Reynolds,et al.  An Iterative Ensemble Kalman Filter for Data Assimilation , 2007 .

[35]  B. Cornuelle,et al.  Interannual to Decadal Changes in the ECCO Global Synthesis , 2007 .

[36]  Ibrahim Hoteit,et al.  Using Low-Rank Ensemble Kalman Filters for Data Assimilation with High Dimensional Imperfect Models 1 , 2007 .

[37]  Pierre F. J. Lermusiaux,et al.  Adaptive modeling, adaptive data assimilation and adaptive sampling , 2007 .

[38]  J. Carton,et al.  A Reanalysis of Ocean Climate Using Simple Ocean Data Assimilation (SODA) , 2008 .

[39]  Q. Xiao,et al.  An Ensemble-Based Four-Dimensional Variational Data Assimilation Scheme. Part I: Technical Formulation and Preliminary Test , 2008 .

[40]  Albert C. Reynolds,et al.  Iterative Ensemble Kalman Filters for Data Assimilation , 2009 .

[41]  X. Deng,et al.  Model Error Representation in an Operational Ensemble Kalman Filter , 2009 .

[42]  J. Kepert.  Covariance localisation and balance in an Ensemble Kalman Filter , 2009 .

[43]  Fuqing Zhang,et al.  Coupling ensemble Kalman filter with four-dimensional variational data assimilation , 2009 .

[44]  B. Cornuelle,et al.  An Adaptive Approach to Mitigate Background Covariance Limitations in the Ensemble Kalman Filter , 2010 .

[45]  Patrick Heimbach,et al.  An eddy-permitting, dynamically consistent adjoint-based assimilation system for the tropical Pacific: Hindcast experiments in 2000 , 2010 .

[46]  Marc Bocquet,et al.  Ensemble Kalman filtering without the intrinsic need for inflation , 2011 .

[47]  Patrick Heimbach,et al.  A MITgcm/DART ensemble analysis and prediction system with application to the Gulf of Mexico , 2013 .