Errors in the Initial Conditions for Numerical Weather Prediction: A Study of Error Growth Patterns and Error Reduction with Ensemble Filtering

Title of dissertation: ERRORS IN THE INITIAL CONDITIONS FOR NUMERICAL WEATHER PREDICTION: A STUDY OF ERROR GROWTH PATTERNS AND ERROR REDUCTION WITH ENSEMBLE FILTERING John Harlim, Doctor of Philosophy, 2006 Dissertation directed by: Professor Brian R. Hunt Department of Mathematics In this dissertation, we study the errors of a numerical weather prediction due to the errors in initial conditions and we present efficient nonlinear ensemble filters for reducing these errors. First, we investigate the error growth, that is, the growth in time of the distance E between two solutions of a global weather model with similar initial conditions. Typically E grows until it reaches a saturation value Es. We find two distinct broad log-linear regimes, one for E below 2% of Es and the other for E above. In each, log(E/Es) grows as if satisfying a linear differential equation. When plotting d log(E)/dt vs log(E), the graph is convex. We argue this behavior is quite different from error growth in other simpler dynamical systems, which yield concave graphs. Secondly, we present an efficient variation of the Local Ensemble Kalman Filter [32, 33] and the results of perfect model tests with the Lorenz-96 model. This scheme is locally similar to performing the Ensemble Transform Kalman Filter [5]. We also include a “four-dimensional” extension of the scheme to allow for asynchronous observations. Finally, we present a modified ensemble Kalman filter that allows a nonGaussian background error distribution. Using a distribution that decays more slowly than a Gaussian is an alternative to using a high amount of variance inflation. We demonstrate the effectiveness of this approach for the three-dimensional Lorenz-63 model and the 40-dimensional Lorenz-96 model in cases when the observations are infrequent, for which the non-Gaussian filter reduces the average analysis error by about 10% compared to the analogous Gaussian filter. The mathematical formulation of this non-Gaussian filter is designed to preserve the computational efficiency of the local filter described in the previous paragraph for high-dimensional systems. ERRORS IN THE INITIAL CONDITIONS FOR NUMERICAL WEATHER PREDICTION: A STUDY OF ERROR GROWTH PATTERNS AND ERROR REDUCTION WITH ENSEMBLE FILTERING

[1]  Joseph Sela,et al.  Spectral Modeling at the National Meteorological Center , 1980 .

[2]  M. Zupanski.  Maximum Likelihood Ensemble Filter: Theoretical Aspects , 2005 .

[3]  Eugenia Kalnay,et al.  Ensemble Forecasting at NMC: The Generation of Perturbations , 1993 .

[4]  S. Cohn,et al.  Applications of Estimation Theory to Numerical Weather Prediction , 1981 .

[5]  R. Rotunno,et al.  Effects of Moist Convection on Mesoscale Predictability , 2003 .

[6]  S. Julier,et al.  Which Is Better, an Ensemble of Positive–Negative Pairs or a Centered Spherical Simplex Ensemble? , 2004 .

[7]  Christopher K. Wikle,et al.  Atmospheric Modeling, Data Assimilation, and Predictability , 2005, Technometrics.

[8]  Lennart Bengtsson,et al.  A note on atmospheric predictability , 2006 .

[9]  J. Whitaker,et al.  Ensemble Data Assimilation without Perturbed Observations , 2002 .

[10]  E. Lorenz.  Deterministic nonperiodic flow , 1963 .

[11]  Jeffrey L. Anderson,et al.  A Monte Carlo Implementation of the Nonlinear Filtering Problem to Produce Ensemble Assimilations and Forecasts , 1999 .

[12]  J. Holton.  An introduction to dynamic meteorology , 2004 .

[13]  Istvan Szunyogh,et al.  A Local Ensemble Kalman Filter for Atmospheric Data Assimilation , 2002 .

[14]  Istvan Szunyogh,et al.  Assessing a local ensemble Kalman filter: Perfect model experiments with the NCEP global model , 2004 .

[15]  Jeffrey L. Anderson.  An Ensemble Adjustment Kalman Filter for Data Assimilation , 2001 .

[16]  G. Evensen.  Sequential data assimilation with a nonlinear quasi‐geostrophic model using Monte Carlo methods to forecast error statistics , 1994 .

[17]  J. Whitaker,et al.  Ensemble Square Root Filters , 2003, Statistical Methods for Climate Scientists.

[18]  Istvan Szunyogh,et al.  Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter , 2005, physics/0511236.

[19]  J. Yorke,et al.  Four-dimensional ensemble Kalman filtering , 2004 .

[20]  G. Evensen,et al.  Analysis Scheme in the Ensemble Kalman Filter , 1998 .

[21]  J. Whitaker,et al.  Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter , 2001 .

[22]  Oliver Talagrand,et al.  A study of the dynamics of four-dimensional data assimilation , 1981 .

[23]  A. Lorenc.  A Global Three-Dimensional Multivariate Statistical Interpolation Scheme , 1981 .

[24]  P. Houtekamer,et al.  Data Assimilation Using an Ensemble Kalman Filter Technique , 1998 .

[25]  E. Kalnay,et al.  Ensemble Forecasting at NCEP and the Breeding Method , 1997 .

[26]  Craig H. Bishop,et al.  Adaptive sampling with the ensemble transform Kalman filter , 2001 .

[27]  P. Houtekamer,et al.  A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation , 2001 .

[28]  E. Lorenz,et al.  The predictability of a flow which possesses many scales of motion , 1969 .

[29]  E. Lorenz.  Atmospheric predictability experiments with a large numerical model , 1982 .

[30]  Christian L. Keppenne,et al.  Data Assimilation into a Primitive-Equation Model with a Parallel Ensemble Kalman Filter , 2000 .

[31]  F. Molteni.  Atmospheric simulations using a GCM with simplified physical parametrizations. I: model climatology and variability in multi-decadal experiments , 2003 .

[32]  John Harlim,et al.  Convex error growth patterns in a global weather model. , 2005, Physical review letters.

[33]  Franco Molteni,et al.  Toward a dynamical understanding of planetary-scale flow regimes. , 1993 .

[34]  G. D. Nastrom,et al.  A Climatology of Atmospheric Wavenumber Spectra of Wind and Temperature Observed by Commercial Aircraft , 1985 .

[35]  B R Hunt,et al.  Local low dimensionality of atmospheric dynamics. , 2001, Physical review letters.

[36]  Istvan Szunyogh,et al.  Exploiting Local Low Dimensionality of the Atmospheric Dynamics for Efficient Ensemble Kalman Filtering , 2002 .

[37]  K. Emanuel,et al.  Optimal Sites for Supplementary Weather Observations: Simulation with a Small Model , 1998 .