Indistinguishable states I.: perfect model scenario

An accurate forecast of a nonlinear system will require an accurate estimation of the initial state. It is shown that even under the ideal conditions of a perfect model and infinite past observations of a deterministic nonlinear system, uncertainty in the observations makes exact state estimation is impossible. Consistent with the noisy observations there is a set of states indistinguishable from the true state. This implies that an accurate forecast must be based on a probability density on the indistinguishable states. This paper shows that this density can be calculated by first calculating a maximum likelihood estimate of the state, and then an ensemble estimate of the density of states that are indistinguishable from the maximum likelihood state. A new method for calculating the maximum likelihood estimate of the true state is presented which allows practical ensemble forecasting even when the recurrence time of the system is long. In a subsequent paper the theory and practice described in this paper are extended to an imperfect model scenario. © 2001 Published by Elsevier Science B.V.

[1]  C. Wunsch The Ocean Circulation Inverse Problem , 1996 .

[2]  Stephen M. Hammel,et al.  A noise reduction method for chaotic systems , 1990 .

[3]  E. Lorenz Atmospheric Predictability as Revealed by Naturally Occurring Analogues , 1969 .

[4]  H. V. D. Dool,et al.  Searching for analogues, how long must we wait? , 1994 .

[5]  Alistair I. Mees,et al.  Convergence of an annealing algorithm , 1986, Math. Program..

[6]  Kevin Judd,et al.  Convergence properties of gradient descent noise reduction , 2002, Physica D: Nonlinear Phenomena.

[7]  R. Daley Atmospheric Data Analysis , 1991 .

[8]  A. N. Sharkovskiĭ Dynamic systems and turbulence , 1989 .

[9]  J. D. Farmer,et al.  State space reconstruction in the presence of noise" Physica D , 1991 .

[10]  Steven P. Lalley,et al.  Removing the Noise from Chaos Plus Noise , 2001 .

[11]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[12]  K. Ikeda Multiple-valued stationary state and its instability of the transmitted light by a ring cavity system , 1979 .

[13]  F. Molteni,et al.  The ECMWF Ensemble Prediction System: Methodology and validation , 1996 .

[14]  Lawrence F. Shampine,et al.  The MATLAB ODE Suite , 1997, SIAM J. Sci. Comput..

[15]  Arnold Neumaier,et al.  Global Optimization by Multilevel Coordinate Search , 1999, J. Glob. Optim..

[16]  Leonard A. Smith,et al.  The role of operational constraints in selecting supplementary observations , 2000 .

[17]  L. Mark Berliner,et al.  Likelihood and Bayesian Prediction of Chaotic Systems , 1991 .

[18]  C. D. Perttunen,et al.  Lipschitzian optimization without the Lipschitz constant , 1993 .

[19]  F. Takens Detecting strange attractors in turbulence , 1981 .

[20]  Eugenia Kalnay,et al.  Ensemble Forecasting at NMC: The Generation of Perturbations , 1993 .

[21]  P. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[22]  W. Härdle Applied Nonparametric Regression , 1992 .

[23]  Mike E. Davies,et al.  Noise reduction by gradient descent , 1993 .

[24]  Olivier Talagrand,et al.  On extending the limits of variational assimilation in nonlinear chaotic systems , 1996 .

[25]  Mike E. Davies,et al.  Noise reduction schemes for chaotic time series , 1994 .