Roots of Ensemble Forecasting

Abstract The generation of a probabilistic view of dynamical weather prediction is traced back to the early 1950s, to that point in time when deterministic short-range numerical weather prediction (NWP) achieved its earliest success. Eric Eady was the first meteorologist to voice concern over strict determinism—that is, a future determined by the initial state without account for uncertainties in that state. By the end of the decade, Philip Thompson and Edward Lorenz explored the predictability limits of deterministic forecasting and set the stage for an alternate view—a stochastic–dynamic view that was enunciated by Edward Epstein. The steps in both operational short-range NWP and extended-range forecasting that justified a coupling between probability and dynamical law are followed. A discussion of the bridge from theory to practice follows, and the study ends with a genealogy of ensemble forecasting as an outgrowth of traditions in the history of science.

[1]  R. Buizza,et al.  A Comparison of the ECMWF, MSC, and NCEP Global Ensemble Prediction Systems , 2005 .

[2]  T. Palmer.  Medium and extended range predictability and stability of the Pacific/North American mode , 2006 .

[3]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[4]  N. Metropolis,et al.  The Monte Carlo method. , 1949 .

[5]  A. E. Gill.  Atmosphere-Ocean Dynamics , 1982 .

[6]  Renate Hagedorn,et al.  Representing model uncertainty in weather and climate prediction , 2005 .

[7]  G. Evensen,et al.  Analysis Scheme in the Ensemble Kalman Filter , 1998 .

[8]  J. Wallace,et al.  Teleconnections in the Geopotential Height Field during the Northern Hemisphere Winter , 1981 .

[9]  Franco Molteni,et al.  Ensemble prediction using dynamically conditioned perturbations , 1993 .

[10]  C. E. Leith,et al.  Predictability of climate , 1978, Nature.

[11]  J. Neumann,et al.  Numerical Integration of the Barotropic Vorticity Equation , 1950 .

[12]  Joseph Smagorinsky,et al.  problems and promises of deterministic extended range forecasting , 1969 .

[13]  C. E. Leith,et al.  Predictability of Turbulent Flows , 1972 .

[14]  G. A. Corby,et al.  United Kingdom Meteorological Office Five-Level General Circulation Model , 1977 .

[15]  P. D. Thompson,et al.  Uncertainty of Initial State as a Factor in the Predictability of Large Scale Atmospheric Flow Patterns , 1957 .

[16]  Lee E. Smith,et al.  Oral History , 1983 .

[17]  Barry Saltzman,et al.  Finite Amplitude Free Convection as an Initial Value Problem—I , 1962 .

[18]  Richard L. Pfeffer.  Dynamics of climate : the proceedings of a Conference on the Application of Numerical Integration Techniques to the Problem of the General Circulation, held October 26-28, 1955 , 1960 .

[19]  O. Talagrand,et al.  The assimilation of past data in dynamical analysis. II , 1971 .

[20]  E. Lorenz.  Deterministic nonperiodic flow , 1963 .

[21]  M. Ehrendorfer.  Vorhersage der Unsicherheit numerischer Wetterprognosen: eine Übersicht , 1997 .

[22]  E. Epstein,et al.  Stochastic dynamic prediction1 , 1969 .

[23]  E. Lorenz.  Atmospheric Predictability as Revealed by Naturally Occurring Analogues , 1969 .

[24]  Rex J. Fleming,et al.  ON STOCHASTIC DYNAMIC PREDICTION: I. The Energetics of Uncertainty and the Question of Closure , 1971 .

[25]  A. Hollingsworth,et al.  Some aspects of the improvement in skill of numerical weather prediction , 2002 .

[27]  Eugenia Kalnay,et al.  Ensemble Forecasting at NMC: The Generation of Perturbations , 1993 .

[28]  C. Gauss.  Theory of the Motion of the Heavenly Bodies Moving About the Sun in Conic Sections , 1957 .

[29]  K. Hinkelmann.  Der Mechanismus des meteorologischen Lärmes , 1951 .

[30]  Rex J. Fleming,et al.  ON STOCHASTIC DYNAMIC PREDICTION , 1971 .

[31]  J. Whitaker,et al.  Ensemble Forecasts and the Properties of Flow-Dependent Analysis-Error Covariance Singular Vectors , 2003 .

[32]  R. F. Strickler,et al.  Numerical Simulation of the Breakdown of a Polar-Night Vortex in the Stratosphere , 1970 .

[33]  T. Palmer.  Extended-range atmospheric prediction and the Lorenz model , 1993 .

[34]  K. Miyakoda,et al.  One-Month Forecast Experiments—without Anomaly Boundary Forcings , 1986 .

[35]  E. Lorenz.  A study of the predictability of a 28-variable atmospheric model , 1965 .

[36]  J. G. Charney,et al.  The Use of the Primitive Equations of Motion in Numerical Prediction , 1955 .

[37]  P. L. Houtekamer,et al.  A System Simulation Approach to Ensemble Prediction , 1996 .

[38]  N. Wiener.  Nonlinear Prediction and Dynamics , 1956 .

[39]  Ragnar Fjørtoft,et al.  On a Numerical Method of Integrating the Barotropic Vorticity Equation , 1952, Tellus A: Dynamic Meteorology and Oceanography.

[40]  E. Epstein,et al.  Stochastic dynamic prediction , 1969 .

[41]  Akio Arakawa,et al.  Chapter 1 - A Personal Perspective on the Early Years of General Circulation Modeling at UCLA , 2000 .

[42]  Norman A. Phillips,et al.  The general circulation of the atmosphere: A numerical experiment , 1956 .

[43]  E. Lorenz.  The predictability of a flow which possesses many scales of motion , 1969 .

[44]  G. Evensen,et al.  Assimilation of Geosat altimeter data for the Agulhas current using the ensemble Kalman filter with , 1996 .

[45]  J. Shukla,et al.  Dynamical predictability of monthly means , 1981 .

[46]  George W. Platzman,et al.  The ENIAC Computations of 1950—Gateway to Numerical Weather Prediction , 1979 .

[47]  Charles Coulston Gillispie,et al.  Dictionary of scientific biography , 1970 .

[48]  E. Pitcher.  Application of Stochastic Dynamic Prediction to Real Data , 1977 .

[49]  E. T. Eady,et al.  Long Waves and Cyclone Waves , 1949 .

[50]  C. Brezinski.  Interpolation and Extrapolation , 2001 .

[51]  E. Lorenz,et al.  The essence of chaos , 1993 .

[52]  E. T. Eady.  The Quantitative Theory of Cyclone Development , 1951 .

[53]  Paul N. Edwards,et al.  Chapter 2 - A Brief History of Atmospheric General Circulation Modeling , 2000 .

[54]  A. Arakawa.  Computational design for long-term numerical integration of the equations of fluid motion: two-dimen , 1997 .

[55]  Douglas K. Lilly.  Introduction to “Computational Design for Long-Term Numerical Integration of the Equations of Fluid Motion , 1997 .

[56]  Joseph Smagorjnsky,et al.  The Beginnings of Numerical Weather Prediction and General Circulation Modeling: Early Recollections , 1983 .

[57]  J. G. Charney,et al.  THE DYNAMICS OF LONG WAVES IN A BAROCLINIC WESTERLY CURRENT , 1947 .

[58]  Ross N. Hoffman,et al.  Lagged average forecasting, an alternative to Monte Carlo forecasting , 1983 .

[59]  Brian F. Farrell,et al.  Small Error Dynamics and the Predictability of Atmospheric Flows. , 1990 .

[60]  L. Broglie,et al.  Causality and chance in modern physics , 1984 .

[61]  Eugenia Kalnay,et al.  Operational Ensemble Prediction at the National Meteorological Center: Practical Aspects , 1993 .

[62]  D. Thompson,et al.  A history of numerical weather prediction in the United States , 1983 .

[63]  Roberto Buizza,et al.  The Singular-Vector Structure of the Atmospheric Global Circulation , 1995 .

[64]  Jan Barkmeijer.  Constructing Fast-Growing Perturbations for the Nonlinear Regime , 1996 .

[65]  J. Smagorinsky,et al.  GENERAL CIRCULATION EXPERIMENTS WITH THE PRIMITIVE EQUATIONS , 1963 .

[66]  C. Leith.  Theoretical Skill of Monte Carlo Forecasts , 1974 .

[67]  E. Lorenz.  Atmospheric predictability experiments with a large numerical model , 1982 .

[68]  The birth of numerical weather prediction , 1991 .

[69]  Lewis F. Richardson,et al.  Weather Prediction by Numerical Process , 1922 .

[70]  Jeffrey L. Anderson,et al.  Selection of Initial Conditions for Ensemble Forecasts in a Simple Perfect Model Framework , 1996 .

[71]  F. Molteni,et al.  The ECMWF Ensemble Prediction System: Methodology and validation , 1996 .

[72]  Lennart Bengtsson.  From short-range barotropic modelling to extended-range global weather prediction: a 40-year perspective , 1999 .

[73]  T. Petroliagis,et al.  Error growth and estimates of predictability from the ECMWF forecasting system , 1995 .

[74]  Chris Snyder,et al.  Ensemble Forecasting in the Short to Medium Range: Report from a Workshop , 2000 .

[75]  John M. Lewis,et al.  Clarifying the Dynamics of the General Circulation: Phillips's 1956 Experiment , 1998 .

[76]  C. Leith.  Atmospheric Predictability and Two-Dimensional Turbulence , 1971 .

[77]  O. Talagrand,et al.  Short-range evolution of small perturbations in a barotropic model , 1988 .