Using Initial Condition and Model Physics Perturbations in Short-Range Ensemble Simulations of Mesoscale Convective Systems

Two separate numerical model ensembles are created by using model configurations with different model physical process parameterization schemes and identical initial conditions, and by using different model initial conditions from a Monte Carlo approach and the identical model configuration. Simulations from these two ensembles are investigated for two 48-h periods during which large, long-lived mesoscale convective systems develop. These two periods are chosen because, in some respects, they span the range of convective forecast problems routinely handled by operational forecasters. Calculations of the root-mean-square error, equitable threat score, and ranked probability score from both ensembles indicate that the model physics ensemble is more skillful than the initial-condition ensemble when the large-scale forcing for upward motion is weak. When the large-scale forcing for upward motion is strong, the initial-condition ensemble is more skillful than the model physics ensemble. This result is consistent with the expectation that model physics play a larger role in model simulations when the large-scale signal is weak and the assumptions used within the model parameterization schemes largely determine the evolution of the simulated weather events. The variance from the two ensembles is created at significantly different rates, with the variance in the physics ensemble being produced two to six times faster during the first 12 h than the variance in the initial-condition ensemble. Therefore, within a very brief time period, the variance from the physics ensemble often greatly exceeds that produced by the initial-condition ensemble. These results suggest that varying the model physics is a potentially powerful method to use in creating an ensemble. In essence, by using different model configurations, the systematic errors of the individual ensemble members are different and, hence, this may allow one to determine a probability density function from this ensemble that is more diffuse than can be accomplished using a single model configuration.

[1]  G. Grell Prognostic evaluation of assumptions used by cumulus parameterizations , 1993 .

[2]  A. Arakawa,et al.  Interaction of a Cumulus Cloud Ensemble with the Large-Scale Environment, Part I , 1974 .

[3]  J. Fritsch,et al.  Forcing Mechanisms and Other Characteristics of Significant Summertime Precipitation , 1988 .

[4]  W. Gallus,et al.  An Intense Small-Scale Wintertime Vortex in the Midwest United States , 1997 .

[5]  Da‐Lin Zhang,et al.  A High-Resolution Model of the Planetary Boundary Layer—Sensitivity Tests and Comparisons with SESAME-79 Data , 1982 .

[6]  A. Betts,et al.  A new convective adjustment scheme. Part II: Single column tests using GATE wave, BOMEX, ATEX and arctic air‐mass data sets , 1986 .

[7]  Kenneth W. Howard,et al.  Mesoscale Convective Complexes over the United States during 1985 , 1988 .

[8]  Thomas M. Hamill,et al.  Verification of Eta–RSM Short-Range Ensemble Forecasts , 1997 .

[9]  D. Stensrud,et al.  Mesoscale Convective Systems in Weakly Forced Large-Scale Environments. Part III: Numerical Simulations and Implications for Operational Forecasting , 1994 .

[10]  Rudolph W. Preisendorfer,et al.  Numerical Model-Reality Intercomparison Tests Using Small-Sample Statistics , 1983 .

[11]  Daniel S. Wilks,et al.  Statistical Methods in the Atmospheric Sciences: An Introduction , 1995 .

[12]  N. Seaman,et al.  A Comparison Study of Convective Parameterization Schemes in a Mesoscale Model , 1997 .

[13]  E. Lorenz Deterministic nonperiodic flow , 1963 .

[14]  James M. Murphy,et al.  The impact of ensemble forecasts on predictability , 1988 .

[15]  S. Barnes,et al.  A Technique for Maximizing Details in Numerical Weather Map Analysis , 1964 .

[16]  R. Maddox Meoscale Convective Complexes , 1980 .

[17]  John B. Cunning,et al.  The Oklahoma-Kansas Preliminary Regional Experiment for STORM-Central , 1986 .

[18]  Jun Du,et al.  Short-Range Ensemble Forecasting of Quantitative Precipitation , 1997 .

[19]  Eugenia Kalnay,et al.  Ensemble Forecasting at NMC: The Generation of Perturbations , 1993 .

[20]  A. Blackadar,et al.  High resolution models of the planetary boundary layer , 1979 .

[21]  P. Wetzel,et al.  Effects of Spatial Variations of Soil Moisture and Vegetation on the Evolution of a Prestorm Environment: A Numerical Case Study , 1991 .

[22]  William T. Thompson,et al.  A vertically nested regional numerical weather prediction model with second-order closure physics , 1989 .

[23]  J. Michael Fritsch,et al.  Numerical Simulation of the Meso-β Scale Structure and Evolution of the 1977 Johnstown Flood. Part I: Model Description and Verification , 1986 .

[24]  D. Deaven,et al.  The Regional Analysis System for the Operational “Early” Eta Model: Original 80-km Configuration and Recent Changes , 1995 .

[25]  A. Hollingsworth,et al.  Probabilistic Predictions of Precipitation Using the ECMWF Ensemble Prediction System , 1999 .

[26]  P. L. Houtekamer,et al.  Methods for Ensemble Prediction , 1995 .

[27]  T. Palmer,et al.  Singular Vectors, Metrics, and Adaptive Observations. , 1998 .

[28]  E. Epstein,et al.  Stochastic dynamic prediction , 1969 .

[29]  David B. Parsons,et al.  Numerical Simulation of an Intense Squall Line during 10–11 June 1985 PRE-STORM. Part I: Model Verification , 1989 .

[30]  David J. Stensrud,et al.  Simulating Flash Flood Events: Importance of the Subgrid Representation of Convection , 1998 .

[31]  P. D. Thompson,et al.  How to Improve Accuracy by Combining Independent Forecasts , 1977 .

[32]  Joseph Tribbia,et al.  The Reliability of Improvements in Deterministic Short-Range Forecasts in the Presence of Initial State and Modeling Deficiencies , 1988 .

[33]  F. Molteni,et al.  The ECMWF Ensemble Prediction System: Methodology and validation , 1996 .

[34]  Stephen J. Lord,et al.  Interaction of a Cumulus Cloud Ensemble with the Large-Scale Environment. Part III: Semi-Prognostic Test of the Arakawa-Schubert Cumulus Parameterization , 1982 .

[35]  Roger Daley,et al.  Estimates of Global Analysis Error from the Global Weather Experiment Observational Network , 1986 .

[36]  Harold E. Brooks,et al.  Using Ensembles for Short-Range Forecasting , 1999 .

[37]  J. Gyakum,et al.  On the Evolution of the QE II Storm. II: Dynamic and Thermodynamic Structure , 1983 .

[38]  D. Baumhefner,et al.  Predictability Experiments Using a High-Resolution Limited-Area Model , 1987 .

[39]  John M. Wallace,et al.  Diurnal Variations in Precipitation and Thunderstorm Frequency over the Conterminous United States , 1975 .

[40]  T. Vukicevic Possibility of Skill Forecast Based on the Finite-Time Dominant Linear Solutions for a Primitive Equation Regional Forecast Model , 1993 .

[41]  C. Leith Theoretical Skill of Monte Carlo Forecasts , 1974 .

[42]  Richard H. Johnson,et al.  The Relationship of Surface Pressure Features to the Precipitation and Airflow Structure of an Intense Midlatitude Squall Line , 1988 .

[43]  P. L. Houtekamer,et al.  Using ensemble forecasts for model validation , 1997 .

[44]  T. Palmer,et al.  Analysis and model dependencies in medium‐range ensembles: Two transplant case‐studies , 1999 .

[45]  J. Kain,et al.  A One-Dimensional Entraining/Detraining Plume Model and Its Application in Convective Parameterization , 1990 .

[46]  G. Grell,et al.  A description of the fifth-generation Penn State/NCAR Mesoscale Model (MM5) , 1994 .

[47]  R. Buizza Potential Forecast Skill of Ensemble Prediction and Spread and Skill Distributions of the ECMWF Ensemble Prediction System , 1997 .

[48]  J. Dudhia A Nonhydrostatic Version of the Penn State–NCAR Mesoscale Model: Validation Tests and Simulation of an Atlantic Cyclone and Cold Front , 1993 .

[49]  Y. Kuo,et al.  Description of the Penn State/NCAR Mesoscale Model: Version 4 (MM4) , 1987 .

[50]  J. Fritsch,et al.  Numerical Prediction of Convectively Driven Mesoscale Pressure Systems. Part I: Convective Parameterization , 1980 .

[51]  J. Fritsch,et al.  The Contribution of Mesoscale Convective Weather Systems to the Warm-Season Precipitation in the United States , 1986 .

[52]  Andrew F. Loughe,et al.  The Relationship between Ensemble Spread and Ensemble Mean Skill , 1998 .

[53]  Nelson L. Seaman,et al.  A Simple Scheme for Objective Analysis in Curved Flow , 1985 .

[54]  Robert L. Vislocky,et al.  Improved Model Output Statistics Forecasts through Model Consensus , 1995 .

[55]  P. L. Houtekamer,et al.  A System Simulation Approach to Ensemble Prediction , 1996 .

[56]  The effect of parameterized ice microphysics on the simulation of vortex circulation with a mesoscale hydrostatic model , 1989 .

[57]  T. Hamill,et al.  Evaluation of Eta-RSM Ensemble Probabilistic Precipitation Forecasts , 1998 .

[58]  D. Stensrud,et al.  Mesoscale Convective Systems in Weakly Forced Large-Scale Environments. Part II: Generation of a Mesoscale Initial Condition , 1994 .

[59]  David P. Baumhefner,et al.  Sensitivity of Numerical Simulations of Explosive Oceanic Cyclogenesis to Changes in Physical Parameterizations , 1988 .