Data Mining Numerical Model Output for Single-Station Cloud-Ceiling Forecast Algorithms

Accurate cloud-ceiling-height forecasts derived from numerical weather prediction (NWP) model data are useful for aviation and other interests where low cloud ceilings have an impact on operations. A demonstration of the usefulness of data-mining methods in developing cloud-ceiling forecast algorithms from NWP model output is provided here. Rapid Update Cycle (RUC) 1-h forecast data were made available for nearly every hour in 2004. Various model variables were extracted from these data and stored in a database of hourly records for routine aviation weather report (METAR) station KJFK at John F. Kennedy International Airport along with other single-station locations. Using KJFK cloud-ceiling observations as ground truth, algorithms were derived for 1-, 3-, 6-, and 12-h forecasts through a data-mining process. Performance of these cloud-ceiling forecast algorithms, as evaluated through cross-validation testing, is compared with persistence and Global Forecast System (GFS) model output statistics (MOS) performance (6 and 12 h only) over the entire year. The 1-h algorithms were also compared with the RUC model cloud-ceiling (or cloud base) height translation algorithms. The cloud-ceiling algorithms developed through data mining outperformed these RUC model translation algorithms, showed slightly better skill and accuracy than persistence at 3 h, and outperformed persistence at 6 and 12 h. Comparisons to GFS MOS (which uses observations in addition to model data for algorithm derivation) at 6 h demonstrated similar performance between the two methods with the cloud-ceiling algorithm derived through data mining demonstrating more skill at 12 h.

[1]  G. Grell,et al.  Mesoscale Weather Prediction with the RUC Hybrid Isentropic–Terrain-Following Coordinate Model , 2004 .

[2]  Sherri K. Harms,et al.  Discovering Associations between Climatic and Oceanic Parameters to Monitor Drought in Nebraska Using Data-Mining Techniques , 2005 .

[3]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[4]  Donald L. Reinke,et al.  Cloud-Base Height Estimates Using a Combination of Meteorological Satellite Imagery and Surface Reports , 2000 .

[5]  John M. Brown,et al.  Use of a mixed-phase microphysics scheme in the operational NCEP Rapid Update Cycle , 2000 .

[6]  R. E. Abdel-Aal,et al.  Modeling and Forecasting the Daily Maximum Temperature Using Abductive Machine Learning , 1995 .

[7]  Michael Hadjimichael,et al.  Remote cloud ceiling assessment using data-mining methods , 2004 .

[8]  Robert L. Vislocky,et al.  An Automated, Observations-Based System for Short-Term Prediction of Ceiling and Visibility , 1997 .

[9]  Martin L. Hazelton,et al.  Predicting the Onset of Australian Winter Rainfall by Nonlinear Classification , 2005 .

[10]  A. H. Murphy.  Climatology, Persistence, and Their Linear Combination as Standards of Reference in Skill Scores , 1992 .

[11]  D. Norquist.  Cloud Predictions Diagnosed from Mesoscale Weather Model Forecasts , 1999 .

[12]  John Bjørnar Bremnes,et al.  Probabilistic Forecasts of Precipitation in Terms of Quantiles Using NWP Model Output , 2004 .

[13]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[14]  Richard T. McNider,et al.  An Optimal Model Output Calibration Algorithm Suitable for Objective Temperature Forecasting , 1999 .

[15]  Caren Marzban,et al.  Neural Networks for Postprocessing Model Output: ARPS , 2003 .

[16]  H. Glahn,et al.  Use of Model Output Statistics for Predicting Ceiling Height , 1972 .

[17]  F. Woodcock.  Australian Experimental Model Output Statistics Forecasts of Daily Maximum and Minimum Temperature , 1984 .

[18]  H. Glahn,et al.  The Use of Model Output Statistics (MOS) in Objective Weather Forecasting , 1972 .

[19]  L. S. Rathore,et al.  Forecasting Maximum and Minimum Temperatures by Statistical Interpretation of Numerical Weather Prediction Model Output , 2003 .

[20]  Harry R. Glahn,et al.  Recent Developments in Automated Prediction of Ceiling and Visibility , 1974 .

[21]  Thomas T. Warner,et al.  Nonhydrostatic, Mesobeta-Scale Model Simulations of Cloud Ceiling and Visibility for an East Coast Winter Precipitation Event , 1999 .

[22]  Mitchell Weiss.  A Summary of Ceiling Height and Total Sky Cover Short-Term Statistical Forecasts in the Localized Aviation MOS Program (LAMP) , 2005 .

[23]  Evgueni I. Kassianov,et al.  Cloud-Base-Height Estimation from Paired Ground-Based Hemispherical Observations , 2005 .

[24]  C. Doswell,et al.  On Summary Measures of Skill in Rare Event Forecasting Based on Contingency Tables , 1990 .

[25]  R. Frehlich,et al.  Estimates of Turbulence from Numerical Weather Prediction Model Output with Applications to Turbulence Diagnosis and Data Assimilation , 2004 .

[26]  W. Briggs.  Statistical Methods in the Atmospheric Sciences , 2007 .

[27]  William J. Thompson,et al.  Estimating Marine Fog Probability Using a Model Output Statistics Scheme , 1983 .

[28]  Joby L. Hilliker,et al.  An Observations-Based Statistical System for Warm-Season Hourly Probabilistic Forecasts of Low Ceiling at the San Francisco International Airport , 1999 .

[29]  J. Fritsch,et al.  The Impact of High-Frequency Surface Weather Observations on Short-Term Probabilistic Forecasts of Ceiling and Visibility , 2004 .

[30]  Stephen M. Leyton,et al.  Short-Term Probabilistic Forecasts of Ceiling and Visibility Utilizing High-Density Surface Weather Observations , 2003 .

[31]  Steven A. Ackerman,et al.  Cloud Classification of Satellite Radiance Data by Multicategory Support Vector Machines , 2004, Journal of Atmospheric and Oceanic Technology.

[32]  Barry E. Schwartz,et al.  An Hourly Assimilation–Forecast Cycle: The RUC , 2004 .

[33]  Steven S. Fine,et al.  A Simple Technique for Multiple-Parameter Pattern Recognition with an Example of Locating Fronts in Model Output , 1990 .

[34]  Paul M. Tag,et al.  Machine Learning of Maritime Fog Forecast Rules , 1996 .

[35]  F. Woodcock,et al.  The application of model output statistics to precipitation prediction in Australia , 1986 .