Black-box modeling for temperature prediction in weather forecasting

Accurate weather forecasting is one of most challenging tasks that deals with a large amount of observations and features. In this paper, a black-box modeling technique is proposed for temperature forecasting. Due to the high dimensionality of data, feature selection is done in two steps with k-Nearest Neighbors and Elastic net. Next, Least Squares Support Vector Machine regression is applied to generate the forecasting model. In the experimental results, the influence of each part of this procedure on the performance is investigated and compared with “Weather underground” results. For the case study, the prediction of the temperature in Brussels is considered. It is shown that black-box modeling has a good and competitive accuracy with current state-of-the-art methods for temperature prediction.

[1]  Ajith Abraham,et al.  Weather analysis using ensemble of connectionist learning paradigms , 2007, Appl. Soft Comput..

[2]  Nikhil R. Pal,et al.  SOFM-MLP: a hybrid neural network for atmospheric temperature prediction , 2003, IEEE Trans. Geosci. Remote. Sens..

[3]  A. Massi Pavan,et al.  Least squares support vector machine for short-term prediction of meteorological time series , 2012, Theoretical and Applied Climatology.

[4]  A. Barros,et al.  Localized Precipitation Forecasts from a Numerical Weather Prediction Model Using Artificial Neural Networks , 1998 .

[5]  A. Bowman.  An alternative method of cross-validation for the smoothing of density estimates , 1984 .

[6]  HighWire Press.  Philosophical transactions of the Royal Society of London. Series A, Containing papers of a mathematical or physical character , 1896 .

[7]  R. Shah,et al.  Least Squares Support Vector Machines , 2022 .

[8]  Johan A. K. Suykens,et al.  Representative subsets for big data learning using k-NN graphs , 2014, 2014 IEEE International Conference on Big Data (Big Data).

[9]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[10]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[11]  Arthur E. Hoerl,et al.  Ridge Regression: Biased Estimation for Nonorthogonal Problems , 2000, Technometrics.

[12]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[13]  M. Rudemo.  Empirical Choice of Histograms and Kernel Density Estimators , 1982 .

[14]  J. Mercer.  Functions of Positive and Negative Type, and their Connection with the Theory of Integral Equations , 1909 .

[15]  Sucharita Gopal,et al.  Spatial Interpolation of Surface Air Temperatures Using Artificial Neural Networks: Evaluating Their Use for Downscaling GCMs , 2000 .

[16]  Alex J. Cannon,et al.  Daily streamflow forecasting by machine learning methods with weather and climate inputs , 2012 .

[17]  Johan A. K. Suykens,et al.  High level high performance computing for multitask learning of time-varying models , 2014, 2014 IEEE Symposium on Computational Intelligence in Big Data (CIBD).

[18]  A. Kusiak,et al.  Short-Term Prediction of Wind Farm Power: A Data Mining Approach , 2009, IEEE Transactions on Energy Conversion.

[19]  Nitesh V. Chawla,et al.  Complex networks as a unified framework for descriptive analysis and predictive modeling in climate science , 2011, Stat. Anal. Data Min..

[20]  Ruhaidah Samsudin,et al.  A hybrid model of self-organizing maps (SOM) and least square support vector machine (LSSVM) for time-series forecasting , 2011, Expert Syst. Appl..

[21]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[22]  Shafiqur Rehman,et al.  Application of neural networks for the prediction of hourly mean surface temperatures in Saudi Arabia , 2002 .

[23]  Snigdhansu Chatterjee,et al.  Sparse Group Lasso: Consistency and Climate Applications , 2012, SDM.