Least squares support vector machine for short-term prediction of meteorological time series

The prediction of meteorological time series plays very important role in several fields. In this paper, an application of least squares support vector machine (LS-SVM) for short-term prediction of meteorological time series (e.g. solar irradiation, air temperature, relative humidity, wind speed, wind direction and pressure) is presented. In order to check the generalization capability of the LS-SVM approach, a K-fold cross-validation and Kolmogorov–Smirnov test have been carried out. A comparison between LS-SVM and different artificial neural network (ANN) architectures (recurrent neural network, multi-layered perceptron, radial basis function and probabilistic neural network) is presented and discussed. The comparison showed that the LS-SVM produced significantly better results than ANN architectures. It also indicates that LS-SVM provides promising results for short-term prediction of meteorological data.

[1]  Zhigang Zeng,et al.  Advances in Neural Network Research and Applications , 2010 .

[2]  Ajith Abraham,et al.  Weather analysis using ensemble of connectionist learning paradigms , 2007, Appl. Soft Comput..

[3]  I. Matyasovszky.  A nonlinear approach to modeling climatological time series , 2001 .

[4]  Ralf Kretzschmar,et al.  Neural Network Classifiers for Local Wind Prediction , 2004 .

[5]  Wenjian Wang,et al.  Online prediction model based on support vector machine , 2008, Neurocomputing.

[6]  Soteris A. Kalogirou,et al.  FPGA-based implementation of intelligent predictor for global solar irradiation, Part I: Theory and simulation , 2011, Expert Syst. Appl..

[7]  Jamshid Piri,et al.  Comparison of LLR, MLP, Elman, NNARX and ANFIS Models―with a case study in solar radiation estimation , 2009 .

[8]  M. Collares-Pereira,et al.  Simple procedure for generating sequences of daily radiation values using a library of Markov transition matrices , 1988 .

[9]  Gary William Flake,et al.  Efficient SVM Regression Training with SMO , 2002, Machine Learning.

[10]  John A. Dracup,et al.  Artificial Neural Networks and Long-Range Precipitation Prediction in California , 2000 .

[11]  Anastasios A. Tsonis,et al.  Nonlinear Prediction, Chaos, and Noise. , 1992 .

[12]  E. Tulcan-Paulescu,et al.  Fuzzy modelling of solar irradiation using air temperature data , 2008 .

[13]  F. Massey.  The Kolmogorov-Smirnov Test for Goodness of Fit , 1951 .

[14]  Robert J. Kuligowski,et al.  Experiments in Short-Term Precipitation Forecasting Using Artificial Neural Networks , 1998 .

[15]  Sucharita Gopal,et al.  Spatial Interpolation of Surface Air Temperatures Using Artificial Neural Networks: Evaluating Their Use for Downscaling GCMs , 2000 .

[16]  Francis Eng Hock Tay,et al.  Support vector machine with adaptive parameters in financial time series forecasting , 2003, IEEE Trans. Neural Networks.

[17]  A. Shabri,et al.  A comparison of time series forecasting using support vector machine and artificial neural network model , 2010 .

[18]  Pijush Samui,et al.  Utilization of a least square support vector machine (LSSVM) for slope stability analysis , 2011 .

[19]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[20]  David Sharon.  On the Further Development of Gringorten's Stochastic Model for Climatological Predictions , 1967 .

[21]  Dobrivoje Popovic,et al.  Computational Intelligence in Time Series Forecasting: Theory and Engineering Applications (Advances in Industrial Control) , 2005 .

[22]  S. Deng,et al.  Applying least squares support vector machines to the airframe wing-box structural design cost estimation , 2010, Expert Syst. Appl..

[23]  James E. Gentle,et al.  Elements of computational statistics , 2002 .

[24]  Soteris A. Kalogirou,et al.  Methodology for predicting sequences of mean monthly clearness index and daily solar radiation data in remote areas: Application for sizing a stand-alone PV system , 2008 .

[25]  Maria Macchiato,et al.  Time modelling and spatial clustering of daily ambient temperature: An application in Southern Italy , 1995 .

[26]  Shuichi Hokoi,et al.  Statistical time series models of solar radiation and outdoor temperature — Identification of seasonal models by Kalman filter , 1990 .

[27]  Yuval.  Neural Network Training for Prediction of Climatological Time Series, Regularized by Minimization of the Generalized Cross-Validation Function , 2000 .

[28]  V. Gómez,et al.  Fuzzy modeling of solar irradiance on inclined surfaces , 2003 .

[29]  Roger Fletcher,et al.  Practical methods of optimization; (2nd ed.) , 1987 .

[30]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[31]  V. Pérez-Muñnuzuri,et al.  Application of nonlinear forecasting techniques for meteorological modeling , 2000 .

[32]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[33]  Soteris A. Kalogirou,et al.  An adaptive wavelet-network model for forecasting daily total solar-radiation , 2006 .

[34]  Y. Radhika,et al.  Atmospheric Temperature Prediction using Support Vector Machines , 2009 .

[35]  Danilo P. Mandic,et al.  Recurrent Neural Networks for Prediction: Learning Algorithms, Architectures and Stability , 2001 .

[36]  Ioannis B. Theocharis,et al.  Locally recurrent neural networks for wind speed prediction using spatial correlation , 2007, Inf. Sci..

[37]  Alan J. Miller.  Subset Selection in Regression , 1992 .

[38]  A. Massi Pavan,et al.  An adaptive model for predicting of global, direct and diffuse hourly solar irradiance , 2010 .

[39]  Shafiqur Rehman,et al.  Application of neural networks for the prediction of hourly mean surface temperatures in Saudi Arabia , 2002 .

[40]  Adel Mellit,et al.  A simplified model for generating sequences of global solar radiation data for isolated sites: Using artificial neural network and a library of Markov transition matrices approach , 2005 .

[41]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[42]  Miguel Figueroa,et al.  Competitive learning with floating-gate circuits , 2002, IEEE Trans. Neural Networks.

[43]  Ajith Abraham,et al.  An ensemble of neural networks for weather forecasting , 2004, Neural Computing & Applications.