Short term wind speed prediction based on evolutionary support vector regression algorithms

Hyper-parameters estimation in regression Support Vector Machines (SVMr) is one of the main problems in the application of this type of algorithms to learning problems. This is a hot topic in which very recent approaches have shown very good results in different applications in fields such as bio-medicine, manufacturing, control, etc. Different evolutionary approaches have been tested to be hybridized with SVMr, though the most used are evolutionary approaches for continuous problems, such as evolutionary strategies or particle swarm optimization algorithms. In this paper we discuss the application of two different evolutionary computation techniques to tackle the hyper-parameters estimation problem in SVMrs. Specifically we test an Evolutionary Programming algorithm (EP) and a Particle Swarm Optimization approach (PSO). We focus the paper on the discussion of the application of the complete evolutionary-SVMr algorithm to a real problem of wind speed prediction in wind turbines of a Spanish wind farm.

[1]  Yanchun Liang,et al.  Immune Particle Swarm Optimization for Support Vector Regression on Forest Fire Prediction , 2009, ISNN.

[2]  Christian Igel,et al.  Evolutionary tuning of multiple SVM parameters , 2005, ESANN.

[3]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[4]  J. Dudhia.  A Nonhydrostatic Version of the Penn State–NCAR Mesoscale Model: Validation Tests and Simulation of an Atlantic Cyclone and Cold Front , 1993 .

[5]  Kristin P. Bennett,et al.  A Pattern Search Method for Model Selection of Support Vector Regression , 2002, SDM.

[6]  Chih-Hung Wu,et al.  A Novel hybrid genetic algorithm for kernel function and parameter optimization in support vector regression , 2009, Expert Syst. Appl..

[7]  Boris Katz,et al.  Recent Changes Implemented into the Global Forecast System at NMC , 1991 .

[8]  Cheng-Lung Huang,et al.  A distributed PSO-SVM hybrid system with feature selection and parameter optimization , 2008, Appl. Soft Comput..

[9]  Xin Wang,et al.  Parameter selection of support vector regression based on hybrid optimization algorithm and its application , 2005 .

[10]  Mohamed Mohandes,et al.  Support vector machines for wind speed prediction , 2004 .

[11]  Yunqian Ma,et al.  Practical selection of SVM parameters and noise estimation for SVM regression , 2004, Neural Networks.

[12]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[13]  David B. Fogel,et al.  An introduction to simulated evolutionary optimization , 1994, IEEE Trans. Neural Networks.

[14]  A. Staniforth,et al.  The Operational CMC–MRB Global Environmental Multiscale (GEM) Model. Part I: Design Considerations and Formulation , 1998 .

[15]  Ángel M. Pérez-Bellido,et al.  Hybridizing the fifth generation mesoscale model with artificial neural networks for short-term wind speed prediction , 2009 .

[16]  K. W. Chau,et al.  River stage prediction based on a distributed support vector regression , 2008 .

[17]  A. Staniforth,et al.  The Operational CMC–MRB Global Environmental Multiscale (GEM) Model. Part II: Results , 1998 .

[18]  P. Dokopoulos,et al.  Short-term forecasting of wind speed and related electrical power , 1998 .

[19]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[20]  Min-Yuan Cheng,et al.  Evolutionary support vector machine inference system for construction management , 2009 .

[21]  Xin Yao,et al.  Evolutionary programming using mutations based on the Levy probability distribution , 2004, IEEE Transactions on Evolutionary Computation.

[22]  Zhizhong Wang,et al.  Model optimizing and feature selecting for support vector regression in time series forecasting , 2008, Neurocomputing.

[23]  Yourong Li,et al.  Short-term fault prediction based on support vector machines with parameter optimization by evolution strategy , 2009, Expert Syst. Appl..

[24]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[25]  Raymond F. Toll,et al.  An Operational Evaluation of the Navy Operational Global Atmospheric Prediction System (NOGAPS): 48-Hour Surface Pressure Forecasts , 1985 .

[26]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[27]  Weifeng Liu,et al.  Adaptive and Learning Systems for Signal Processing, Communication, and Control , 2010 .

[28]  Shih-Wei Lin,et al.  Particle swarm optimization for parameter determination and feature selection of support vector machines , 2008, Expert Syst. Appl..

[29]  Lars Landberg,et al.  Short-term prediction of the power production from wind farms , 1999 .

[30]  Hans-Paul Schwefel,et al.  Evolutionary Programming and Evolution Strategies: Similarities and Differences , 1993 .

[31]  Min Xiang,et al.  Quantum-inspired evolutionary tuning of SVM parameters , 2008 .

[32]  Chih-Hung Wu,et al.  A real-valued genetic algorithm to optimize the parameters of support vector machine for predicting bankruptcy , 2007, Expert Syst. Appl..

[33]  Mehmet Fatih Akay,et al.  Support vector machines combined with feature selection for breast cancer diagnosis , 2009, Expert Syst. Appl..

[34]  Qi Wu,et al.  Power load forecasts based on hybrid PSO with Gaussian and adaptive mutation and Wv-SVM , 2010, Expert Syst. Appl..

[35]  Fernando Pérez-Cruz,et al.  Support Vector Regression for the simultaneous learning of a multivariate function and its derivatives , 2005, Neurocomputing.

[36]  B. Schölkopf,et al.  Asymptotically Optimal Choice of ε-Loss for Support Vector Machines , 1998 .

[37]  Chang-Ying Ma,et al.  In silico prediction of mitochondrial toxicity by using GA-CG-SVM approach. , 2009, Toxicology in vitro : an international journal published in association with BIBRA.

[38]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).