A review on optimization of least squares support vector machine for time series forecasting

Support Vector Machine has appeared as an active study in machine learning community and extensively used in various fields including in prediction, pattern recognition and many more. However, the Least Squares Support Vector Machine which is a variant of Support Vector Machine offers better solution strategy. In order to utilize the LSSVM capability in data mining task such as prediction, there is a need to optimize its hyper parameters. This paper presents a review on techniques used to optimize the parameters based on two main classes; Evolutionary Computation and Cross Validation.

[1]  Min Zou.  Condition prediction of hydroturbine generating units using least squares support vector regression with genetic algorithms , 2009, 2009 International Conference on Machine Learning and Cybernetics.

[2]  Wang Xiaolan,et al.  One-Month Ahead Prediction of Wind Speed and Output Power Based on EMD and LSSVM , 2009, 2009 International Conference on Energy and Environment Technology.

[3]  V. Selvi,et al.  Comparative Analysis of Ant Colony and Particle Swarm Optimization Techniques , 2010 .

[4]  Leandro dos Santos Coelho,et al.  Least squares support vector machines with tuning based on chaotic differential evolution approach applied to the identification of a thermal process , 2012, Expert Syst. Appl..

[5]  Lijun Yang,et al.  Particle swarm optimization-least squares support vector regression based forecasting model on dissolved gases in oil-filled power transformers , 2011 .

[6]  Ali Azadeh,et al.  A flexible neural network-fuzzy mathematical programming algorithm for improvement of oil price estimation and forecasting , 2012, Comput. Ind. Eng..

[7]  Ping Liu,et al.  Application of least square support vector machine based on particle swarm optimization to chaotic time series prediction , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[8]  Huiru Zhao,et al.  Annual Electric Load Forecasting by a Least Squares Support Vector Machine with a Fruit Fly Optimization Algorithm , 2012 .

[9]  Yang Li.  Short-Term Load Forecasting Based on LS-SVM Optimized by BCC Algorithm , 2009, 2009 15th International Conference on Intelligent System Applications to Power Systems.

[10]  Abdelkader Mazouz,et al.  Using artificial neural networks to forecast the futures prices of crude oil , 2008 .

[11]  Dongxiao Niu,et al.  Short-Term Power Load Forecasting Using Least Squares Support Vector Machines(LS-SVM) , 2009, 2009 Second International Workshop on Computer Science and Engineering.

[12]  Dervis Karaboga,et al.  A comprehensive survey: artificial bee colony (ABC) algorithm and applications , 2012, Artificial Intelligence Review.

[13]  Dervis Karaboga,et al.  A comparative study of Artificial Bee Colony algorithm , 2009, Appl. Math. Comput..

[14]  Jiang Liangzhong,et al.  Water Quality Prediction Using LS-SVM and Particle Swarm Optimization , 2009, WKDD.

[15]  Yuhanis Yusof,et al.  Lévy Mutation in Artificial Bee Colony Algorithm for Gasoline Price Prediction , 2012 .

[16]  Zhen Yang,et al.  Genetic algorithm-least squares support vector regression based predicting and optimizing model on carbon fiber composite integrated conductivity , 2010 .

[17]  Weiping Zhang,et al.  Forecasting of turbine heat rate with online least squares support vector machine based on gravitational search algorithm , 2013, Knowl. Based Syst..

[18]  Jun Wang,et al.  A real time IDSs based on artificial Bee Colony-support vector machine algorithm , 2010, Third International Workshop on Advanced Computational Intelligence.

[19]  Yun Wu,et al.  Research on Customers Demand Forecasting for E-business Web Site Based on LS-SVM , 2008, 2008 International Symposium on Electronic Commerce and Security.

[20]  Yi-Ming Wei,et al.  Carbon price forecasting with a novel hybrid ARIMA and least squares support vector machines methodology , 2013 .

[21]  Mohd Wazir Mustafa,et al.  Reactive power tracing in pool-based power system utilising the hybrid genetic algorithm and least squares support vector machine , 2012 .

[22]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[23]  Randy L. Haupt,et al.  Practical Genetic Algorithms , 1998 .

[24]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machines , 2002 .

[25]  Johan A. K. Suykens,et al.  Financial time series prediction using least squares support vector machines within the evidence framework , 2001, IEEE Trans. Neural Networks.

[26]  Jong-Bae Park,et al.  An Improved Particle Swarm Optimization for Nonconvex Economic Dispatch Problems , 2010, IEEE Transactions on Power Systems.

[27]  Mohammad Yusri Hassan,et al.  Application of hybrid GMDH and Least Square Support Vector Machine in energy consumption forecasting , 2012 .

[28]  H. Shareef,et al.  An application of Genetic Algorithm and Least Squares Support Vector Machine for tracing the transmission loss in deregulated power system , 2011, 2011 5th International Power Engineering and Optimization Conference.

[29]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[30]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[31]  Wu Niu,et al.  The application of particle swarm optimization-based RBF neural network in fault diagnosis of power transformer , 2009, 2009 2nd IEEE International Conference on Computer Science and Information Technology.

[32]  Tao Bai,et al.  Share Price Prediction Using Wavelet Transform and Ant Colony Algorithm for Parameters Optimization in SVM , 2009, 2009 WRI Global Congress on Intelligent Systems.

[33]  Jin Wang,et al.  Prediction of Chaotic Time Series Using LS-SVM with Automatic Parameter Selection , 2005, Sixth International Conference on Parallel and Distributed Computing Applications and Technologies (PDCAT'05).

[34]  Siti Sakira Kamaruddin,et al.  ENHANCED ABC-LSSVM FOR ENERGY FUEL PRICE PREDICTION , 2013 .

[35]  Wen-Tsao Pan,et al.  A new Fruit Fly Optimization Algorithm: Taking the financial distress model as an example , 2012, Knowl. Based Syst..

[36]  Huanhuan Chen,et al.  Evolving Least Squares Support Vector Machines for Stock Market Trend Mining , 2009, IEEE Trans. Evol. Comput..

[37]  Nan Li,et al.  Application of LS-SVM by GA for Dissolved Gas Concentration Forecasting in Power Transformer Oil , 2009, 2009 Asia-Pacific Power and Energy Engineering Conference.

[38]  Yong Peng,et al.  An Improved Artificial Fish Swarm Algorithm for Optimal Operation of Cascade Reservoirs , 2011, J. Comput..

[39]  A. Massi Pavan,et al.  Least squares support vector machine for short-term prediction of meteorological time series , 2012, Theoretical and Applied Climatology.

[40]  Wang Chun-xiu,et al.  Air Temperature Prediction Based on EMD and LS-SVM , 2010, 2010 Fourth International Conference on Genetic and Evolutionary Computing.

[41]  Wenjing Liao,et al.  LSSVM Network Flow Prediction Based on the Self-adaptive Genetic Algorithm Optimization , 2013, J. Networks.

[42]  Ruhaidah Samsudin,et al.  A hybrid model of self-organizing maps (SOM) and least square support vector machine (LSSVM) for time-series forecasting , 2011, Expert Syst. Appl..

[43]  Lixia Liu,et al.  Exchange Rates Forecasting with Least Squares Support Vector Machine , 2008, 2008 International Conference on Computer Science and Software Engineering.

[44]  K. Lai,et al.  AN INTEGRATED MODEL USING WAVELET DECOMPOSITION AND LEAST SQUARES SUPPORT VECTOR MACHINES FOR MONTHLY CRUDE OIL PRICES FORECASTING , 2011 .

[45]  Yi Wang,et al.  Applying LS-SVM to Predict Primary Energy Consumption , 2010, 2010 International Conference on E-Product E-Service and E-Entertainment.

[46]  Adnan Khashman,et al.  Intelligent prediction of crude oil price using Support Vector Machines , 2011, 2011 IEEE 9th International Symposium on Applied Machine Intelligence and Informatics (SAMI).

[47]  Michel Verleysen,et al.  LS-SVM Hyperparameter Selection with a Nonparametric Noise Estimator , 2005, ICANN.

[48]  Thomas Stützle,et al.  Ant Colony Optimization , 2009, EMO.

[49]  Siti Sakira Kamaruddin,et al.  Enhanced artificial bee colony for training least squares support vector machines in commodity price forecasting , 2014, J. Comput. Sci..

[50]  Rodney C. Wolff,et al.  Forecasting crude oil price (revisited) , 2011 .

[51]  Li Xiao,et al.  An Optimizing Method Based on Autonomous Animats: Fish-swarm Algorithm , 2002 .

[52]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[53]  Bo Zhou,et al.  LSSVM and hybrid particle swarm optimization for ship motion prediction , 2010, 2010 International Conference on Intelligent Control and Information Processing.

[54]  Sheng Liu,et al.  Ship motion prediction based on AGA-LSSVM , 2010, 2010 IEEE International Conference on Mechatronics and Automation.

[55]  Murat Kulahci,et al.  Introduction to Time Series Analysis and Forecasting , 2008 .

[56]  Jianzhou Wang,et al.  Time Series Forecasting Based on Novel Support Vector Machine Using Artificial Fish Swarm Algorithm , 2008, 2008 Fourth International Conference on Natural Computation.

[57]  M. Malliaris,et al.  Forecasting inter-related energy product prices , 2008 .

[58]  Yuhanis Yusof,et al.  Optimizing LSSVM Using ABC For Non-Volatile Financial Prediction , 2011 .

[59]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[60]  Fuyu Zhao,et al.  Particle swarm optimization-based least squares support vector regression for critical heat flux prediction , 2013 .

[61]  Muhsin Tunay Gençoglu,et al.  Prediction of flashover voltage of insulators using least squares support vector machines , 2009, Expert Syst. Appl..

[62]  Chiun-Sin Lin,et al.  Empirical mode decomposition–based least squares support vector regression for foreign exchange rate forecasting , 2012 .

[63]  Wei Sun,et al.  Forecasting Day Ahead Spot Electricity Prices Based on GASVM , 2008, 2008 International Conference on Internet Computing in Science and Engineering.

[64]  Wei Shen,et al.  Stock Return Forecast with LS-SVM and Particle Swarm Optimization , 2009, 2009 International Conference on Business Intelligence and Financial Engineering.