Improved multi-kernel LS-SVR for time series online prediction with incremental learning

Since it is difficult to establish precise physical model of complex systems, time series prediction is often used to predict their health trend and running state. Aiming at online prediction, we proposed a new scheme to fix the problems of time series online prediction, which is based on LS-SVR model and incremental learning algorithm. The scheme includes two aspects. Firstly, by replacing single kernel with new fixed kernel consisting of several basis kernels, a better information mapping in high dimension is obtained; secondly, by establishing new LS-SVR model without bias term b, the calculation process with incremental learning is simplified. Prediction experiment is performed via certain avionics application. The results indicate preliminarily that the proposed scheme is an effective prediction approach for its good prediction precision and less computing time. The method will be useful in actual application.

[1]  Ming Jian Zuo,et al.  An LSSVR-based algorithm for online system condition prognostics , 2012, Expert Syst. Appl..

[2]  Hua Li,et al.  An algorithm of soft fault diagnosis for analog circuit based on the optimized SVM by GA , 2009, 2009 9th International Conference on Electronic Measurement & Instruments.

[3]  Gunnar Rätsch,et al.  Predicting Time Series with Support Vector Machines , 1997, ICANN.

[4]  Guoqiang Peter Zhang,et al.  Trend time series modeling and forecasting with neural networks , 2003, 2003 IEEE International Conference on Computational Intelligence for Financial Engineering, 2003. Proceedings..

[5]  James V. Hansen,et al.  Neural networks and traditional time series methods: a synergistic combination in state economic forecasts , 1997, IEEE Trans. Neural Networks.

[6]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[7]  Guan Xiaoqing,et al.  Notice of RetractionApplication of least squares support vector regression in network flow forecasting , 2010, 2010 2nd International Conference on Computer Engineering and Technology.

[8]  Shie Mannor,et al.  Sparse Online Greedy Support Vector Regression , 2002, ECML.

[9]  Chuanhou Gao,et al.  Design of a multiple kernel learning algorithm for LS-SVM by convex programming , 2011, Neural Networks.

[10]  Valeriy V. Gavrishchaka,et al.  Support Vector Machine as an Efficient Framework for Stock Market Volatility Forecasting , 2006, Comput. Manag. Sci..

[11]  Knud D. Andersen,et al.  The Mosek Interior Point Optimizer for Linear Programming: An Implementation of the Homogeneous Algorithm , 2000 .

[12]  Vojislav Kecman.  Support Vector Machines , 2001 .

[13]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machines , 2002 .

[14]  Zhang Hao,et al.  Incremental and Online Learning Algorithm for Regression Least Squares Support Vector Machine , 2006 .

[15]  Jieping Ye,et al.  Multi-class Discriminant Kernel Learning via Convex Programming , 2008, J. Mach. Learn. Res..

[16]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[17]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[18]  Yan-Ning Cai,et al.  On Multiple Kernel Learning Methods: On Multiple Kernel Learning Methods , 2010 .

[19]  Amaury Lendasse,et al.  Methodology for long-term prediction of time series , 2007, Neurocomputing.

[20]  D. Basak,et al.  Support Vector Regression , 2008 .

[21]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[22]  Gunnar Rätsch,et al.  Large Scale Multiple Kernel Learning , 2006, J. Mach. Learn. Res..

[23]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[24]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[25]  Wang Hong.  On Multiple Kernel Learning Methods , 2010 .

[26]  Ping Zhong,et al.  Application of Least Squares Support Vector Regression Based on Time Series in Prediction of Gas , 2011 .

[27]  Nello Cristianini,et al.  Learning the Kernel Matrix with Semidefinite Programming , 2002, J. Mach. Learn. Res..

[28]  Ying Hao,et al.  The Application of Support Vector Machines to Gas Turbine Performance Diagnosis , 2005 .