Bias Reduction for Time Series Models Based on Support Vector Regression

In the past few years a new learning method called Support Vector Machines (SVMs) has enjoyed increasing popularity. Based on statistical learning theory it shows very good generalization abilities. Though SVMs are mainly used for classification tasks, they are also applicable to regression problems and thus to modeling the dynamics of a time series. However when regression techniques are used to build dynamical models caution is advisable if the data are noisy. Due to correlations between data points, estimates of model parameters deviate systematically from the true values. An approach is presented to reduce such bias in SVM parameters.

[1]  Ulrich Parlitz Lyapunov exponents from Chua's Circuit , 1993, J. Circuits Syst. Comput..

[2]  Sheng Chen,et al.  Identification of MIMO non-linear systems using a forward-regression orthogonal estimator , 1989 .

[3]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[4]  Gunnar Rätsch,et al.  Predicting Time Series with Support Vector Machines , 1997, ICANN.

[6]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[7]  A. Gretton,et al.  Support vector regression for black-box system identification , 2001, Proceedings of the 11th IEEE Signal Processing Workshop on Statistical Signal Processing (Cat. No.01TH8563).

[8]  James Durbin,et al.  The fitting of time series models , 1960 .

[9]  Vladimir Cherkassky,et al.  The Nature Of Statistical Learning Theory , 1997, IEEE Trans. Neural Networks.