c-ascending support vector machines for financial time series forecasting

This paper proposes a modified version of support vector machines (SVMs), called c-ascending support vector machines (c-ASVMs), to model non-stationary financial time series. c-ASVMS are obtained by a simple modification of the regularized risk function in SVMs whereby the recent /spl epsiv/-insensitive errors are penalized more heavily than the distant /spl epsiv/-insensitive errors. This procedure is based on the prior knowledge that in the non-stationary financial time series, the recent past data could provide more important information than the distant past data. In the experiment, c-ASVMS are tested using three real futures collected from the Chicago Mercantile Market. It is shown that the c-ASVMS with the actually ordered sample data consistently forecast better than the standard SVMs, with the worst performance when the reversely ordered sample data are used. Furthermore, the c-ASVMs use fewer support vectors than those of the standard SVMs, resulting in a sparser representation of solution.

[1]  J. Nazuno.  Haykin, Simon. Neural networks: A comprehensive foundation, Prentice Hall, Inc. Segunda Edición, 1999 , 2000 .

[2]  F. Girosi,et al.  Nonlinear prediction of chaotic time series using support vector machines , 1997, Neural Networks for Signal Processing VII. Proceedings of the 1997 IEEE Signal Processing Society Workshop.

[3]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[4]  Bernhard Schölkopf,et al.  Extracting Support Data for a Given Task , 1995, KDD.

[5]  Derek W. Bunn,et al.  Financial time series modelling with discounted least squares backpropagation , 1997, Neurocomputing.

[6]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[7]  Thorsten Joachims,et al.  Text categorization with support vector machines , 1999 .

[8]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[9]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[10]  Douglas C. Montgomery,et al.  Applied Statistics and Probability for Engineers, Third edition , 1994 .

[11]  Francis Eng Hock Tay,et al.  A comparative study of saliency analysis and genetic algorithm for feature selection in support vector machines , 2001, Intell. Data Anal..

[12]  M. Niranjan,et al.  Sequential support vector machines , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[13]  Kazuo Asakawa,et al.  Stock market prediction system with modular neural networks , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[14]  Alexander J. Smola,et al.  Support Vector Method for Function Approximation, Regression Estimation and Signal Processing , 1996, NIPS.

[15]  Amir F. Atiya,et al.  Introduction to financial forecasting , 1996, Applied Intelligence.

[16]  Michael Y. Hu,et al.  Neural network forecasting of the British pound/US dol-lar exchange rate , 1998 .

[17]  Gunnar Rätsch,et al.  Predicting Time Series with Support Vector Machines , 1997, ICANN.

[18]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[19]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[20]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[21]  Gunnar Rätsch,et al.  Using support vector machines for time series prediction , 1999 .