Financial time series forecasting using independent component analysis and support vector regression

As financial time series are inherently noisy and non-stationary, it is regarded as one of the most challenging applications of time series forecasting. Due to the advantages of generalization capability in obtaining a unique solution, support vector regression (SVR) has also been successfully applied in financial time series forecasting. In the modeling of financial time series using SVR, one of the key problems is the inherent high noise. Thus, detecting and removing the noise are important but difficult tasks when building an SVR forecasting model. To alleviate the influence of noise, a two-stage modeling approach using independent component analysis (ICA) and support vector regression is proposed in financial time series forecasting. ICA is a novel statistical signal processing technique that was originally proposed to find the latent source signals from observed mixture signals without having any prior knowledge of the mixing mechanism. The proposed approach first uses ICA to the forecasting variables for generating the independent components (ICs). After identifying and removing the ICs containing the noise, the rest of the ICs are then used to reconstruct the forecasting variables which contain less noise and served as the input variables of the SVR forecasting model. In order to evaluate the performance of the proposed approach, the Nikkei 225 opening index and TAIEX closing index are used as illustrative examples. Experimental results show that the proposed model outperforms the SVR model with non-filtered forecasting variables and a random walk model.

[1]  Guoqiang Peter Zhang,et al.  An investigation of neural networks for linear time-series forecasting , 2001, Comput. Oper. Res..

[2]  Du-Ming Tsai,et al.  Independent component analysis based filter design for defect detection in low-contrast textured images , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[3]  Monica Lam,et al.  Neural network techniques for financial performance prediction: integrating fundamental and technical analysis , 2004, Decis. Support Syst..

[4]  Guoqing Wang,et al.  Estimation of source spectra profiles and simultaneous determination of polycomponent in mixtures from ultraviolet spectra data using kernel independent component analysis and support vector regression. , 2007, Analytica chimica acta.

[5]  Mary E. Thomson,et al.  Performance evaluation of judgemental directional exchange rate predictions B , 2005 .

[6]  Mohamed Mohandes,et al.  Support vector machines for wind speed prediction , 2004 .

[7]  Andrew D. Back,et al.  Discovering Structure in Finance Using Independent Component Analysis , 1998 .

[8]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[9]  Soushan Wu,et al.  Credit rating analysis with support vector machines and neural networks: a market comparative study , 2004, Decis. Support Syst..

[10]  Lutgarde M. C. Buydens,et al.  Using support vector machines for time series prediction , 2003 .

[11]  Josef Kittler,et al.  Independent component analysis in a local facial residue space for face recognition , 2004, Pattern Recognit..

[12]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[13]  Norman R. Swanson,et al.  Forecasting economic time series using flexible versus fixed specification and linear versus nonlinear econometric models , 1997 .

[14]  Francis Eng Hock Tay,et al.  Support vector machine with adaptive parameters in financial time series forecasting , 2003, IEEE Trans. Neural Networks.

[15]  Chih-Chou Chiu,et al.  Neural network forecasting of an opening cash price index , 2002, Int. J. Syst. Sci..

[16]  Wu Meng,et al.  Application of Support Vector Machines in Financial Time Series Forecasting , 2007 .

[17]  Tian-Shyug Lee,et al.  Investigating the information content of non-cash-trading index futures using neural networks , 2002, Expert Syst. Appl..

[18]  Stephen M. Smith,et al.  Probabilistic independent component analysis for functional magnetic resonance imaging , 2004, IEEE Transactions on Medical Imaging.

[19]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[20]  Chi-Jie Lu,et al.  Integrated Application of SPC/EPC/ICA and neural networks , 2008 .

[21]  Ulf Norinder,et al.  Support vector machine models in drug design: applications to drug transport processes and QSAR using simplex optimisations and variable selection , 2003, Neurocomputing.

[22]  Yong Yu,et al.  Sales forecasting using extreme learning machine with applications in fashion retailing , 2008, Decis. Support Syst..

[23]  E. Oja,et al.  Independent component analysis for financial time series , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[24]  Kyoung-jae Kim,et al.  Financial time series forecasting using support vector machines , 2003, Neurocomputing.

[25]  Christopher J. James,et al.  Temporally constrained ICA: an application to artifact rejection in electromagnetic brain signal analysis , 2003, IEEE Transactions on Biomedical Engineering.

[26]  Lei Xu,et al.  Independent component ordering in ICA time series analysis , 2001, Neurocomputing.

[27]  Yunqian Ma,et al.  Practical selection of SVM parameters and noise estimation for SVM regression , 2004, Neural Networks.

[28]  Erkki Oja,et al.  Independent Component Analysis for Parallel Financial Time Series , 1998, International Conference on Neural Information Processing.

[29]  Bart Baesens,et al.  Predicting going concern opinion with data mining , 2008, Decis. Support Syst..

[30]  Amir F. Atiya,et al.  Introduction to financial forecasting , 1996, Applied Intelligence.

[31]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[32]  Johan A. K. Suykens,et al.  Weighted least squares support vector machines: robustness and sparse approximation , 2002, Neurocomputing.

[33]  Lijuan Cao,et al.  Support vector machines experts for time series forecasting , 2003, Neurocomputing.

[34]  Huimin Zhao,et al.  Incorporating domain knowledge into data mining classifiers: An application in indirect lending , 2008, Decis. Support Syst..

[35]  Te-Won Lee,et al.  Learning statistically efficient features for speaker recognition , 2002, Neurocomputing.

[36]  Billy M. Williams,et al.  Comparison of parametric and nonparametric models for traffic flow forecasting , 2002 .

[37]  Te-Won Lee,et al.  Independent Component Analysis , 1998, Springer US.

[38]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[39]  William Leigh,et al.  Forecasting the New York stock exchange composite index with past price and interest rate on condition of volume spike , 2005, Expert Syst. Appl..

[40]  Alfredo Vellido,et al.  Neural networks in business: a survey of applications (1992–1998) , 1999 .

[41]  Shun-Feng Su,et al.  Robust support vector regression networks for function approximation with outliers , 2002, IEEE Trans. Neural Networks.

[42]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[43]  F. Tay,et al.  Application of support vector machines in financial time series forecasting , 2001 .

[44]  Yaonan Wang,et al.  Texture classification using the support vector machines , 2003, Pattern Recognit..

[45]  Russell L. Purvis,et al.  Forecasting the NYSE composite index with technical analysis, pattern recognizer, neural network, and genetic algorithm: a case study in romantic decision support , 2002, Decis. Support Syst..

[46]  Ping-Feng Pai,et al.  Using support vector machines to forecast the production values of the machinery industry in Taiwan , 2005 .

[47]  Ping Li,et al.  Soft Sensor Modeling Based on DICA-SVR , 2005, ICIC.

[48]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[49]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[50]  L. J. Cao,et al.  Feature extraction in support vector machine: a comparison of PCA, XPCA and ICA , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[51]  Du-Ming Tsai,et al.  An independent component analysis-based filter design for defect detection in low-contrast surface images , 2006, Pattern Recognit..

[52]  Janette B. Bradley,et al.  Neural networks: A comprehensive foundation: S. HAYKIN. New York: Macmillan College (IEEE Press Book) (1994). v + 696 pp. ISBN 0-02-352761-7 , 1995 .

[53]  Gunnar Rätsch,et al.  Using support vector machines for time series prediction , 1999 .

[54]  Hang Joon Kim,et al.  Support Vector Machines for Texture Classification , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Steve Woods Float Analysis: Powerful Technical Indicators Using Price and Volume , 2002 .

[56]  Guido Deboeck,et al.  Trading on the Edge: Neural, Genetic, and Fuzzy Systems for Chaotic Financial Markets , 1994 .

[57]  Du-Ming Tsai,et al.  Independent component analysis-based defect detection in patterned liquid crystal display surfaces , 2008, Image Vis. Comput..

[58]  Bernard F. Buxton,et al.  Drug Design by Machine Learning: Support Vector Machines for Pharmaceutical Data Analysis , 2001, Comput. Chem..

[59]  Lijuan Cao,et al.  Bond rating using support vector machine , 2006, Intell. Data Anal..

[60]  Modesto Castrillón,et al.  Face recognition using independent component analysis and support vector machines , 2003 .

[61]  James T. Kwok,et al.  Mining customer product ratings for personalized marketing , 2003, Decis. Support Syst..

[62]  Ming-Ming Lai,et al.  An Examination of the Random Walk Model and Technical Trading Rules in the Malaysian Stock Market , 2002 .

[63]  Francis Eng Hock Tay,et al.  Financial Forecasting Using Support Vector Machines , 2001, Neural Computing & Applications.

[64]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[65]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[66]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[67]  Theodore B. Trafalis,et al.  A hybrid model for exchange rate prediction , 2006, Decis. Support Syst..

[68]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[69]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[70]  Ted Jaditz,et al.  MULTIVARIATE NONLINEAR FORECASTING Using Financial Information to Forecast the Real Sector , 1998 .