Forecasting stock indices with wavelet domain kernel partial least square regressions

Abstract: Financial time series are nonlinear and non-stationary. Most financial phenomena cannot be clearly characterized in time domain. Therefore, traditional time domain models are not very effective in financial forecasting. To address the problem, this study combines wavelet analysis with kernel partial least square (PLS) regressions for stock index forecasting. Wavelet transformation maps time domain inputs to time-frequency (or wavelet) domain, where financial characteristics can be clearly identified. Because of the high dimensionality and heavy multi-collinearity of the input data, a wavelet domain kernel PLS regressor is employed to create the most efficient subspace that maintains maximum covariance between inputs and outputs, and to perform final forecasting. Empirical results demonstrate that the proposed model outperforms traditional neural networks, support vector machines, GARCH models, and has significantly reduced the forecasting errors.

[1]  Peter Bloomfield,et al.  Fourier Analysis of Time Series: An Introduction , 1977 .

[2]  J. B. Ramsey,et al.  The Decomposition of Economic Relationships by Time Scale Using Wavelets: Expenditure and Income , 1998 .

[3]  Paul Newbold,et al.  Testing the equality of prediction mean squared errors , 1997 .

[4]  Yuan Ren,et al.  Determination of Optimal SVM Parameters by Using GA/PSO , 2010, J. Comput..

[5]  Richard Bellman,et al.  Adaptive Control Processes: A Guided Tour , 1961, The Mathematical Gazette.

[6]  R. Gencay,et al.  Multiscale systematic risk , 2005 .

[7]  R. Gencay,et al.  An Introduction to Wavelets and Other Filtering Methods in Finance and Economics , 2001 .

[9]  L. Glosten,et al.  On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks , 1993 .

[10]  R. Davidson,et al.  Walvelet Analysis of Commodity Price Behavior , 1998 .

[11]  Shie-Jue Lee,et al.  A multiple-kernel support vector regression approach for stock market price forecasting , 2011, Expert Syst. Appl..

[12]  Arash Bahrammirzaee,et al.  A comparative survey of artificial intelligence applications in finance: artificial neural networks, expert system and hybrid intelligent systems , 2010, Neural Computing and Applications.

[13]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[14]  Brandon Whitcher,et al.  Systematic risk and timescales , 2003 .

[15]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[16]  Roman Rosipal,et al.  Overview and Recent Advances in Partial Least Squares , 2005, SLSFS.

[17]  J. Kamruzzaman,et al.  Forecasting of currency exchange rates using ANN: a case study , 2003, International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003.

[18]  Zuohong Pan,et al.  A Stochastic Nonlinear Regression Estimator Using Wavelets , 1998 .

[19]  Fionn Murtagh,et al.  Wavelet-based feature extraction and decomposition strategies for financial forecasting , 1998 .

[20]  Charles K. Chui,et al.  An Introduction to Wavelets , 1992 .

[21]  Bruce J. Vanstone,et al.  Financial time series forecasting with machine learning techniques: a survey , 2010, ESANN.

[22]  Dominik R. Dersch,et al.  Multiresolution Forecasting for Futures Trading , 2001 .

[23]  Hahn-Shik Lee.  International transmission of stock market movements: a wavelet analysis , 2004 .

[24]  Marko Grobelnik,et al.  Subspace, Latent Structure and Feature Selection techniques , 2006 .

[25]  Cheng-Lung Huang,et al.  A GA-based feature selection and parameters optimizationfor support vector machines , 2006, Expert Syst. Appl..

[26]  A. Walden,et al.  Wavelet Methods for Time Series Analysis , 2000 .

[27]  Hong-Ye Gao,et al.  Applied wavelet analysis with S-plus , 1996 .

[28]  Shian-Chang Huang,et al.  Integrating recurrent SOM with wavelet-based kernel partial least square regressions for financial forecasting , 2010, Expert Syst. Appl..

[29]  Jingtao Yao,et al.  A case study on using neural networks to perform technical forecasting of forex , 2000, Neurocomputing.

[30]  Nello Cristianini,et al.  An introduction to Support Vector Machines , 2000 .

[31]  J. B. Ramsey,et al.  The analysis of foreign exchange data using waveform dictionaries , 1997 .

[32]  Sheng-Tun Li,et al.  Knowledge discovery in financial investment for forecasting and trading strategy through wavelet-based SOM networks , 2008, Expert Syst. Appl..

[33]  R. Gencay,et al.  Scaling properties of foreign exchange volatility , 2001 .

[34]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[35]  F. In,et al.  The Hedge Ratio and the Empirical Relationship between the Stock and Futures Markets: A New Approach Using Wavelet Analysis , 2006 .

[36]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[37]  Ilona Weinreich,et al.  Wavelet-based prediction of oil prices , 2005 .

[38]  Kimon P. Valavanis,et al.  Surveying stock market forecasting techniques - Part II: Soft computing methods , 2009, Expert Syst. Appl..

[39]  J. B. Ramsey,et al.  DECOMPOSITION OF ECONOMIC RELATIONSHIPS BY TIMESCALE USING WAVELETS , 1998, Macroeconomic Dynamics.

[40]  Michael Y. Hu,et al.  Neural network forecasting of the British pound/US dol-lar exchange rate , 1998 .

[41]  I. Jolliffe.  A Note on the Use of Principal Components in Regression , 1982 .

[42]  Lotfi A. Zadeh,et al.  Fuzzy logic, neural networks, and soft computing , 1993, CACM.

[43]  H. Yamada.  Wavelet-based beta estimation and Japanese industrial stock prices , 2005 .

[44]  C. B. Tilanus,et al.  Applied Economic Forecasting , 1966 .

[45]  T. Bollerslev,et al.  Generalized autoregressive conditional heteroskedasticity , 1986 .

[46]  Ralph Neuneier,et al.  Multi-agent modeling of multiple FX-markets by neural networks , 2001, IEEE Trans. Neural Networks.

[47]  S. Wold,et al.  The Collinearity Problem in Linear Regression. The Partial Least Squares (PLS) Approach to Generalized Inverses , 1984 .

[48]  Roman Rosipal,et al.  Kernel Partial Least Squares Regression in Reproducing Kernel Hilbert Space , 2002, J. Mach. Learn. Res..

[49]  James B. Ramsey,et al.  Wavelets in Economics and Finance: Past and Future , 2002 .

[50]  Viviana Fernandez,et al.  Wavelet- and SVM-based forecasts: An analysis of the U.S. metal and materials manufacturing industry , 2007 .

[51]  R. Harrison,et al.  Support Vector Machines for System Identification , 1998 .