European Exchange Trading Funds Trading with Locally Weighted Support Vector Regression

In this paper, two different Locally Weighted Support Vector Regression (wSVR) algorithms are generated and applied to the task of forecasting and trading five European Exchange Traded Funds. The trading application covers the recent European Monetary Union debt crisis. The performance of the proposed models is benchmarked against traditional Support Vector Regression (SVR) models. The Radial Basis Function, the Wavelet and the Mahalanobis kernel are explored and tested as SVR kernels. Finally, a novel statistical SVR input selection procedure is introduced based on a principal component analysis and the Hansen, Lunde, and Nason (2011) model confidence test. The results demonstrate the superiority of the wSVR models over the traditional SVRs and of the v-SVR over the e-SVR algorithms. We note that the performance of all models varies and considerably deteriorates in the peak of the debt crisis. In terms of the kernels, our results do not confirm the belief that the Radial Basis Function is the optimum choice for financial series.

[1]  Shie-Jue Lee,et al.  A multiple-kernel support vector regression approach for stock market price forecasting , 2011, Expert Syst. Appl..

[2]  Chenghui Zhang,et al.  Estimation of battery state-of-charge using ν-support vector regression algorithm , 2008 .

[3]  Georgios Sermpinis,et al.  Modeling, forecasting and trading the EUR exchange rates with hybrid rolling genetic algorithms - Support vector regression forecast combinations , 2015, Eur. J. Oper. Res..

[4]  Douglas Wood,et al.  The profitability of daily stock market indices trades based on neural network predictions: case study for the S&P 500, the DAX, the TOPIX and the FTSE in the period 1965–1999 , 2004 .

[5]  Fong-Ching Yuan.  Parameters Optimization Using Genetic Algorithms in Support Vector Regression for Sales Volume Forecasting , 2012 .

[6]  C. Mallows.  Some Comments on Cp , 2000, Technometrics.

[7]  Senjian An,et al.  Fast cross-validation algorithms for least squares support vector machine and kernel ridge regression , 2007, Pattern Recognit..

[8]  M. Hashem Pesaran,et al.  A Simple Nonparametric Test of Predictive Performance , 1992 .

[9]  R. Fisman.  Estimating the Value of Political Connections , 2001 .

[10]  Paolo Tenti,et al.  Forecasting Foreign Exchange Rates Using Recurrent Neural Networks , 1996, Appl. Artif. Intell..

[11]  Joydeep Ghosh,et al.  The pi-sigma network: an efficient higher-order neural network for pattern classification and function approximation , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[12]  Georgios Sermpinis,et al.  Modelling and trading the EUR/USD exchange rate at the ECB fixing , 2010 .

[13]  Peter Reinhard Hansen,et al.  The Model Confidence Set , 2010 .

[14]  David de la Fuente,et al.  Stock Market Simulation Using Support Vector Machines , 2014 .

[15]  P. Hansen.  A Test for Superior Predictive Ability , 2005 .

[16]  Q. Henry Wu,et al.  Electric Load Forecasting Based on Locally Weighted Support Vector Regression , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[17]  J. L. Hodges,et al.  Discriminatory Analysis - Nonparametric Discrimination: Consistency Properties , 1989 .

[18]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[19]  Sheng-Hsun Hsu,et al.  A two-stage architecture for stock price forecasting by integrating self-organizing map and support vector regression , 2009, Expert Syst. Appl..

[20]  Michael G. Madden,et al.  The Genetic Kernel Support Vector Machine: Description and Evaluation , 2005, Artificial Intelligence Review.

[21]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[22]  A. Lo.  The Adaptive Markets Hypothesis , 2004 .

[23]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[24]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[25]  Chih-Chou Chiu,et al.  Financial time series forecasting using independent component analysis and support vector regression , 2009, Decis. Support Syst..

[26]  B. Hansen.  Least Squares Model Averaging , 2007 .

[27]  W. Cleveland,et al.  Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting , 1988 .

[28]  Arnold F. Shapiro,et al.  A Hitchhiker’s guide to the techniques of adaptive nonlinear models , 2000 .

[29]  Timo Teräsvirta,et al.  Testing the constancy of regression parameters against continuous structural change , 1994 .

[30]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[31]  Georgios Sermpinis,et al.  Adaptive Evolutionary Neural Networks for Forecasting and Trading without a Data‐Snooping Bias , 2016 .

[32]  Martin Brown,et al.  Network Performance Assessment for Neurofuzzy Data Modelling , 1997, IDA.

[33]  En Sup Yoon,et al.  Weighted support vector machine for quality estimation in the polymerization process , 2005 .

[34]  Shian-Chang Huang,et al.  Chaos-based support vector regressions for exchange rate forecasting , 2010, Expert Syst. Appl..

[35]  Michael R. Lyu,et al.  Local Support Vector Regression for Financial Time Series Prediction , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[36]  Weimin Huang,et al.  Weighted Support Vector Regression Algorithm Based on Data Description , 2008, 2008 ISECS International Colloquium on Computing, Communication, Control, and Management.

[37]  Wei‐Chiang Hong.  A hybrid support vector machine regression for exchange rate prediction , 2006 .

[38]  D. Andrews,et al.  Asymptotic optimality of generalized CL, cross-validation, and generalized cross-validation in regression with heteroskedastic errors , 1991 .

[39]  Ping-Feng Pai,et al.  A fuzzy support vector regression model for business cycle predictions , 2010, Expert Syst. Appl..

[40]  Georgios Sermpinis,et al.  Higher order and recurrent neural architectures for trading the EUR/USD exchange rate , 2011 .

[41]  C. L. Mallows.  Some comments on C_p , 1973 .

[42]  C.-C. Chuang,et al.  Fuzzy Weighted Support Vector Regression With a Fuzzy Partition , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[43]  Li Zhang,et al.  Wavelet support vector machine , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[44]  Theodore B. Trafalis,et al.  A hybrid model for exchange rate prediction , 2006, Decis. Support Syst..

[45]  H. Tong,et al.  ON ESTIMATING THRESHOLDS IN AUTOREGRESSIVE MODELS , 1986 .

[46]  So Young Sohn,et al.  Support vector machines for default prediction of SMEs based on technology credit , 2010, Eur. J. Oper. Res..

[47]  Johan A. K. Suykens,et al.  Weighted least squares support vector machines: robustness and sparse approximation , 2002, Neurocomputing.

[48]  Blake LeBaron,et al.  The Stability of Moving Average Technical Trading Rules on the Dow Jones Index , 2000 .

[49]  Kenneth A. Froot,et al.  Herd on the Street: Informational Inefficiencies in a Market with Short-Term Speculation , 1990 .

[50]  Sylvain Arlot,et al.  A survey of cross-validation procedures for model selection , 2009, 0907.4728.

[51]  Chih-Jen Lin,et al.  Training v-Support Vector Regression: Theory and Algorithms , 2002, Neural Computation.

[52]  Lei Guo,et al.  Forecasting stock composite index by fuzzy support vector machines regression , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[53]  Shaoning Pang,et al.  Correlation-aided support vector regression for forex time series prediction , 2011, Neural Computing and Applications.

[54]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[55]  Georgios Sermpinis,et al.  A hybrid genetic algorithm–support vector machine approach in the task of forecasting and trading , 2013 .

[56]  Mu-Yen Chen.  Using a hybrid evolution approach to forecast financial failures for Taiwan-listed companies , 2014 .

[57]  Milton S. Boyd,et al.  Designing a neural network for forecasting financial and economic time series , 1996, Neurocomputing.

[58]  Klaus-Robert Müller,et al.  Asymptotic statistical theory of overtraining and cross-validation , 1997, IEEE Trans. Neural Networks.

[59]  Gavin C. Cawley,et al.  On Over-fitting in Model Selection and Subsequent Selection Bias in Performance Evaluation , 2010, J. Mach. Learn. Res..

[60]  Franklin Allen,et al.  Using genetic algorithms to find technical trading rules , 1999 .

[61]  Jonathan Crook,et al.  Support vector regression for loss given default modelling , 2015, Eur. J. Oper. Res..

[62]  Ruibin Geng,et al.  Prediction of financial distress: An empirical study of listed Chinese companies using data mining , 2015, Eur. J. Oper. Res..

[63]  Kate Smith-Miles,et al.  A meta-learning approach to automatic kernel selection for support vector machines , 2006, Neurocomputing.

[64]  Byung Ro Moon,et al.  A Hybrid Neurogenetic Approach for Stock Forecasting , 2007, IEEE Transactions on Neural Networks.

[65]  Hui Jiang,et al.  Grey relational grade in local support vector regression for financial time series prediction , 2012, Expert Syst. Appl..

[66]  I. Jolliffe.  Principal Component Analysis , 2002 .

[67]  Bernhard Schölkopf,et al.  Shrinking the Tube: A New Support Vector Regression Algorithm , 1998, NIPS.

[68]  Cheng-Lung Huang,et al.  A hybrid SOFM-SVR with a filter-based feature selection for stock market forecasting , 2009, Expert Syst. Appl..

[69]  Min Wu,et al.  Technical Trading-Rule Profitability, Data Snooping, and Reality Check: Evidence from the Foreign Exchange Market , 2005 .

[70]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .