Stochastic and genetic neural network combinations in trading and hybrid time-varying leverage effects

The motivation of this paper is 3-fold. Firstly, we apply a Multi-Layer Perceptron (MLP), a Recurrent Neural Network (RNN) and a Psi-Sigma Network (PSN) architecture in a forecasting and trading exercise on the EUR/USD, EUR/GBP and EUR/CHF exchange rates and explore the utility of Kalman Filter, Genetic Programming (GP) and Support Vector Regression (SVR) algorithms as forecasting combination techniques. Secondly, we introduce a hybrid leverage factor based on volatility forecasts and market shocks and study if its application improves the trading performance of our models. Thirdly, we introduce a specialized loss function for Neural Networks (NNs) in financial applications. In terms of our results, the PSN from the individual forecasts and the SVR from our forecast combination techniques outperform their benchmarks in statistical accuracy and trading efficiency. We also note that our trading strategy is successful, as it increased the trading performance of most of our models, while our NNs loss function seems promising.

[1]  Lilian M. de Menezes,et al.  Forecasting with genetically programmed polynomial neural networks , 2006 .

[2]  Georgios Sermpinis,et al.  Modelling and trading the EUR/USD exchange rate at the ECB fixing , 2010 .

[3]  Georgios Sermpinis,et al.  Forecasting and trading the EUR/USD exchange rate with stochastic Neural Network combination and time-varying leverage , 2012, Decis. Support Syst..

[4]  Timo Teräsvirta,et al.  Testing the constancy of regression parameters against continuous structural change , 1994 .

[5]  P. Hansen.  A Test for Superior Predictive Ability , 2005 .

[6]  V. Corradi,et al.  Assessing Market Microstructure Effects via Realized Volatility Measures with an Application to the Dow Jones Industrial Average Stocks , 2009 .

[7]  A. Speight,et al.  Dynamic news effects in high frequency Euro exchange rates , 2010 .

[8]  Shu-Heng Chen,et al.  Genetic Algorithms and Genetic Programming in Computational Finance , 2002 .

[9]  SermpinisGeorgios,et al.  Forecasting and trading the EUR/USD exchange rate with stochastic Neural Network combination and time-varying leverage , 2012, DSS 2012.

[10]  Rolf Sundberg.  Shrinkage regression , 2001 .

[11]  Rob J Hyndman,et al.  25 years of time series forecasting , 2006 .

[12]  Paolo Tenti,et al.  Forecasting Foreign Exchange Rates Using Recurrent Neural Networks , 1996, Appl. Artif. Intell..

[13]  Amir F. Atiya,et al.  Forecast combinations of computational intelligence and linear models for the NN5 time series forecasting competition , 2011 .

[14]  Rozaida Ghazali.  Higher order neural networks for financial time series prediction , 2007 .

[15]  M. Yuan,et al.  On the non‐negative garrotte estimator , 2007 .

[16]  J. Franklin,et al.  The elements of statistical learning: data mining, inference and prediction , 2005 .

[17]  K. Zimmermann,et al.  PSEUDO‐R2 MEASURES FOR SOME COMMON LIMITED DEPENDENT VARIABLE MODELS , 1996 .

[18]  Muddun Bhuruth,et al.  Forecasting exchange rates with linear and nonlinear models , 2008 .

[19]  John Moody,et al.  Developments in forecast combination and portfolio choice , 2001 .

[20]  Douglas K. Pearce,et al.  Macroeconomic news and exchange rates , 2007 .

[21]  Hak-Keung Lam,et al.  A novel genetic-algorithm-based neural network for short-term load forecasting , 2003, IEEE Trans. Ind. Electron..

[22]  Lijuan Cao,et al.  c-ascending support vector machines for financial time series forecasting , 2003, 2003 IEEE International Conference on Computational Intelligence for Financial Engineering, 2003. Proceedings..

[23]  Theodore B. Trafalis,et al.  Kernel methods for short-term portfolio management , 2006, Expert Syst. Appl..

[24]  Min Wu,et al.  Technical Trading-Rule Profitability, Data Snooping, and Reality Check: Evidence from the Foreign Exchange Market , 2005 .

[25]  Olivier Darné,et al.  Are Disaggregate Data Useful for Factor Analysis in Forecasting French GDP? , 2009 .

[26]  Reza Ebrahimpour,et al.  Mixture of MLP-experts for trend forecasting of time series: A case study of the Tehran stock exchange , 2011 .

[27]  Axel Großmann,et al.  Forecasting exchange rates: Non-linear adjustment and time-varying equilibrium , 2010 .

[28]  Christian Borgelt,et al.  Introduction to Neural Networks , 2016 .

[29]  Bernhard Schölkopf,et al.  Experimentally optimal v in support vector regression for different noise models and parameter settings , 2004, Neural Networks.

[30]  William R. Kinney,et al.  Capital market seasonality: The case of stock returns , 1976 .

[31]  Christian L. Dunis,et al.  Forecasting and Trading Currency Volatility: An Application of Recurrent Neural Regression and Model Combination , 2002 .

[32]  Monica Lam,et al.  Neural network techniques for financial performance prediction: integrating fundamental and technical analysis , 2004, Decis. Support Syst..

[33]  Mukta Paliwal,et al.  Neural networks and statistical techniques: A review of applications , 2009, Expert Syst. Appl..

[34]  Theodore B. Trafalis,et al.  Support vector machine for regression and applications to financial forecasting , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[35]  P. Bacchetta,et al.  On the Unstable Relationship between Exchange Rates and Macroeconomic Fundamentals , 2009 .

[36]  Georgios Sermpinis,et al.  Higher order and recurrent neural architectures for trading the EUR/USD exchange rate , 2011 .

[37]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[38]  Arnold F. Shapiro,et al.  A Hitchhiker’s guide to the techniques of adaptive nonlinear models , 2000 .

[39]  J. L. Roux.  An Introduction to the Kalman Filter , 2003 .

[40]  Amélie Charles,et al.  Large shocks and the September 11th terrorist attacks on international stock markets , 2006 .

[41]  S. Sathiya Keerthi,et al.  Evaluation of simple performance measures for tuning SVM hyperparameters , 2003, Neurocomputing.

[42]  An-Sing Chen,et al.  Regression neural network for error correction in foreign exchange forecasting and trading , 2004, Comput. Oper. Res..

[43]  Hansheng Wang,et al.  Robust Regression Shrinkage and Consistent Variable Selection Through the LAD-Lasso , 2007 .

[44]  Theodore B. Trafalis,et al.  Short term forecasting with support vector machines and application to stock price prediction , 2008, Int. J. Gen. Syst..

[45]  D. Basak,et al.  Support Vector Regression , 2008 .

[46]  Joydeep Ghosh,et al.  The pi-sigma network: an efficient higher-order neural network for pattern classification and function approximation , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[47]  Riccardo Poli,et al.  Parsimony pressure made easy , 2008, GECCO '08.

[48]  V. Puttonen,et al.  Fundamental indexation in Europe , 2008 .

[49]  Arash Bahrammirzaee,et al.  A comparative survey of artificial intelligence applications in finance: artificial neural networks, expert system and hybrid intelligent systems , 2010, Neural Computing and Applications.

[50]  Mark J. Kamstra,et al.  Neural network forecast combining with interaction effects , 1999 .

[51]  Paul G. Harrald,et al.  Evolving artificial neural networks to combine financial forecasts , 1997, IEEE Trans. Evol. Comput..

[52]  Huaiyu Zhu,et al.  No Free Lunch for Cross-Validation , 1996, Neural Computation.

[53]  Hüseyin Tastan,et al.  Estimating time-varying conditional correlations between stock and foreign exchange markets , 2006 .

[54]  M. Flannery,et al.  Macroeconomic Factors Do Influence Aggregate Stock Returns , 2002 .

[55]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[56]  B. Schölkopf,et al.  Asymptotically Optimal Choice of ε-Loss for Support Vector Machines , 1998 .

[57]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[58]  S. Sosvilla‐Rivero,et al.  Technical analysis in foreign exchange markets: evidence from the EMS , 2000 .

[59]  A. Timmermann,et al.  Forecasts of Us Short-Term Interest Rates: A Flexible Forecast Combination Approach , 2006 .

[60]  Patrick van der Smagt,et al.  Introduction to neural networks , 1995, The Lancet.

[61]  I. Mathur,et al.  Trading rule profits in european currency spot cross-rates , 1996 .

[62]  J. Stock,et al.  A dynamic factor model framework for forecast combination , 1999 .

[63]  Vladimir Cherkassky,et al.  The Nature Of Statistical Learning Theory , 1997, IEEE Trans. Neural Networks.

[64]  Peter Bühlmann.  Regression shrinkage and selection via the Lasso: a retrospective (Robert Tibshirani): Comments on the presentation , 2011 .

[65]  Kenneth S. Rogoff,et al.  Exchange rate models of the seventies. Do they fit out of sample , 1983 .

[66]  Stephen M. Horan.  The Adaptive Markets Hypothesis , 2005 .

[67]  Carlo Altavilla,et al.  Forecasting and combining competing models of exchange rate determination , 2006, SSRN Electronic Journal.

[68]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[69]  R. Tibshirani,et al.  Regression shrinkage and selection via the lasso: a retrospective , 2011 .

[70]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[71]  Paul Newbold,et al.  Testing the equality of prediction mean squared errors , 1997 .

[72]  Kevin N. Gurney,et al.  An introduction to neural networks , 2018 .

[73]  Yunqian Ma,et al.  Practical selection of SVM parameters and noise estimation for SVM regression , 2004, Neural Networks.

[74]  Janne Äijö.  Impact of US and UK macroeconomic news announcements on the return distribution implied by FTSE-100 index options , 2008 .

[75]  M. Medeiros,et al.  Linear models, smooth transition autoregressions, and neural networks for forecasting macroeconomic time series: A re-examination , 2005 .

[76]  Cheolbeom Park,et al.  What Do We Know About the Profitability of Technical Analysis? , 2007 .

[77]  Anil K. Bera,et al.  Efficient tests for normality, homoscedasticity and serial independence of regression residuals , 1980 .

[78]  Chih-Chou Chiu,et al.  Financial time series forecasting using independent component analysis and support vector regression , 2009, Decis. Support Syst..

[79]  T. Yalcinoz,et al.  Implementing soft computing techniques to solve economic dispatch problem in power systems , 2008, Expert Syst. Appl..

[80]  Bernhard Schölkopf,et al.  Shrinking the Tube: A New Support Vector Regression Algorithm , 1998, NIPS.

[81]  Christopher J. Neely.  The temporal pattern of trading rule returns and exchange rate intervention: intervention does not generate technical trading profits , 2002 .

[82]  H. Tong,et al.  ON ESTIMATING THRESHOLDS IN AUTOREGRESSIVE MODELS , 1986 .

[83]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[84]  Giovanni Montana,et al.  Learning to Trade with Incremental Support Vector Regression Experts , 2008, HAIS.

[85]  Christian Dreger,et al.  Forecasting Private Consumption by Consumer Surveys , 2010 .

[86]  Christopher J. Neely,et al.  Can Markov Switching Models Predict Excess Foreign Exchange Returns? , 2006 .

[87]  Frank T. Magiera,et al.  Macroeconomic Factors Do Influence Aggregate Stock Returns , 2002 .

[88]  Michael Y. Hu,et al.  Combining conditional volatility forecasts using neural networks: an application to the EMS exchange rates , 1999 .

[89]  Jessica James,et al.  Handbook of exchange rates , 2012 .

[90]  Alfredo Vellido,et al.  Neural networks in business: a survey of applications (1992–1998) , 1999 .

[91]  Yuhong Yang.  COMBINING FORECASTING PROCEDURES: SOME THEORETICAL RESULTS , 2004, Econometric Theory.

[92]  Johan A. K. Suykens,et al.  Weighted least squares support vector machines: robustness and sparse approximation , 2002, Neurocomputing.