Recurrent support vector regression for a non-linear ARMA model with applications to forecasting financial returns

Motivated by recurrent neural networks, this paper proposes a recurrent support vector regression (SVR) procedure to forecast nonlinear ARMA model based simulated data and real data of financial returns. The forecasting ability of the recurrent SVR based ARMA model is compared with five competing models (random walk, threshold ARMA model, MLE based ARMA model, recurrent artificial neural network based ARMA model and feed-forward SVR based ARMA model) by using two forecasting accuracy evaluation metrics (NSME and sign) and robust Diebold–Mariano test. The results reveal that for one-step-ahead forecasting, the recurrent SVR model is consistently better than the benchmark models in forecasting both the magnitude and turning points, and statistically improves the forecasting performance as opposed to the usual feed-forward SVR.

[1]  I. Moosa.  Exchange rate forecasting : techniques and applications , 2000 .

[2]  James D. Hamilton.  Time Series Analysis , 1994 .

[3]  Massimiliano Pontil,et al.  Regularization and statistical learning theory for data analysis , 2002 .

[4]  W. Newey,et al.  A Simple, Positive Semi-Definite, Heteroskedasticity and Autocorrelationconsistent Covariance Matrix , 1986 .

[5]  Francesco Lisi,et al.  A comparison between neural networks and chaotic models for exchange rate prediction , 1999 .

[6]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[7]  Johan A. K. Suykens,et al.  Financial time series prediction using least squares support vector machines within the evidence framework , 2001, IEEE Trans. Neural Networks.

[8]  Graphical Data Representation in Bankruptcy Analysis , 2006 .

[9]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[10]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[11]  Wei-Chiang Hong,et al.  Electric load forecasting by seasonal recurrent SVR (support vector regression) with chaotic artific , 2011 .

[12]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[13]  Philip A. Klein,et al.  Forecasting Financial and Economic Cycles , 1994 .

[14]  Michael I. Jordan.  Attractor dynamics and parallelism in a connectionist sequential machine , 1990 .

[15]  Jean Gaudart,et al.  Comparison of the performance of multi-layer perceptron and linear regression for epidemiological data , 2004, Comput. Stat. Data Anal..

[16]  J. Nazuno.  Haykin, Simon. Neural networks: A comprehensive foundation, Prentice Hall, Inc. Segunda Edición, 1999 , 2000 .

[17]  Angelos Kanas,et al.  Non‐linear forecasts of stock returns , 2003 .

[18]  Berlin Wu,et al.  Model-free forecasting for nonlinear time series (with application to exchange rates) , 1995 .

[19]  Lai-Wan Chan,et al.  Support Vector Machine Regression for Volatile Stock Market Prediction , 2002, IDEAL.

[20]  Francis Eng Hock Tay,et al.  Financial Forecasting Using Support Vector Machines , 2001, Neural Computing & Applications.

[21]  Kurt Hornik,et al.  A Convergence Result for Learning in Recurrent Neural Networks , 1994, Neural Computation.

[22]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[23]  Chung-Ming Kuan.  A recurrent Newton algorithm and its convergence properties , 1995, IEEE Trans. Neural Networks.

[24]  N. Hautsch,et al.  Price Adjustment to News with Uncertain Precision , 2010 .

[25]  M. B. Priestley,et al.  Non-linear and non-stationary time series analysis , 1990 .

[26]  Predicting Bankruptcy with Support Vector Machines , 2005 .

[27]  Johan A. K. Suykens,et al.  LS-SVM REGRESSION WITH AUTOCORRELATED ERRORS , 2006 .

[28]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[29]  Theodore B. Trafalis,et al.  Support vector machine for regression and applications to financial forecasting , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[30]  E. Lorenz.  Deterministic nonperiodic flow , 1963 .

[31]  J. Suykens,et al.  Recurrent least squares support vector machines , 2000 .

[32]  Fred Collopy,et al.  How effective are neural networks at forecasting and prediction? A review and evaluation , 1998 .

[33]  Chung-Ming Kuan,et al.  Forecasting exchange rates using feedforward and recurrent neural networks , 1992 .

[34]  Amit Mitra,et al.  Forecasting daily foreign exchange rates using genetically optimized neural networks , 2002 .

[35]  R. Shah,et al.  Least Squares Support Vector Machines , 2022 .

[36]  D. Andrews.  Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation , 1991 .

[37]  Anton Andriyashin,et al.  Recursive Portfolio Selection with Decision Trees , 2008 .

[38]  Tian-Shyug Lee,et al.  Mining the customer credit using classification and regression tree and multivariate adaptive regression splines , 2006, Comput. Stat. Data Anal..

[39]  L. Hildebrandt,et al.  Gruppenvergleiche bei hypothetischen Konstrukten — Die Prüfung der Übereinstimmung von Messmodellen mit der Strukturgleichungsmethodik , 2008 .

[40]  Martti Juhola,et al.  AR parameter estimation by a feedback neural network , 1997 .

[41]  A. Timmermann,et al.  The Statistical And Economic Significance Of The Predictability Of Excess Returns On Common Stocks , 1990 .

[42]  Joarder Kamruzzaman,et al.  ANN-Based Forecasting of Foreign Currency Exchange Rates , 2004 .

[43]  N. Hautsch,et al.  Modelling High-Frequency Volatility and Liquidity Using Multiplicative Error Models , 2008 .

[44]  Wolfgang Härdle,et al.  Predicting Bankruptcy with Support Vector Machines , 2005 .