Recurrent Embedding Kernel for Predicting Stock Daily Direction

Stock price movement is typically affected by a lot of hidden factors. Predicting stock price direction, especially short-term direction, is very challenging and consistently attracts researches. Deep recurrent neural networks, such as Long Short-Term Memory, typically outperform statistical time series models and traditional machine learning approaches with their mechanisms of learning to vectorize historical information. However, encoding entire history into a vector may unavoidably causes information loss regardless of memory learning and updating mechanisms, especially for those tasks where decisions need to be made on the current time point and similar historical time points are of great references to the decision making. In this paper, we propose a new deep architecture called Recurrent Embedding Kernel (REK) that can learn to make optimal decisions by referring to the entire history instead of just current memory vectors. Experimental results on multiple stock ETFs with different long-term trends show that REK outperforms RNN, LSTM, and GRU, on predicting daily price direction.

[1]  Razvan Pascanu,et al.  Theano: A CPU and GPU Math Compiler in Python , 2010, SciPy.

[2]  Jim Kyung-Soo Liew,et al.  Forecasting ETFs with Machine Learning Algorithms , 2017 .

[3]  James D. Hamilton Time Series Analysis , 1994 .

[4]  Ying Xie,et al.  Deep Kernel: Learning Kernel Function from Data Using Deep Neural Network , 2016, 2016 IEEE/ACM 3rd International Conference on Big Data Computing Applications and Technologies (BDCAT).

[5]  Thomas Fischer,et al.  Deep learning with long short-term memory networks for financial market predictions , 2017, Eur. J. Oper. Res..

[6]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[7]  Shan Gao,et al.  Financial Series Prediction: Comparison Between Precision of Time Series Models and Machine Learning Methods , 2017, ArXiv.

[8]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[9]  Frank Klawonn,et al.  Multi-Layer Perceptrons , 2013 .

[10]  Adriano C. M. Pereira,et al.  Stock market's price movement prediction with LSTM neural networks , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[11]  R. K. Agrawal,et al.  A combination of artificial neural network and random walk models for financial time series forecasting , 2013, Neural Computing and Applications.

[12]  Jianjun Xu,et al.  Deep Learning with Gated Recurrent Unit Networks for Financial Sequence Predictions , 2018 .

[13]  Shan Suthaharan,et al.  Support Vector Machine , 2016 .

[14]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[15]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[16]  Ying Xie,et al.  Unsupervised deep kernel for high dimensional data , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[17]  Yuichi Nakamura,et al.  Approximation of dynamical systems by continuous time recurrent neural networks , 1993, Neural Networks.