Restricted Boltzmann machine based stock market trend prediction

For the past decades, stock prediction has been a popular topic in financial applications. Many approaches including machine learning based and statistical models have been employed to forecast price changes in stock market. Considering the power of Restricted Bolztmann Machine (RBM) for feature extraction, we propose to incorporate RBM and several classifiers to predict short-term stock market trend. In this paper, eleven technical indicators are firstly inferred by using trading data, e.g., close price, lowest price, open price and highest price. Afterwards, these technical indicators are conveyed to binary values by using a trend deterministic preparation layer. We apply a RBM to extract features from binary valued features from the last step. The experimental study demonstrates this model's effectiveness compared with several traditional methods.

[1]  E. Fama.  EFFICIENT CAPITAL MARKETS: A REVIEW OF THEORY AND EMPIRICAL WORK* , 1970 .

[2]  Geoffrey E. Hinton.  Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[3]  Vikas Jain.  From Efficient Markets Theory to Behavioral Finance , 2003 .

[4]  Ping-Feng Pai,et al.  A hybrid ARIMA and support vector machines model in stock price forecasting , 2005 .

[5]  Ingoo Han,et al.  An evolutionary approach to the combination of multiple classifiers to predict a stock price index , 2006, Expert Syst. Appl..

[6]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[7]  K. Sakakibara,et al.  Stock Price Forecasting using Back Propagation Neural Networks with Time and Profit Based Adjusted Weight Factors , 2006, 2006 SICE-ICASE International Joint Conference.

[8]  Pei-Chann Chang,et al.  A Hybrid System Integrating a Wavelet and TSK Fuzzy Rules for Stock Price Forecasting , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[9]  Tijmen Tieleman,et al.  Training restricted Boltzmann machines using approximations to the likelihood gradient , 2008, ICML '08.

[10]  Chenn-Jung Huang,et al.  Application of wrapper approach and composite classifier to the stock trend prediction , 2008, Expert Syst. Appl..

[11]  Cheng-Lung Huang,et al.  A hybrid SOFM-SVR with a filter-based feature selection for stock market forecasting , 2009, Expert Syst. Appl..

[12]  Derya Avci,et al.  An Adaptive Network-Based Fuzzy Inference System (ANFIS) for the prediction of stock market return: The case of the Istanbul Stock Exchange , 2010, Expert Syst. Appl..

[13]  Chih-Fong Tsai,et al.  Combining multiple feature selection methods for stock prediction: Union, intersection, and multi-intersection approaches , 2010, Decis. Support Syst..

[14]  Arash Ghanbari,et al.  Integration of genetic fuzzy systems and artificial neural networks for stock price forecasting , 2010, Knowl. Based Syst..

[15]  Wei-Chang Yeh,et al.  Forecasting stock markets using wavelet transforms and recurrent neural networks: An integrated system based on artificial bee colony algorithm , 2011, Appl. Soft Comput..

[16]  Tai-Liang Chen,et al.  A hybrid model based on adaptive-network-based fuzzy inference system to forecast Taiwan stock market , 2011, Expert Syst. Appl..

[17]  Zhe George Zhang,et al.  Forecasting stock indices with back propagation neural network , 2011, Expert Syst. Appl..

[18]  Zhi-Wei Ni,et al.  Stock trend prediction based on fractal feature selection and support vector machine , 2011, Expert Syst. Appl..

[19]  Xiaola Lin,et al.  Feature extraction using Restricted Boltzmann Machine for stock price prediction , 2012, 2012 IEEE International Conference on Computer Science and Automation Engineering (CSAE).

[20]  Peng Qinke,et al.  Stock price prediction method based on cluster of trend vectors , 2012 .

[21]  Christian Igel,et al.  An Introduction to Restricted Boltzmann Machines , 2012, CIARP.

[22]  Geoffrey E. Hinton.  A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[23]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Xin Zheng,et al.  Feature Learning with Gaussian Restricted Boltzmann Machine for Robust Speech Recognition , 2013, ArXiv.

[25]  A. K. Nassirtoussi,et al.  A novel FOREX prediction methodology based on fundamental data , 2013 .

[26]  Jeng-Shyang Pan,et al.  Fuzzy Forecasting Based on Two-Factors Second-Order Fuzzy-Trend Logical Relationship Groups and Particle Swarm Optimization Techniques , 2013, IEEE Transactions on Cybernetics.

[27]  Kotagiri Ramamohanarao,et al.  A HMM-based adaptive fuzzy inference system for stock market forecasting , 2013, Neurocomputing.

[28]  S. Imandoust,et al.  Forecasting the direction of stock market index movement using three data mining techniques: the case of Tehran Stock Exchange , 2014 .

[29]  S. Lahmiri.  Entropy-Based Technical Analysis Indicators Selection for International Stock Markets Fluctuations Prediction Using Support Vector Machines , 2014 .

[30]  Kazuhiro Seki,et al.  Predicting Stock Market Trends by Recurrent Deep Neural Networks , 2014, PRICAI.

[31]  Pradipta Kishore Dash,et al.  A hybrid evolutionary dynamic neural network for stock market trend analysis and prediction using unscented Kalman filter , 2014, Appl. Soft Comput..

[32]  Aderemi Oluyinka Adewumi,et al.  Stock Price Prediction Using the ARIMA Model , 2014, 2014 UKSim-AMSS 16th International Conference on Computer Modelling and Simulation.

[33]  Shouyang Wang,et al.  A causal feature selection algorithm for stock prediction modeling , 2014, Neurocomputing.

[34]  Christian Igel,et al.  Training restricted Boltzmann machines: An introduction , 2014, Pattern Recognit..

[35]  B. Eswara Reddy,et al.  A moving-average filter based hybrid ARIMA-ANN model for forecasting time series data , 2014, Appl. Soft Comput..

[36]  Sahil Shah,et al.  Predicting stock and stock price index movement using Trend Deterministic Data Preparation and machine learning techniques , 2015, Expert Syst. Appl..

[37]  Mohammad Modarres,et al.  Developing an approach to evaluate stocks by forecasting effective features with data mining methods , 2015, Expert Syst. Appl..

[38]  Jan Hendrik Witte,et al.  Deep Learning for Finance: Deep Portfolios , 2016 .

[39]  Muneki Yasuda.  Relationship between PreTraining and Maximum Likelihood Estimation in Deep Boltzmann Machines , 2016, AISTATS.

[40]  Amit Konar,et al.  Secondary factor induced stock index time-series prediction using Self-Adaptive Interval Type-2 Fuzzy Sets , 2016, Neurocomputing.

[41]  Nicholas G. Polson,et al.  Deep learning for finance: deep portfolios: J. B. HEATON, N. G. POLSON AND J. H. WITTE , 2017 .