Predicting the Direction of US Stock Prices Using Effective Transfer Entropy and Machine Learning Techniques

This study aims to predict the direction of US stock prices by integrating time-varying effective transfer entropy (ETE) and various machine learning algorithms. At first, we explore that the ETE based on 3 and 6 months moving windows can be regarded as the market explanatory variable by analyzing the association between the financial crises and Granger-causal relationships among the stocks. Then, we discover that the prediction performance on the stock price direction can be improved when the ETE driven variable is integrated as a new feature in the logistic regression, multilayer perceptron, random forest, XGBoost, and long short-term memory network. Meanwhile, we suggest utilizing the adjusted accuracy derived from the risk-adjusted return in finance as a prediction performance measure. Lastly, we confirm that the multilayer perceptron and long short-term memory network are more suitable for stock price prediction. This study is the first attempt to predict the stock price direction using ETE, which can be conveniently applied to the practical field.

[1]  Francis C. M. Lau,et al.  A network perspective of the stock market , 2010 .

[2]  Mehdi Jabbari Nooghabi,et al.  Chaos Process Testing (Using Local Polynomial Approximation Model) in Predicting Stock Returns in Tehran Stock Exchange , 2014 .

[3]  D. Cox.  The Regression Analysis of Binary Sequences , 1958 .

[4]  Stefan Feuerriegel,et al.  Long-term stock index forecasting based on text mining of regulatory disclosures , 2018, Decis. Support Syst..

[5]  Ömer Kaan Baykan,et al.  Predicting direction of stock price index movement using artificial neural networks and support vector machines: The sample of the Istanbul Stock Exchange , 2011, Expert Syst. Appl..

[6]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[7]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[8]  Alejandra Figliola,et al.  A multifractal approach for stock market inefficiency , 2008 .

[9]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[10]  F. Lillo,et al.  Topology of correlation-based minimal spanning trees in real and model markets. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  Ammar Belatreche,et al.  Forecasting movements of health-care stock prices based on different categories of news articles using multiple kernel learning , 2016, Decis. Support Syst..

[12]  Thomas Fischer,et al.  Deep learning with long short-term memory networks for financial market predictions , 2017, Eur. J. Oper. Res..

[13]  H. Kantz,et al.  Analysing the information flow between financial time series , 2002 .

[14]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[15]  Adriano C. M. Pereira,et al.  Stock market's price movement prediction with LSTM neural networks , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[16]  Lu Zhang,et al.  An improved Stacking framework for stock index prediction by leveraging tree-based ensemble models and deep learning algorithms , 2020 .

[17]  Tugrul U. Daim,et al.  Using artificial neural network models in stock market index prediction , 2011, Expert Syst. Appl..

[18]  Dirk Neumann,et al.  Automated news reading: Stock price prediction based on financial news using context-capturing features , 2013, Decis. Support Syst..

[19]  T. Dimpfl,et al.  Using Transfer Entropy to Measure Information Flows Between Financial Markets , 2013 .

[20]  Rui Ferreira Neves,et al.  Combining Principal Component Analysis, Discrete Wavelet Transform and XGBoost to trade in the financial markets , 2019, Expert Syst. Appl..

[21]  Nivedita Deo,et al.  Correlation and network analysis of global financial indices. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  Lara Khansa,et al.  Predicting stock market returns from malicious attacks: A comparative analysis of vector autoregression and time-delayed neural networks , 2011, Decis. Support Syst..

[23]  Sujin Pyo,et al.  Predictability of machine learning techniques to forecast the trends of market index prices: Hypothesis testing for the Korean stock markets , 2017, PloS one.

[24]  W. Sharpe.  The Sharpe Ratio , 1994 .

[25]  Samuel W. K. Chan,et al.  A text-based decision support system for financial sequence prediction , 2011, Decis. Support Syst..

[26]  Eric Ghysels,et al.  A Multivariate Time Series Analysis of the Data Revision Process for Industrial Production and the Composite Leading Indicator * , 2012 .

[27]  Noh.  Model for correlations in stock markets , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[28]  Kyuseong Lim,et al.  Information transfer across intra/inter-structure of CDS and stock markets , 2017 .

[29]  Gabjin Oh,et al.  Asymmetric information flow between market index and individual stocks in several stock markets , 2012 .

[30]  Rosario N. Mantegna,et al.  Book Review: An Introduction to Econophysics, Correlations, and Complexity in Finance, N. Rosario, H. Mantegna, and H. E. Stanley, Cambridge University Press, Cambridge, 2000. , 2000 .

[31]  Yu Song,et al.  Predicting the Direction of Stock Market Index Movement Using an Optimized Artificial Neural Network Model , 2016, PloS one.

[32]  Arun Agarwal,et al.  Recurrent neural network and a hybrid model for prediction of stock returns , 2015, Expert Syst. Appl..

[33]  C. Granger.  Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[34]  Michael P. Clements,et al.  Forecasting economic and financial time-series with non-linear models , 2004 .

[35]  Denise R. Osborn,et al.  The Econometric Analysis of Seasonal Time Series , 2001 .

[36]  So Young Sohn,et al.  Global stock market investment strategies based on financial network indicators using machine learning techniques , 2019, Expert Syst. Appl..

[37]  Wei-Xing Zhou,et al.  Information Flow Networks of Chinese Stock Market Sectors , 2020, IEEE Access.

[38]  Mohammad Mahdi Rounaghi,et al.  Application of artificial neural network models and principal component analysis method in predicting stock prices on Tehran Stock Exchange , 2015 .

[39]  Leonidas Sandoval,et al.  Structure of a Global Network of Financial Companies Based on Transfer Entropy , 2014, Entropy.

[40]  Kihwan Nam,et al.  Financial news-based stock movement prediction using causality analysis of influence in the Korean stock market , 2019, Decis. Support Syst..

[41]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[42]  Alexandros Iosifidis,et al.  Feature Engineering for Mid-Price Prediction With Deep Learning , 2019, IEEE Access.

[43]  Okyu Kwon,et al.  Information flow between stock indices , 2008, 0802.1747.

[44]  Ramazan Sari,et al.  Energy consumption and GDP: causality relationship in G-7 countries and emerging markets , 2003 .

[45]  Sahil Shah,et al.  Predicting stock and stock price index movement using Trend Deterministic Data Preparation and machine learning techniques , 2015, Expert Syst. Appl..

[46]  Li Tang,et al.  Predicting the direction of stock markets using optimized neural networks with Google Trends , 2018, Neurocomputing.

[47]  Henry M. K. Mok,et al.  Causality of interest rate, exchange rate and stock prices at stock market open and close in Hong Kong , 1993 .

[48]  Chih-Chou Chiu,et al.  A hybrid approach by integrating wavelet-based feature extraction with MARS and SVR for stock index forecasting , 2013, Decis. Support Syst..

[49]  M. Moradi,et al.  Investigation of fractal market hypothesis and forecasting time series stock returns for Tehran Stock Exchange and London Stock Exchange , 2019, International Journal of Finance & Economics.

[50]  Luca Faes,et al.  Compensated Transfer Entropy as a Tool for Reliably Estimating Information Transfer in Physiological Time Series , 2013, Entropy.

[51]  Li He,et al.  Study on the contagion among American industries , 2016 .

[52]  V. Plerou,et al.  Random matrix approach to cross correlations in financial data. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[53]  Okyu Kwon,et al.  Information flow between composite stock index and individual stocks , 2007, 0708.0063.

[54]  Soo Yong Kim,et al.  Dependence structure of the Korean stock market in high frequency data , 2011 .

[55]  Ray Tsaih,et al.  Forecasting S&P 500 stock index futures with a hybrid AI system , 1998, Decis. Support Syst..

[56]  Yulei Rao,et al.  A deep learning framework for financial time series using stacked autoencoders and long-short term memory , 2017, PloS one.

[57]  Huaiqing Wang,et al.  A Stock Market Forecasting Model Combining Two-Directional Two-Dimensional Principal Component Analysis and Radial Basis Function Neural Network , 2015, PloS one.

[58]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[59]  Kyoung-jae Kim,et al.  Financial time series forecasting using support vector machines , 2003, Neurocomputing.

[60]  Ahmet Sensoy,et al.  Effective transfer entropy approach to information flow between exchange rates and stock markets , 2014 .

[61]  Tomer Geva,et al.  Empirical evaluation of an automated intraday stock recommendation system incorporating both market data and textual news , 2014, Decis. Support Syst..

[62]  Chih-Fong Tsai,et al.  Combining multiple feature selection methods for stock prediction: Union, intersection, and multi-intersection approaches , 2010, Decis. Support Syst..

[63]  Leonidas Sandoval,et al.  To lag or not to lag? How to compare indices of stock markets that operate on different times , 2014 .

[64]  Peter Christen,et al.  Macro-level information transfer in social media: Reflections of crowd phenomena , 2016, Neurocomputing.

[65]  Michel Ballings,et al.  Evaluating multiple classifiers for stock price direction prediction , 2015, Expert Syst. Appl..

[66]  Gordon Pipa,et al.  Transfer entropy—a model-free measure of effective connectivity for the neurosciences , 2010, Journal of Computational Neuroscience.

[67]  Kai Chen,et al.  A LSTM-based method for stock returns prediction: A case study of China stock market , 2015, 2015 IEEE International Conference on Big Data (Big Data).