Learning Uncertainty in Market Trend Forecast Using Bayesian Neural Networks

Forecasting financial market trends is challenging. Predicting financial market trends always involves uncertainty because the economy is a complex system with a wide variety of interactions. Thus, to consider uncertainty, trends must be estimated stochastically. Conventional machine learning and deep learning methods cannot learn prediction uncertainty, and predicted “probabilities” calculated using such methods are unreliable. Bayesian neural networks (BNN) have been studied relative to their ability to consider uncertainty. A BNN enables Bayesian inference by considering a prior distribution of parameters in a neural network (NN). We have proposed a Bayesian convolutional neural network (CNN) method to predict short-term stock price trends using stock order data. We used a CNN to learn the series features of the stock order data and a dropout technique is employed to enable Bayesian inference. The proposed Bayesian CNN model trained prediction uncertainty properly, and the predicted probability calculated by the proposed model is more likely to predict the actual market movement than the conventional CNN and logistic regression models. It is expected that using Bayesian CNN will provide more reliable market trend forecasts.

[1]  Nate Silver,et al.  The signal and the noise : why so many predictions fail but some don't , 2012 .

[2]  Julien Cornebise,et al.  Weight Uncertainty in Neural Networks , 2015, ArXiv.

[3]  David Barber,et al.  Bayesian Classification With Gaussian Processes , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Neil R. Ericsson Forecast Uncertainty in Economic Modeling , 2001 .

[5]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[6]  Rayner Alfred,et al.  A review of stock market prediction with Artificial neural network (ANN) , 2013, 2013 IEEE International Conference on Control System, Computing and Engineering.

[7]  Tim Oates,et al.  Time series classification from scratch with deep neural networks: A strong baseline , 2016, 2017 International Joint Conference on Neural Networks (IJCNN).

[8]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[9]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[10]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[11]  Ying Wah Teh,et al.  Text mining for market prediction: A systematic review , 2014, Expert Syst. Appl..

[12]  Alex Kendall,et al.  What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? , 2017, NIPS.

[13]  Xiaoli Li,et al.  Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition , 2015, IJCAI.