An approach to handle concept drift in financial time series based on Extreme Learning Machines and explicit Drift Detection

Financial markets are very important to the economical and social organization of modern society. Due to they importance, several researchers have investigated how to predict future market movements by using both statistical and soft computing methods based on historical time series data. However, as a typical data stream, financial time series frequently present concept drift, which is a change in the relationship between input data and the target variable over time. The concept drift phenomenon affects negatively the forecasting accuracy since the learned model becomes outdated after a change in the current concept. In this paper we investigate how to handle concept drift in financial time series prediction in order to improve the forecasting accuracy. Two explicit drift detector mechanisms, namely the Drift Detection Mechanism (DDM) and the Exponentially Weighted Moving Average for Concept Drift Detection Mechanism (ECDD), were investigated. The main contribution of this work is an approach that combines Online Sequential Extreme Learning Machines (OS-ELM) with explicit drift detection, in which the OS-ELM updates the decision model just in the presence of concept drift in data. Experimental results showed that the use of drift detection was able to speed up the prediction time of OS-ELM maintaining equivalent accuracy.

[1]  Yong Hu,et al.  Stock trading rule discovery with an evolutionary trend following model , 2015, Expert Syst. Appl..

[2]  Tony Jan,et al.  Machine Learning Techniques and Use of Event Information for Stock Market Prediction: A Survey and Evaluation , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[3]  Zhe George Zhang,et al.  Forecasting stock indices with back propagation neural network , 2011, Expert Syst. Appl..

[4]  Tarun Chordia,et al.  High-Frequency Trading , 2013 .

[5]  Chih-Chou Chiu,et al.  Financial time series forecasting using independent component analysis and support vector regression , 2009, Decis. Support Syst..

[6]  João Gama,et al.  A survey on concept drift adaptation , 2014, ACM Comput. Surv..

[7]  Roberto Souto Maior de Barros,et al.  A comparative study on concept drift detectors , 2014, Expert Syst. Appl..

[8]  João Gama,et al.  A survey on learning from data streams: current and future trends , 2012, Progress in Artificial Intelligence.

[9]  Gisele L. Pappa,et al.  From an artificial neural network to a stock market day-trading system: A case study on the BM&F BOVESPA , 2009, 2009 International Joint Conference on Neural Networks.

[10]  Ying Tan,et al.  Recentness biased learning for time series forecasting , 2013, Inf. Sci..

[11]  Gerwin A. W. Griffioen Technical Analysis in Financial Markets , 2003 .

[12]  Jerzy Stefanowski,et al.  Combining block-based and online methods in learning ensembles from concept drifting data streams , 2014, Inf. Sci..

[13]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[14]  Dimitris K. Tasoulis,et al.  Exponentially weighted moving average charts for detecting concept drift , 2012, Pattern Recognit. Lett..

[15]  Adriano Lorena Inácio de Oliveira,et al.  A method for automatic stock trading combining technical analysis and nearest neighbor classification , 2010, Expert Syst. Appl..

[16]  Richard A. Davis,et al.  Time Series: Theory and Methods (2Nd Edn) , 1993 .

[17]  Roberto Souto Maior de Barros,et al.  RCD: A recurring concept drift framework , 2013, Pattern Recognit. Lett..

[18]  P. Cowpertwait,et al.  Introductory Time Series with R , 2009 .

[19]  Chee Kheong Siew,et al.  Real-time learning capability of neural networks , 2006, IEEE Trans. Neural Networks.

[20]  Rui Araújo,et al.  An on-line weighted ensemble of regressor models to handle concept drifts , 2015, Eng. Appl. Artif. Intell..

[21]  T. Yu,et al.  Performance analysis of Indian stock market index using neural network time series model , 2013, 2013 International Conference on Pattern Recognition, Informatics and Mobile Engineering.

[22]  Richard Weber,et al.  A model updating strategy for predicting time series with seasonal patterns , 2010, Appl. Soft Comput..

[23]  João Gama,et al.  Learning with Drift Detection , 2004, SBIA.

[24]  Monica Lam,et al.  Neural network techniques for financial performance prediction: integrating fundamental and technical analysis , 2004, Decis. Support Syst..

[25]  Dong Sun Park,et al.  Online sequential extreme learning machine with forgetting mechanism , 2012, Neurocomputing.

[26]  Juan M. Corchado,et al.  Applying lazy learning algorithms to tackle concept drift in spam filtering , 2007, Expert Syst. Appl..

[27]  Mykola Pechenizkiy,et al.  Dynamic integration of classifiers for handling concept drift , 2008, Inf. Fusion.

[28]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[29]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .