A Robust Approach for Multivariate Time Series Forecasting

Time series forecasting is often confronted with multivariate data, but few model is available in this situation. Besides, data distortion aggravates the difficulty to predict multivariate time series. To tackle such problems, we propose an approach based on convolutional neural network with a feature extraction layer added before convolution layer to extract multivariate features and handle multivariate time series data, as well as decreases the effect of distortion by transforming the sample into a denser representation with both its information and the information of its temporal neighbors. A full connection layer then fuses these extracted features and gets the final result. Given that events in the world are always related, using both the target time series and other related time series to forecast the future changes of the target dimension would achieve a better prediction. The proposed approach can process multivariate time series data and is robust to the number of samples, numeric ranges of data etc. Extensive experiments validate the effectiveness of the approach in accomplishing multivariate time series forecasting.

[1]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[2]  Paresh Kumar Narayan,et al.  Stock return forecasting: Some new evidence , 2015 .

[3]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[4]  Xin Jin,et al.  Wavelet-based feature extraction using probabilistic finite state automata for pattern classification , 2011, Pattern Recognit..

[5]  Shun-ichi Amari,et al.  Backpropagation and stochastic gradient descent method , 1993, Neurocomputing.

[6]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[7]  Frank M Sanfilippo,et al.  Predicting the number of emergency department presentations in Western Australia: A population‐based time series analysis , 2015, Emergency medicine Australasia : EMA.

[8]  Ji-Rong Wen,et al.  Learning abstract snippet detectors with Temporal embedding in convolutional neural Networks , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[9]  Gerald Penn,et al.  Convolutional Neural Networks for Speech Recognition , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[10]  Jiajun Liu,et al.  Understanding Human Mobility from Twitter , 2014, PloS one.

[11]  Lee D. Han,et al.  Online-SVR for short-term traffic flow prediction under typical and atypical traffic conditions , 2009, Expert Syst. Appl..

[12]  A. Ng Feature selection, L1 vs. L2 regularization, and rotational invariance , 2004, Twenty-first international conference on Machine learning - ICML '04.

[13]  Ram Akella,et al.  Dynamically Modeling Patient's Health State from Electronic Medical Records: A Time Series Approach , 2015, KDD.

[14]  Huan Liu Feature Selection , 2010, Encyclopedia of Machine Learning.

[15]  George C. Runger,et al.  A time series forest for classification and feature extraction , 2013, Inf. Sci..

[16]  Erich Elsen,et al.  Deep Speech: Scaling up end-to-end speech recognition , 2014, ArXiv.

[17]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[18]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.