Compound Autoregressive Network for Prediction of Multivariate Time Series

The prediction information has effects on the emergency prevention and advanced control in various complex systems. There are obvious nonlinear, nonstationary, and complicated characteristics in the time series. Moreover, multiple variables in the time-series impact on each other to make the prediction more difficult. Then, a solution of time-series prediction for the multivariate was explored in this paper. Firstly, a compound neural network framework was designed with the primary and auxiliary networks. The framework attempted to extract the change features of the time series as well as the interactive relation of multiple related variables. Secondly, the structures of the primary and auxiliary networks were studied based on the nonlinear autoregressive model. The learning method was also introduced to obtain the available models. Thirdly, the prediction algorithm was concluded for the time series with multiple variables. Finally, the experiments on environment-monitoring data were conducted to verify the methods. The results prove that the proposed method can obtain the accurate prediction value in the short term.

[1]  Roman Matkovskyy,et al.  Application of Neural Networks to Short Time Series Composite Indexes: Evidence from the Nonlinear Autoregressive with Exogenous Inputs (NARX) Model , 2019 .

[2]  W. Zhuang,et al.  Estimating and Predicting Metal Concentration Using Online Turbidity Values and Water Quality Models in Two Rivers of the Taihu Basin, Eastern China , 2016, PloS one.

[3]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[4]  Mehdi Khashei,et al.  A least squares-based parallel hybridization of statistical and intelligent models for time series forecasting , 2018, Comput. Ind. Eng..

[5]  Zhisong Pan,et al.  时间序列预测方法综述 (Review of Time Series Prediction Methods) , 2019, 计算机科学.

[6]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[7]  Jianbin Qiu,et al.  A Combined Adaptive Neural Network and Nonlinear Model Predictive Control for Multirate Networked Industrial Process Control , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Jürgen Schmidhuber,et al.  Bidirectional LSTM Networks for Improved Phoneme Classification and Recognition , 2005, ICANN.

[9]  Jianbin Qiu,et al.  Adaptive Neural Control of Stochastic Nonlinear Time-Delay Systems With Multiple Constraints , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  C. Borrego,et al.  A Gaussian puff model with optimal interpolation for air pollution modelling assessment , 2008 .

[11]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[12]  Tao Chen,et al.  Back propagation neural network with adaptive differential evolution algorithm for time series forecasting , 2015, Expert Syst. Appl..

[13]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[14]  Vadlamani Ravi,et al.  Forecasting financial time series volatility using Particle Swarm Optimization trained Quantile Regression Neural Network , 2017, Appl. Soft Comput..

[15]  Rami J. Haddad,et al.  Nonlinear auto-regressive neural network model for forecasting Hi-Def H.265 video traffic over Ethernet Passive Optical Networks , 2017, SoutheastCon 2017.

[16]  Zahra Hajirahimi,et al.  A comparative study of series arima/mlp hybrid models for stock price forecasting , 2019, Commun. Stat. Simul. Comput..

[17]  Limin Jia,et al.  Real-time road traffic state prediction based on ARIMA and Kalman filter , 2017, Frontiers of Information Technology & Electronic Engineering.

[18]  Baihua Xiao,et al.  Short-term cloud coverage prediction using the ARIMA time series model , 2018 .

[19]  Jürgen Schmidhuber,et al.  Multi-dimensional Recurrent Neural Networks , 2007, ICANN.

[20]  Anifat Olawoyin Time series prediction using Artificial Neural Network , 2018 .

[21]  Paul Rodríguez,et al.  A Recurrent Neural Network that Learns to Count , 1999, Connect. Sci..

[22]  Kin Keung Lai,et al.  An improved grey neural network model for predicting transportation disruptions , 2016, Expert Syst. Appl..