Effects of direct input–output connections on multilayer perceptron neural networks for time series prediction

Feedforward neural network prediction is the most commonly used method in time series prediction. In view of the low prediction accuracy of the conventional BPNN model when the time series data contain a certain linear relationship, this paper describes a neural network approach for time series prediction, that is BPNN–DIOC (back-propagation neural network with direct input-to-output connections). Eight different datasets were used to verify the validity of BPNN–DIOC model in time series prediction. In this paper, the BPNN was extended to four variants based on the presence or absence of output layer bias and input-to-output connections firstly, and the prediction accuracy of eight datasets are analyzed by statistic method secondly. Finally, the experimental results demonstrate that the BPNN–DIOC has better prediction accuracy compared to the conventional BPNN while the output layer bias has no significant effect. Therefore, the input-to-output connections can significantly improve the prediction ability of time series.

[1]  Zhe George Zhang,et al.  Forecasting stock indices with back propagation neural network , 2011, Expert Syst. Appl..

[2]  Jing Shi,et al.  On comparing three artificial neural networks for wind speed forecasting , 2010 .

[3]  Göksel Biricik,et al.  Artificial neural network and SARIMA based models for power load forecasting in Turkish electricity market , 2017, PloS one.

[4]  Dejan J. Sobajic,et al.  Learning and generalization characteristics of the random vector Functional-link net , 1994, Neurocomputing.

[5]  Roberto Besteiro,et al.  Prediction of carbon dioxide concentration in weaned piglet buildings by wavelet neural network models , 2017, Comput. Electron. Agric..

[6]  Ponnuthurai N. Suganthan,et al.  Random vector functional link network for short-term electricity load demand forecasting , 2016, Inf. Sci..

[7]  Srdjan Jovic,et al.  Analysing of exchange rate and gross domestic product (GDP) by adaptive neuro fuzzy inference system (ANFIS) , 2019, Physica A: Statistical Mechanics and its Applications.

[8]  P. N. Suganthan,et al.  A comprehensive evaluation of random vector functional link networks , 2016, Inf. Sci..

[9]  Xu Hu,et al.  Wavelet neural network with improved genetic algorithm for traffic flow time series prediction , 2016 .

[10]  Thomas E. Potok,et al.  Document clustering using particle swarm optimization , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[11]  Lipo Wang,et al.  Stock Forecasting with Feedforward Neural Networks and Gradual Data Sub-Sampling , 2010, Aust. J. Intell. Inf. Process. Syst..

[12]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[13]  Jia Jia,et al.  Financial Time Series Prediction Based on BP Neural Network , 2014 .

[14]  P. Arulmozhivarman,et al.  ANN Based Rainfall Prediction—A Tool for Developing a Landslide Early Warning System , 2017 .

[15]  Zhiping Lin,et al.  Predicting time series with wavelet packet neural networks , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[16]  Yue Hou,et al.  Chaotic Prediction for Traffic Flow of Improved BP Neural Network , 2013 .

[17]  P. McSharry,et al.  A comparison of univariate methods for forecasting electricity demand up to a day ahead , 2006 .

[18]  Zhong Shi-sheng,et al.  Time series prediction using wavelet process neural network , 2008 .

[19]  George G. Karady,et al.  Advancement in the application of neural networks for short-term load forecasting , 1992 .

[20]  B. Krishna,et al.  Monthly Rainfall Prediction Using Wavelet Neural Network Analysis , 2013, Water Resources Management.

[21]  Zhiping Lin,et al.  Wavelet Packet Multi-layer Perceptron for Chaotic Time Series Prediction: Effects of Weight Initialization , 2001, International Conference on Computational Science.

[22]  G. Chi,et al.  Future Interstate Highway System Demands: Predictions Based on Population Projections. , 2019, Case studies on transport policy.

[23]  Jolanta Szoplik,et al.  Forecasting of natural gas consumption with artificial neural networks , 2015 .

[24]  Kodjo Agbossou,et al.  Time series prediction using artificial wavelet neural network and multi-resolution analysis: Application to wind speed data , 2016 .

[25]  A. Shabri,et al.  A comparison of time series forecasting using support vector machine and artificial neural network model , 2010 .

[26]  Raymond Y. K. Lau,et al.  An ontology-based Web mining method for unemployment rate prediction , 2014, Decis. Support Syst..

[27]  Yu Fang,et al.  Improving the genetic-algorithm-optimized wavelet neural network for stock market prediction , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[28]  Abhishek Mishra,et al.  Indian stock market prediction using artificial neural networks on tick data , 2019, Financial Innovation.

[29]  Ming Zhu,et al.  Intelligent trading using support vector regression and multilayer perceptrons optimized with genetic algorithms , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[30]  Li Song,et al.  Prediction for chaotic time series of optimized BP neural network based on modified PSO , 2014, The 26th Chinese Control and Decision Conference (2014 CCDC).