Recurrent Multiplicative Neuron Model Artificial Neural Network for Non-linear Time Series Forecasting

Artificial neural networks (ANN) have been widely used in recent years to model non-linear time series since ANN approach is a responsive method and does not require some assumptions such as normality or linearity. An important problem with using ANN for time series forecasting is to determine the number of neurons in hidden layer. There have been some approaches in the literature to deal with the problem of determining the number of neurons in hidden layer. A new ANN model was suggested which is called multiplicative neuron model (MNM) in the literature. MNM has only one neuron in hidden layer. Therefore, the problem of determining the number of neurons in hidden layer is automatically solved when MNM is employed. Also, MNM can produce accurate forecasts for non-linear time series. ANN models utilized for non-linear time series have generally autoregressive structures since lagged variables of time series are generally inputs of these models. On the other hand, it is a well-known fact that better forecasts for real life time series can be obtained from models whose inputs are lagged variables of error. In this study, a new recurrent multiplicative neuron neural network model is firstly proposed. In the proposed method, lagged variables of error are included in the model. Also, the problem of determining the number of neurons in hidden layer is avoided when the proposed method is used. To train the proposed neural network model, particle swarm optimization algorithm was used. To evaluate the performance of the proposed model, it was applied to a real life time series. Then, results produced by the proposed method were compared to those obtained from other methods. It was observed that the proposed method has superior performance to existing methods.

[1]  Erol Egrioglu,et al.  A new hybrid approach based on SARIMA and partial high order bivariate fuzzy time series forecasting model , 2009, Expert Syst. Appl..

[2]  Nejib Smaoui,et al.  The Box-Jenkins analysis and neural networks: prediction and time series modelling , 2003 .

[3]  Mehdi Khashei,et al.  An artificial neural network (p, d, q) model for timeseries forecasting , 2010, Expert Syst. Appl..

[4]  C. Lee Giles,et al.  How embedded memory in recurrent neural network architectures helps learning long-term temporal dependencies , 1998, Neural Networks.

[5]  Ah Chung Tsoi,et al.  Noisy Time Series Prediction using Recurrent Neural Networks and Grammatical Inference , 2001, Machine Learning.

[6]  Çagdas Hakan Aladag,et al.  A New Multiplicative Seasonal Neural Network Model Based on Particle Swarm Optimization , 2012, Neural Processing Letters.

[7]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[8]  G. J. Janacek,et al.  Practical Time Series , 2001 .

[9]  Sven F. Crone,et al.  CorrigendumCorrigendum to “Advances in forecasting with neural networks? Empirical evidence from the NN3 competition on time series prediction” [Int. J. Forecast. 27 (2011) 635–660] , 2014 .

[10]  Çagdas Hakan Aladag,et al.  A new linear & nonlinear artificial neural network model for time series forecasting , 2013, Decis. Support Syst..

[11]  Cagdas Hakan Aladag,et al.  A new architecture selection method based on tabu search for artificial neural networks , 2011, Expert Syst. Appl..

[12]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[13]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[14]  Prem Kumar Kalra,et al.  Time series prediction with single multiplicative neuron model , 2007, Appl. Soft Comput..

[15]  Nikolaos Kourentzes,et al.  Naive Support Vector Regression and Multilayer Perceptron benchmarks for the 2010 neural network grand competition (NNGC) on time series prediction , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[16]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[17]  Çagdas Hakan Aladag,et al.  A new model selection strategy in artificial neural networks , 2008, Appl. Math. Comput..

[18]  Erol Egrioglu,et al.  Improving weighted information criterion by using optimization , 2010, J. Comput. Appl. Math..

[19]  Erol Egrioglu,et al.  Advances in Time Series Forecasting , 2012 .

[20]  Ryad Zemouri,et al.  Prediction error feedback for time series prediction: a way to improve the accuracy of predictions , 2010 .

[21]  Michael I. Jordan.  Serial Order: A Parallel Distributed Processing Approach , 1997 .

[22]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[23]  Sven F. Crone,et al.  Advances in forecasting with neural networks? Empirical evidence from the NN3 competition on time series prediction , 2011 .

[24]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .