A simple neural network for ARMA(p,q) time series

This study was designed: (a) to investigate a simple neural-network solution to forecasting the special class of time series corresponding to a wide range of ARMA(p,q) structures; (b) to study the significance of matching the input window size with the nature of time series. The study adopted a simulation approach in conjunction with an experimental design. It is discovered that a simple two-layered network, with proper input window size, is able to consistently outperform the multi-layer feedforward network and that the two-layered network is comparable to the Box-Jenkins modelling approach for a majority of the ARMA(p,q) time series studied and better than the Box-Jenkins modelling approach when the ARMA structure gets more complex and generates more variability. The results affirm that it is unnecessary to use multi-layer feedforward networks for this special class of linear time series and that the two-layered network can be a useful forecasting alternative to the widely popular Box-Jenkins model.

[1]  Barbara D. Klein,et al.  Data quality in neural network models: effect of error rate and magnitude of error on predictive accuracy , 1999 .

[2]  A. Lapedes,et al.  Nonlinear signal processing using neural networks: Prediction and system modelling , 1987 .

[3]  Nowrouz Kohzadi,et al.  A comparison of artificial neural network and time series models for forecasting commodity prices , 1996, Neurocomputing.

[4]  Shouhong Wang,et al.  An insight into the standard back-propagation neural network model for regression analysis , 1998 .

[5]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[6]  Milton S. Boyd,et al.  Designing a neural network for forecasting financial and economic time series , 1996, Neurocomputing.

[7]  William Remus,et al.  Neural Network Models for Time Series Forecasts , 1996 .

[8]  Jung-Hua Wang,et al.  Stock market trend prediction using ARIMA-based neural networks , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[9]  Jae Kyu Lee,et al.  Performance of Neural Networks in Managerial Forecasting , 1993 .

[10]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[11]  Q. Lu,et al.  How Well Does A Neural Network Model ARMA Models? , 1997, ICONIP.

[12]  C. Chatfield,et al.  Neural networks: Forecasting breakthrough or passing fad? , 1993 .

[13]  Robert L. Winkler,et al.  The Forecasting accuracy of major time series methods , 1986 .

[14]  Michael Y. Hu,et al.  Neural network forecasting of the British pound/US dol-lar exchange rate , 1998 .

[15]  Martti Juhola,et al.  AR parameter estimation by a feedback neural network , 1997 .

[16]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[17]  C. Tan,et al.  Option price forecasting using neural networks , 2000 .

[18]  H. Brian Hwarng.  Modelling ARMA Time Series: the Effect of Noise , 1997, ICONIP.

[19]  Paul A. Fishwick,et al.  Time series forecasting using neural networks vs. Box- Jenkins methodology , 1991, Simul..

[20]  Krzysztof J. Cios,et al.  Time series forecasting by combining RBF networks, certainty factors, and the Box-Jenkins model , 1996, Neurocomputing.

[21]  Reinaldo Castro Souza,et al.  A bootstrap simulation study in ARMA (p, q) structures , 1996 .

[22]  James V. Hansen,et al.  Neural networks and traditional time series methods: a synergistic combination in state economic forecasts , 1997, IEEE Trans. Neural Networks.

[23]  Yufei Yuan,et al.  Neural network forecasting of quarterly accounting earnings , 1996 .

[24]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[25]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .