Time Series Prediction With Genetic‐Algorithm Designed Neural Networks: An Empirical Comparison With Modern Statistical Models

Neural networks whose architecture is determined by genetic algorithms outperform autoregressive integrated moving average forecasting models in six different time series examples. Refinements to the autoregressive integrated moving average model improve forecasting performance over standard ordinary least squares estimation by 8% to 13%. In contrast, neural networks achieve dramatic improvements of 10% to 40%. Additionally, neural networks give evidence of detecting patterns in data which remain hidden to the autoregression and moving average models. The consequent forecasting potential of neural networks makes them a very promising addition to the variety of techniques and methodologies used to anticipate future movements in time series.

[1]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[2]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[3]  Robert L. Winkler,et al.  The accuracy of extrapolation (time series) methods: Results of a forecasting competition , 1982 .

[4]  James B. McDonald,et al.  Partially Adaptive Estimation of Regression Models via the Generalized T Distribution , 1988, Econometric Theory.

[5]  Using genetic recombination to optimize neural networks , 1989, International 1989 Joint Conference on Neural Networks.

[6]  Halbert White,et al.  Learning in Artificial Neural Networks: A Statistical Perspective , 1989, Neural Computation.

[7]  Tariq Samad,et al.  Towards the Genetic Synthesisof Neural Networks , 1989, ICGA.

[8]  Tariq Samad,et al.  Designing Application-Specific Neural Networks Using the Genetic Algorithm , 1989, NIPS.

[9]  Alexander H. Waibel,et al.  Modular Construction of Time-Delay Neural Networks for Speech Recognition , 1989, Neural Computation.

[10]  Peter M. Todd,et al.  Designing Neural Networks using Genetic Algorithms , 1989, ICGA.

[11]  David E. Rumelhart,et al.  Generalization by Weight-Elimination with Application to Forecasting , 1990, NIPS.

[12]  David J. Chalmers,et al.  The Evolution of Learning: An Experiment in Genetic Connectionism , 1991 .

[13]  B. L. Kalman,et al.  Why tanh: choosing a sigmoidal function , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[14]  D. Hammerstrom,et al.  Neural networks at work , 1993, IEEE Spectrum.

[15]  P. Newbold,et al.  Introductory Business & Economic Forecasting , 1993 .

[16]  Marcus O'Connor,et al.  Artificial neural network models for forecasting and decision making , 1994 .

[17]  Paul Newbold,et al.  Adventures with ARIMA software , 1994 .

[18]  J. McDonald,et al.  Some forecasting applications of partially adaptive estimators of ARIMA models , 1994 .

[19]  Monica Adya,et al.  Does AI Research Aid Prediction? A Review and Evaluation , 1995, ICIS.

[20]  Timothy Masters,et al.  Advanced algorithms for neural networks: a C++ sourcebook , 1995 .

[21]  M.H. Hassoun,et al.  Fundamentals of Artificial Neural Networks , 1996, Proceedings of the IEEE.