Time-series analysis with neural networks and ARIMA-neural network hybrids

Time-series analysis is important to a wide range of disciplines transcending both the physical and social sciences. Statistical models have sound theoretical bases and have been successfully used in a number of problem domains. More recently, machine-learning models such as neural networks have been suggested as offering potential for time-series analysis. Results of neural network empirical testing have thus far been mixed. This paper proposes melding useful parameters from the statistical ARIMA model with neural networks of two types: multilevel perceptrons (MLPs) and radial basis functions (RBFs). Tests are run on a range of time-series problems that exhibit many common patterns encountered by analysts. The results suggest that hybrids of the type proposed may yield better outcomes than either model by itself.

[1]  James V. Hansen,et al.  Neural networks and traditional time series methods: a synergistic combination in state economic forecasts , 1997, IEEE Trans. Neural Networks.

[2]  Bruce A. Whitehead,et al.  Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction , 1996, IEEE Trans. Neural Networks.

[3]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[4]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[5]  Jose C. Principe,et al.  Neural and adaptive systems , 2000 .

[6]  H. Akaike.  A new look at the statistical model identification , 1974 .

[7]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[8]  Pawan Lingras,et al.  Time Delay Neural Networks Designed Using Genetic Algorithms for Short Term Inter-City Traffic Forecasting , 2001, IEA/AIE.

[9]  Marios M. Polycarpou,et al.  High-order neural network structures for identification of dynamical systems , 1995, IEEE Trans. Neural Networks.

[10]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[11]  Timothy Masters,et al.  Advanced algorithms for neural networks: a C++ sourcebook , 1995 .

[12]  William Remus,et al.  Neural Network Models for Time Series Forecasts , 1996 .

[13]  J. McDonald,et al.  Some forecasting applications of partially adaptive estimators of ARIMA models , 1994 .

[14]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[15]  Spyros Makridakis,et al.  The M3-Competition: results, conclusions and implications , 2000 .

[16]  Fred Collopy,et al.  Expert Systems for Forecasting , 2001 .

[17]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .