Reducing error in neural network time series forecasting

Neural network time series forecasting error comprises autocorrelation error, due to an imperfect model, and random noise, inherent in the data. Both problems are addressed here, the first using a two stage training, growth-network neuron: the autocorrelation error (ACE) neuron. The second is considered as a post-processing noise filtering problem. These techniques are applied in forecasting the sunspot time series, with comparison of stochastic, BFGS and conjugate gradient solvers.

[1]  Roberto Battiti,et al.  First- and Second-Order Methods for Learning: Between Steepest Descent and Newton's Method , 1992, Neural Computation.

[2]  Apostolos Nikolaos Refenes,et al.  Currency exchange rate prediction and neural network design strategies , 1993, Neural Computing & Applications.

[3]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[4]  K. L. Doty.  Digital Spectral Analysis of Audio Signals , 1965 .

[5]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[6]  Martin Casdagli,et al.  Nonlinear Modeling And Forecasting , 1992 .

[7]  David A. H. Jacobs,et al.  The State of the Art in Numerical Analysis. , 1978 .

[8]  I. Duff,et al.  The state of the art in numerical analysis , 1997 .

[9]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[10]  C. K. Yuen,et al.  Digital spectral analysis , 1979 .

[11]  H. Tong,et al.  Threshold Autoregression, Limit Cycles and Cyclical Data , 1980 .

[12]  E. Michael Azoff,et al.  Neural Network Time Series: Forecasting of Financial Markets , 1994 .

[13]  Geoffrey E. Hinton,et al.  Learning representations by back-propagation errors, nature , 1986 .

[14]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[15]  Kishan G. Mehrotra,et al.  Forecasting the behavior of multivariate time series using neural networks , 1992, Neural Networks.

[16]  David E. Rumelhart,et al.  Predicting the Future: a Connectionist Approach , 1990, Int. J. Neural Syst..

[17]  Eitan Michael Azoff,et al.  Neural network principal components preprocessing and diffraction tomography , 1993, Neural Computing & Applications.

[18]  A. Lapedes,et al.  Nonlinear signal processing using neural networks: Prediction and system modelling , 1987 .

[19]  David F. Shanno,et al.  Conjugate Gradient Methods with Inexact Searches , 1978, Math. Oper. Res..

[20]  Mahmoud M. Gabr,et al.  THE ESTIMATION AND PREDICTION OF SUBSET BILINEAR TIME SERIES MODELS WITH APPLICATIONS , 1981 .

[21]  Marcus Frean,et al.  The Upstart Algorithm: A Method for Constructing and Training Feedforward Neural Networks , 1990, Neural Computation.

[22]  J. Nadal,et al.  Learning in feedforward layered networks: the tiling algorithm , 1989 .