Radial Basis Function Nets for Time Series Prediction

This paper introduces a novel ensemble learning approach based on recurrent radial basis function networks (RRBFN) for time series prediction with the aim of increasing the prediction accuracy. Standing for the base learner in this ensemble, the adaptive recurrent network proposed is based on the nonlinear autoregressive with exogenous input model (NARX) and works according to a multi-step (MS) prediction regime. The ensemble learning technique combines various MSNARX-based RRBFNs which differ in the set of controlling parameters. The evaluation of the approach includes a discussion on the performance of the individual predictors and their combination

[1]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[2]  Günther Palm,et al.  Decision templates for the classification of bioacoustic time series , 2003, Inf. Fusion.

[3]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[4]  Peter Tiño,et al.  Learning long-term dependencies in NARX recurrent neural networks , 1996, IEEE Trans. Neural Networks.

[5]  Dulakshi S. K. Karunasinghe,et al.  Chaotic time series prediction with a global model: Artificial neural network , 2006 .

[6]  Dale Schuurmans,et al.  Automatic basis selection techniques for RBF networks , 2003, Neural Networks.

[7]  Héctor Pomares,et al.  Hybridization of intelligent techniques and ARIMA models for time series prediction , 2008, Fuzzy Sets Syst..

[8]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[9]  Michele Marchesi,et al.  A hybrid genetic-neural architecture for stock indexes forecasting , 2005, Inf. Sci..

[10]  Hubert Cardot,et al.  A new boosting algorithm for improved time-series forecasting with recurrent neural networks , 2008, Inf. Fusion.

[11]  Abdelhamid Bouchachia,et al.  Learning with partly labeled data , 2007, Neural Computing and Applications.

[12]  Stefan C. Kremer,et al.  Spatiotemporal Connectionist Networks: A Taxonomy and Review , 2001, Neural Computation.

[13]  Guilherme De A. Barreto,et al.  A New Look at Nonlinear Time Series Prediction with NARX Recurrent Neural Network , 2006, 2006 Ninth Brazilian Symposium on Neural Networks (SBRN'06).

[14]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[15]  Christian W. Dawson,et al.  The effect of different basis functions on a radial basis function network for time series prediction: A comparative study , 2006, Neurocomputing.

[16]  Krzysztof J. Cios,et al.  Time series forecasting by combining RBF networks, certainty factors, and the Box-Jenkins model , 1996, Neurocomputing.

[17]  Giovanni Soda,et al.  Local Feedback Multilayered Networks , 1992, Neural Computation.

[18]  James C. Bezdek,et al.  Decision templates for multiple classifier fusion: an experimental comparison , 2001, Pattern Recognit..

[19]  Maciej Ogorzalek,et al.  Time series prediction with ensemble models applied to the CATS benchmark , 2007, Neurocomputing.

[20]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[21]  Hiok Chai Quek,et al.  RLDDE: A novel reinforcement learning-based dimension and delay estimator for neural networks in time series prediction , 2007, Neurocomputing.

[22]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[23]  Chee Peng Lim,et al.  Predicting drug dissolution profiles with an ensemble of boosted neural networks: a time series approach , 2003, IEEE Trans. Neural Networks.

[24]  Aluizio F. R. Araújo,et al.  Context in temporal sequence processing: a self-organizing approach and its application to robotics , 2002, IEEE Trans. Neural Networks.