Time series prediction using evolving radial basis function networks with new encoding scheme

This paper presents a new encoding scheme for training radial basis function (RBF) networks by genetic algorithms (GAs). In general, it is very difficult to select the proper input variables and the exact number of nodes before training an RBF network. In the proposed encoding scheme, both the architecture (numbers and selections of nodes and inputs) and the parameters (centres and widths) of the RBF networks are represented in one chromosome and evolved simultaneously by GAs so that the selection of nodes and inputs can be achieved automatically. The performance and effectiveness of the presented approach are evaluated using two benchmark time series prediction examples and one practical application example, and are then compared with other existing methods. It is shown by the simulation tests that the developed evolving RBF networks are able to predict the time series accurately with the automatically selected nodes and inputs.

[1]  Héctor Pomares,et al.  Time series analysis using normalized PG-RBF network with regression weights , 2002, Neurocomputing.

[2]  Chang-Hyun Kim,et al.  Evolving Compact and Interpretable Takagi–Sugeno Fuzzy Models With a New Encoding Scheme , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Ranjan Ganguli,et al.  Helicopter rotor blade frequency evolution with damage growth and signal processing , 2005 .

[4]  Sergio M. Savaresi,et al.  Identification of semi-physical and black-box non-linear models: the case of MR-dampers for vehicles control , 2005, Autom..

[5]  Horst Bischof,et al.  An efficient MDL-based construction of RBF networks , 1998, Neural Networks.

[6]  B. F. Spencer,et al.  Nonlinear blackbox modeling of MR-dampers for civil structural control , 2005, IEEE Transactions on Control Systems Technology.

[7]  Junhong Nie,et al.  Constructing fuzzy model by self-organizing counterpropagation network , 1995, IEEE Trans. Syst. Man Cybern..

[8]  James Lam,et al.  Modelling of a magneto-rheological damper by evolving radial basis function networks , 2006, Eng. Appl. Artif. Intell..

[9]  Ranjan Ganguli,et al.  Genetic fuzzy system for damage detection in beams and helicopter rotor blades , 2003 .

[10]  Kwang Bo Cho,et al.  Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction , 1996, Fuzzy Sets Syst..

[11]  S. Aiguo,et al.  Evolving Gaussian RBF network for nonlinear time series modelling and prediction , 1998 .

[12]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[13]  Lipo Wang,et al.  Data dimensionality reduction with application to simplifying RBF network structure and improving classification performance , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[14]  Shirley J. Dyke,et al.  PHENOMENOLOGICAL MODEL FOR MAGNETORHEOLOGICAL DAMPERS , 1997 .

[15]  Alaa F. Sheta,et al.  Time-series forecasting using GA-tuned radial basis functions , 2001, Inf. Sci..

[16]  Jiwen Dong,et al.  Time-series forecasting using flexible neural tree model , 2005, Inf. Sci..

[17]  Juan Julián Merelo Guervós,et al.  Evolving RBF neural networks for time-series forecasting with EvRBF , 2004, Inf. Sci..

[18]  Sheng Chen,et al.  Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks , 1999, IEEE Trans. Neural Networks.

[19]  YangQuan Chen,et al.  Fusion of soft computing and hard computing: computational structures and characteristic features , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[20]  Christian W. Dawson,et al.  A review of genetic algorithms applied to training radial basis function networks , 2004, Neural Computing & Applications.

[21]  Shie-Jue Lee,et al.  An ART-based construction of RBF networks , 2002, IEEE Trans. Neural Networks.

[22]  Ranjan Ganguli,et al.  Matrix Crack Detection in Thin-walled Composite Beam using Genetic Fuzzy System , 2005 .

[23]  Ranjan Ganguli,et al.  Filter design using radial basis function neural network and genetic algorithm for improved operational health monitoring , 2006, Appl. Soft Comput..

[24]  Ranjan Ganguli,et al.  Structural damage detection in a helicopter rotor blade using radial basis function neural networks , 2003 .

[25]  Alfonso Rodríguez-Patón,et al.  Evolutionary system for automatically constructing and adapting radial basis function networks , 2006, Neurocomputing.

[26]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[27]  Kezhi Mao,et al.  Feature subset selection for support vector machines through discriminative function pruning analysis , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  Vincent Wertz,et al.  Takagi-Sugeno fuzzy modeling incorporating input variables selection , 2002, IEEE Trans. Fuzzy Syst..

[29]  David E. Goldberg,et al.  Genetic Algorithms, Tournament Selection, and the Effects of Noise , 1995, Complex Syst..

[30]  Tom V. Mathew.  Genetic Algorithm , 2022 .

[31]  Christian W. Dawson,et al.  The effect of different basis functions on a radial basis function network for time series prediction: A comparative study , 2006, Neurocomputing.

[32]  Bernhard Sick,et al.  Evolutionary optimization of radial basis function classifiers for data mining applications , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[33]  Jiwen Dong,et al.  Time-series prediction using a local linear wavelet neural network , 2006, Neurocomputing.

[34]  Kezhi Mao,et al.  RBF neural network center selection based on Fisher ratio class separability measure , 2002, IEEE Trans. Neural Networks.

[35]  Yinghua Lin,et al.  A new approach to fuzzy-neural system modeling , 1995, IEEE Trans. Fuzzy Syst..