A new sequential learning algorithm using pseudo-Gaussian functions for neuro-fuzzy systems

This paper proposes a framework for constructing and training a radial basis function (RBF) neural network, which is an example of fuzzy system. For this purpose, a sequential learning algorithm is presented to adapt the structure of the network, in which it is possible to create a new hidden unit (rule) and also to detect and remove inactive units. The structure of the gaussian functions (membership functions) is modified using a pseudo-Gaussian function (PG) in which two sealing parameters /spl sigma/ are introduced, which eliminates the symmetry restriction and provides the neurons in the hidden layer with greater flexibility with respect to function approximation. Other important characteristics of the proposed neural system is that instead of using a single parameter for the output weights, these are functions of the input variables which leads to a significant reduction in the number of hidden units compared with the classical RBF network Finally, we examine the result of applying the proposed algorithm to time series prediction.

[1]  Steven J. Nowlan,et al.  Maximum Likelihood Competitive Learning , 1989, NIPS.

[2]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[3]  Rosalind W. Picard,et al.  On the efficiency of the orthogonal least squares training method for radial basis function networks , 1996, IEEE Trans. Neural Networks.

[4]  Kwang Bo Cho,et al.  Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction , 1996, Fuzzy Sets Syst..

[5]  John C. Platt.  A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[6]  Héctor Pomares,et al.  What are the main factors involved in the design of a Radial Basis Function Network? , 1998, ESANN.

[7]  Nicolaos B. Karayiannis,et al.  Growing radial basis neural networks: merging supervised and unsupervised learning with network growth techniques , 1997, IEEE Trans. Neural Networks.

[8]  Paramasivan Saratchandran,et al.  Performance evaluation of a sequential minimal radial basis function (RBF) neural network learning algorithm , 1998, IEEE Trans. Neural Networks.

[9]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[10]  Shoji Suzuki,et al.  Short-Term Prediction of Chaotic Time Series by Local Fuzzy Reconstruction Method , 1997, J. Intell. Fuzzy Syst..

[11]  Bruce A. Whitehead,et al.  Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction , 1996, IEEE Trans. Neural Networks.

[12]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[13]  Seok Hee Lee,et al.  Time Series Analysis Using Fuzzy Learning , 1994 .

[14]  Sukhan Lee,et al.  A Gaussian potential function network with hierarchically self-organizing learning , 1991, Neural Networks.

[15]  Mohamad T. Musavi,et al.  On the training of radial basis function classifiers , 1992, Neural Networks.

[16]  Michel Benaïm,et al.  On Functional Approximation with Normalized Gaussian Units , 1994, Neural Comput..

[17]  Fouad Badran,et al.  Probabilistic self-organizing map and radial basis function networks , 1998, Neurocomputing.

[18]  Chulhyun Kim,et al.  Forecasting time series with genetic fuzzy predictor ensemble , 1997, IEEE Trans. Fuzzy Syst..