The optimization of radial basis probabilistic neural networks based on genetic algorithms

In this paper, a genetic algorithm (GA) is introduced into optimizing the radial basis probabilistic neural networks (RBPNN). The encoding method proposed in this paper involves not only the number and the locations of selected hidden centers but also the shape parameter of the Gaussian kernel function. We use the telling-two-spirals-apart problem as an example to validate the genetic algorithm for optimizing the RBPNN. Consequently, we obtain an optimal interval of the shape parameter of the kernel function for this problem except the reduced RBPNN structure (including the optimal number of the hidden centers and their optimal locations). The experimental results show that with the shape parameters in the optimal interval and with the optimized hidden centers the designed network is not only parsimonious but also of better generalization performance.

[1]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[2]  K. Lang,et al.  Learning to tell two spirals apart , 1988 .

[3]  Lawrence Davis,et al.  Training Feedforward Neural Networks Using Genetic Algorithms , 1989, IJCAI.

[4]  William A. Sethares,et al.  Nonlinear parameter estimation via the genetic algorithm , 1994, IEEE Trans. Signal Process..

[5]  Vittorio Maniezzo,et al.  Genetic evolution of the topology and weight distribution of neural networks , 1994, IEEE Trans. Neural Networks.

[6]  Peter J. Angeline,et al.  An evolutionary algorithm that constructs recurrent neural networks , 1994, IEEE Trans. Neural Networks.

[7]  Stephen A. Billings,et al.  Radial basis function network configuration using genetic algorithms , 1995, Neural Networks.

[8]  D.-S. Huang,et al.  Radial Basis Probabilistic Neural Networks: Model and Application , 1999, Int. J. Pattern Recognit. Artif. Intell..

[9]  Zhi-Hua Zhou,et al.  FANNC: A Fast Adaptive Neural Network Classifier , 2000, Knowledge and Information Systems.

[10]  Dingli Yu,et al.  Selecting radial basis function network centers with recursive orthogonal least squares training , 2000, IEEE Trans. Neural Networks Learn. Syst..

[11]  Ivica Kostanic,et al.  Principles of Neurocomputing for Science and Engineering , 2000 .

[12]  Zekeriya Uykan,et al.  Analysis of input-output clustering for determining centers of RBFN , 2000, IEEE Trans. Neural Networks Learn. Syst..