Evolving radial basis function neural networks using a genetic algorithm

Most research to date using genetic algorithms to evolve neural networks has focused on the multi-layer perceptron. Altemative neural network approaches such as the radial basis function network, and their representations appear to have received relatively little attention as grist for the GA mill. This is perhaps surprising since, for example, the radial basis function network has also been proved to be universal function approximator. Here we focus on evolution of radial basis function networks. While the multilayer perceptron network approximates functions through global interaction between network nodes, the radial basis function network uses local interactions between network nodes. It is suggested, that this difference may be of significance in tem of epistatic interactions in encoded genomes for the two types of network, which affects the ability of the genetic algorithm to evolve successful networks. A representation and attendant genetic operators for evolving radial basis function networks are proposed, drawing on recent work on evolutionary fuzzy logic systems. Experimental results in applying a hybrid leaming technique, using a genetic algorithm for evolving the radial basis function hidden layer (number of hidden nodes and hidden node centres and widths) and supervised leaming for tuning of network connection weights, are presented.

[1]  David S. Broomhead,et al.  Multivariable Functional Interpolation and Adaptive Networks , 1988, Complex Syst..

[2]  Thomas M. Cover,et al.  Geometrical and Statistical Properties of Systems of Linear Inequalities with Applications in Pattern Recognition , 1965, IEEE Trans. Electron. Comput..

[3]  Richard K. Belew,et al.  Evolving networks: using the genetic algorithm with connectionist learning , 1990 .

[4]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[5]  Wolfram Schiffmann,et al.  Application of Genetic Algorithms to the Construction of Topologies for Multilayer Perceptrons , 1993 .

[6]  Saleem A. Kassam,et al.  Radial basis function networks in nonlinear signal processing applications , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[7]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[8]  Frédéric Gruau,et al.  Genetic Synthesis of Modular Neural Networks , 1993, ICGA.

[9]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[10]  Brian Carse,et al.  A Fuzzy Classifier System Using the Pittsburgh Approach , 1994, PPSN.

[11]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[12]  D. Lowe,et al.  Adaptive radial basis function nonlinearities, and the problem of generalisation , 1989 .

[13]  Chuen-Tsai Sun,et al.  Functional equivalence between radial basis function networks and fuzzy inference systems , 1993, IEEE Trans. Neural Networks.

[14]  Richard Lippmann,et al.  Practical Characteristics of Neural Network and Conventional Pattern Classifiers on Artificial and Speech Problems , 1989, NIPS.

[15]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[16]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[17]  Alistair Munro,et al.  Evolving fuzzy rule based controllers using genetic algorithms , 1996, Fuzzy Sets Syst..