An Immunological Approach to Initialize Centers of Radial Basis Function Neural Networks

The appropriate operation of a radial basis function (RBF) neural network depends mainly upon an adequate choice of the number and positions of its basis function centers. The simplest approach to train an RBF network is to assume fixed radial basis functions defining the activation of the hidden units, followed by the application of a regression procedure to determine the linear output weights. The main drawback of this strategy is the lack of an efficient algorithm to determine the amount and positions of the RBF centers. In this paper, an immunological approach makes use of the training data in order to initialize the radial basis functions. The approach to be proposed is inspired by the vertebrate immune system, and tries to compress the information contained in the data set while positioning the prototype vectors into representative regions of the input space. The algorithm is compared to random and k-means center selection, and results are reported concerning regression and classification problems.

[1]  Alan S. Perelson,et al.  Self-nonself discrimination in a computer , 1994, Proceedings of 1994 IEEE Computer Society Symposium on Research in Security and Privacy.

[2]  J. Nazuno Haykin, Simon. Neural networks: A comprehensive foundation, Prentice Hall, Inc. Segunda Edición, 1999 , 2000 .

[3]  Jerne Nk Towards a network theory of the immune system. , 1974 .

[4]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[5]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[6]  C. Micchelli Interpolation of scattered data: Distance matrices and conditionally positive definite functions , 1986 .

[7]  Leandro Nunes de Castro,et al.  The Clonal Selection Algorithm with Engineering Applications 1 , 2000 .

[8]  David S. Broomhead,et al.  Multivariable Functional Interpolation and Adaptive Networks , 1988, Complex Syst..

[9]  Nicolaos B. Karayiannis,et al.  Growing radial basis neural networks: merging supervised and unsupervised learning with network growth techniques , 1997, IEEE Trans. Neural Networks.

[10]  R.P. Lippmann,et al.  Pattern classification using neural networks , 1989, IEEE Communications Magazine.

[11]  M. J. D. Powell,et al.  Radial basis functions for multivariable interpolation: a review , 1987 .

[12]  Leandro Nunes de Castro,et al.  Artificial Immune Systems: Part I-Basic Theory and Applications , 1999 .

[13]  C. Janeway Immunobiology: The Immune System in Health and Disease , 1996 .

[14]  Prabhat Hajela,et al.  Immune network modelling in design optimization , 1999 .

[15]  Jeffrey O. Kephart,et al.  A biologically inspired immune system for computers , 1994 .

[16]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[17]  Yoshiki Uchikawa,et al.  A robot with a decentralized consensus-making mechanism based on the immune system , 1997, Proceedings of the Third International Symposium on Autonomous Decentralized Systems. ISADS 97.

[18]  Dipankar Dasgupta,et al.  Artificial immune systems in industrial applications , 1999, Proceedings of the Second International Conference on Intelligent Processing and Manufacturing of Materials. IPMM'99 (Cat. No.99EX296).

[19]  F. von Zuben,et al.  An evolutionary immune network for data clustering , 2000, Proceedings. Vol.1. Sixth Brazilian Symposium on Neural Networks.