论文信息 - Improved Clustering and Anisotropic Gradient Descent Algorithm for Compact RBF Network

Improved Clustering and Anisotropic Gradient Descent Algorithm for Compact RBF Network

In the formulation of radial basis function (RBF) network, there are three factors mainly considered, i.e., centers, widths, and weights, which significantly affect the performance of the network. Within thus three factors, the placement of centers is proved theoretically and practically to be critical. In order to obtain a compact network, this paper presents an improved clustering (IC) scheme to obtain the location of the centers. What is more, since the location of the corresponding widths does affect the performance of the networks, a learning algorithms referred to as anisotropic gradient descent (AGD) method for designing the widths is presented as well. In the context of this paper, the conventional gradient descent method for learning the weights of the networks is combined with that of the widths to form an array of couple recursive equations. The implementation of the proposed algorithm shows that it is as efficient and practical as GGAP-RBF.

Shengli Xie | Zhiheng Zhou | Delu Zeng

[1] Narasimhan Sundararajan,et al. A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation , 2005, IEEE Transactions on Neural Networks.

[2] Marimuthu Palaniswami,et al. Effects of moving the center's in an RBF network , 2002, IEEE Trans. Neural Networks.

[3] Sheng Chen,et al. Regularized orthogonal least squares algorithm for constructing radial basis function networks , 1996 .

[4] D. Broomhead,et al. Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[5] Shang-Liang Chen,et al. Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[6] Mark J. L. Orr,et al. Regularization in the Selection of Radial Basis Function Centers , 1995, Neural Computation.

[7] Marimuthu Palaniswami,et al. Effects of moving the centers in an RBF network , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).