A new clustering and training method for radial basis function networks

In view of the drawbacks of traditional learning algorithms for the radial basis function networks (RBFN), including improper selection of RBF centers, oversize problem of the network in the clustering stage and ill-condition in the training stage, a new clustering and training algorithm is proposed based on constructing an augmented vector consisting of both input and output, combined with the singular value decomposition (SVD) for selecting the significant basis function centers and for training the RBFN using an SVD-based recursive least squares (RLS) method so as to avoid the ill-conditioned problem. The new algorithm is superior to the RLS in convergence rate and mean square errors of training. The effectiveness and superiority of the proposed method are demonstrated via simulation examples.

[1]  Gene H. Golub,et al.  Matrix computations , 1983 .

[2]  A New Recursive Identification Method Based On Singular Value Decomposition , 1995 .

[3]  Youmin Zhang,et al.  A SVD-based extended Kalman filter and applications to aircraft flight state and parameter estimation , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[4]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[5]  Zhang Youmi A SVD-Based Extended Kalman Filter and Application to Flight State and Parameter Estimation of Aircraft , 1996 .

[6]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[7]  P. Kumar,et al.  Theory and practice of recursive identification , 1985, IEEE Transactions on Automatic Control.

[8]  Martin Pottman,et al.  Identification of non-linear processes using reciprocal multiquadric functions , 1992 .

[9]  Yung C. Shin,et al.  Radial basis function neural network for approximation and estimation of nonlinear stochastic dynamic systems , 1994, IEEE Trans. Neural Networks.

[10]  Heikki N. Koivo,et al.  Application of artificial neural networks in process fault diagnosis , 1991, Autom..

[11]  Dimitry M. Gorinevsky,et al.  On the persistency of excitation in radial basis function network identification of nonlinear systems , 1995, IEEE Trans. Neural Networks.

[12]  Philip D. Wasserman,et al.  Advanced methods in neural computing , 1993, VNR computer library.