An efficient learning algorithm for function approximation with radial basis function networks

This paper proposes a novel learning algorithm for constructing function approximators with radial basis function (RBF) networks. In comparison with the existing learning algorithms, the proposed algorithm features lower time complexity for constructing the RBF network and is able to deliver the same level of accuracy. The time taken by the proposed algorithm to construct the RBF network is in the order of O(|S|), where S is the set of training samples. As far as the time complexity for predicting the function values of input vectors is concerned, the RBF network constructed with the proposed learning algorithm can complete the task in O(|T|), where T is the set of input vectors. Another important feature of the proposed learning algorithm is that the space complexity of the RBF network constructed is O(m|S|), where m is the dimension of the vector space in which the target function is defined.

[1]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[2]  Mark J. L. Orr Optimising the widths of radial basis functions , 1998, Proceedings 5th Brazilian Symposium on Neural Networks (Cat. No.98EX209).

[3]  Mark J. L. Orr,et al.  Regularization in the Selection of Radial Basis Function Centers , 1995, Neural Computation.

[4]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[5]  C. K. Yuen,et al.  Theory and Application of Digital Signal Processing , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[6]  James D. Keeler,et al.  Layered Neural Networks with Gaussian Hidden Units as Universal Approximations , 1990, Neural Computation.

[7]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .