Fuzzy basis functions: comparisons with other basis functions

Fuzzy basis functions (FBF's) which have the capability of combining both numerical data and linguistic information, are compared with other basis functions. Because a FBF network is different from other networks in that it is the only one that can combine numerical and linguistic information, comparisons are made when only numerical data is available. In particular, a FBF network is compared with a radial basis function (RBF) network from the viewpoint of function approximation. Their architectural interrelationships are discussed. Additionally, a RBF network, which is implemented using a regularization technique, is compared with a FBF network from the viewpoint of overcoming ill-posed problems. A FBF network is also compared with Specht's probabilistic neural network and his general regression neural network (GRNN) from an architectural point of view. A FBF network is also compared with a Gaussian sum approximation in which Gaussian functions play a central role. Finally, we summarize the architectural relationships between all the networks discussed in this paper. >

[1]  Jerry M. Mendel,et al.  Lessons in digital estimation theory , 1986 .

[2]  W. S. Meisel,et al.  Potential Functions in Mathematical Pattern Recognition , 1969, IEEE Transactions on Computers.

[3]  R. P. Lippmann.  A critical overview of neural network pattern classifiers , 1991, Neural Networks for Signal Processing Proceedings of the 1991 IEEE Workshop.

[4]  T. Cacoullos.  Estimation of a multivariate density , 1966 .

[5]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[6]  L X Wang,et al.  Fuzzy basis functions, universal approximation, and orthogonal least-squares learning , 1992, IEEE Trans. Neural Networks.

[7]  Pietro Burrascano,et al.  Learning vector quantization for the probabilistic neural network , 1991, IEEE Trans. Neural Networks.

[8]  Tomaso A. Poggio,et al.  Extensions of a Theory of Networks for Approximation and Learning , 1990, NIPS.

[9]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[10]  L. Breiman,et al.  Variable Kernel Estimates of Multivariate Densities , 1977 .

[11]  H. Sorenson,et al.  Nonlinear Bayesian estimation using Gaussian sum approximations , 1972 .

[12]  K. M. Tao,et al.  A closer look at the radial basis function (RBF) networks , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[13]  Donald F. Specht,et al.  Generation of Polynomial Discriminant Functions for Pattern Recognition , 1967, IEEE Trans. Electron. Comput..

[14]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[15]  Clovis Sperb de Barcellos,et al.  Non-homogeneous field potential problems solution by the modified local Green's function method (MLGFM) , 1993 .

[16]  C. Quesenberry,et al.  A nonparametric estimate of a multivariate density function , 1965 .

[17]  Jerry M. Mendel,et al.  Fuzzy adaptive filters, with application to nonlinear channel equalization , 1993, IEEE Trans. Fuzzy Syst..

[18]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[19]  Ronald Robert Lemke.  ON THE APPLICATION OF THE POTENTIAL FUNCTION METHOD TO PATTERN RECOGNITION AND SYSTEM IDENTIFICATION , 1968 .

[20]  Jerry M. Mendel,et al.  Back-propagation fuzzy system as nonlinear dynamic system identifiers , 1992, [1992 Proceedings] IEEE International Conference on Fuzzy Systems.

[21]  H. Sorenson,et al.  Recursive bayesian estimation using gaussian sums , 1971 .

[22]  J. D. Powell,et al.  Radial basis function approximations to polynomials , 1989 .

[23]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[24]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[25]  Uwe Hartmann,et al.  Mapping neural network derived from the parzen window estimator , 1992, Neural Networks.

[26]  Donald F. Specht,et al.  A general regression neural network , 1991, IEEE Trans. Neural Networks.

[27]  Bart Kosko,et al.  Fuzzy Systems as Universal Approximators , 1994, IEEE Trans. Computers.

[28]  C. Micchelli.  Interpolation of scattered data: Distance matrices and conditionally positive definite functions , 1986 .