Conditional fuzzy clustering in the design of radial basis function neural networks

This paper is concerned with the use of radial basis function (RBF) neural networks aimed at an approximation of nonlinear mappings from R(n) to R. The study is devoted to the design of these networks, especially their layer composed of RBF's, using the techniques of fuzzy clustering. Proposed is an idea of conditional clustering whose main objective is to develop clusters (receptive fields) preserving homogeneity of the clustered patterns with regard to their similarity in the input space as well as their respective values assumed in the output space. The detailed clustering algorithm is accompanied by extensive simulation studies.

[1]  Chuen-Tsai Sun,et al.  Functional equivalence between radial basis function networks and fuzzy inference systems , 1993, IEEE Trans. Neural Networks.

[2]  Yung C. Shin,et al.  Radial basis function neural network for approximation and estimation of nonlinear stochastic dynamic systems , 1994, IEEE Trans. Neural Networks.

[3]  Mohamad T. Musavi,et al.  Adaptive detection of small sinusoidal signals in non-Gaussian noise using an RBF neural network , 1995, IEEE Trans. Neural Networks.

[4]  James D. Keeler,et al.  Layered Neural Networks with Gaussian Hidden Units as Universal Approximations , 1990, Neural Computation.

[5]  Lyle H. Ungar,et al.  Using radial basis functions to approximate a function and its error bounds , 1992, IEEE Trans. Neural Networks.

[6]  Witold Pedrycz,et al.  D-fuzzy clustering , 1995, Pattern Recognit. Lett..

[7]  E. D. Avedyan,et al.  Synthesis of multilayer neural networks architecture (for the case of cascaded NNs) , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[8]  J. Nadal,et al.  Learning in feedforward layered networks: the tiling algorithm , 1989 .

[9]  Michael T. Manry,et al.  Conventional modeling of the multilayer perceptron using polynomial basis functions , 1993, IEEE Trans. Neural Networks.

[10]  Witold Pedrycz,et al.  Conditional Fuzzy C-Means , 1996, Pattern Recognit. Lett..

[11]  Bruce A. Whitehead,et al.  Evolving space-filling curves to distribute radial basis functions over an input space , 1994, IEEE Trans. Neural Networks.

[12]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[13]  W. T. Tucker,et al.  Convergence theory for fuzzy c-means: Counterexamples and repairs , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[14]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[15]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[16]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[17]  Paolo Frasconi,et al.  Learning without local minima in radial basis function networks , 1995, IEEE Trans. Neural Networks.