Kernel-Based Fuzzy C-Means Clustering Algorithm for RBF Network Initialization

Designing an effective structure of the RBF network is the task carried-out at the network initialization phase. Usual approach to deal with the problem is to decide on the number of hidden units and to apply a clustering algorithm to calculate cluster centroids. Clustering techniques have a strong influence on the performance of the RBF networks. The paper focuses on the radial basis function neural network initialization problem and the implementation of the kernel-based fuzzy C-means clustering algorithm, as an alternative method for the RBF networks initialization. Performance of the RBFNs initialized using the kernel-based fuzzy clustering algorithm is compared with several other clustering techniques, including k-means, fuzzy C-means and X-means.

[1]  John C. Platt.  A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[2]  Witold Pedrycz,et al.  Kernel-based fuzzy clustering and fuzzy clustering: A comparative experimental study , 2010, Fuzzy Sets Syst..

[3]  Piotr Jedrzejowicz,et al.  AGENT-BASED APPROACH TO THE DESIGN OF RBF NETWORKS , 2013, Cybern. Syst..

[4]  Surjya K. Pal,et al.  Genetically evolved radial basis function network based prediction of drill flank wear , 2010, Eng. Appl. Artif. Intell..

[5]  Boqin Feng,et al.  Training RBF Neural Network with Hybrid Particle Swarm Optimization , 2006, ISNN.

[6]  Enrique H. Ruspini,et al.  Numerical methods for fuzzy clustering , 1970, Inf. Sci..

[7]  George E. Tsekouras,et al.  A novel training algorithm for RBF neural network using a hybrid fuzzy clustering approach , 2012, Fuzzy Sets Syst..

[8]  Nidhi Grover.  A study of various Fuzzy Clustering Algorithms , 2014 .

[9]  Kah Phooi Seng,et al.  Radial Basis Function Neural Network With Incremental Learning for Face Recognition , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Narasimhan Sundararajan,et al.  A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation , 2005, IEEE Transactions on Neural Networks.

[11]  Shiwei Tang,et al.  Modified FCM clustering based on kernel mapping , 2001, International Symposium on Multispectral Image Processing and Pattern Recognition.

[12]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  Combining RBF Networks Trained by Different Clustering Techniques , 2001, Neural Processing Letters.

[13]  Antonio Bellacicco,et al.  Handbook of statistics 2: Classification, pattern recognition and reduction of dimensionality: P.R. KRISHNAIAH and L.N. KANAL (Eds.) North-Holland, Amsterdam, 1982, xxii + 903 pages, Dfl.275.00 , 1984 .

[14]  Marimuthu Palaniswami,et al.  Cluster validity for kernel fuzzy clustering , 2012, 2012 IEEE International Conference on Fuzzy Systems.

[15]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[16]  Ke-Lin Du,et al.  Clustering: A neural network approach , 2010, Neural Networks.

[17]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[18]  M. Y. Mashor.  Hybrid training algorithm for RBF Network , 2000 .

[19]  Yu Gong,et al.  A Fast Adaptive Tunable RBF Network For Nonstationary Systems , 2016, IEEE Transactions on Cybernetics.

[20]  Sheng Chen,et al.  Recursive hybrid algorithm for non-linear system identification using radial basis function networks , 1992 .

[21]  David S. Broomhead,et al.  Multivariable Functional Interpolation and Adaptive Networks , 1988, Complex Syst..

[22]  Andrew W. Moore,et al.  X-means: Extending K-means with Efficient Estimation of the Number of Clusters , 2000, ICML.

[23]  John Q. Gan,et al.  Mercer Kernel, Fuzzy C-Means Algorithm, and Prototypes of Clusters , 2004, IDEAL.

[24]  Blaise Cronin.  Book Reviews : Eugene GARFIELD, Essays of an information scien tist. Vol.3, 1977-1978 (ISI Press, Philadelphia, 1980), 892 pp., $ 15 , 1980 .

[25]  V. David,et al.  Searching for a solution to the automatic RBF network design problem , 2002 .