A simple and effective algorithm for implementing particle swarm optimization in RBF network's design using input-output fuzzy clustering

In this paper we investigate the implementation of particle swarm optimization in the design of radial basis function neural networks under the framework of input-output fuzzy clustering. The problem being studied concerns the optimal estimation of the basis function centers, provided that the learning process is guided by the information of the output space. The proposed method encompasses a cost function, which is defined by a reformulated version of the fuzzy c-means applied in the product (i.e. input-output) space. The minimization of this function is accomplished by using the particle swarm optimization, where each particle encodes a set of cluster centers associated to a single fuzzy partition. The algorithm is simple and easy to implement, yet very effective. The performance of the resulting network is tested and verified through a number of experimental cases in terms of a 10-fold cross validation analysis.

[1]  Russell C. Eberhart,et al.  Tracking and optimizing dynamic systems with particle swarms , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[2]  Xiaoyong Liu,et al.  Radial Basis Function Neural Network Based on PSO with Mutation Operation to Solve Function Approximation Problem , 2010, ICSI.

[3]  Witold Pedrycz,et al.  Conditional fuzzy clustering in the design of radial basis function neural networks , 1998, IEEE Trans. Neural Networks.

[4]  Witold Pedrycz,et al.  A granular-oriented development of functional radial basis function neural networks , 2008, Neurocomputing.

[5]  Seok-Beom Roh,et al.  The development of fuzzy radial basis function neural networks based on the concept of information ambiguity , 2010, Neurocomputing.

[6]  M. Clerc,et al.  Particle Swarm Optimization , 2006 .

[7]  Sultan Noman Qasem,et al.  Improving performance of radial basis function network based with particle swarm optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[8]  Sung-Kwun Oh,et al.  Polynomial-based radial basis function neural networks (P-RBF NNs) realized with the aid of particle swarm optimization , 2011, Fuzzy Sets Syst..

[9]  Qing Chen,et al.  RBF Neural Network Based on Particle Swarm Optimization , 2010, ISNN.

[10]  James C. Bezdek,et al.  Fuzzy Kohonen clustering networks , 1994, Pattern Recognit..

[11]  Sultan Noman Qasem,et al.  Author's Personal Copy Applied Soft Computing Radial Basis Function Network Based on Time Variant Multi-objective Particle Swarm Optimization for Medical Diseases Diagnosis , 2022 .

[12]  George E. Tsekouras,et al.  A novel training algorithm for RBF neural network using a hybrid fuzzy clustering approach , 2012, Fuzzy Sets Syst..

[13]  James C. Bezdek,et al.  An integrated approach to fuzzy learning vector quantization and fuzzy c-means clustering , 1997, IEEE Trans. Fuzzy Syst..

[14]  Chia-Nan Ko,et al.  Time series prediction using RBF neural networks with a nonlinear time-varying evolution PSO algorithm , 2009, Neurocomputing.

[15]  Junying Chen,et al.  Training RBF Neural Networks with PSO and Improved Subtractive Clustering Algorithms , 2006, ICONIP.

[16]  Sung-Kwun Oh,et al.  Granular Neural Networks and Their Development Through Context-Based Clustering and Adjustable Dimensionality of Receptive Fields , 2009, IEEE Transactions on Neural Networks.

[17]  Sung-Kwun Oh,et al.  Design of K-means clustering-based polynomial radial basis function neural networks (pRBF NNs) realized with the aid of particle swarm optimization and differential evolution , 2012, Neurocomputing.

[18]  James C. Bezdek,et al.  Sequential Competitive Learning and the Fuzzy c-Means Clustering Algorithms , 1996, Neural Networks.

[19]  Jiguang Yue,et al.  Adaptive Training of Radial Basis Function Networks Using Particle Swarm Optimization Algorithm , 2005, ICNC.

[20]  George W. Irwin,et al.  Fast Forward RBF Network Construction Based on Particle Swarm Optimization , 2010, LSMS/ICSEE.

[21]  Witold Pedrycz,et al.  Improving RBF networks performance in regression tasks by means of a supervised fuzzy clustering , 2006, Neurocomputing.

[22]  Hsuan-Ming Feng,et al.  Self-generation RBFNs using evolutional PSO learning , 2006, Neurocomputing.

[23]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[24]  Gerry Dozier,et al.  Adapting Particle Swarm Optimizationto Dynamic Environments , 2001 .

[25]  Yu Liu,et al.  Training Radial Basis Function Networks with Particle Swarms , 2004, ISNN.

[26]  Wai Keung Wong,et al.  A hybrid particle swarm optimization and its application in neural networks , 2012, Expert Syst. Appl..

[27]  James D. Keeler,et al.  Algorithms for Better Representation and Faster Learning in Radial Basis Function Networks , 1989, NIPS.