Design of K-means clustering-based polynomial radial basis function neural networks (pRBF NNs) realized with the aid of particle swarm optimization and differential evolution

In this paper, we introduce an advanced architecture of K-means clustering-based polynomial Radial Basis Function Neural Networks (p-RBF NNs) designed with the aid of Particle Swarm Optimization (PSO) and Differential Evolution (DE) and develop a comprehensive design methodology supporting their construction. The architecture of the p-RBF NNs comes as a result of a synergistic usage of the evolutionary optimization-driven hybrid tools. The connections (weights) of the proposed p-RBF NNs being of a certain functional character and are realized by considering four types of polynomials. In order to design the optimized p-RBF NNs, a prototype (center value) of each receptive field is determined by running the K-means clustering algorithm and then a prototype and a spread of the corresponding receptive field are further optimized through running Particle Swarm Optimization (PSO) and Differential Evolution (DE). The Weighted Least Square Estimation (WLSE) is used to estimate the coefficients of the polynomials (which serve as functional connections of the network). The performance of the proposed model and the comparative analysis involving models designed with the aid of PSO and DE are presented in case of a nonlinear function and two Machine Learning (ML) datasets

[1]  Jiye Liang,et al.  Combination Entropy and Combination Granulation in Rough Set Theory , 2008, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[2]  Witold Pedrycz,et al.  Linguistic models as a framework of user-centric system modeling , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[3]  Tipu Z. Aziz,et al.  Prediction of Parkinson's disease tremor onset using radial basis function neural networks , 2010, Expert Syst. Appl..

[4]  W. Pedrycz,et al.  A fuzzy ensemble of parallel polynomial neural networks with information granules formed by fuzzy clustering , 2010, Knowl. Based Syst..

[5]  Xinggao Liu,et al.  Melt index prediction by RBF neural network optimized with an MPSO-SA hybrid algorithm , 2011, Neurocomputing.

[6]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[7]  Alexander A. Frolov,et al.  Boolean Factor Analysis by Attractor Neural Network , 2007, IEEE Transactions on Neural Networks.

[8]  Sung-Kwun Oh,et al.  Optimization of Fuzzy Set-Fuzzy Systems based on IG by Means of GAs with Successive Tuning Method , 2008 .

[9]  Seok-Beom Roh,et al.  The design methodology of radial basis function neural networks based on fuzzy K-nearest neighbors approach , 2010, Fuzzy Sets Syst..

[10]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[11]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[12]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[13]  D. Karaboga,et al.  A Simple and Global Optimization Algorithm for Engineering Problems: Differential Evolution Algorithm , 2004 .

[14]  Chao Wu,et al.  Forecasting stock indices using radial basis function neural networks optimized by artificial fish swarm algorithm , 2011, Knowl. Based Syst..

[15]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[16]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[17]  Jiye Liang,et al.  Knowledge structure, knowledge granulation and knowledge distance in a knowledge base , 2009, Int. J. Approx. Reason..

[18]  Antônio de Pádua Braga,et al.  An efficient multi-objective learning algorithm for RBF neural network , 2010, Neurocomputing.

[19]  Lotfi A. Zadeh,et al.  Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic , 1997, Fuzzy Sets Syst..

[20]  Witold Pedrycz,et al.  A granular-oriented development of functional radial basis function neural networks , 2008, Neurocomputing.

[21]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.