Polynomial-based radial basis function neural networks (P-RBF NNs) realized with the aid of particle swarm optimization

In this study, we design polynomial-based radial basis function neural networks (P-RBF NNs) based on a fuzzy inference mechanism. The essential design parameters (including learning rate, momentum coefficient and fuzzification coefficient of the underlying clustering method) are optimized by means of the particle swarm optimization. The proposed P-RBF NNs dwell upon structural findings about training data that are expressed in terms of a partition matrix resulting from fuzzy clustering in this case being the fuzzy C-means (FCM). The network is of functional nature as the weights between the hidden layer and the output are some polynomials. The use of the polynomial weights becomes essential in capturing the nonlinear nature of data encountered in regression or classification problems. From the perspective of linguistic interpretation, the proposed network can be expressed as a collection of ''if-then'' fuzzy rules. The architecture of the networks discussed here embraces three functional modules reflecting the three phases of input-output mapping realized in rule-based architectures, namely condition formation, conclusion creation, and aggregation. The proposed classifier is applied to some synthetic and machine learning datasets, and its results are compared with those reported in the previous studies.

[1]  Witold Pedrycz,et al.  Improving RBF networks performance in regression tasks by means of a supervised fuzzy clustering , 2006, Neurocomputing.

[2]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[3]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[4]  Michael N. Vrahatis,et al.  On the computation of all global minimizers through particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[5]  Sung-Kwun Oh,et al.  Self-organizing neurofuzzy networks in modeling software data , 2004, Fuzzy Sets Syst..

[6]  Ilias Maglogiannis,et al.  Neural network-based diagnostic and prognostic estimations in breast cancer microscopic instances , 2006, Medical and Biological Engineering and Computing.

[7]  J. D. Provence,et al.  Pattern classification using polynomial networks , 1992 .

[8]  Zwe-Lee Gaing,et al.  A particle swarm optimization approach for optimum design of PID controller in AVR system , 2004 .

[9]  Hussein A. Abbass,et al.  An evolutionary artificial neural networks approach for breast cancer diagnosis , 2002, Artif. Intell. Medicine.

[10]  Seok-Beom Roh,et al.  Hybrid fuzzy set-based polynomial neural networks and their development with the aid of genetic optimization and information granulation , 2009, Appl. Soft Comput..

[11]  Seong-Whan Lee,et al.  A self-organizing neural tree for large-set pattern classification , 1998, IEEE Trans. Neural Networks.

[12]  Zheng Rong Yang,et al.  A novel radial basis function neural network for discriminant analysis , 2006, IEEE Transactions on Neural Networks.

[13]  Michael E. Tipping The Relevance Vector Machine , 1999, NIPS.

[14]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[15]  James Kennedy,et al.  The particle swarm: social adaptation of knowledge , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[16]  Norbert Jankowski,et al.  New developments in the Feature Space Mapping model , 2000 .

[17]  Sushmita Mitra,et al.  Symbolic classification, clustering and fuzzy radial basis function network , 2005, Fuzzy Sets Syst..

[18]  Finn Verner Jensen,et al.  Introduction to Bayesian Networks , 2008, Innovations in Bayesian Networks.

[19]  Sun-Yuan Kung,et al.  Face recognition/detection by probabilistic decision-based neural network , 1997, IEEE Trans. Neural Networks.

[20]  Wei-Yin Loh,et al.  A Comparison of Prediction Accuracy, Complexity, and Training Time of Thirty-Three Old and New Classification Algorithms , 2000, Machine Learning.

[21]  Sung-Kwun Oh,et al.  Design of Polynomial Neural Network Classifier for Pattern Classification with Two Classes , 2008 .

[22]  Sotiris B. Kotsiantis,et al.  Logitboost of Simple Bayesian Classifier , 2005, Informatica.

[23]  Peter E. Hart,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[24]  M. Fajfer,et al.  Fuzzy partitioning with FID3.1 , 1999, 18th International Conference of the North American Fuzzy Information Processing Society - NAFIPS (Cat. No.99TH8397).

[25]  Chia-Feng Juang,et al.  Zero-order TSK-type fuzzy system learning using a two-phase swarm intelligence algorithm , 2008, Fuzzy Sets Syst..

[26]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[27]  M.H. Hassoun,et al.  Fundamentals of Artificial Neural Networks , 1996, Proceedings of the IEEE.

[28]  M. A. Abido Optimal des'ign of Power System Stabilizers Using Particle Swarm Opt'imization , 2002, IEEE Power Engineering Review.

[29]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[30]  M.M.B.R. Vellasco,et al.  Inverted hierarchical neuro-fuzzy BSP system: a novel neuro-fuzzy model for pattern classification and rule extraction in databases , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[31]  Georgios C. Anagnostopoulos,et al.  Cross-validation in Fuzzy ARTMAP for large databases , 2001, Neural Networks.

[32]  J. Ross Quinlan,et al.  Improved Use of Continuous Attributes in C4.5 , 1996, J. Artif. Intell. Res..

[33]  Kwang Bo Cho,et al.  Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction , 1996, Fuzzy Sets Syst..

[34]  Meng Joo Er,et al.  Face recognition with radial basis function (RBF) neural networks , 2002, IEEE Trans. Neural Networks.