A Radial Basis Function Neural Network Training Mechanism for Pattern Classification Tasks

This chapter proposes a radial basis function network learning approach for classification problems that combines hierarchical fuzzy clustering and particle swarm optimization (PSO) with discriminant analysis to elaborate on an effective design of radial basis function neural network classifier. To eliminate the redundant information, the training data are pre-processed to create a partition of the feature space into a number of fuzzy subspaces. The center elements of the subspaces are considered as a new data set which is further clustered by means of a weighted clustering scheme. The obtained cluster centers coincide with the centers of the network’s basis functions. The method of PSO is used to estimate the neuron connecting weights involved in the learning process. The proposed classifier is applied to three machine learning data sets, and its results are compared to other relative approaches that exist in the literature.

[1]  Friedhelm Schwenker,et al.  Three learning phases for radial-basis-function networks , 2001, Neural Networks.

[2]  Michael I. Posner,et al.  Cognition (2nd ed.). , 1987 .

[3]  Oscar Castillo,et al.  Evolutionary method combining Particle Swarm Optimisation and Genetic Algorithms using fuzzy logic for parameter adaptation and aggregation: the case neural network optimisation for face recognition , 2010, Int. J. Artif. Intell. Soft Comput..

[4]  Haralambos Sarimveis,et al.  A simple algorithm for training fuzzy systems using input-output data , 2003 .

[5]  M. Clerc,et al.  Particle Swarm Optimization , 2006 .

[6]  Sultan Noman Qasem,et al.  Improving performance of radial basis function network based with particle swarm optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[7]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[8]  Kah Phooi Seng,et al.  Radial Basis Function Neural Network With Incremental Learning for Face Recognition , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Xuli Han,et al.  Constructive Approximation to Multivariate Function by Decay RBF Neural Network , 2010, IEEE Transactions on Neural Networks.

[10]  Gerry Dozier,et al.  Adapting Particle Swarm Optimizationto Dynamic Environments , 2001 .

[11]  Robert Babuska,et al.  Neuro-fuzzy methods for nonlinear system identification , 2003, Annu. Rev. Control..

[12]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[13]  Sung-Kwun Oh,et al.  Granular Neural Networks and Their Development Through Context-Based Clustering and Adjustable Dimensionality of Receptive Fields , 2009, IEEE Transactions on Neural Networks.

[14]  Wei-Yin Loh,et al.  A Comparison of Prediction Accuracy, Complexity, and Training Time of Thirty-Three Old and New Classification Algorithms , 2000, Machine Learning.

[15]  Haralambos Sarimveis,et al.  A hierarchical fuzzy-clustering approach to fuzzy modeling , 2005, Fuzzy Sets Syst..

[16]  Gholam Ali Montazer,et al.  An improvement in RBF learning algorithm based on PSO for real time applications , 2013, Neurocomputing.

[17]  Carl G. Looney,et al.  Fuzzy connectivity clustering with radial basis kernel functions , 2009, Fuzzy Sets Syst..

[18]  Derek A. Linkens,et al.  Input selection and partition validation for fuzzy modelling using neural network , 1999, Fuzzy Sets Syst..

[19]  Sheng Chen,et al.  Particle Swarm Optimization Aided Orthogonal Forward Regression for Unified Data Modeling , 2010, IEEE Transactions on Evolutionary Computation.

[20]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[21]  Hao Yu,et al.  Fast and Efficient Second-Order Method for Training Radial Basis Function Networks , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Sultan Noman Qasem,et al.  Author's Personal Copy Applied Soft Computing Radial Basis Function Network Based on Time Variant Multi-objective Particle Swarm Optimization for Medical Diseases Diagnosis , 2022 .

[23]  Hussein A. Abbass,et al.  An evolutionary artificial neural networks approach for breast cancer diagnosis , 2002, Artif. Intell. Medicine.

[24]  Sultan Noman Qasem,et al.  Improving generalization of radial basis function network with adaptive multi-objective particle swarm optimization , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[25]  John Tsimikas,et al.  On training RBF neural networks using input-output fuzzy clustering and particle swarm optimization , 2013, Fuzzy Sets Syst..

[26]  Zheng Rong Yang,et al.  A novel radial basis function neural network for discriminant analysis , 2006, IEEE Transactions on Neural Networks.

[27]  Michael E. Tipping.  The Relevance Vector Machine , 1999, NIPS.

[28]  Yuehui Chen,et al.  Hierarchical Radial Basis Function Neural Networks for Classification Problems , 2006, ISNN.

[29]  Karim Faez,et al.  A fuzzy hybrid learning algorithm for radial basis function neural network with application in human face recognition , 2003, Pattern Recognit..

[30]  Sotiris B. Kotsiantis,et al.  Logitboost of Simple Bayesian Classifier , 2005, Informatica.

[31]  Ignacio Rojas,et al.  A New Clustering Technique for Function Approximation , 2005 .

[32]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[33]  Boudewijn P. F. Lelieveldt,et al.  Optimal design of radial basis function neural networks for fuzzy-rule extraction in high dimensional data , 2002, Pattern Recognit..

[34]  Sung-Kwun Oh,et al.  Polynomial-based radial basis function neural networks (P-RBF NNs) realized with the aid of particle swarm optimization , 2011, Fuzzy Sets Syst..

[35]  Huu Tue Huynh,et al.  Efficient Algorithm for Training Interpolation RBF Networks With Equally Spaced Nodes , 2011, IEEE Transactions on Neural Networks.

[36]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[37]  Norbert Jankowski,et al.  New developments in the Feature Space Mapping model , 2000 .

[38]  George E. Tsekouras,et al.  On the use of the weighted fuzzy c-means in fuzzy modeling , 2005, Adv. Eng. Softw..

[39]  Witold Pedrycz,et al.  Improving RBF networks performance in regression tasks by means of a supervised fuzzy clustering , 2006, Neurocomputing.

[40]  J. Nazuno.  Haykin, Simon. Neural networks: A comprehensive foundation, Prentice Hall, Inc. Segunda Edición, 1999 , 2000 .

[41]  Finn Verner Jensen,et al.  Introduction to Bayesian Networks , 2008, Innovations in Bayesian Networks.

[42]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[43]  Ilias Maglogiannis,et al.  Neural network-based diagnostic and prognostic estimations in breast cancer microscopic instances , 2006, Medical and Biological Engineering and Computing.

[44]  George E. Tsekouras,et al.  On training radial basis function neural networks using optimal fuzzy clustering , 2009, 2009 17th Mediterranean Conference on Control and Automation.

[45]  Yuehui Chen,et al.  Automatic design of hierarchical RBF networks for system identification , 2006 .