Differential Evolution-Based Optimization of Kernel Parameters in Radial Basis Function Networks for Classification

In this paper a two phases learning algorithm with a modified kernel for radial basis function neural networks is proposed for classification. In phase one a new meta-heuristic approach differential evolution is used to reveal the parameters of the modified kernel. The second phase focuses on optimization of weights for learning the networks. Further, a predefined set of basis functions is taken for empirical analysis of which basis function is better for which kind of domain. The simulation result shows that the proposed learning mechanism is evidently producing better classification accuracy vis-A -vis radial basis function neural networks (RBFNs) and genetic algorithm-radial basis function (GA-RBF) neural networks.

[1]  De-shuang Huang,et al.  The optimization of radial basis probabilistic neural networks based on genetic algorithms , 2002, Proceedings of the International Joint Conference on Neural Networks, 2003..

[2]  Jouni Lampinen,et al.  Training RBF networks using a DE algorithm with adaptive control , 2005, 17th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'05).

[3]  Vennila Ramalingam,et al.  Breast mass classification based on cytological patterns using RBFNN and SVM , 2009, Expert Syst. Appl..

[4]  S Forrest,et al.  Genetic algorithms , 1996, CSUR.

[5]  C. Raghavendra Rao,et al.  Differential evolution trained radial basis function network: application to bankruptcy prediction in banks , 2010, Int. J. Bio Inspired Comput..

[6]  M. J. D. Powell,et al.  Radial basis functions for multivariable interpolation: a review , 1987 .

[7]  Sukhan Lee,et al.  A Gaussian potential function network with hierarchically self-organizing learning , 1991, Neural Networks.

[8]  Dingli Yu,et al.  Selecting radial basis function network centers with recursive orthogonal least squares training , 2000, IEEE Trans. Neural Networks Learn. Syst..

[9]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[10]  Stephen A. Billings,et al.  Radial Basis Function Network Configuration Using Mutual Information and the Orthogonal Least Squares Algorithm , 1996, Neural Networks.

[11]  Mohamed Adel Taher,et al.  A New Modular Strategy For Action Sequence Automation Using Neural Networks And Hidden Markov Models , 2013, Int. J. Syst. Dyn. Appl..

[12]  Sultan Noman Qasem,et al.  Memetic Elitist Pareto Differential Evolution algorithm based Radial Basis Function Networks for classification problems , 2011, Appl. Soft Comput..

[13]  Vadlamani Ravi,et al.  Rule extraction from differential evolution trained radial basis function network using genetic algorithms , 2009, 2009 IEEE International Conference on Automation Science and Engineering.

[14]  Rainer Storn,et al.  System design by constraint adaptation and differential evolution , 1999, IEEE Trans. Evol. Comput..

[15]  Andreas Wichert,et al.  Flexible kernels for RBF networks , 2006, Neurocomputing.

[16]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[17]  Jouni Lampinen,et al.  A differential evolution based incremental training method for RBF networks , 2005, GECCO '05.

[18]  Rafael Vasconcelos,et al.  Design and Evaluation of an Autonomous Load Balancing System for Mobile Data Stream Processing Based On a Data Centric Publish Subscribe Approach , 2014, Int. J. Adapt. Resilient Auton. Syst..

[19]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[20]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[21]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[22]  Christophe Giraud-Carrier,et al.  GA-RBF: A Self-Optimising RBF Network , 1997, ICANNGA.

[23]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[24]  P. Dhanalakshmi,et al.  Classification of audio signals using SVM and RBFNN , 2009, Expert Syst. Appl..

[25]  Mohammed Obaid Mustafa,et al.  International Journal of System Dynamics Applications , 2014 .

[26]  Ali Idri,et al.  Design of Radial Basis Function Neural Networks for Software Effort Estimation , 2010 .

[27]  Alaa F. Sheta,et al.  Time-series forecasting using GA-tuned radial basis functions , 2001, Inf. Sci..

[28]  Dale Schuurmans,et al.  Automatic basis selection techniques for RBF networks , 2003, Neural Networks.

[29]  Yuri Pavlov,et al.  Decision Control, Management, and Support in Adaptive and Complex Systems: Quantitative Models , 2013 .

[30]  Anthony Brabazon,et al.  Designing Radial Basis Function Networks for Classification Using Differential Evolution , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[31]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.