Radial Basis Function Neural Networks : A Review

Radial Basis Function neural networks (RBFNNs) represent an attractive alternative to other neural network models. One reason is that they form a unifying link between function approximation, regularization, noisy interpolation, classification and density estimation. It is also the case that training RBF neural networks is faster than training multi-layer perceptron networks. RBFNN learning is usually split into an unsupervised part, where center and widths of the Gaussian basis functions are set, and a linear supervised part for weight computation. This paper reviews various learning methods for determining centers, widths, and synaptic weights of RBFNN. In addition, we will point to some applications of RBFNN in various fields. In the end, we name software that can be used for implementing RBFNNs.

[1]  Gholam Ali Montazer,et al.  An improved radial basis function neural network for object image retrieval , 2015, Neurocomputing.

[2]  Gholam Ali Montazer,et al.  Scene Classification Using Multi-Resolution WAHOLB Features and Neural Network Classifier , 2017, Neural Processing Letters.

[3]  Oscar Castillo,et al.  An improved evolutionary method with fuzzy logic for combining Particle Swarm Optimization and Genetic Algorithms , 2011, Appl. Soft Comput..

[4]  Fevzullah Temurtas,et al.  A comparative study on diabetes disease diagnosis using neural networks , 2009, Expert Syst. Appl..

[5]  Yong Zhao,et al.  Concurrent Subspace Width Optimization Method for RBF Neural Network Modeling , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[6]  María José del Jesús,et al.  KEEL: a software tool to assess evolutionary algorithms for data mining problems , 2008, Soft Comput..

[7]  Hao Yu,et al.  Advantages of Radial Basis Function Networks for Dynamic System Design , 2011, IEEE Transactions on Industrial Electronics.

[8]  Gholam Ali Montazer,et al.  An improvement in RBF learning algorithm based on PSO for real time applications , 2013, Neurocomputing.

[9]  Reza Sabzevari,et al.  Three-phase strategy for the OSD learning method in RBF neural networks , 2009, Neurocomputing.

[10]  Kok Kiong Tan,et al.  Adaptive online correction and interpolation of quadrature encoder signals using radial basis functions , 2005, IEEE Trans. Control. Syst. Technol..

[11]  Haralambos Sarimveis,et al.  A new algorithm for developing dynamic radial basis function neural network models based on genetic algorithms , 2004, Comput. Chem. Eng..

[12]  B.M. Wilamowski,et al.  Neural network architectures and learning algorithms , 2009, IEEE Industrial Electronics Magazine.

[13]  Hao Yu,et al.  Improved Computation for Levenberg–Marquardt Training , 2010, IEEE Transactions on Neural Networks.

[14]  Kai-Yuan Cai,et al.  Fuzzy nonlinear regression with fuzzified radial basis function network , 2005, IEEE Transactions on Fuzzy Systems.

[15]  M. J. D. Powell,et al.  Radial basis functions for multivariable interpolation: a review , 1987 .

[16]  Hui Li,et al.  Fuzzy Radius Basis Function neural network based vector control of Permanent Magnet Synchronous Motor , 2008, 2008 IEEE International Conference on Mechatronics and Automation.

[17]  Horst Bischof,et al.  An efficient MDL-based construction of RBF networks , 1998, Neural Networks.

[18]  Vennila Ramalingam,et al.  Breast mass classification based on cytological patterns using RBFNN and SVM , 2009, Expert Syst. Appl..

[19]  Alexander,et al.  Mammograms Classification Using Gray-level Co-occurrence Matrix and Radial Basis Function Neural Network , 2015 .

[20]  David S. Broomhead,et al.  Multivariable Functional Interpolation and Adaptive Networks , 1988, Complex Syst..

[21]  M. Serdar Bascil,et al.  A Study on Hepatitis Disease Diagnosis Using Probabilistic Neural Network , 2012, Journal of Medical Systems.

[22]  Shigeo Abe,et al.  A fast incremental learning algorithm of RBF networks with long-term memory , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[23]  Xu Jianqiang,et al.  Self-adaptive Clustering Algorithm Based RBF Neural Network and its Application in the Fault Diagnosis of Power Systems , 2005, 2005 IEEE/PES Transmission & Distribution Conference & Exposition: Asia and Pacific.

[24]  Felipe Miguel Aparicio Acosta,et al.  Radial basis function and related models: An overview , 1995, Signal Process..

[25]  Saad Amin,et al.  Diagnosis of heart disease by using a radial basis function network classification technique on patients' medical records , 2014, 2014 IEEE MTT-S International Microwave Workshop Series on RF and Wireless Technologies for Biomedical and Healthcare Applications (IMWS-Bio2014).

[26]  Narasimhan Sundararajan,et al.  A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation , 2005, IEEE Transactions on Neural Networks.

[27]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  Zarita Zainuddin,et al.  An Improved Fast Training Algorithm for RBF Networks Using Symmetry-Based Fuzzy C-Means Clustering , 2008 .

[29]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[30]  Roman Neruda,et al.  Learning methods for radial basis function networks , 2005, Future Gener. Comput. Syst..

[31]  Michel van Tooren,et al.  Euclidean distance and second derivative based widths optimization of radial basis function neural networks , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[32]  Rafael Stubs Parpinelli,et al.  Theory and New Applications of Swarm Intelligence , 2012 .

[33]  Adam Krzyzak,et al.  A Distribution-Free Theory of Nonparametric Regression , 2002, Springer series in statistics.

[34]  Scott E. Fahlman,et al.  An empirical study of learning speed in back-propagation networks , 1988 .

[35]  Tingting Mu,et al.  Detection of breast cancer using v-SVM and RBF networks with self organized selection of centers , 2005 .

[36]  Ming-Huwi Horng,et al.  Firefly Meta-Heuristic Algorithm for Training the Radial Basis Function Network for Data Classification and Disease Diagnosis , 2012 .

[37]  Gholam Ali Montazer,et al.  Improvement of RBF neural networks using Fuzzy-OSD algorithm in an online radar pulse classification system , 2013, Appl. Soft Comput..

[38]  Mohamed Cheriet,et al.  The Combined Statistical Stepwise and Iterative Neural Network Pruning Algorithm , 2009, Intell. Autom. Soft Comput..

[39]  Alex Alexandridis,et al.  A medical diagnostic tool based on radial basis function classifiers and evolutionary simulated annealing , 2014, J. Biomed. Informatics.

[40]  Mark J. L. Orr.  Optimising the widths of radial basis functions , 1998, Proceedings 5th Brazilian Symposium on Neural Networks (Cat. No.98EX209).

[41]  New SISO and MISO Adaptive Nonlinear Predictive Controllers based on self organizing RBF neural networks , 2008, 2008 3rd International Symposium on Communications, Control and Signal Processing.

[42]  Feyzullah Temurtas,et al.  A Comparative Study on Parkinson's Disease Diagnosis Using Neural Networks and Artificial Immune System , 2016 .

[43]  Sultan Noman Qasem,et al.  Author's Personal Copy Applied Soft Computing Radial Basis Function Network Based on Time Variant Multi-objective Particle Swarm Optimization for Medical Diseases Diagnosis , 2022 .

[44]  T.,et al.  Training Feedforward Networks with the Marquardt Algorithm , 2004 .

[45]  Tipu Z. Aziz,et al.  Prediction of Parkinson's disease tremor onset using radial basis function neural networks , 2010, Expert Syst. Appl..

[46]  T. Yıldırım,et al.  MEDICAL DIAGNOSIS ON PIMA INDIAN DIABETES USING GENERAL REGRESSION NEURAL NETWORKS , 2003 .

[47]  Reza Sabzevari,et al.  Improvement of learning algorithms for RBF neural networks in a helicopter sound identification system , 2007, Neurocomputing.

[48]  Héctor Pomares,et al.  Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximation , 2003, IEEE Trans. Neural Networks.

[49]  Hao Yu,et al.  Fast and Efficient Second-Order Method for Training Radial Basis Function Networks , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[50]  Feng Kong,et al.  Selection of Logistics Service Provider based on fuzzy RBF neural networks , 2008, 2008 IEEE International Conference on Automation and Logistics.

[51]  Feng Chu,et al.  Applying RBF Neural Networks to Cancer Classification Based on Gene Expressions , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[52]  Oscar Castillo,et al.  Evolutionary method combining Particle Swarm Optimisation and Genetic Algorithms using fuzzy logic for parameter adaptation and aggregation: the case neural network optimisation for face recognition , 2010, Int. J. Artif. Intell. Soft Comput..

[53]  Huu Tue Huynh,et al.  Efficient Algorithm for Training Interpolation RBF Networks With Equally Spaced Nodes , 2011, IEEE Transactions on Neural Networks.

[54]  Y Lu,et al.  A Sequential Learning Scheme for Function Approximation Using Minimal Radial Basis Function Neural Networks , 1997, Neural Computation.

[55]  Roderick Murray-Smith,et al.  Extending the functional equivalence of radial basis function networks and fuzzy inference systems , 1996, IEEE Trans. Neural Networks.

[56]  Tulay Yildirim,et al.  BREAST CANCER DIAGNOSIS USING STATISTICAL NEURAL NETWORKS , 2004 .

[57]  Pedro Antonio Gutiérrez,et al.  Logistic Regression by Means of Evolutionary Radial Basis Function Neural Networks , 2011, IEEE Transactions on Neural Networks.

[58]  De-Shuang Huang,et al.  A Constructive Hybrid Structure Optimization Methodology for Radial Basis Probabilistic Neural Networks , 2008, IEEE Transactions on Neural Networks.

[59]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[60]  Z. Zainuddin,et al.  Improving RBF Networks Classification Performance by using K-Harmonic Means , 2010 .

[61]  B. Baxter,et al.  The Interpolation Theory of Radial Basis Functions , 2010, 1006.2443.

[62]  John Yen,et al.  Radial basis function networks, regression weights, and the expectation-maximization algorithm , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[63]  Nando de Freitas,et al.  Robust Full Bayesian Learning for Radial Basis Networks , 2001, Neural Computation.

[64]  Mark J. L. Orr,et al.  Regularization in the Selection of Radial Basis Function Centers , 1995, Neural Computation.

[65]  Bernhard Sick,et al.  Evolutionary optimization of radial basis function classifiers for data mining applications , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[66]  S. Anitha,et al.  Application of a radial basis function neural network for diagnosis of diabetes mellitus , 2006 .

[67]  Pedro Antonio Gutiérrez,et al.  Evolutionary q-Gaussian Radial Basis Function Neural Network to determine the microbial growth/no growth interface of Staphylococcus aureus , 2011, Appl. Soft Comput..