A Spiking-based mechanism for self-organizing RBF neural networks

In this paper, a spiking growing algorithm (SGA) is proposed for optimizing the structure of radial basis function (RBF) neural network. Inspired by the synchronous behavior of spiking neurons, the spiking strength (ss) of the hidden neurons is defined as the criteria of SGA, which investigates a new way to simulate the connections between hidden and output neurons of RBF neural network. This SGA-based RBF (SGA-RBF) neural network can self-organize the hidden neurons online, to achieve the appropriate network efficiency. Meanwhile, to ensure the accuracy of SGA-RBF neural network, the structure-adjusting and parameters-training phases are performed simultaneously. Simulation results demonstrate that the proposed method can obtain a higher precision in comparison with some other existing methods.

[1]  S. Gopal,et al.  Orthogonal least square center selection technique - A robust scheme for multiple source Partial Discharge pattern recognition using Radial Basis Probabilistic Neural Network , 2011, Expert Syst. Appl..

[2]  Narasimhan Sundararajan,et al.  A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation , 2005, IEEE Transactions on Neural Networks.

[3]  Feng Cheng,et al.  The automatic model selection and variable kernel width for RBF neural networks , 2011, Neurocomputing.

[4]  Konstantinos P. Ferentinos,et al.  Biological engineering applications of feedforward neural networks designed and parameterized by genetic algorithms , 2005, Neural Networks.

[5]  Haralambos Sarimveis,et al.  Radial Basis Function Network Training Using a Nonsymmetric Partition of the Input Space and Particle Swarm Optimization , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Junfei Qiao,et al.  A Repair Algorithm for Radial Basis Function Neural Network and its Application to Chemical oxygen Demand Modeling , 2010, Int. J. Neural Syst..

[7]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[8]  Y Lu,et al.  A Sequential Learning Scheme for Function Approximation Using Minimal Radial Basis Function Neural Networks , 1997, Neural Computation.

[9]  Xin Yao,et al.  A New Constructive Algorithm for Architectural and Functional Adaptation of Artificial Neural Networks , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Wai-Kai Chen,et al.  Linear Networks and Systems , 1983 .

[11]  T. Martin McGinnity,et al.  Design for Self-Organizing Fuzzy Neural Networks Based on Genetic Algorithms , 2006, IEEE Transactions on Fuzzy Systems.

[12]  Josep M. Sopena,et al.  Performing Feature Selection With Multilayer Perceptrons , 2008, IEEE Transactions on Neural Networks.

[13]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[14]  Viktor B. Kazantsev,et al.  Pattern retrieval in a three-layer oscillatory network with a context dependent synaptic connectivity , 2012, Neural Networks.

[15]  Vincenzo Piuri,et al.  A Hierarchical RBF Online Learning Algorithm for Real-Time 3-D Scanner , 2010, IEEE Transactions on Neural Networks.

[16]  Dingli Yu,et al.  Selecting radial basis function network centers with recursive orthogonal least squares training , 2000, IEEE Trans. Neural Networks Learn. Syst..

[17]  Junfei Qiao,et al.  Adaptive Computation Algorithm for RBF Neural Network , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Haralambos Sarimveis,et al.  A new algorithm for online structure and parameter adaptation of RBF networks , 2003, Neural Networks.

[19]  S. Chen,et al.  Fast orthogonal least squares algorithm for efficient subset model selection , 1995, IEEE Trans. Signal Process..

[20]  J. Qiao,et al.  Prediction of activated sludge bulking based on a self-organizing RBF neural network☆ , 2012 .

[21]  Hao Yu,et al.  Fast and Efficient Second-Order Method for Training Radial Basis Function Networks , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[22]  D. Massart,et al.  The Radial Basis Functions — Partial Least Squares approach as a flexible non-linear regression technique , 1996 .

[23]  Narasimhan Sundararajan,et al.  Identification of time-varying nonlinear systems using minimal radial basis function neural networks , 1997 .

[24]  Narasimhan Sundararajan,et al.  An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Daming Shi,et al.  Sensitivity analysis applied to the construction of radial basis function networks , 2005, Neural Networks.

[26]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[27]  Cornelius Glackin,et al.  Synchrony: A spiking-based mechanism for processing sensory stimuli , 2012, Neural Networks.

[28]  Jing Yang,et al.  A supervised multi-spike learning algorithm based on gradient descent for spiking neural networks , 2013, Neural Networks.

[29]  Paramasivan Saratchandran,et al.  Performance evaluation of a sequential minimal radial basis function (RBF) neural network learning algorithm , 1998, IEEE Trans. Neural Networks.

[30]  Bruno Sudret,et al.  Global sensitivity analysis using polynomial chaos expansions , 2008, Reliab. Eng. Syst. Saf..

[31]  John C. Platt.  A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[32]  Maria Bortman,et al.  A Growing and Pruning Method for Radial Basis Function Networks , 2009, IEEE Transactions on Neural Networks.

[33]  A. Saltelli,et al.  A quantitative model-independent method for global sensitivity analysis of model output , 1999 .

[34]  Junfei Qiao,et al.  Identification and modeling of nonlinear dynamical systems using a novel self-organizing RBF-based approach , 2012, Autom..

[35]  Visakan Kadirkamanathan,et al.  A Function Estimation Approach to Sequential Learning with Neural Networks , 1993, Neural Computation.

[36]  Jinxiao Pan,et al.  A HAMPSO-RBF Algorithm Applied to Target Localization , 2012 .