Constrained PSO Based Center Selection for RBF Networks Under Concurrent Fault Situation

In the training of radial basis function (RBF) networks, one important issue is to select RBF centers before constructing the networks. Most existing center selection methods are designed for the fault-free situation only. However, as the implementation of the networks may be perturbed by faults, these algorithms may lead to networks with degraded performance. This paper considers the center selection problem for RBF networks under the concurrent fault situation where multiplicative weight noise and open weight fault exist simultaneously. In particular, we introduce a binary label vector indicating the centers selected from training samples. Using the label vector, the fault-tolerant RBF model under the concurrent fault situation is reformulated as a constrained optimization problem, so that fault-tolerance can be considered in the procedure of center selection. To solve this constrained optimization problem, a constrained particle swarm optimization based algorithm is developed to select centers and train the network simultaneously. Simulation results show that the proposed algorithm is superior than state-of-the-art center selection algorithms.

[1]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[2]  Sheng Chen,et al.  Local regularization assisted orthogonal least squares regression , 2006, Neurocomputing.

[3]  Chi-Sing Leung,et al.  ADMM-Based Algorithm for Training Fault Tolerant RBF Networks and Selecting Centers , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[4]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[5]  Bernard Widrow,et al.  Sensitivity of feedforward neural networks to weight errors , 1990, IEEE Trans. Neural Networks.

[6]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[7]  ImplementationsJames B. BurrDepartment.  Digital Neural Network Implementations , 1995 .

[8]  I-Cheng Yeh,et al.  Analysis of Strength of Concrete Using Design of Experiments and Neural Networks , 2006 .

[9]  Pınar Tüfekci,et al.  Prediction of full load electrical power output of a base load operated combined cycle power plant using machine learning methods , 2014 .

[10]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[11]  S..  Nonlinear time series modelling and prediction using Gaussian RBF networks with enhanced clustering and RLS learning , 2004 .

[12]  Richard M. Voyles,et al.  Artificial neural network performance degradation under network damage: Stuck-at faults , 2011, The 2011 International Joint Conference on Neural Networks.

[13]  Andrew Chi-Sing Leung,et al.  A Regularizer Approach for RBF Networks Under the Concurrent Weight Failure Situation , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Andrew Chi-Sing Leung,et al.  RBF Networks Under the Concurrent Fault Situation , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Andrew Chi-Sing Leung,et al.  LCA based RBF training algorithm for the concurrent fault situation , 2016, Neurocomputing.

[16]  Guo Wenzhong.  Settings and Experimental Analysis of Acceleration Coefficients in Particle Swarm Optimization Algorithm , 2006 .

[17]  Lawrence O. Hall,et al.  Active cleaning of label noise , 2016, Pattern Recognit..

[18]  Masashi Sugiyama,et al.  Optimal design of regularization term and regularization parameter by subspace information criterion , 2002, Neural Networks.

[19]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[20]  Dhananjay S. Phatak,et al.  Complete and partial fault tolerance of feedforward neural nets , 1995, IEEE Trans. Neural Networks.

[21]  Andrew Chi-Sing Leung,et al.  Online training and its convergence for faulty networks with multiplicative weight noise , 2015, Neurocomputing.

[22]  John Mark,et al.  Introduction to radial basis function networks , 1996 .

[23]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[24]  Hao Yu,et al.  An Incremental Design of Radial Basis Function Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.