Training of fuzzy neural networks via quantum-behaved particle swarm optimization and rival penalized competitive learning

There are some difficulties encountered in the application of fuzzy Radial Basis Function (RBF) neural network. One of them is how to determine the number of hidden rule neurons and another difficulty is about interpretability. In order to overcome these difficulties, we have proposed a fuzzy neural network based on RBF network and takagi-sugeno fuzzy system. We have used a new structure of fuzzy RBF neural network, which has been proved that it is better than other structures in term of interpretability. Our model also use a Rival Penalized Competitive Learning (RPCL) and a swarm based algorithm called Quantum-behaved Particle Swarm Optimization (QPSO) to determine design parameters of hidden layer and design parameters of output layer, respectively. RPCL is the best clustering algorithm that is introduced so far. The Particle Swarm Optimization (PSO) is a well-known population-based swarm intelligence algorithm. The QPSO is also proposed by combining the classical CPSO philosophy and quantum mechanics to improve performance of PSO. We have compared the performance of the proposed method with gradient based method. Simulation results of nonlinear function approximation demonstrate the superiority of the proposed method over gradient based method.

[1]  Wenbo Xu,et al.  Adaptive parameter control for quantum-behaved particle swarm optimization on individual level , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[2]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[3]  Derek A. Linkens,et al.  Input selection and partition validation for fuzzy modelling using neural network , 1999, Fuzzy Sets Syst..

[4]  Chuen-Tsai Sun,et al.  Neuro-fuzzy modeling and control , 1995, Proc. IEEE.

[5]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[6]  Jing Liu,et al.  Parameter Selection of Quantum-Behaved Particle Swarm Optimization , 2005, ICNC.

[7]  Bernhard Sendhoff,et al.  Extracting Interpretable Fuzzy Rules from RBF Networks , 2003, Neural Processing Letters.

[8]  Jun Sun,et al.  A global search strategy of quantum-behaved particle swarm optimization , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[9]  Wenbo Xu,et al.  Particle swarm optimization with particles having quantum behavior , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[10]  Yoichi Hori,et al.  An Algorithm for Extracting Fuzzy Rules Based on RBF Neural Network , 2006, IEEE Transactions on Industrial Electronics.

[11]  Erkki Oja,et al.  Rival penalized competitive learning for clustering analysis, RBF net, and curve detection , 1993, IEEE Trans. Neural Networks.

[12]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[13]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..

[14]  Yaochu Jin,et al.  Fuzzy modeling of high-dimensional systems: complexity reduction and interpretability improvement , 2000, IEEE Trans. Fuzzy Syst..

[15]  A. A. Mullin,et al.  Principles of neurodynamics , 1962 .