Hierarchical Cluster-Based Multispecies Particle-Swarm Optimization for Fuzzy-System Optimization

This paper proposes a hierarchical cluster-based multispecies particle-swarm optimization (HCMSPSO) algorithm for fuzzy-system optimization. The objective of this paper is to learn Takagi-Sugeno-Kang (TSK) type fuzzy rules with high accuracy. In the HCMSPSO-designed fuzzy system (FS), each rule defines its own fuzzy sets, which implies that the number of fuzzy sets for each input variable is equal to the number of fuzzy rules. A swarm in HCMSPSO is clustered into multiple species at an upper hierarchical level, and each species is further clustered into multiple subspecies at a lower hierarchical level. For an FS consisting of r rules, r species (swarms) are formed in the upper level, where one species optimizes a single fuzzy rule. Initially, there are no species in HCMSPSO. An online cluster-based algorithm is proposed to generate new species (fuzzy rules) automatically. In the lower layer, subspecies within the same species are formed adaptively in each iteration during the particle update. Several simulations are conducted to verify HCMSPSO performance. Comparisons with other neural learning, genetic, and PSO algorithms demonstrate the superiority of HCMSPSO performance.

[1]  John Q. Gan,et al.  Low-level interpretability and high-level interpretability: a unified view of data-driven interpretable fuzzy system modelling , 2008, Fuzzy Sets Syst..

[2]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[3]  Wang Yu-ping,et al.  Multi-objective fuzzy particle swarm optimization based on elite archiving and its convergence , 2008 .

[4]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[5]  H. Ishibuchi.  Genetic fuzzy systems: evolutionary tuning and learning of fuzzy knowledge bases , 2004 .

[6]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[7]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[8]  Chin-Teng Lin,et al.  An On-Line Self-Constructing Neural Fuzzy Inference Network and Its Applications , 1998 .

[9]  Kiyotaka Izumi,et al.  A particle-swarm-optimized fuzzy-neural network for voice-controlled robot systems , 2005, IEEE Transactions on Industrial Electronics.

[10]  Jesús Alcalá-Fdez,et al.  Local identification of prototypes for genetic learning of accurate TSK fuzzy rule-based systems: Research Articles , 2007 .

[11]  María José del Jesús,et al.  KEEL: a software tool to assess evolutionary algorithms for data mining problems , 2008, Soft Comput..

[12]  Dragan Kukolj,et al.  Design of adaptive Takagi-Sugeno-Kang fuzzy models , 2002, Appl. Soft Comput..

[13]  Changjiang Zhang,et al.  A particle swarm optimization-aided fuzzy cloud classifier applied for plant numerical taxonomy based on attribute similarity , 2009, Expert systems with applications.

[14]  Chia-Feng Juang,et al.  Ant Colony Optimization Algorithm for Fuzzy Controller Design and Its FPGA Implementation , 2008, IEEE Transactions on Industrial Electronics.

[15]  Chia-Feng Juang,et al.  A Self-Organizing TS-Type Fuzzy Network With Support Vector Learning and its Application to Classification Problems , 2007, IEEE Transactions on Fuzzy Systems.

[16]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[17]  S. García,et al.  An Extension on "Statistical Comparisons of Classifiers over Multiple Data Sets" for all Pairwise Comparisons , 2008 .

[18]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[19]  Marco Russo,et al.  Genetic fuzzy learning , 2000, IEEE Trans. Evol. Comput..

[20]  Eghbal G. Mansoori,et al.  SGERD: A Steady-State Genetic Algorithm for Extracting Fuzzy Classification Rules From Data , 2008, IEEE Transactions on Fuzzy Systems.

[21]  Xin Chen,et al.  A Modified PSO Structure Resulting in High Exploration Ability With Convergence Guaranteed , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Suganthan.  [IEEE 1999. Congress on Evolutionary Computation-CEC99 - Washington, DC, USA (6-9 July 1999)] Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406) - Particle swarm optimiser with neighbourhood operator , 1999 .

[23]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[24]  Tapabrata Ray,et al.  Society and civilization: An optimization algorithm based on the simulation of social behavior , 2003, IEEE Trans. Evol. Comput..

[25]  Xiaodong Li,et al.  This article has been accepted for inclusion in a future issue. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 Locating and Tracking Multiple Dynamic Optima by a Particle Swarm Model Using Speciation , 2022 .

[26]  Chia-Feng Juang,et al.  Temperature control by chip-implemented adaptive recurrent fuzzy controller designed by evolutionary algorithm , 2005, IEEE Trans. Circuits Syst. I Regul. Pap..

[27]  Hak-Keung Lam,et al.  Hybrid Particle Swarm Optimization With Wavelet Mutation and Its Industrial Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  Nikola K. Kasabov,et al.  HyFIS: adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems , 1999, Neural Networks.

[29]  S.N. Singh,et al.  Fuzzy Adaptive Particle Swarm Optimization for Bidding Strategy in Uniform Price Spot Market , 2007, IEEE Transactions on Power Systems.

[30]  Rudolf Kruse,et al.  Neuro-fuzzy systems for function approximation , 1999, Fuzzy Sets Syst..

[31]  Chia-Feng Juang,et al.  A hybrid of genetic algorithm and particle swarm optimization for recurrent network design , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[32]  Xiao-Feng Xie,et al.  DEPSO: hybrid particle swarm with differential evolution operator , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[33]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[34]  J. Kennedy,et al.  Neighborhood topologies in fully informed and best-of-neighborhood particle swarms , 2003, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[35]  Leandro dos Santos Coelho,et al.  Particle swarm approaches using Lozi map chaotic sequences to fuzzy modelling of an experimental thermal-vacuum system , 2008, Appl. Soft Comput..

[36]  Paulo Cortez,et al.  Particle swarms for feedforward neural network training , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[37]  Kwang Bo Cho,et al.  Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction , 1996, Fuzzy Sets Syst..

[38]  Frank Hoffmann,et al.  Incremental Evolutionary Design of TSK Fuzzy Controllers , 2007, IEEE Transactions on Fuzzy Systems.

[39]  P. Suganthan.  Particle swarm optimiser with neighbourhood operator , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[40]  Meng Joo Er,et al.  Dynamic fuzzy neural networks-a novel approach to function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[41]  Gary G. Yen,et al.  PSO-Based Multiobjective Optimization With Dynamic Population Size and Adaptive Local Archives , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[42]  A. M. El-Zonkoly,et al.  Optimal tunning of lead-lag and fuzzy logic power system stabilizers using particle swarm optimization , 2009, Expert Syst. Appl..

[43]  Chia-Feng Juang,et al.  A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms , 2002, IEEE Trans. Fuzzy Syst..

[44]  Yutian Liu,et al.  Multi-objective reactive power and voltage control based on fuzzy optimization strategy and fuzzy adaptive particle swarm , 2008 .

[45]  Jesús Alcalá-Fdez,et al.  Local identification of prototypes for genetic learning of accurate TSK fuzzy rule‐based systems , 2007, Int. J. Intell. Syst..

[46]  Chin-Teng Lin,et al.  A Hybrid of Cooperative Particle Swarm Optimization and Cultural Algorithm for Neural Fuzzy Networks and Its Prediction Applications , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[47]  Amitava Chatterjee,et al.  A Hybrid Approach for Design of Stable Adaptive Fuzzy Controllers Employing Lyapunov Theory and Particle Swarm Optimization , 2009, IEEE Transactions on Fuzzy Systems.