Automatically extracting T-S fuzzy models using cooperative random learning particle swarm optimization

This paper proposes a methodology for automatically extracting T-S fuzzy models from data using particle swarm optimization (PSO). In the proposed method, the structures and parameters of the fuzzy models are encoded into a particle and evolve together so that the optimal structure and parameters can be achieved simultaneously. An improved version of the original PSO algorithm, the cooperative random learning particle swarm optimization (CRPSO), is put forward to enhance the performance of PSO. CRPSO employs several sub-swarms to search the space and the useful information is exchanged among them during the iteration process. Simulation results indicate that CRPSO outperforms the standard PSO algorithm, genetic algorithm (GA) and differential evolution (DE) on the functions optimization and benchmark modeling problems. Moreover, the proposed CRPSO-based method can extract accurate T-S fuzzy model with appropriate number of rules.

[1]  Andries Petrus Engelbrecht,et al.  A study of particle swarm optimization particle trajectories , 2006, Inf. Sci..

[2]  Russell C. Eberhart,et al.  Implementation of evolutionary fuzzy systems , 1999, IEEE Trans. Fuzzy Syst..

[3]  John Yen,et al.  Extracting fuzzy rules for system modeling using a hybrid of genetic algorithms and Kalman filter , 1999, Fuzzy Sets Syst..

[4]  Chia-Feng Juang,et al.  Zero-order TSK-type fuzzy system learning using a two-phase swarm intelligence algorithm , 2008, Fuzzy Sets Syst..

[5]  Witold Pedrycz,et al.  Evolutionary fuzzy modeling , 2003, IEEE Trans. Fuzzy Syst..

[6]  Francisco Herrera,et al.  A Two-stage Evolutionary Process for Designing Tsk Fuzzy Rule-based Systems a Two-stage Evolutionary Process for Designing Tsk Fuzzy Rule-based Systems , 1996 .

[7]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[8]  朱云龙,et al.  A multi-swarm optimizer based fuzzy modeling approach for dynamic systems processing , 2008 .

[9]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[10]  Nong Zhang,et al.  Application of evolving Takagi-Sugeno fuzzy model to nonlinear system identification , 2008, Appl. Soft Comput..

[11]  Chia-Chong Chen,et al.  A PSO-BASED METHOD FOR EXTRACTING FUZZY RULES DIRECTLY FROM NUMERICAL DATA , 2006, Cybern. Syst..

[12]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[13]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[14]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[15]  E. Ozcan,et al.  Particle swarm optimization: surfing the waves , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[16]  Chang-Hyun Kim,et al.  Evolving Compact and Interpretable Takagi–Sugeno Fuzzy Models With a New Encoding Scheme , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  A. H. Jahanmiri,et al.  Eliciting transparent fuzzy model using differential evolution , 2008, Appl. Soft Comput..

[18]  Kamel Mohamed,et al.  Cooperative Particle Swarm Optimizers: A Powerful and Promising Approach , 2006 .

[19]  Visakan Kadirkamanathan,et al.  Stability analysis of the particle dynamics in particle swarm optimizer , 2006, IEEE Transactions on Evolutionary Computation.

[20]  Hasan A. Yousef,et al.  Adaptive fuzzy APSO based inverse tracking-controller with an application to DC motors , 2009, Expert Syst. Appl..

[21]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[22]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[23]  Russell C. Eberhart,et al.  Solving Constrained Nonlinear Optimization Problems with Particle Swarm Optimization , 2002 .

[24]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[25]  F. Gomide,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[26]  Chia-Feng Juang,et al.  Automatic construction of feedforward/recurrent fuzzy systems by clustering-aided simplex particle swarm optimization , 2007, Fuzzy Sets Syst..

[27]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[28]  Chun-Hee Woo,et al.  Evolutionary design of fuzzy rule base for nonlinear system modeling and control , 2000, IEEE Trans. Fuzzy Syst..

[29]  S. Kumar,et al.  A Comparison of Computational Efforts between Particle Swarm Optimization and Genetic Algorithm for Identification of Fuzzy Models , 2007, NAFIPS 2007 - 2007 Annual Meeting of the North American Fuzzy Information Processing Society.

[30]  A. Khosla,et al.  A Framework for Identification of Fuzzy Models through Particle Swarm Optimization Algorithm , 2005, 2005 Annual IEEE India Conference - Indicon.

[31]  Cheng-Jian Lin,et al.  An efficient immune-based symbiotic particle swarm optimization learning algorithm for TSK-type neuro-fuzzy networks design , 2008, Fuzzy Sets Syst..

[32]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[33]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[34]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[35]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..