Hybrid Stages Particle Swarm Optimization Learning Fuzzy Modeling Systems Design

An innovative hybrid stages particle swarm optimization (HSPSO) learning method, contains fuzzy c-mean (FCM) clustering, particle swarm optimization (PSO) and recursive least-squares, is developed to generate evolutional fuzzy modeling systems to approach three different nonlinear functions. In spite of the adaptive ability of PSO algorithm, its training result is not desirable for the reason of incomplete learning cycles. To actually approximate the desired output of the nonlinear function, the input-output training data is first clustered by FCM algorithm, and then some favorable features of training data will be got as initial population of the PSO. Finally, both recursive leastsquares and PSO are utilized to quickly regulate adjustable parameters to construct desired fuzzy modeling systems. After the procedure of the FCM, small initial swarms of PSO are not got by random process but direct selected from training patterns. Therefore, the proposed HSPSO-based fuzzy modeling system with small numbers of fuzzy rules and necessary initial population sizes is enough to approach high accuracy within a short training time. Simulation results compared with the standard PSO and other popular methods demonstrate the efficiency of the proposed fuzzy model systems.

[1]  Li-Xin Wang,et al.  A Course In Fuzzy Systems and Control , 1996 .

[2]  Dragan Kukolj,et al.  Design of adaptive Takagi-Sugeno-Kang fuzzy models , 2002, Appl. Soft Comput..

[3]  Ching-Chang Wong,et al.  A hybrid clustering and gradient descent approach for fuzzy modeling , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[4]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[5]  Shie-Jue Lee,et al.  A neuro-fuzzy system modeling with self-constructing rule generationand hybrid SVD-based learning , 2003, IEEE Trans. Fuzzy Syst..

[6]  Shigeo Abe,et al.  Function approximation based on fuzzy rules extracted from partitioned numerical data , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[7]  Y. Rahmat-Samii,et al.  Particle swarm optimization in electromagnetics , 2004, IEEE Transactions on Antennas and Propagation.

[8]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[9]  Ching-Chang Wong,et al.  A GA-based method for constructing fuzzy systems directly from numerical data , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[10]  Hsuan-Ming Feng,et al.  SELF-GENERATION FUZZY MODELING SYSTEMS THROUGH HIERARCHICAL RECURSIVE-BASED PARTICLE SWARM OPTIMIZATION , 2005, Cybern. Syst..

[11]  Antonio F. Gómez-Skarmeta,et al.  A fuzzy clustering-based rapid prototyping for fuzzy rule-based modeling , 1997, IEEE Trans. Fuzzy Syst..

[12]  James Kennedy,et al.  The particle swarm: social adaptation of knowledge , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[13]  Yoshikazu Fukuyama,et al.  A hybrid particle swarm optimization for distribution state estimation , 2003, 2003 IEEE Power Engineering Society General Meeting (IEEE Cat. No.03CH37491).

[14]  Bart Kosko,et al.  Fuzzy function approximation with ellipsoidal rules , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[15]  Wei-Yen Wang,et al.  Evolutionary learning of BMF fuzzy-neural networks using a reduced-form genetic algorithm , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[16]  Hsuan-Ming Feng,et al.  A self-tuning fuzzy control system design , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[17]  James C. Bezdek,et al.  Efficient Implementation of the Fuzzy c-Means Clustering Algorithms , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Chia-Feng Juang,et al.  A hybrid of genetic algorithm and particle swarm optimization for recurrent network design , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  W. Peizhuang Pattern Recognition with Fuzzy Objective Function Algorithms (James C. Bezdek) , 1983 .

[20]  Ching-Chang Wong,et al.  A Clustering-Based Method for Fuzzy Modeling , 1999 .

[21]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..