A novel hybrid algorithm for creating self-organizing fuzzy neural networks

A novel hybrid algorithm based on a genetic algorithm and particle swarm optimization to design a fuzzy neural network, named self-organizing fuzzy neural network based on GA and PSO (SOFNNGAPSO), to implement Takagi-Sugeno (TS) type fuzzy models is proposed in this paper. The proposed algorithm, as a new hybrid algorithm, consists of two phases. A tuning based on TS's fuzzy model is applied to identify the fuzzy structure, and also a fuzzy cluster validity index is utilized to determine the optimal number of clusters. To obtain a more precision model, GA and PSO are performed to conduct fine tuning for the obtained parameter set of the premise parts and consequent parts in the aforementioned fuzzy model. The proposed algorithm is successfully applied to three tested examples.

[1]  Frank Klawonn,et al.  Constructing a fuzzy controller from data , 1997, Fuzzy Sets Syst..

[2]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[3]  Kwang Bo Cho,et al.  Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction , 1996, Fuzzy Sets Syst..

[4]  T. Martin McGinnity,et al.  An on-line algorithm for creating self-organizing fuzzy neural networks , 2004, Neural Networks.

[5]  Meng Joo Er,et al.  Dynamic fuzzy neural networks-a novel approach to function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[6]  Antonio F. Gómez-Skarmeta,et al.  About the use of fuzzy clustering techniques for fuzzy model identification , 1999, Fuzzy Sets Syst..

[7]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[8]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[9]  Andreas Kroll,et al.  Identification of functional fuzzy models using multidimensional reference fuzzy sets , 1996, Fuzzy Sets Syst..

[10]  A. Rosenfeld,et al.  IEEE TRANSACTIONS ON SYSTEMS , MAN , AND CYBERNETICS , 2022 .

[11]  Germano Lambert-Torres,et al.  A genetic-based neuro-fuzzy approach for modeling and control of dynamical systems , 1998, IEEE Trans. Neural Networks.

[12]  Hao Ying,et al.  Essentials of fuzzy modeling and control , 1995 .

[13]  Junfei Qiao,et al.  A self-organizing fuzzy neural network and its applications to function approximation and forecast modeling , 2008, Neurocomputing.

[14]  Li-Xin Wang,et al.  Adaptive fuzzy systems and control - design and stability analysis , 1994 .

[15]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[16]  Zne-Jung Lee,et al.  A genetic algorithm based robust learning credit assignment cerebellar model articulation controller , 2004, Appl. Soft Comput..

[17]  Euntai Kim,et al.  A transformed input-domain approach to fuzzy modeling , 1998, IEEE Trans. Fuzzy Syst..

[18]  Euntai Kim,et al.  A new approach to fuzzy modeling , 1997, IEEE Trans. Fuzzy Syst..

[19]  Abdulkadir Sengür,et al.  Comparison of clustering algorithms for analog modulation classification , 2006, Expert Syst. Appl..

[20]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[21]  T. Martin McGinnity,et al.  A design for a self-organizing fuzzy neural network based on the genetic algorithm , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[22]  Song-Shyong Chen,et al.  Robust TSK fuzzy modeling for function approximation with outliers , 2001, IEEE Trans. Fuzzy Syst..

[23]  George E. Tsekouras,et al.  A hierarchical fuzzy-clustering approach to fuzzy modeling , 2004, Fuzzy Sets Syst..

[24]  W. Peizhuang.  Pattern Recognition with Fuzzy Objective Function Algorithms (James C. Bezdek) , 1983 .

[25]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[26]  Ujjwal Maulik,et al.  A study of some fuzzy cluster validity indices, genetic clustering and application to pixel classification , 2005, Fuzzy Sets Syst..

[27]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[28]  Zne-Jung Lee.  A novel hybrid algorithm for function approximation , 2008, Expert Syst. Appl..

[29]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[30]  Meng Joo Er,et al.  A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks , 2001, IEEE Trans. Fuzzy Syst..

[31]  T. Martin McGinnity,et al.  Design for Self-Organizing Fuzzy Neural Networks Based on Genetic Algorithms , 2006, IEEE Transactions on Fuzzy Systems.

[32]  H Tanaka,et al.  A SIMPLE BUT POWERFUL METHOD FOR GENERATING FUZZY RULES FROM NUMERICAL DATA , 1997 .

[33]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[34]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[35]  Hichem Frigui,et al.  A Robust Competitive Clustering Algorithm With Applications in Computer Vision , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Chou-Yuan Lee,et al.  Efficiently solving general weapon-target assignment problem by genetic algorithms with greedy eugenics , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[37]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[38]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[39]  Hisao Ishibuchi,et al.  A simple but powerful heuristic method for generating fuzzy rules from numerical data , 1997, Fuzzy Sets Syst..

[40]  Abdulkadir Sengur,et al.  Comparison of clustering algorithms for analog modulation classification , 2006 .

[41]  Bart Kosko,et al.  Fuzzy function approximation with ellipsoidal rules , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[42]  Chi-Jen Huang,et al.  A particle swarm optimization to identifying the ARMAX model for short-term load forecasting , 2005, IEEE Transactions on Power Systems.

[43]  Rajesh N. Davé,et al.  Robust clustering methods: a unified view , 1997, IEEE Trans. Fuzzy Syst..

[44]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (2nd, extended ed.) , 1994 .