A Self-Organizing Fuzzy Neural Network Based on a Growing-and-Pruning Algorithm

A novel growing-and-pruning (GP) approach is proposed, which optimizes the structure of a fuzzy neural network (FNN). This GP-FNN is based on radial basis function neurons, which have center and width vectors. The structure-learning phase and the parameter-training phase are performed concurrently. The structure-learning approach relies on the sensitivity analysis of the output. A set of fuzzy rules can be inserted or reduced during the learning process. The parameter-training algorithm is implemented using a supervised gradient decent method. The convergence of the GP-FNN-learning process is also discussed in this paper. The proposed method effectively generates a fuzzy neural model with a highly accurate and compact structure. Simulation results demonstrate that the proposed GP-FNN has a self-organizing ability, which can determine the structure and parameters of the FNN automatically. The algorithm performs better than some other existing self-organizing FNN algorithms.

[1]  Chin-Teng Lin,et al.  Support-vector-based fuzzy neural network for pattern classification , 2006, IEEE Transactions on Fuzzy Systems.

[2]  Francisco Herrera,et al.  Learning the membership function contexts for mining fuzzy association rules by using genetic algorithms , 2009, Fuzzy Sets Syst..

[3]  Russell C. Eberhart,et al.  Implementation of evolutionary fuzzy systems , 1999, IEEE Trans. Fuzzy Syst..

[4]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[5]  Wen-June Wang,et al.  New similarity measures on fuzzy sets and on elements , 1997, Fuzzy Sets Syst..

[6]  Meng Joo Er,et al.  A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks , 2001, IEEE Trans. Fuzzy Syst..

[7]  T. Martin McGinnity,et al.  Design for Self-Organizing Fuzzy Neural Networks Based on Genetic Algorithms , 2006, IEEE Transactions on Fuzzy Systems.

[8]  Zhi Liu,et al.  A Probabilistic Neural-Fuzzy Learning System for Stochastic Modeling , 2008, IEEE Transactions on Fuzzy Systems.

[9]  Amparo Alonso-Betanzos,et al.  A Very Fast Learning Method for Neural Networks Based on Sensitivity Analysis , 2006, J. Mach. Learn. Res..

[10]  Jinde Cao,et al.  Analysis of global exponential stability and periodic solutions of neural networks with time-varying delays , 2005, Neural Networks.

[11]  Christos S. Akratos,et al.  An artificial neural network model and design equations for BOD and COD removal prediction in horizontal subsurface flow constructed wetlands , 2008 .

[12]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[13]  Yu Zhao,et al.  Asymptotic stability analysis of neural networks with successive time delay components , 2008, Neurocomputing.

[14]  T. Martin McGinnity,et al.  An approach for on-line extraction of fuzzy rules using a self-organising fuzzy neural network , 2005, Fuzzy Sets Syst..

[15]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[16]  Edwin Lughofer,et al.  FLEXFIS: A Robust Incremental Learning Approach for Evolving Takagi–Sugeno Fuzzy Models , 2008, IEEE Transactions on Fuzzy Systems.

[17]  Rong-Jong Wai,et al.  Dynamic Control of Maglev Transportation System Via Adaptive Fuzzy-Neural-Network , 2007, 2007 International Joint Conference on Neural Networks.

[18]  Chia-Feng Juang,et al.  A Self-Evolving Interval Type-2 Fuzzy Neural Network With Online Structure and Parameter Learning , 2008, IEEE Transactions on Fuzzy Systems.

[19]  Kwang Bo Cho,et al.  Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction , 1996, Fuzzy Sets Syst..

[20]  John Sum,et al.  On-line estimation of the final prediction error via recursive least-squares method , 2006, Neurocomputing.

[21]  Yaonan Wang,et al.  A Selection Model for Optimal Fuzzy Clustering Algorithm and Number of Clusters Based on Competitive Comprehensive Fuzzy Evaluation , 2009, IEEE Transactions on Fuzzy Systems.

[22]  S. Kupongsak,et al.  Application of fuzzy set and neural network techniques in determining food process control set points , 2006, Fuzzy Sets Syst..

[23]  Chia-Feng Juang,et al.  Using self-organizing fuzzy network with support vector learning for face detection in color images , 2008, Neurocomputing.

[24]  Srinivasa Lingireddy,et al.  Backfilling missing microbial concentrations in a riverine database using artificial neural networks. , 2007, Water research.

[25]  Chia-Feng Juang,et al.  Hierarchical Cluster-Based Multispecies Particle-Swarm Optimization for Fuzzy-System Optimization , 2010, IEEE Transactions on Fuzzy Systems.

[26]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[27]  Meng Joo Er,et al.  Dynamic fuzzy neural networks-a novel approach to function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[28]  How Yong Ng,et al.  Influence of mixed liquor recycle ratio and dissolved oxygen on performance of pre-denitrification submerged membrane bioreactors. , 2008, Water research.

[29]  Chin-Teng Lin,et al.  An On-Line Self-Constructing Neural Fuzzy Inference Network and Its Applications , 1998 .

[30]  Kazimierz Duzinkiewicz,et al.  Hierarchical dissolved oxygen control for activated sludge processes , 2008 .

[31]  Huaicheng Guo,et al.  Water quality modeling for load reduction under uncertainty: a Bayesian approach. , 2008, Water research.

[32]  Paramasivan Saratchandran,et al.  Sequential Adaptive Fuzzy Inference System (SAFIS) for nonlinear system identification and prediction , 2006, Fuzzy Sets Syst..

[33]  Mats Ekman,et al.  Bilinear black-box identification and MPC of the activated sludge process , 2008 .

[34]  Chia-Feng Juang,et al.  A Self-Organizing TS-Type Fuzzy Network With Support Vector Learning and its Application to Classification Problems , 2007, IEEE Transactions on Fuzzy Systems.

[35]  Mietek A. Brdys,et al.  Dissolved Oxygen Control for Activated Sludge Processes , 2001 .

[36]  Chih-Lyang Hwang,et al.  Fuzzy Neural-Based Control for Nonlinear Time-Varying Delay Systems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[37]  A. Saltelli,et al.  Making best use of model evaluations to compute sensitivity indices , 2002 .

[38]  Alfred Jean Philippe Lauret,et al.  A node pruning algorithm based on a Fourier amplitude sensitivity test method , 2006, IEEE Transactions on Neural Networks.

[39]  José de Jesús Rubio,et al.  SOFMLS: Online Self-Organizing Fuzzy Modified Least-Squares Network , 2009, IEEE Transactions on Fuzzy Systems.

[40]  Junfei Qiao,et al.  A self-organizing fuzzy neural network and its applications to function approximation and forecast modeling , 2008, Neurocomputing.

[41]  Monique Polit,et al.  Fuzzy control of dissolved oxygen in a sequencing batch reactor pilot plant , 2005 .

[42]  Stefano Tarantola,et al.  Uncertainty and global sensitivity analysis of road transport emission estimates , 2004 .

[43]  Jung-Hsien Chiang,et al.  Support vector learning mechanism for fuzzy rule-based modeling: a new approach , 2004, IEEE Trans. Fuzzy Syst..

[44]  Rong-Jong Wai,et al.  Adaptive Fuzzy-Neural-Network Control for Maglev Transportation System , 2008, IEEE Transactions on Neural Networks.

[45]  Xingsheng Deng,et al.  Incremental learning of dynamic fuzzy neural networks for accurate system modeling , 2009, Fuzzy Sets Syst..

[46]  Meng Joo Er,et al.  A fast and accurate online self-organizing scheme for parsimonious fuzzy neural networks , 2009, Neurocomputing.