An Online Self-organizing Neuro-Fuzzy System from training data

In this paper, we design a novel Online Self-constructing Neuro-Fuzzy System (OSNFS) based on the proposed generalized ellipsoidal basis functions (GEBF). Due to the flexibility and dissymmetry of the GEBF, the partitioning made by GEBFs in the input space is more flexible and more economical, and therefore results in a parsimonious neuro-fuzzy system (NFS) with high performance under the online learning algorithm. The geometric growing criteria and the error reduction ratio (ERR) method are used as growing and pruning strategies respectively to realize the structure learning algorithm which implements an optimal and compact network structure. The proposed OSNFS starts with no fuzzy rules and does not need to partition the input space a priori. In addition, all the free parameters in premises and consequents are adjusted online based on the ε-completeness of fuzzy rules and the linear least square (LLS) approach, respectively. The performance of the proposed OSNFS is compared with other well-known algorithms on a benchmark problem in nonlinear dynamic system identification. Simulation results demonstrate that the proposed OSNFS approach can facilitate a compact and economical NFS with better approximation performance.

[1]  Ning Wang,et al.  A fast and parsimonious fuzzy neural network (FPFNN) for function approximation , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[2]  Visakan Kadirkamanathan,et al.  A Function Estimation Approach to Sequential Learning with Neural Networks , 1993, Neural Computation.

[3]  Chun-Fei Hsu,et al.  Adaptive asymmetric fuzzy neural network controller design via network structuring adaptation , 2008, Fuzzy Sets Syst..

[4]  Sushmita Mitra,et al.  Neuro-fuzzy rule generation: survey in soft computing framework , 2000, IEEE Trans. Neural Networks Learn. Syst..

[5]  Meng Joo Er,et al.  A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks , 2001, IEEE Trans. Fuzzy Syst..

[6]  W. Leithead,et al.  A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks , 2001, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[7]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[8]  T. Martin McGinnity,et al.  Design for Self-Organizing Fuzzy Neural Networks Based on Genetic Algorithms , 2006, IEEE Transactions on Fuzzy Systems.

[9]  Héctor Pomares,et al.  Time series analysis using normalized PG-RBF network with regression weights , 2002, Neurocomputing.

[10]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[11]  Kwang Bo Cho,et al.  Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction , 1996, Fuzzy Sets Syst..

[12]  John C. Platt.  A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[13]  Meng Joo Er,et al.  Dynamic fuzzy neural networks-a novel approach to function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[14]  Satish Kumar,et al.  Asymmetric subsethood-product fuzzy neural inference system (ASuPFuNIS) , 2005, IEEE Transactions on Neural Networks.

[15]  Y Lu,et al.  A Sequential Learning Scheme for Function Approximation Using Minimal Radial Basis Function Neural Networks , 1997, Neural Computation.

[16]  Li-Xin Wang,et al.  Adaptive fuzzy systems and control - design and stability analysis , 1994 .

[17]  T. Martin McGinnity,et al.  An approach for on-line extraction of fuzzy rules using a self-organising fuzzy neural network , 2005, Fuzzy Sets Syst..

[18]  Julio Ortega Lopera,et al.  Improved RAN sequential prediction using orthogonal techniques , 2001, Neurocomputing.

[19]  Meng Joo Er,et al.  A fast and accurate online self-organizing scheme for parsimonious fuzzy neural networks , 2009, Neurocomputing.