A Generalized Online Self-constructing Fuzzy Neural Network

We propose a Generalized Online Self-constructing Fuzzy Neural Network (GOSFNN) which extends the ellipsoidal basis function (EBF) based fuzzy neural networks (FNNs) by permitting input variables to be modeled by dissymmetrical Gaussian functions (DGFs). Due to the flexibility and dissymmetry of left and right widths of the DGF, the partitioning made by DGFs in the input space is more flexible and more interpretable, and therefore results in a parsimonious FNN with high performance under the online learning algorithm. The geometric growing criteria and the error reduction ratio (ERR) method are incorporated into structure identification which implements an optimal and compact network structure. The GOSFNN starts with no hidden neurons and does not need to partition the input space a priori. In addition, all free parameters in premises and consequents are adjusted online based on the Extended Kalman Filter (EKF) method. The performance of the GOSFNN paradigm is compared with other well-known algorithms like ANFIS, OLS, GDFNN, SOFNN and FAOS-PFNN, etc., on a benchmark problem of multi-dimensional function approximation. Simulation results demonstrate that the proposed GOSFNN approach can facilitate a more powerful and parsimonious FNN with better performance of approximation and generalization.

[1]  Meng Joo Er,et al.  Dynamic fuzzy neural networks-a novel approach to function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[2]  Satish Kumar,et al.  Asymmetric subsethood-product fuzzy neural inference system (ASuPFuNIS) , 2005, IEEE Transactions on Neural Networks.

[3]  Chun-Fei Hsu,et al.  Adaptive asymmetric fuzzy neural network controller design via network structuring adaptation , 2008, Fuzzy Sets Syst..

[4]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[5]  John C. Platt A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[6]  Paramasivan Saratchandran,et al.  Performance evaluation of a sequential minimal radial basis function (RBF) neural network learning algorithm , 1998, IEEE Trans. Neural Networks.

[7]  Visakan Kadirkamanathan,et al.  A Function Estimation Approach to Sequential Learning with Neural Networks , 1993, Neural Computation.

[8]  Sushmita Mitra,et al.  Neuro-fuzzy rule generation: survey in soft computing framework , 2000, IEEE Trans. Neural Networks Learn. Syst..

[9]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[10]  Meng Joo Er,et al.  A fast and accurate online self-organizing scheme for parsimonious fuzzy neural networks , 2009, Neurocomputing.

[11]  T. Martin McGinnity,et al.  An approach for on-line extraction of fuzzy rules using a self-organising fuzzy neural network , 2005, Fuzzy Sets Syst..

[12]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[13]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[14]  Y. J. Chen,et al.  Simplification of fuzzy-neural systems using similarity analysis , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[15]  Xiang Li,et al.  An Online Self-Organizing Scheme for Parsimonious and Accurate Fuzzy Neural Networks , 2010, Int. J. Neural Syst..

[16]  Meng Joo Er,et al.  A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks , 2001, IEEE Trans. Fuzzy Syst..