Structure identification of generalized adaptive neuro-fuzzy inference systems

This paper presents a method to identify the structure of generalized adaptive neuro-fuzzy inference systems (GANFISs). The structure of GANFIS consists of a number of generalized radial basis function (GRBF) units. The radial basis functions are irregularly distributed in the form of hyper-patches in the input-output space. The minimum number of GRBF units is selected based on a heuristic using the fuzzy curve. For structure identification, a new criterion called structure identification criterion (SIC) is proposed. SIC deals with a trade off between performance and computational complexity of the GANFIS model. The computational complexity of gradient descent learning is formulated based on simulation study. Three methods of initialization of GANFIS, viz., fuzzy curve, fuzzy C-means in x/spl times/y space and modified mountain clustering have been compared in terms of cluster validity measure, Akaike's information criterion (AIC) and the proposed SIC.

[1]  Andrzej Piegat,et al.  Fuzzy Modeling and Control , 2001 .

[2]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[3]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[4]  W. Light.  Some Aspects of Radial Basis Function Approximation , 1992 .

[5]  M. Hanmandlu,et al.  A new criteria for input variable identification of dynamical systems , 1998, Proceedings of IEEE TENCON '98. IEEE Region 10 International Conference on Global Connectivity in Energy, Computer, Communication and Control (Cat. No.98CH36229).

[6]  L X Wang,et al.  Fuzzy basis functions, universal approximation, and orthogonal least-squares learning , 1992, IEEE Trans. Neural Networks.

[7]  Roderick Murray-Smith,et al.  Extending the functional equivalence of radial basis function networks and fuzzy inference systems , 1996, IEEE Trans. Neural Networks.

[8]  Stephen A. Billings,et al.  Radial basis function network configuration using genetic algorithms , 1995, Neural Networks.

[9]  Joos Vandewalle,et al.  Identification of nonlinear discrete-time multivariable dynamical systems by RBF neural networks , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[10]  Yong-Zai Lu,et al.  Fuzzy Model Identification and Self-Learning for Dynamic Systems , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..

[12]  H. Akaike.  A new look at the statistical model identification , 1974 .

[13]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[14]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Yinghua Lin,et al.  A new approach to fuzzy-neural system modeling , 1995, IEEE Trans. Fuzzy Syst..

[16]  Narasimhan Sundararajan,et al.  Adaptive nonlinear system identification using minimal radial basis function neural networks , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[17]  John Yen,et al.  Radial basis function networks, regression weights, and the expectation-maximization algorithm , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[18]  Madasu Hanmandlu,et al.  Generalization of adaptive neuro-fuzzy inference systems , 2000, IEEE Trans. Neural Networks Learn. Syst..

[19]  Un-Chul Moon,et al.  A self-organizing fuzzy logic controller for dynamic systems using a fuzzy auto-regressive moving average (FARMA) model , 1995, IEEE Trans. Fuzzy Syst..

[20]  Masaharu Mizumoto,et al.  Fuzzy controls under various fuzzy reasoning methods , 1988, Inf. Sci..

[21]  Ebrahim Mamdani,et al.  Applications of fuzzy algorithms for control of a simple dynamic plant , 1974 .

[22]  Chuen-Chien Lee,et al.  Fuzzy logic in control systems: fuzzy logic controller. II , 1990, IEEE Trans. Syst. Man Cybern..

[23]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[24]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[25]  Chuen-Tsai Sun,et al.  Functional equivalence between radial basis function networks and fuzzy inference systems , 1993, IEEE Trans. Neural Networks.

[26]  Xiao-Jun Zeng,et al.  Approximation accuracy analysis of fuzzy systems as function approximators , 1996, IEEE Trans. Fuzzy Syst..

[27]  M. Sugeno,et al.  Structure identification of fuzzy model , 1988 .

[28]  Dimitar Filev,et al.  Unified structure and parameter identification of fuzzy models , 1993, IEEE Trans. Syst. Man Cybern..

[29]  I. J. Leontaritis,et al.  Model selection and validation methods for non-linear systems , 1987 .