A decomposition approach for fuzzy systems identification

This paper develops a novel approach to building Sugeno-type models. This approach consists of two steps: First, a fuzzy discretization technique is used to determine the membership functions of input variables, which is the most difficult aspect in constructing a Sugeno-type model. Second, an iterative algorithm, known as the EM algorithm, is used to estimate the parameters of linear regression models in the consequent part of the model. The approach has two salient features: 1) The premise identification and the consequence identification of the model can be separated through use of the fuzzy discretization technique, while these are mutually related in previous methods. This greatly simplifies the process of model construction. 2) The complex multiparameter optimization problem essential for building the model can be decomposed into L smaller-scale optimization problems by means of the EM algorithm, where L is the number of fuzzy rules. Hence, the complexity of this approach is essentially unaffected by the number of fuzzy rules in the model. Moreover, Because of the clear separation in algorithmic structure, the proposed approach can also be easily implemented on a parallel computer.

[1]  Liang Wang,et al.  Complex systems modeling via fuzzy logic , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[2]  Reza Langari,et al.  A modified RBF network with application to system identification , 1995, Proceedings of International Conference on Control Applications.

[3]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[4]  Tohru Katayama,et al.  Parameter identification for noisy image via the EM algorithm , 1990 .

[5]  Witold Pedrycz Identification in fuzzy systems , 1984, IEEE Transactions on Systems, Man, and Cybernetics.

[6]  Robert A. Jacobs,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1993, Neural Computation.

[7]  Ehud Weinstein,et al.  Parameter estimation of superimposed signals using the EM algorithm , 1988, IEEE Trans. Acoust. Speech Signal Process..

[8]  M. Sugeno,et al.  Structure identification of fuzzy model , 1988 .

[9]  Reza Langari,et al.  Building Sugeno-type models using fuzzy discretization and orthogonal parameter estimation techniques , 1995, IEEE Trans. Fuzzy Syst..

[10]  R. B. Newell,et al.  Fuzzy identification and control of a liquid level rig , 1988 .

[11]  D. A. Linkens Parallel processing for self-organizing control systems , 1993 .

[12]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[13]  R. Shumway,et al.  AN APPROACH TO TIME SERIES SMOOTHING AND FORECASTING USING THE EM ALGORITHM , 1982 .

[14]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[15]  L X Wang,et al.  Fuzzy basis functions, universal approximation, and orthogonal least-squares learning , 1992, IEEE Trans. Neural Networks.

[16]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[17]  Reza Langari,et al.  Fuzzy models, modular networks, and hybrid learning , 1996, Fuzzy Sets Syst..

[18]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[19]  Yong-Zai Lu,et al.  Fuzzy Model Identification and Self-Learning for Dynamic Systems , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[20]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[21]  W. Peizhuang Pattern Recognition with Fuzzy Objective Function Algorithms (James C. Bezdek) , 1983 .

[22]  W. Pedrycz An identification algorithm in fuzzy relational systems , 1984 .

[23]  Dimitar Filev,et al.  Unified structure and parameter identification of fuzzy models , 1993, IEEE Trans. Syst. Man Cybern..