Simultaneous Structure Identification and Fuzzy Rule Generation for Takagi–Sugeno Models

One of the main attractions of a fuzzy rule-based system is its interpretability which is hindered severely with an increase in the dimensionality of the data. For high-dimensional data, the identification of fuzzy rules also possesses a big challenge. Feature selection methods often ignore the subtle nonlinear interaction that the features and the learning system can have. To address this problem of structure identification, we propose an integrated method that can find the bad features simultaneously when finding the rules from data for Takagi-Sugeno-type fuzzy systems. It is an integrated learning mechanism that can take into account the nonlinear interactions that may be present between features and between features and fuzzy rule-based systems. Hence, it can pick up a small set of useful features and generate useful rules for the problem at hand. Such an approach is computationally very attractive because it is not iterative in nature like the forward or backward selection approaches. The effectiveness of the proposed approach is demonstrated on four function-approximation-type well-studied problems.

[1]  Shyi-Ming Chen,et al.  Forecasting enrollments based on fuzzy time series , 1996, Fuzzy Sets Syst..

[2]  Shyi-Ming Chen,et al.  Temperature prediction using fuzzy time series , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[3]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[4]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Stephen L. Chiu,et al.  Selecting Input Variables for Fuzzy Models , 1996, J. Intell. Fuzzy Syst..

[6]  H. Akaike A new look at the statistical model identification , 1974 .

[7]  Dimitar Filev,et al.  Generation of Fuzzy Rules by Mountain Clustering , 1994, J. Intell. Fuzzy Syst..

[8]  Isao Hayashi,et al.  Construction of fuzzy inference rules by NDF and NDFL , 1992, Int. J. Approx. Reason..

[9]  Kazuo Tanaka,et al.  Modeling and control of carbon monoxide concentration using a neuro-fuzzy technique , 1995, IEEE Trans. Fuzzy Syst..

[10]  Yinghua Lin,et al.  A new approach to fuzzy-neural system modeling , 1995, IEEE Trans. Fuzzy Syst..

[11]  James M. Keller,et al.  Fuzzy Models and Algorithms for Pattern Recognition and Image Processing , 1999 .

[12]  Héctor Pomares,et al.  A systematic approach to a self-generating fuzzy rule-table for function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[13]  Kun-Huang Huarng,et al.  A Multivariate Heuristic Model for Fuzzy Time-Series Forecasting , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  A. Paulson,et al.  Autoregressive Process Order Selection via Model-Critical Methods , 1987 .

[15]  Robert Babuska,et al.  Methods for Simplification of Fuzzy Models , 1997 .

[16]  Jin S. Lee,et al.  Hierarchical Fuzzy Logic Scheme with Constraints on the Fuzzy Rule , 2001, Intell. Autom. Soft Comput..

[17]  Nikhil R. Pal,et al.  Fuzzy logic approaches to structure preserving dimensionality reduction , 2002, IEEE Trans. Fuzzy Syst..

[18]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[19]  Jun Zhou,et al.  Hierarchical fuzzy control , 1991 .

[20]  Nikhil R. Pal,et al.  A neuro-fuzzy scheme for simultaneous feature selection and fuzzy rule-based classification , 2004, IEEE Transactions on Neural Networks.

[21]  Tiffany Hui-Kuang Yu,et al.  Ratio-based lengths of intervals to improve fuzzy time series forecasting , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Rajani K. Mudi,et al.  A new scheme for fuzzy rule-based system identification and its application to self-tuning fuzzy controllers , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[23]  Lawrence O. Hall,et al.  Fast clustering with application to fuzzy rule generation , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[24]  Nikhil R. Pal A fuzzy rule based approach to identify biomarkers for diagnostic classification of cancers , 2007, 2007 IEEE International Fuzzy Systems Conference.

[25]  Yaochu Jin,et al.  Fuzzy modeling of high-dimensional systems: complexity reduction and interpretability improvement , 2000, IEEE Trans. Fuzzy Syst..

[26]  Antonio F. Gómez-Skarmeta,et al.  A fuzzy clustering-based rapid prototyping for fuzzy rule-based modeling , 1997, IEEE Trans. Fuzzy Syst..

[27]  Jun Zhou,et al.  Adaptive hierarchical fuzzy controller , 1993, IEEE Trans. Syst. Man Cybern..

[28]  Jin S. Lee,et al.  A class of hierarchical fuzzy systems with constraints on the fuzzy rules , 2005, IEEE Transactions on Fuzzy Systems.

[29]  Michael R. Berthold,et al.  Input features' impact on fuzzy decision processes , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[30]  Isak Gath,et al.  Unsupervised Optimal Fuzzy Clustering , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Hui-Kuang Yu A refined fuzzy time-series model for forecasting , 2005 .

[32]  Nikhil R. Pal,et al.  Integrated feature analysis and fuzzy rule-based system identification in a neuro-fuzzy paradigm , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[33]  W. Pedrycz,et al.  Construction of fuzzy models through clustering techniques , 1993 .

[34]  Thomas A. Runkler,et al.  Identification of nonlinear systems using regular fuzzy c-elliptotype clustering , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[35]  Thomas A. Runkler,et al.  Some issues in system identification using clustering , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[36]  Chih-Ming Chen,et al.  An efficient fuzzy classifier with feature selection based on fuzzy entropy , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[37]  Jin S. Lee,et al.  Universal approximation by hierarchical fuzzy system with constraints on the fuzzy rule , 2002, Fuzzy Sets Syst..

[38]  H. Akaike Likelihood of a model and information criteria , 1981 .

[39]  Héctor Pomares,et al.  Structure identification in complete rule-based fuzzy systems , 2002, IEEE Trans. Fuzzy Syst..