Fuzzy rule extraction from typicality and membership partitions

This paper proposes extracting fuzzy rules from data using fuzzy possibilistic c-means and possibilistic fuzzy c-means algorithms, which provide more than one partition information: the typicality matrix and the membership matrix. Usually to extract fuzzy rules from data only one of the partition matrix is used, resulting in one rule per cluster. In our work we extract rules from both the membership partition matrix and the typicality matrix, resulting in deriving multiple rules for each cluster. These methods are applied to fuzzy modeling of four different classification problems: Iris, Wine, Wisconsin breast cancer and Altman data sets. The performance of the obtained models is compared and we consider the added value of the proposed approach in fuzzy modeling.

[1]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data: Little/Statistical Analysis with Missing Data , 2002 .

[2]  Rui Jorge Almeida,et al.  A New Feature Selection Criterion for Fuzzy Classification , 2006, 2006 IEEE International Conference on Fuzzy Systems.

[3]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[4]  James C. Bezdek,et al.  A mixed c-means clustering model , 1997, Proceedings of 6th International Fuzzy Systems Conference.

[5]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[6]  Vincent Kanade,et al.  Clustering Algorithms , 2021, Wireless RF Energy Transfer in the Massive IoT Era.

[7]  D. J. Newman,et al.  UCI Repository of Machine Learning Database , 1998 .

[8]  T. Schneider.  Analysis of Incomplete Climate Data: Estimation of Mean Values and Covariance Matrices and Imputation of Missing Values. , 2001 .

[9]  Uzay Kaymak,et al.  Fuzzy Decision Making in Modeling and Control , 2002, World Scientific Series in Robotics and Intelligent Systems.

[10]  Shyi-Ming Chen,et al.  A new method for constructing membership functions and fuzzy rules from training examples , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[11]  Heiko Timm,et al.  Differentiated Treatment of Missing Values in Fuzzy Clustering , 2003, IFSA.

[12]  J. Bezdek.  Numerical taxonomy with fuzzy sets , 1974 .

[13]  Héctor Pomares,et al.  Self-organized fuzzy system generation from training examples , 2000, IEEE Trans. Fuzzy Syst..

[14]  Uzay Kaymak,et al.  Fuzzy classification using probability-based rule weighting , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[15]  David E. Booth,et al.  Analysis of Incomplete Multivariate Data , 2000, Technometrics.

[16]  Shigeo Abe,et al.  Function approximation based on fuzzy rules extracted from partitioned numerical data , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[17]  James M. Keller,et al.  A possibilistic fuzzy c-means clustering algorithm , 2005, IEEE Transactions on Fuzzy Systems.

[18]  William Nick Street,et al.  Breast Cancer Diagnosis and Prognosis Via Linear Programming , 1995, Oper. Res..

[19]  Edward I. Altman,et al.  FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY , 1968 .

[20]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[21]  W. Pedrycz,et al.  Fuzzy computing for data mining , 1999, Proc. IEEE.

[22]  Uzay Kaymak,et al.  Similarity measures in fuzzy rule base simplification , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[23]  Magne Setnes,et al.  GA-fuzzy modeling and classification: complexity and performance , 2000, IEEE Trans. Fuzzy Syst..

[24]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[25]  James M. Keller,et al.  A possibilistic approach to clustering , 1993, IEEE Trans. Fuzzy Syst..

[26]  James M. Keller,et al.  The possibilistic C-means algorithm: insights and recommendations , 1996, IEEE Trans. Fuzzy Syst..