Constructing fuzzy ensembles for pattern classification problems

This paper examines the performance of fuzzy classifier ensembles. In our fuzzy ensembles, there are multiple fuzzy rule-based classification systems and a single credit assignment system. The credit assignment system is generated from the classification results of individual fuzzy rule-based classification systems. Thus, the credit assignment system plays a role in mapping input space to a fuzzy rule-based classification system. Then the fuzzy rule-based classification system that is selected by the credit assignment system maps pattern space to class. In computer simulations in this paper, we show how our fuzzy classifier ensemble works on a simple two-dimensional pattern classification problem. We also show the classification performance on four real-world pattern classification problems: iris, appendicitis, cancer, and wine data sets. From the results of the computer simulations, we illustrate the low similarity between the fuzzy rule-based classification systems in our fuzzy classifier ensemble lead to high classification performance.

[1]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[2]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Roberto Battiti,et al.  Democracy in neural nets: Voting schemes for classification , 1994, Neural Networks.

[4]  Naonori Ueda,et al.  Generalization error of ensemble estimators , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[5]  Sung-Bae Cho,et al.  Fuzzy aggregation of modular neural networks with ordered weighted averaging operators , 1995, Int. J. Approx. Reason..

[6]  Hisao Ishibuchi,et al.  Voting in fuzzy rule-based systems for pattern classification problems , 1999, Fuzzy Sets Syst..

[7]  Sung-Bae Cho,et al.  Combining multiple neural networks by fuzzy integral for robust classification , 1995, IEEE Trans. Syst. Man Cybern..

[8]  Jon Atli Benediktsson,et al.  Consensus theoretic classification methods , 1992, IEEE Trans. Syst. Man Cybern..

[9]  Hisao Ishibuchi,et al.  Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[10]  Hisao Ishibuchi,et al.  A Boosting Algorithm of Fuzzy Rule-Based Systems for Pattern Classification Problems , 2002, FSKD.

[11]  Hisao Ishibuchi,et al.  Effect of rule weights in fuzzy rule-based classification systems , 2001, IEEE Trans. Fuzzy Syst..

[12]  Hisao Ishibuchi,et al.  Improving the performance of fuzzy classifier systems for pattern classification problems with continuous attributes , 1999, IEEE Trans. Ind. Electron..

[13]  Yufei Yuan,et al.  A genetic algorithm for generating fuzzy classification rules , 1996, Fuzzy Sets Syst..

[14]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[15]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[16]  Sung-Bae Cho,et al.  Multiple network fusion using fuzzy logic , 1995, IEEE Trans. Neural Networks.