Fusing Fuzzy Association Rule-Based Classifiers Using Sugeno Integral with Ordered Weighted Averaging Operators

The time or space complexity may considerably increase for a single classifier if all features are taken into account. Thus, it is reasonable to train a single classifier by partial features. Then, a set of multiple classifiers can be generated, and an aggregation of outputs from different classifiers is subsequently performed. The aim of this paper is to propose a classification system with a heuristic fusion scheme in which multiple fuzzy association rule-based classifiers with partial features are combined, and show the feasibility and effectiveness of fusing multiple classifiers through the Sugeno integral extended by ordered weighted averaging operators. In comparison with the Sugeno integral by computer simulations on the iris data and the appendicitis data show that the overall classification accuracy rate could be improved by the Sugeno integral with ordered weighted averaging operators. The experimental results further demonstrate that the proposed method performs well in comparison with other fuzzy or non-fuzzy classification methods.

[1]  Ching Y. Suen,et al.  Application of majority voting to pattern recognition: an analysis of its behavior and performance , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[2]  Hisao Ishibuchi,et al.  Adaptive fuzzy rule-based classification systems , 1996, IEEE Trans. Fuzzy Syst..

[3]  Aureli Soria-Frisch,et al.  Unsupervised construction of fuzzy measures through self-organizing feature maps and its application in color image segmentation , 2006, Int. J. Approx. Reason..

[4]  Tzung-Pei Hong,et al.  Mining Fuzzy Multiple-Level Association Rules from Quantitative Data , 2004, Applied Intelligence.

[5]  Ludmila I. Kuncheva,et al.  Generating classifier outputs of fixed accuracy and diversity , 2002, Pattern Recognit. Lett..

[6]  M. Shaw,et al.  Induction of fuzzy decision trees , 1995 .

[7]  Hans-Jürgen Zimmermann,et al.  Pattern classification with principal component analysis and fuzzy rule bases , 2000, Eur. J. Oper. Res..

[8]  Janusz Kacprzyk,et al.  The Ordered Weighted Averaging Operators , 1997 .

[9]  Kwong-Sak Leung,et al.  Applying fuzzy measures and nonlinear integrals in data mining , 2005, Fuzzy Sets Syst..

[10]  Sung-Bae Cho,et al.  Multiple network fusion using fuzzy logic , 1995, IEEE Trans. Neural Networks.

[11]  Gwo-Hshiung Tzeng,et al.  Using fuzzy integral for evaluating subjectively perceived travel costs in a traffic assignment model , 2001, Eur. J. Oper. Res..

[12]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[13]  Ching Y. Suen,et al.  Optimal combinations of pattern classifiers , 1995, Pattern Recognit. Lett..

[14]  Sung-Bae Cho,et al.  Fuzzy aggregation of modular neural networks with ordered weighted averaging operators , 1995, Int. J. Approx. Reason..

[15]  Ludmila I. Kuncheva,et al.  Using measures of similarity and inclusion for multiple classifier fusion by decision templates , 2001, Fuzzy Sets Syst..

[16]  Ronald R. Yager,et al.  On ordered weighted averaging aggregation operators in multicriteria decisionmaking , 1988, IEEE Trans. Syst. Man Cybern..

[17]  James M. Keller,et al.  Information fusion in computer vision using the fuzzy integral , 1990, IEEE Trans. Syst. Man Cybern..

[18]  Ying Li,et al.  A Fuzzy Integral Method of Applying Support Vector Machine for Multi-class Problem , 2006, ICNC.

[19]  Yi-Chung Hu,et al.  A NEW FUZZY-DATA MINING METHOD FOR PATTERN CLASSIFICATION BY PRINCIPAL COMPONENT ANALYSIS , 2005, Cybern. Syst..

[20]  Sung-Bae Cho,et al.  Combining multiple neural networks by fuzzy integral for robust classification , 1995, IEEE Trans. Syst. Man Cybern..

[21]  Hisao Ishibuchi,et al.  Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[22]  Patrick Siarry,et al.  A genetic algorithm for optimizing Takagi-Sugeno fuzzy rule bases , 1998, Fuzzy Sets Syst..

[23]  Steven J. Simske,et al.  Performance analysis of pattern classifier combination by plurality voting , 2003, Pattern Recognit. Lett..

[24]  Witold Pedrycz,et al.  Face recognition using fuzzy Integral and wavelet decomposition method , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  D Wang,et al.  Use of fuzzy-logic-inspired features to improve bacterial recognition through classifier fusion , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[26]  Madan M. Gupta,et al.  Fuzzy automata and decision processes , 1977 .

[27]  Kwong-Sak Leung,et al.  A new type of nonlinear integrals and the computational algorithm , 2000, Fuzzy Sets Syst..

[28]  Gwo-Hshiung Tzeng,et al.  Using fuzzy measures and habitual domains to analyze the public attitude and apply to the gas taxi policy , 2002, Eur. J. Oper. Res..

[29]  H. Ishibuchi,et al.  Distributed representation of fuzzy rules and its application to pattern classification , 1992 .

[30]  R. Galen,et al.  The assessment of laboratory tests in the diagnosis of acute appendicitis. , 1983, American journal of clinical pathology.

[31]  Eric Bauer,et al.  An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants , 1999, Machine Learning.

[32]  S. K. Basu,et al.  Robust classification of multispectral data using multiple neural networks and fuzzy integral , 1997, IEEE Trans. Geosci. Remote. Sens..

[33]  Keon Myung Lee,et al.  Identification of λ-fuzzy measure by genetic algorithms , 1995, Fuzzy Sets Syst..

[34]  Hisao Ishibuchi,et al.  Voting in fuzzy rule-based systems for pattern classification problems , 1999, Fuzzy Sets Syst..

[35]  Kwong-Sak Leung,et al.  Determining nonnegative monotone set functions based on Sugeno's integral: an application of genetic algorithms , 2000, Fuzzy Sets Syst..

[36]  Tzung-Pei Hong,et al.  Trade-off Between Computation Time and Number of Rules for Fuzzy Mining from Quantitative Data , 2001, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[37]  W. Pedrycz,et al.  An introduction to fuzzy sets : analysis and design , 1998 .

[38]  HUA-KAI CHIOU,et al.  Fuzzy Multiple-Criteria Decision-Making Approach for Industrial Green Engineering , 2002, Environmental management.

[39]  M. Sugeno,et al.  Fuzzy measure analysis of public attitude towards the use of nuclear energy , 1986 .

[40]  Ronald R. Yager Element selection from a fuzzy subset using the fuzzy integral , 1993, IEEE Trans. Syst. Man Cybern..

[41]  Vicenç Torra,et al.  Twofold integral and multi-step Choquet integral , 2004, Kybernetika.