A novel fuzzy classifier with Choquet integral-based grey relational analysis for pattern classification problems

This paper aims to propose a fuzzy classifier, which is a one-class-in-one-network structure consisting of multiple novel single-layer perceptrons. Since the output value of each single-layer perceptron can be interpreted as the overall grade of the relationship between the input pattern and one class, the degree of relationship between an attribute of the input pattern and that of this class can be taken into account by establishing a representative pattern for each class. A feature of this paper is that it employs the grey relational analysis to compute the grades of relationship for individual attributes. In particular, instead of using the sigmoid function as the activation function, a non-additive technique, the Choquet integral, is used as an activation function to synthesize the performance values, since an assumption of noninteraction among attributes may not be reasonable. Thus, a single-layer perceptron in the proposed structure performs the synthetic evaluation of the Choquet integral-based grey relational analysis for a pattern. Each connection weight is interpreted as a degree of importance of an attribute and can be determined by a genetic algorithm-based method. The experimental results further demonstrate that the test results of the proposed fuzzy classifier are better than or comparable to those of other fuzzy or non-fuzzy classification methods.

[1]  Ludmila I. Kuncheva,et al.  Fuzzy Classifier Design , 2000, Studies in Fuzziness and Soft Computing.

[2]  Madan M. Gupta,et al.  Fuzzy automata and decision processes , 1977 .

[3]  Ronald R. Yager Element selection from a fuzzy subset using the fuzzy integral , 1993, IEEE Trans. Syst. Man Cybern..

[4]  Ferenc Szeifert,et al.  Data-driven generation of compact, accurate, and linguistically sound fuzzy classifiers based on a decision-tree initialization , 2003, Int. J. Approx. Reason..

[5]  Hisao Ishibuchi,et al.  Three-objective genetics-based machine learning for linguistic rule extraction , 2001, Inf. Sci..

[6]  Sun-Yuan Kung,et al.  Digital neural networks , 1993, Prentice Hall Information and System Sciences Series.

[7]  G. Klir,et al.  Fuzzy Measure Theory , 1993 .

[8]  M. Sugeno,et al.  An interpretation of fuzzy measures and the Choquet integral as an integral with respect to a fuzzy , 1989 .

[9]  菅野 道夫,et al.  Theory of fuzzy integrals and its applications , 1975 .

[10]  Fang-Mei Tseng,et al.  Partitioned fuzzy integral multinomial logit model for Taiwan's internet telephony market , 2005 .

[11]  Lakhmi C. Jain,et al.  Automatic generation of a neural network architecture using evolutionary computation , 1995, Proceedings Electronic Technology Directions to the Year 2000.

[12]  Yo-Ping Huang,et al.  Real-valued genetic algorithms for fuzzy grey prediction system , 1997, Fuzzy Sets Syst..

[13]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[14]  R. Palmer,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[15]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[16]  Michio Sugeno,et al.  Choquet integral and fuzzy measures on locally compact space , 1998, Fuzzy Sets Syst..

[17]  M. Sugeno FUZZY MEASURES AND FUZZY INTEGRALS—A SURVEY , 1993 .

[18]  Andrzej Osyczka,et al.  Evolutionary Algorithms for Single and Multicriteria Design Optimization , 2001 .

[19]  Gwo-Hshiung Tzeng,et al.  Hierarchical MADM with fuzzy integral for evaluating enterprise intranet web sites , 2005, Inf. Sci..

[20]  Kwong-Sak Leung,et al.  Applying fuzzy measures and nonlinear integrals in data mining , 2005, Fuzzy Sets Syst..

[21]  Jian Li,et al.  Reducing the Overfitting of Adaboost by Controlling its Data Distribution Skewness , 2006, Int. J. Pattern Recognit. Artif. Intell..

[22]  Jung-Hsien Chiang,et al.  Choquet fuzzy integral-based hierarchical networks for decision analysis , 1999, IEEE Trans. Fuzzy Syst..

[23]  Casimir A. Kulikowski,et al.  Computer Systems That Learn: Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning and Expert Systems , 1990 .

[24]  Patrick Siarry,et al.  A genetic algorithm for optimizing Takagi-Sugeno fuzzy rule bases , 1998, Fuzzy Sets Syst..

[25]  K. S. Tang,et al.  Genetic Algorithms: Concepts and Designs with Disk , 1999 .

[26]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[27]  Kwong-Sak Leung,et al.  A genetic algorithm for determining nonadditive set functions in information fusion , 1999, Fuzzy Sets Syst..

[28]  Ronald R. Yager,et al.  On ordered weighted averaging aggregation operators in multicriteria decisionmaking , 1988, IEEE Trans. Syst. Man Cybern..

[29]  Chien-Ming Chen,et al.  A novel fuzzy logic system based on N-version programming , 2000, IEEE Trans. Fuzzy Syst..

[30]  HUA-KAI CHIOU,et al.  Fuzzy Multiple-Criteria Decision-Making Approach for Industrial Green Engineering , 2002, Environmental management.

[31]  M. Sugeno,et al.  Some quantities represented by the Choquet integral , 1993 .

[32]  Lakhmi C. Jain,et al.  Neural Network Training Using Genetic Algorithms , 1996 .

[33]  Sam Kwong,et al.  Genetic Algorithms : Concepts and Designs , 1998 .

[34]  Deng Ju-Long,et al.  Control problems of grey systems , 1982 .

[35]  Sun-Yuan Kung,et al.  Decision-based neural networks with signal/image classification applications , 1995, IEEE Trans. Neural Networks.

[36]  Gwo-Hshiung Tzeng,et al.  Using fuzzy measures and habitual domains to analyze the public attitude and apply to the gas taxi policy , 2002, Eur. J. Oper. Res..

[37]  M. Sugeno,et al.  A theory of fuzzy measures: Representations, the Choquet integral, and null sets , 1991 .

[38]  Hisao Ishibuchi,et al.  Hybridization of fuzzy GBML approaches for pattern classification problems , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).