Nonadditive grey single-layer perceptron with Choquet integral for pattern classification problems using genetic algorithms

Since the output of a single-layer perceptron can be interpreted as the synthetic evaluation of the relationship between the input pattern and one class for two-class pattern classification problems, this paper proposes a novel perceptron with nonadditive property, named the grey single-layer perceptron, by measuring the grades of relationship between an input pattern and this class for individual attributes with the grey relational analysis. A nonlinear integral, namely the Choquet integral, with respect to the fuzzy measure serves as an activation function of a neuron to synthesize the performance values owing to the interaction among attributes. Moreover, the connection weights are interpreted as the degrees of importance of the respective input signals and can be determined by the genetic algorithm-based learning algorithm. The experimental results further demonstrate that the generalization ability of the proposed grey single-layer perceptron is better than or comparable to that of other fuzzy or non-fuzzy classification methods.

[1]  Yo-Ping Huang,et al.  Real-valued genetic algorithms for fuzzy grey prediction system , 1997, Fuzzy Sets Syst..

[2]  Gwo-Hshiung Tzeng,et al.  Identification of general fuzzy measures by genetic algorithms based on partial information , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[3]  Sam Kwong,et al.  Genetic Algorithms : Concepts and Designs , 1998 .

[4]  K. S. Tang,et al.  Genetic Algorithms: Concepts and Designs with Disk , 1999 .

[5]  Deng Ju-Long,et al.  Control problems of grey systems , 1982 .

[6]  Fang-Mei Tseng,et al.  Partitioned fuzzy integral multinomial logit model for Taiwan's internet telephony market , 2005 .

[7]  Yi-Chung Hu,et al.  Grey self-organizing feature maps , 2002, Neurocomputing.

[8]  Lakhmi C. Jain,et al.  Automatic generation of a neural network architecture using evolutionary computation , 1995, Proceedings Electronic Technology Directions to the Year 2000.

[9]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[10]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[11]  M. Sugeno FUZZY MEASURES AND FUZZY INTEGRALS—A SURVEY , 1993 .

[12]  Andrzej Osyczka,et al.  Evolutionary Algorithms for Single and Multicriteria Design Optimization , 2001 .

[13]  Witold Pedrycz,et al.  Face recognition using fuzzy Integral and wavelet decomposition method , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  George J. Klir,et al.  Genetic algorithms for determining fuzzy measures from data , 1998, J. Intell. Fuzzy Syst..

[15]  R. Palmer,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[16]  Kwong-Sak Leung,et al.  A genetic algorithm for determining nonadditive set functions in information fusion , 1999, Fuzzy Sets Syst..

[17]  Ludmila I. Kuncheva,et al.  Fuzzy Classifier Design , 2000, Studies in Fuzziness and Soft Computing.

[18]  M. Sugeno,et al.  A theory of fuzzy measures: Representations, the Choquet integral, and null sets , 1991 .

[19]  Hisao Ishibuchi,et al.  Three-objective genetics-based machine learning for linguistic rule extraction , 2001, Inf. Sci..

[20]  Patrick Siarry,et al.  A genetic algorithm for optimizing Takagi-Sugeno fuzzy rule bases , 1998, Fuzzy Sets Syst..

[21]  Sun-Yuan Kung,et al.  Decision-based neural networks with signal/image classification applications , 1995, IEEE Trans. Neural Networks.

[22]  Gwo-Hshiung Tzeng,et al.  Using fuzzy measures and habitual domains to analyze the public attitude and apply to the gas taxi policy , 2002, Eur. J. Oper. Res..

[23]  Efraim Turban,et al.  Neural Networks in Finance and Investing: Using Artificial Intelligence to Improve Real-World Performance , 1992 .

[24]  Gwo-Hshiung Tzeng,et al.  Hierarchical MADM with fuzzy integral for evaluating enterprise intranet web sites , 2005, Inf. Sci..

[25]  Chien-Ming Chen,et al.  A novel fuzzy logic system based on N-version programming , 2000, IEEE Trans. Fuzzy Syst..

[26]  HUA-KAI CHIOU,et al.  Fuzzy Multiple-Criteria Decision-Making Approach for Industrial Green Engineering , 2002, Environmental management.

[27]  M. Sugeno,et al.  Some quantities represented by the Choquet integral , 1993 .

[28]  Lakhmi C. Jain,et al.  Neural Network Training Using Genetic Algorithms , 1996 .

[29]  E. Mine Cinar,et al.  Neural Networks: A New Tool for Predicting Thrift Failures , 1992 .

[30]  Iuan-Yuan Lu,et al.  The evaluation of service quality using generalized Choquet integral , 2006, Inf. Sci..

[31]  Kwong-Sak Leung,et al.  Applying fuzzy measures and nonlinear integrals in data mining , 2005, Fuzzy Sets Syst..

[32]  M. Sugeno,et al.  An interpretation of fuzzy measures and the Choquet integral as an integral with respect to a fuzzy , 1989 .

[33]  菅野 道夫,et al.  Theory of fuzzy integrals and its applications , 1975 .

[34]  Madan M. Gupta,et al.  Fuzzy automata and decision processes , 1977 .

[35]  Sun-Yuan Kung,et al.  Digital neural networks , 1993, Prentice Hall Information and System Sciences Series.

[36]  G. Klir,et al.  Fuzzy Measure Theory , 1993 .

[37]  Jung-Hsien Chiang,et al.  Choquet fuzzy integral-based hierarchical networks for decision analysis , 1999, IEEE Trans. Fuzzy Syst..

[38]  Casimir A. Kulikowski,et al.  Computer Systems That Learn: Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning and Expert Systems , 1990 .

[39]  Michio Sugeno,et al.  Choquet integral and fuzzy measures on locally compact space , 1998, Fuzzy Sets Syst..

[40]  J. Ross Quinlan,et al.  Simplifying Decision Trees , 1987, Int. J. Man Mach. Stud..