Classification performance evaluation of single-layer perceptron with Choquet integral-based TOPSIS

Abstract This paper interprets an output of the single-layer perceptron as the synthetic evaluation of the similarity between the input pattern and two classes for two-class pattern classification problems. For this, an appropriate tool for multiple attribute decision making, TOPSIS, can be an appropriate tool. A novel single-layer perceptron based on the TOPSIS is proposed by measuring the grades of similarity between an input pattern and the typical patterns of the respective classes. To obtain the relative similarity in terms of certain distance measure, since the interaction among attributes cannot be ignored, the nonlinear Choquet integral with respect to the fuzzy measure is incorporated into the activation function. Moreover, a genetic algorithm-based method is designed to determine the connection weights, which are interpreted as the degrees of importance of the respective input signals. The experimental results further demonstrate that classification results obtained by the single-layer perceptron with the Choquet integral-based TOPSIS are comparable to those obtained by the other fuzzy or non-fuzzy classification methods.

[1]  Andrzej Osyczka,et al.  Evolutionary Algorithms for Single and Multicriteria Design Optimization , 2001 .

[2]  Michio Sugeno,et al.  Choquet integral and fuzzy measures on locally compact space , 1998, Fuzzy Sets Syst..

[3]  Iuan-Yuan Lu,et al.  The evaluation of service quality using generalized Choquet integral , 2006, Inf. Sci..

[4]  G. Lewicki,et al.  Approximation by Superpositions of a Sigmoidal Function , 2003 .

[5]  Kwong-Sak Leung,et al.  Applying fuzzy measures and nonlinear integrals in data mining , 2005, Fuzzy Sets Syst..

[6]  Witold Pedrycz,et al.  Face recognition using fuzzy Integral and wavelet decomposition method , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Sun-Yuan Kung,et al.  Decision-based neural networks with signal/image classification applications , 1995, IEEE Trans. Neural Networks.

[8]  Chaoyong Zhang,et al.  Identification of λ-fuzzy Measure by Modified Genetic Algorithms , 2009, 2009 Sixth International Conference on Fuzzy Systems and Knowledge Discovery.

[9]  Frederick Zarndt,et al.  A Comprehensive Case Study: An Examination of Machine Learning and Connectionist Algorithms , 1995 .

[10]  M. Sugeno,et al.  A theory of fuzzy measures: Representations, the Choquet integral, and null sets , 1991 .

[11]  Ching-Lai Hwang,et al.  Fuzzy Multiple Attribute Decision Making - Methods and Applications , 1992, Lecture Notes in Economics and Mathematical Systems.

[12]  Hisao Ishibuchi,et al.  Hybridization of fuzzy GBML approaches for pattern classification problems , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Yoh-Han Pao,et al.  Adaptive pattern recognition and neural networks , 1989 .

[14]  Gwo-Hshiung Tzeng,et al.  Using fuzzy measures and habitual domains to analyze the public attitude and apply to the gas taxi policy , 2002, Eur. J. Oper. Res..

[15]  Sheng-Hshiung Tsaur,et al.  The evaluation of airline service quality by fuzzy MCDM. , 2002 .

[16]  Ching-Lai Hwang,et al.  Multiple Attribute Decision Making: Methods and Applications - A State-of-the-Art Survey , 1981, Lecture Notes in Economics and Mathematical Systems.

[17]  Aistis Raudys,et al.  MLP Based Linear Fea ure Ex rac ion for Nonlinearly Separable Data , 2001, Pattern Analysis & Applications.

[18]  Gwo-Hshiung Tzeng,et al.  Hierarchical MADM with fuzzy integral for evaluating enterprise intranet web sites , 2005, Inf. Sci..

[19]  Jung-Hsien Chiang,et al.  Choquet fuzzy integral-based hierarchical networks for decision analysis , 1999, IEEE Trans. Fuzzy Syst..

[20]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[21]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[22]  George J. Klir,et al.  Genetic algorithms for determining fuzzy measures from data , 1998, J. Intell. Fuzzy Syst..

[23]  K. S. Tang,et al.  Genetic Algorithms: Concepts and Designs with Disk , 1999 .

[24]  Edward I. Altman,et al.  FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY , 1968 .

[25]  G. Peter Zhang.  Neural Networks in Business Forecasting , 2003 .

[26]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[27]  Kwong-Sak Leung,et al.  A genetic algorithm for determining nonadditive set functions in information fusion , 1999, Fuzzy Sets Syst..

[28]  Gwo-Hshiung Tzeng,et al.  Identification of general fuzzy measures by genetic algorithms based on partial information , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[29]  Fang-Mei Tseng,et al.  Partitioned fuzzy integral multinomial logit model for Taiwan's internet telephony market , 2005 .

[30]  E. Mine Cinar,et al.  Neural Networks: A New Tool for Predicting Thrift Failures , 1992 .

[31]  E. Altman.  Corporate financial distress : a complete guide to predicting, avoiding, and dealing with bankruptcy , 1983 .

[32]  Ludmila I. Kuncheva,et al.  Fuzzy Classifier Design , 2000, Studies in Fuzziness and Soft Computing.

[33]  Hisao Ishibuchi,et al.  Three-objective genetics-based machine learning for linguistic rule extraction , 2001, Inf. Sci..

[34]  Ching-Lai Hwang,et al.  Multiple attribute decision making : an introduction , 1995 .

[35]  Efraim Turban,et al.  Neural Networks in Finance and Investing: Using Artificial Intelligence to Improve Real-World Performance , 1992 .

[36]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[37]  HUA-KAI CHIOU,et al.  Fuzzy Multiple-Criteria Decision-Making Approach for Industrial Green Engineering , 2002, Environmental management.

[38]  M. Sugeno,et al.  Some quantities represented by the Choquet integral , 1993 .

[39]  Casimir A. Kulikowski,et al.  Computer Systems That Learn: Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning and Expert Systems , 1990 .

[40]  Ferenc Szeifert,et al.  Data-driven generation of compact, accurate, and linguistically sound fuzzy classifiers based on a decision-tree initialization , 2003, Int. J. Approx. Reason..

[41]  M. Sugeno,et al.  An interpretation of fuzzy measures and the Choquet integral as an integral with respect to a fuzzy , 1989 .

[42]  菅野 道夫,et al.  Theory of fuzzy integrals and its applications , 1975 .

[43]  Y. Takefuji,et al.  Functional-link net computing: theory, system architecture, and functionalities , 1992, Computer.

[44]  Sam Kwong,et al.  Genetic Algorithms : Concepts and Designs , 1998 .