Projection with Double Nonlinear Integrals for Classification

In this study, a new classification model based on projection with Double Nonlinear Integrals is proposed. There exist interactions among predictive attributes towards the decisive attribute. The contribution rate of each combination of predictive attributes, including each singleton, towards the decisive attribute can be re presented by a fuzzy measure. We use Double Nonlinear Integrals with respect to the signed fuzzy measure to project data to 2-Dimension space. Then classify the virtual value in the 2-D space projected by Nonlinear Integrals. In our experiments, we compare our classifier based on projection with Double Nonlinear Integrals with the classical method- Naive Bayes. The results show that our classification model is better than Naive Bayes.

[1]  M. Sugeno,et al.  Non-monotonic fuzzy measures and the Choquet integral , 1994 .

[2]  Bernhard Schölkopf,et al.  An improved training algorithm for kernel Fisher discriminants , 2001, AISTATS.

[3]  Michel Grabisch,et al.  Classification by fuzzy integral: performance and tests , 1994, CVPR 1994.

[4]  G. Klir,et al.  Fuzzy Measure Theory , 1993 .

[5]  Geoffrey J. McLachlan,et al.  Discriminant Analysis and Statistical Pattern Recognition: McLachlan/Discriminant Analysis & Pattern Recog , 2005 .

[6]  George J. Klir,et al.  Genetic algorithms for determining fuzzy measures from data , 1998, J. Intell. Fuzzy Syst..

[7]  Sebastian Thrun,et al.  The MONK''s Problems-A Performance Comparison of Different Learning Algorithms, CMU-CS-91-197, Sch , 1991 .

[8]  G. McLachlan.  Discriminant Analysis and Statistical Pattern Recognition , 1992 .

[9]  M. Sugeno,et al.  Fuzzy Measures and Integrals: Theory and Applications , 2000 .

[10]  Dr. Marcus Hutter,et al.  Universal artificial intelligence , 2004 .

[11]  Hans-Jürgen Zimmermann,et al.  Improved feature selection and classification by the 2-additive fuzzy measure , 1999, Fuzzy Sets Syst..

[12]  Kwong-Sak Leung,et al.  A genetic algorithm for determining nonadditive set functions in information fusion , 1999, Fuzzy Sets Syst..

[13]  Michel Grabisch,et al.  The representation of importance and interaction of features by fuzzy measures , 1996, Pattern Recognit. Lett..

[14]  James M. Keller,et al.  Possibility expectation and its decision making algorithm , 1992, [1992 Proceedings] IEEE International Conference on Fuzzy Systems.

[15]  Kwong-Sak Leung,et al.  Classification by nonlinear integral projections , 2003, IEEE Trans. Fuzzy Syst..