Classification based on Choquet integral

The Choquet integral is a powerful aggregation tool in information fusing and data mining. In this paper, a generalized nonlinear classification model based on single Choquet integral is summarized, and a novel generalized nonlinear classification model based on cross-oriented Choquet integrals is presented. Compared to the classification model based on single Choquet integral, a couple of Choquet integral are used to achieve the classification boundaries which can classify data in such situation as one class surrounding another one in a high dimensional space. The classification problems come down to properly specifying the fuzzy measure on which the Choquet integral(s) are defined and the classifying boundaries by which the different classes are separated. The values of these unknown parameters are optimally determined by evolutionary computation. The performance of these models are compared and validated with existed methods on a number of benchmark datasets.

[1]  Honggang Wang,et al.  A new nonlinear classifier with a penalized signed fuzzy measure using effective genetic algorithm , 2010, Pattern Recognit..

[2]  Eyke Hüllermeier,et al.  Preference Learning Using the Choquet Integral: The Case of Multipartite Ranking , 2012, IEEE Transactions on Fuzzy Systems.

[3]  R.P. Lippmann,et al.  Pattern classification using neural networks , 1989, IEEE Communications Magazine.

[4]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[5]  Kwong-Sak Leung,et al.  Classification of Heterogeneous Fuzzy Data by Choquet Integral With Fuzzy-Valued Integrand , 2007, IEEE Transactions on Fuzzy Systems.

[6]  Paul D. Gader,et al.  Minimum Classification Error Training for Choquet Integrals With Applications to Landmine Detection , 2008, IEEE Transactions on Fuzzy Systems.

[7]  Dazhong Ma,et al.  Data-Core-Based Fuzzy Min–Max Neural Network for Pattern Classification , 2011, IEEE Transactions on Neural Networks.

[8]  Yong Shi,et al.  A new nonlinear classification model based on cross-oriented Choquet integrals , 2011, International Conference on Information Science and Technology.

[9]  S. Sathiya Keerthi,et al.  Improvements to Platt's SMO Algorithm for SVM Classifier Design , 2001, Neural Computation.

[10]  Inés María Galván,et al.  AMPSO: A New Particle Swarm Method for Nearest Neighborhood Classification , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  M. Sugeno,et al.  Non-monotonic fuzzy measures and the Choquet integral , 1994 .

[12]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[13]  Ron Kohavi,et al.  Scaling Up the Accuracy of Naive-Bayes Classifiers: A Decision-Tree Hybrid , 1996, KDD.

[14]  Yen-Jen Oyang,et al.  Data classification with radial basis function networks based on a novel kernel density estimation algorithm , 2005, IEEE Transactions on Neural Networks.

[15]  G. Choquet Theory of capacities , 1954 .

[16]  Huanhuan Chen,et al.  Decision tree support vector machine based on genetic algorithm for multi-class classification , 2011 .

[17]  Pat Langley,et al.  Estimating Continuous Distributions in Bayesian Classifiers , 1995, UAI.

[18]  Kwong-Sak Leung,et al.  Classification by nonlinear integral projections , 2003, IEEE Trans. Fuzzy Syst..

[19]  Somnath Sengupta,et al.  Neighborhood Supported Model Level Fuzzy Aggregation for Moving Object Segmentation , 2014, IEEE Transactions on Image Processing.

[20]  Jitendra Malik,et al.  SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[21]  D. Denneberg Non-additive measure and integral , 1994 .

[22]  Yong Wang,et al.  Using Model Trees for Classification , 1998, Machine Learning.

[23]  Pericles A. Mitkas,et al.  Fuzzy lattice reasoning (FLR) classifier and its application for ambient ozone estimation , 2007, Int. J. Approx. Reason..

[24]  G. Klir,et al.  Fuzzy Measure Theory , 1993 .

[25]  M. Shaw,et al.  Induction of fuzzy decision trees , 1995 .

[26]  E. Pap Null-Additive Set Functions , 1995 .