Using Cooperative Clustering to Solve Multiclass Problems

In this paper, we present a multiclass classification algorithm to address the multiclass problems with cooperative clustering. Using cooperative clustering, the cluster centers of all classes can be computed iteratively and simultaneously. In the process of clustering, we select a pair of adjacent class, and make their cluster center drawn towards the boundary. Therefore, the data set around a class is found and the data set plus the data in this class can be trained to form a classifier. With this algorithm, training efficiency and classification efficiency are improved with a slight impact on classification accuracy.

[1]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[2]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[3]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[4]  Nello Cristianini,et al.  Large Margin DAGs for Multiclass Classification , 1999, NIPS.

[5]  H. L. Le Roy,et al.  Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability; Vol. IV , 1969 .

[6]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[7]  Soo-Young Lee,et al.  Support Vector Machines with Binary Tree Architecture for Multi-Class Classification , 2004 .

[8]  J. Platt.  Sequential Minimal Optimization : A Fast Algorithm for Training Support Vector Machines , 1998 .

[9]  Kishan G. Mehrotra,et al.  Efficient classification for multiclass problems using modular neural networks , 1995, IEEE Trans. Neural Networks.

[10]  Nello Cristianini,et al.  An introduction to Support Vector Machines , 2000 .

[11]  Miguel Figueroa,et al.  Competitive learning with floating-gate circuits , 2002, IEEE Trans. Neural Networks.

[12]  Shaomin Mu,et al.  Cooperative Clustering for Training SVMs , 2006, ISNN.

[13]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[14]  B. Fei,et al.  Binary tree of SVM: a new fast multiclass training and classification algorithm , 2006, IEEE Transactions on Neural Networks.

[15]  Robert Tibshirani,et al.  Classification by Pairwise Coupling , 1997, NIPS.

[16]  Ujjwal Maulik,et al.  Performance Evaluation of Some Clustering Algorithms and Validity Indices , 2002, IEEE Trans. Pattern Anal. Mach. Intell..