Classifier combination based on active learning

In this paper, we propose classifier combination based on active learning, which deals with the design of classifier combination systems as training a combiner at the aggregation level and introduces SVM active learning into the design of this multi-category decision combiner. This algorithm greatly reduces the number of labeled data the classifier system needs in order to achieve satisfactory performance. This algorithm consists of two main steps: firstly, designing and training first level classifiers which can output posterior probability vectors as the input of the second level combiner, secondly, designing second level combiner based on SVM active learning and classifying testing samples with this combiner. Experiments on standard database show that our algorithm performs better than current classifier combination rules when considering both labeling cost and classification accuracy.

[1]  Mübeccel Demirekler,et al.  On output independence and complementariness in rank-based multiple classifier decision systems , 2001, Pattern Recognit..

[2]  Roberto Battiti,et al.  Democracy in neural nets: Voting schemes for classification , 1994, Neural Networks.

[3]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[4]  Shlomo Argamon,et al.  Committee-Based Sampling For Training Probabilistic Classi(cid:12)ers , 1995 .

[5]  Harris Drucker,et al.  Boosting and Other Ensemble Methods , 1994, Neural Computation.

[6]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .

[7]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[8]  William A. Gale,et al.  A sequential algorithm for training text classifiers , 1994, SIGIR '94.

[9]  Daphne Koller,et al.  Support Vector Machine Active Learning with Application sto Text Classification , 2000, ICML.

[10]  David A. Cohn,et al.  Active Learning with Statistical Models , 1996, NIPS.

[11]  B.V. Dasarathy,et al.  A composite classifier system design: Concepts and methodology , 1979, Proceedings of the IEEE.

[12]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[13]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[14]  Robert P. W. Duin,et al.  Experiments with Classifier Combining Rules , 2000, Multiple Classifier Systems.

[15]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[16]  Ching Y. Suen,et al.  Multiple Classifier Combination Methodologies for Different Output Levels , 2000, Multiple Classifier Systems.