Ternary Bradley-Terry model-based decoding for multi-class classification

A multi-class classifier based on the Bradley-Terry model predicts the multi-class label of an input by combining the outputs from multiple binary classifiers, where the combination should be a priori designed as a code word matrix. According to this framework, the code word matrix was originally designed to consist of +1 and -1, and has later been extended to allow zero components. This extension has seemed to effectively work, but in fact, contains a problem. In this article, we propose a Boosting algorithm, which deals with three categories by allowing a dasiadonpsilat carepsila category, and present a modified decoding method called dasiaternarypsila Bradley-Terry model. In addition, we propose a fast decoding scheme which resolves the heavy computation of the conventional Bradley-Terry model-based decoding.

[1]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[2]  Andreu Català,et al.  K-SVCR. A Multi-class Support Vector Machine , 2000, ECML.

[3]  Shin Ishii,et al.  Optimal Aggregation of Binary Classifiers for Multiclass Cancer Diagnosis Using Gene Expression Profiles , 2009, TCBB.

[4]  B. Zadrozny.  Reducing multiclass to binary by coupling probability estimates , 2001, NIPS.

[5]  Cecilio Angulo,et al.  Multi-Classification by Using Tri-Class SVM , 2006, Neural Processing Letters.

[6]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[7]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[8]  Eddy Mayoraz,et al.  Improved Pairwise Coupling Classification with Correcting Classifiers , 1998, ECML.

[9]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[10]  Koby Crammer,et al.  On the Algorithmic Implementation of Multiclass Kernel-based Vector Machines , 2002, J. Mach. Learn. Res..

[11]  Yoram Singer,et al.  Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers , 2000, J. Mach. Learn. Res..

[12]  Robert Tibshirani,et al.  Classification by Pairwise Coupling , 1997, NIPS.

[13]  Shin Ishii,et al.  A probabilistic decoding approach to multi-class classification , 2007, 2007 International Joint Conference on Neural Networks.

[14]  R. A. Bradley,et al.  Rank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons , 1952 .

[15]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[16]  Jason Weston,et al.  Support vector machines for multi-class pattern recognition , 1999, ESANN.

[17]  Florin Cutzu,et al.  Polychotomous Classification with Pairwise Classifiers: A New Voting Principle , 2003, Multiple Classifier Systems.