Error-Correcting Tournaments

We present a family of pairwise tournaments reducing k-class classification to binary classification. These reductions are provably robust against a constant fraction of binary errors, and match the best possible computation and regret up to a constant.

[1]  Andrew Chi-Chih Yao,et al.  On Fault-Tolerant Networks for Sorting , 1985, SIAM J. Comput..

[2]  Bala Ravikumar,et al.  On Selecting the Largest Element in Spite of Erroneous Information , 1987, STACS.

[3]  Eli Upfal,et al.  Computing with unreliable information , 1990, STOC '90.

[4]  Javed A. Aslam,et al.  Searching in the presence of linearly bounded errors , 1991, STOC '91.

[5]  S. Rao Kosaraju,et al.  Comparison-based search in the presence of errors , 1993, STOC.

[6]  Claire Mathieu,et al.  Selection in the presence of noise: the design of playoff systems , 1994, SODA '94.

[7]  Krzysztof Diks,et al.  Reliable Minimum Finding Comparator Networks , 1994, MFCS.

[8]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[9]  J. Fox.  Applied Regression Analysis, Linear Models, and Related Methods , 1997 .

[10]  Robert Tibshirani,et al.  Classification by Pairwise Coupling , 1997, NIPS.

[11]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[12]  Venkatesan Guruswami,et al.  Multiclass learning, boosting, and error-correcting codes , 1999, COLT '99.

[13]  Richard F. Gunst,et al.  Applied Regression Analysis , 1999, Technometrics.

[14]  Krzysztof Diks,et al.  Reliable Minimum Finding Comparator Networks , 2000, Fundam. Informaticae.

[15]  Yoram Singer,et al.  Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers , 2000, J. Mach. Learn. Res..

[16]  U. Ligges.  Review of An R and S-PLUS companion to applied regression by J. Fox, Sage Publications, Thousand Oaks, California 2002 , 2003 .

[17]  John Langford,et al.  Cost-sensitive learning by cost-proportionate example weighting , 2003, Third IEEE International Conference on Data Mining.

[18]  Yi Lin.  Multicategory Support Vector Machines, Theory, and Application to the Classification of . . . , 2003 .

[19]  John Langford,et al.  Estimating Class Membership Probabilities using Classifier Learners , 2005, AISTATS.

[20]  John Langford,et al.  Sensitive Error Correcting Output Codes , 2005, COLT.

[21]  Tom Minka,et al.  TrueSkillTM: A Bayesian Skill Rating System , 2006, NIPS.

[22]  John Langford,et al.  Multi-Label Prediction via Compressed Sensing , 2009, NIPS.