Binary Strings and multiclass learning problems

The Output Coding technique for solving multi-class learning problems was originally proposed with rows of an error-corecting code matrix acting as code words to represent the classes. We summarise the requirements on design of the binary strings in the code matrix and consider alternate combining strategies. For shorter codes, it is shown that both code design and combining strategy can affect generalisation. Examples are presented on synthetic data, on natural benchmark data and on an application in face verification.

[1]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[2]  Hamiltonian Dynamical Systems Without Periodic Orbits , 1998, math/9811014.

[3]  Reza Ghaderi,et al.  Least Squares and Estimation Measures via Error Correcting Output Code , 2001, Multiple Classifier Systems.

[4]  CodingEun Bae Kong Probability Estimation via Error-Correcting Output , 1997 .

[5]  F. Lemmermeyer Error-correcting Codes , 2005 .

[6]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[7]  Jiri Matas,et al.  XM2VTSDB: The Extended M2VTS Database , 1999 .

[8]  W. W. Peterson,et al.  Error-Correcting Codes. , 1962 .

[9]  Reza Ghaderi,et al.  Multi-class learning and error-correcting code sensitivity , 2000 .

[10]  Robert E. Schapire,et al.  Using output codes to boost multiclass learning problems , 1997, ICML.

[11]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[12]  Koby Crammer,et al.  On the Learnability and Design of Output Codes for Multiclass Problems , 2002, Machine Learning.

[13]  Christopher J. Merz,et al.  UCI Repository of Machine Learning Databases , 1996 .

[14]  Terrence J. Sejnowski,et al.  Parallel Networks that Learn to Pronounce English Text , 1987, Complex Syst..

[15]  Trevor Hastie,et al.  The Error Coding Method and PICTs , 1998 .

[16]  Thomas G. Dietterich,et al.  Error-Correcting Output Codes: A General Method for Improving Multiclass Inductive Learning Programs , 1991, AAAI.

[17]  Reza Ghaderi,et al.  Binary labelling and decision-level fusion , 2001, Inf. Fusion.

[18]  Reza Ghaderi,et al.  Binary codes for multiclass decision combining , 2000, SPIE Defense + Commercial Sensing.

[19]  Giorgio Valentini,et al.  Effectiveness of Error Correcting Output Codes in Multiclass Learning Problems , 2000, Multiple Classifier Systems.

[20]  Thomas G. Dietterich,et al.  Error-Correcting Output Coding Corrects Bias and Variance , 1995, ICML.

[21]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[22]  Hong Yan,et al.  Comparison of face verification results on the XM2VTFS database , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[23]  Kagan Tumer,et al.  Error Correlation and Error Reduction in Ensemble Classifiers , 1996, Connect. Sci..

[24]  Charles L. Wilson,et al.  Binary decision clustering for neural-network-based optical character recognition , 1994, Pattern Recognit..

[25]  Yoram Singer,et al.  Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers , 2000, J. Mach. Learn. Res..

[26]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[27]  Robert Tibshirani,et al.  Classification by Pairwise Coupling , 1997, NIPS.

[28]  Gareth M. James,et al.  Majority vote classifiers: theory and applications , 1998 .

[29]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[30]  Jiri Matas,et al.  Face verification using error correcting output codes , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[31]  Juergen Luettin,et al.  Evaluation Protocol for the extended M2VTS Database (XM2VTSDB) , 1998 .