Loss-Weighted Decoding for Error-Correcting Output Coding

The multi-class classification is a challenging problem for several applications in Computer Vision. Error Correcting Output Codes technique (ECOC) represents a general framework capable to extend any binary classification process to the multi-class case. In this work, we present a novel decoding strategy that takes advantage of the ECOC coding to outperform the up to now existing decoding strategies. The novel decoding strategy is applied to the state-of-the-art coding designs, extensively tested on the UCI Machine Learning repository database and in two real vision applications: tissue characterization in medical images and traffic sign categorization. The results show that the presented methodology considerably increases the performance of the traditional ECOC strategies and the state-of-the-art multi-classifiers.

[1]  T Windeatt,et al.  CODING AND DECODING FOR MULTI-CLASS LEARNING PROBLEMS , 2003 .

[2]  Yoram Singer,et al.  Multiclass Learning by Probabilistic Embeddings , 2002, NIPS.

[3]  Paolo Frasconi,et al.  New results on error correcting output codes of kernel machines , 2004, IEEE Transactions on Neural Networks.

[4]  Thomas G. Dietterich,et al.  Error-Correcting Output Coding Corrects Bias and Variance , 1995, ICML.

[5]  Naohiro Ishii,et al.  Combining classification improvements by ensemble processing , 2005, Third ACIS Int'l Conference on Software Engineering Research, Management and Applications (SERA'05).

[6]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[7]  Y. Freund,et al.  Discussion of the Paper \additive Logistic Regression: a Statistical View of Boosting" By , 2000 .

[8]  Jordi Vitrià,et al.  Discriminant ECOC: a heuristic method for application dependent design of error correcting output codes , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Sergio Escalera,et al.  ECOC-ONE: A Novel Coding and Decoding Strategy , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[10]  Ching Y. Suen,et al.  Unconstrained numeral pair recognition using enhanced error correcting output coding: a holistic approach , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[11]  Petia Radeva,et al.  In-Vivo IVUS Tissue Classification: A Comparison Between RF Signal Analysis and Reconstructed Images , 2006, CIARP.

[12]  Yoram Singer,et al.  Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers , 2000, J. Mach. Learn. Res..