Combining classifiers in error correcting output coding

The authors performed research on a pattern classifier using ECOC (Error Correcting Output Coding) which encodes learning patterns using error correction coding and then learns such that each discriminant function outputs the encoded values. In particular, in this research the authors focused on a method to decode the output of each discriminant function to class symbols, and then proposed a decoding method: WLS-ECOC (ECOC combination strategy based on Weighted Least Squares). WLS-ECOC estimated posterior probability for each class using the linear sum of the output of each discriminant function and then performed pattern recognition based on these posterior probabilities. © 2004 Wiley Periodicals, Inc. Syst Comp Jpn, 35(4): 9–18, 2004; Published online in Wiley InterScience (www.interscience.wiley.com). DOI 10.1002/scj.10549

[1]  Josef Kittler,et al.  Multiple Classifier Systems , 2004, Lecture Notes in Computer Science.

[2]  Thomas G. Dietterich Machine-Learning Research Four Current Directions , 1997 .

[3]  Thomas G. Dietterich,et al.  Achieving High-Accuracy Text-to-Speech with Machine Learning , 1997 .

[4]  Trevor Hastie,et al.  The Error Coding Method and PICTs , 1998 .

[5]  O. Antoine,et al.  Theory of Error-correcting Codes , 2022 .

[6]  Thomas G. Dietterich,et al.  Error-Correcting Output Coding Corrects Bias and Variance , 1995, ICML.

[7]  Lutz Prechelt,et al.  PROBEN 1 - a set of benchmarks and benchmarking rules for neural network training algorithms , 1994 .

[8]  Gareth M. James,et al.  Majority vote classifiers: theory and applications , 1998 .

[9]  David W. AhaNavy Cloud Classiication Using Error-correcting Output Codes , 1996 .

[10]  Amanda J. C. Sharkey,et al.  Combining Artificial Neural Nets: Ensemble and Modular Multi-Net Systems , 1999 .

[11]  M. Perrone Improving regression estimation: Averaging methods for variance reduction with extensions to general convex measure optimization , 1993 .

[12]  D W Aha,et al.  CLOUD CLASSIFICATION USING ERRORCORRECTING OUTPUT CODES , 1997 .

[13]  Reza Ghaderi,et al.  Least Squares and Estimation Measures via Error Correcting Output Code , 2001, Multiple Classifier Systems.

[14]  Koby Crammer,et al.  On the Learnability and Design of Output Codes for Multiclass Problems , 2002, Machine Learning.

[15]  Adam L. Berger,et al.  ERROR-CORRECTING OUTPUT CODING FOR TEXT CLASSIFICATION , 1999 .

[16]  Robert Tibshirani,et al.  A Comparison of Some Error Estimates for Neural Network Models , 1996, Neural Computation.

[17]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[18]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[19]  Bo-Cheng Wei,et al.  Exponential Family Nonlinear Models , 1998 .