Error-resilient pattern classification using a combination of spreading and coding gains

An approach that aims to enhance error resilience in pattern classification problems is proposed. The new approach combines the spread spectrum technique, specifically its selectivity and sensitivity, with error-correcting output codes (ECOC) for pattern classification. This approach combines both the coding gain of ECOC and the spreading gain of the spread spectrum technique to improve error resilience. ECOC is a well-established technique for general purpose pattern classification, which reduces the multi-class learning problem to an ensemble of two-class problems and uses special codewords to improve the error resilience of pattern classification. The direct sequence code division multiple access (DS-CDMA) technique is a spread spectrum technique that provides high user selectivity and high signal detection sensitivity, resulting in a reliable connection through a noisy radio communication channel shared by multiple users. Using DS-CDMA to spread the codeword, assigned to each pattern class by the ECOC technique, gives codes with coding properties that enable better correction of classification errors than ECOC alone. Results of performance assessment experiments show that the use of DS-CDMA alongside ECOC boosts error-resilience significantly, by yielding better classification accuracy than ECOC by itself.

[1]  José Carlos González,et al.  Good Error Correcting Output Codes for Adaptive Multiclass Learning , 2003, Multiple Classifier Systems.

[2]  Bijan Jabbari,et al.  Spreading codes for direct sequence CDMA and wideband CDMA cellular networks , 1998, IEEE Commun. Mag..

[3]  Ludmila I. Kuncheva Using diversity measures for generating error-correcting output codes in classifier ensembles , 2005, Pattern Recognit. Lett..

[4]  Jian Li,et al.  Unifying the error-correcting and output-code AdaBoost within the margin framework , 2005, ICML.

[5]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[6]  Laurence B. Milstein,et al.  Optimal allocation of bandwidth for source coding, channel coding, and spreading in CDMA systems , 2004, IEEE Transactions on Communications.

[7]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[8]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[9]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  C. Chibelushi,et al.  Multi-class pattern learning using spread spectrum codes , 2006 .

[11]  Khaled Ben Letaief Efficient simulation of direct-sequence spread-spectrum multiple-access communications systems , 1994, Proceedings of ICCS '94.

[12]  S. Moshavi,et al.  Multi-user detection for DS-CDMA communications , 1996, IEEE Commun. Mag..

[13]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[14]  Terrence J. Sejnowski,et al.  Parallel Networks that Learn to Pronounce English Text , 1987, Complex Syst..

[15]  Terry Windeatt,et al.  Boosted ECOC ensembles for face recognition , 2003 .

[16]  Paul G. Flikkema,et al.  Spread-spectrum techniques for wireless communication , 1997, IEEE Signal Process. Mag..