A combining strategy for ill-defined problems

In this paper we present a combining strategy to cope with the problem of classification in ill-defined domains. In these cases, even though a particular target class may be sampled in a representative manner, an outlier class may be poorly sampled, or new outlier classes may occur that have not been considered during training. This may have a considerable impact on classification performance. The objective of a classifier in this situation is to utilise all known information in discriminating, and to remain as robust as possible to changing conditions. A classification scheme is presented that deals with this problem, consisting of a sequential combination of a one-class and multi-class classifier. We show that it can outperform the traditional classifier with reject-option scheme, locally selecting/training models for the purpose of optimising the classification and rejection performance.

[1]  David M. J. Tax,et al.  One-class classification , 2001 .

[2]  Robert P. W. Duin,et al.  The combining classifier: to train or not to train? , 2002, Object recognition supported by user interaction for service robots.

[3]  Robert P. W. Duin,et al.  Building Road-Sign Classifiers Using a Trainable Similarity Measure , 2006, IEEE Transactions on Intelligent Transportation Systems.

[4]  Hiroshi Sako,et al.  Performance evaluation of pattern classifiers for handwritten character recognition , 2002, International Journal on Document Analysis and Recognition.

[5]  Robert P. W. Duin,et al.  Uniform Object Generation for Optimizing One-class Classifiers , 2002, J. Mach. Learn. Res..

[6]  Marcel Worring,et al.  Face detection by aggregated Bayesian network classifiers , 2001, Pattern Recognit. Lett..

[7]  Robert P. W. Duin,et al.  Robust machine fault detection with independent component analysis and support vector data description , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[8]  Bernard Dubuisson,et al.  A statistical decision rule with incomplete knowledge about classes , 1993, Pattern Recognit..

[9]  Andrew Webb,et al.  Classifier Design for Population and Sensor Drift , 2004, SSPR/SPR.