Rejection strategies for learning vector quantization

We present prototype-based classification schemes, e.g. learn- ing vector quantization, with cost-function-based and geometrically mo- tivated reject options. We evaluate the reject schemes in experiments on artificial and benchmark data sets. We demonstrate that reject options improve the accuracy of the models in most cases, and that the perfor- mance of the proposed schemes is comparable to the optimal reject option of the Bayes classifier in cases where the latter is available.

[1]  Anil K. Jain,et al.  Reject option for VQ-based Bayesian classification , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[2]  Fabio Roli,et al.  Support Vector Machines with Embedded Reject Option , 2002, SVM.

[3]  Ivor W. Tsang,et al.  Core Vector Machines: Fast SVM Training on Very Large Data Sets , 2005, J. Mach. Learn. Res..

[4]  Colin Campbell,et al.  Learning with Support Vector Machines , 2011, Learning with Support Vector Machines.

[5]  Eiki Ishidera,et al.  A confidence value estimation method for handwritten Kanji character recognition and its application to candidate reduction , 2003, Document Analysis and Recognition.

[6]  Atsushi Sato,et al.  Generalized Learning Vector Quantization , 1995, NIPS.

[7]  Michael Biehl,et al.  Adaptive Relevance Matrices in Learning Vector Quantization , 2009, Neural Computation.

[8]  Thomas Martinetz,et al.  Topology representing networks , 1994, Neural Networks.

[9]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[10]  Chih-Jen Lin,et al.  Probability Estimates for Multi-class Classification by Pairwise Coupling , 2003, J. Mach. Learn. Res..

[11]  Michael Biehl,et al.  Analysis of Flow Cytometry Data by Matrix Relevance Learning Vector Quantization , 2013, PloS one.

[12]  Horst-Michael Groß,et al.  A life-long learning vector quantization approach for interactive learning of multiple categories , 2012, Neural Networks.

[13]  Klaus Obermayer,et al.  Soft Learning Vector Quantization , 2003, Neural Computation.

[14]  Sarah Jane Delany,et al.  Sampling with Confidence: Using k-NN Confidence Measures in Active Learning , 2009 .

[15]  C. K. Chow,et al.  On optimum recognition error and reject tradeoff , 1970, IEEE Trans. Inf. Theory.

[16]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .