A support vector machine using the lazy learning approach for multi-class classification

Support vector machines can be used in a new machine learning technique based on statistical learning. In this paper, we develop least squares support vector machines (LS-SVMs) using the lazy learning approach to classify data in unclassifiable regions in the case of multi-class classification. LS-SVMs use a set of linear equations while SVMs use a quadratic programming problem. The lazy learning approach is a local and memory-based technique. Therefore, it is an alternative technique to fuzzy inference systems. Our studies show that LS-SVMs with the lazy learning approach can give comparable results to fuzzy LS-SVMs for multi-class classification.

[1]  Hyun-Chul Kim,et al.  Constructing support vector machine ensemble , 2003, Pattern Recognit..

[2]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[3]  Edward Y. Chang,et al.  SVM binary classifier ensembles for image classification , 2001, CIKM '01.

[4]  Shigeo Abe,et al.  Fuzzy support vector machines for multiclass problems , 2002, ESANN.

[5]  Mauro Birattari,et al.  The local paradigm for modeling and control: from neuro-fuzzy to lazy learning , 2001, Fuzzy Sets Syst..

[6]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[7]  Vladimir Cherkassky,et al.  The Nature Of Statistical Learning Theory , 1997, IEEE Trans. Neural Networks.

[8]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[9]  Mauro Birattari,et al.  Recursive Lazy Learning for Modeling and Control , 1998, ECML.

[10]  Shigeo Abe,et al.  Fuzzy least squares support vector machines for multiclass problems , 2003, Neural Networks.

[11]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[12]  Steven H. Kim,et al.  Identifying the Impact of Decision Variables for Nonlinear Classification Tasks , 2000 .

[13]  Thorsten Joachims,et al.  Transductive Inference for Text Classification using Support Vector Machines , 1999, ICML.

[14]  Ulrich H.-G. Kreßel,et al.  Pairwise classification and support vector machines , 1999 .