Multiclass Latent Locally Linear Support Vector Machines

Kernelized Support Vector Machines (SVM) have gained the status of o-the-shelf classiers, able to deliver state of the art performance on almost any problem. Still, their practical use is constrained by their computational and memory complexity, which grows super-linearly with the number of training samples. In order to retain the low training and testing complexity of linear classiers and the exibility of non linear ones, a growing, promising alternative is represented by methods that learn non-linear classiers through local combinations of linear ones. In this paper we propose a new multi class local classier,

[1]  Vojislav Kecman,et al.  Adaptive local hyperplane classification , 2008, Neurocomputing.

[2]  Philip H. S. Torr,et al.  Locally Linear Support Vector Machines , 2011, ICML.

[3]  Vojislav Kecman,et al.  Locally linear support vector machines and other local models , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[4]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[5]  Thorsten Joachims,et al.  Training linear SVMs in linear time , 2006, KDD '06.

[6]  Ethem Alpaydin,et al.  Localized multiple kernel learning , 2008, ICML '08.

[7]  Koby Crammer,et al.  On the Algorithmic Implementation of Multiclass Kernel-based Vector Machines , 2002, J. Mach. Learn. Res..

[8]  Léon Bottou,et al.  Local Learning Algorithms , 1992, Neural Computation.

[9]  Thomas Hofmann,et al.  Kernel Methods for Missing Variables , 2005, AISTATS.

[10]  Antonio Torralba,et al.  Recognizing indoor scenes , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Thorsten Joachims,et al.  Learning structural SVMs with latent variables , 2009, ICML '09.

[13]  Jonathan J. Hull,et al.  A Database for Handwritten Text Recognition Research , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Yihong Gong,et al.  Nonlinear Learning using Local Coordinate Coding , 2009, NIPS.

[15]  Yang Wang,et al.  Max-margin hidden conditional random fields for human action recognition , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Barbara Caputo,et al.  Indoor Scene Recognition using Task and Saliency-driven Feature Pooling , 2012, BMVC.

[17]  Vladimir Vapnik,et al.  Principles of Risk Minimization for Learning Theory , 1991, NIPS.

[18]  Tong Zhang,et al.  Improved Local Coordinate Coding using Local Tangents , 2010, ICML.

[19]  Philip H. S. Torr,et al.  Learning Anchor Planes for Classification , 2011, NIPS.

[20]  Yoshua Bengio,et al.  Gradient-based Learning Applied to Document Recognition Gt Graph Transformer. Gtn Graph Transformer Network. Hmm Hidden Markov Model. Hos Heuristic Oversegmentation. K-nn K-nearest Neighbor. Nn Neural Network. Ocr Optical Character Recognition. Pca Principal Component Analysis. Rbf Radial Basis Func , 1998 .

[21]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Yoram Singer,et al.  Pegasos: primal estimated sub-gradient solver for SVM , 2011, Math. Program..

[23]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[24]  Jitendra Malik,et al.  SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[25]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[26]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[27]  Patrick Gallinari,et al.  SGD-QN: Careful Quasi-Newton Stochastic Gradient Descent , 2009, J. Mach. Learn. Res..

[28]  Qi Tian,et al.  Locality-sensitive support vector machine by exploring local correlation and global regularization , 2011, CVPR 2011.