Solving Mahalanobis Ellipsoidal Learning Machine Via Second Order Cone Programming

In this paper, we propose a Second Order Cone Programming representable Mahalanobis Ellipsoidal Learning Machine (SOCP-MELM) for One Class Classification (OCC). We propose to utilize the covariance matrix and thus the Mahalanobis distance to replace the Euclidean distance in standard Support Vector Data Description (SVDD). Consequently, we modify and rewrite the SVDD as a standard SOCP problem and then solve it directly in its primal form via interior point methods in polynomial time. By introducing a specified uncertainty model and using the chebyshev inequality, we propose a robust form of SOCP-MELM. Finally, we validate the proposed method using real world benchmark datasets.

[1]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[2]  Carl D. Meyer,et al.  Matrix Analysis and Applied Linear Algebra , 2000 .

[3]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[4]  Guang-Bin Huang,et al.  Mahalanobis Ellipsoidal Learning Machine for One Class Classification , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[5]  Olivier Chapelle,et al.  Training a Support Vector Machine in the Primal , 2007, Neural Computation.

[6]  Stephen P. Boyd,et al.  Applications of second-order cone programming , 1998 .

[7]  Yi Liu,et al.  Minimum Enclosing and Maximum Excluding Machine for Pattern Description and Discrimination , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[8]  Shigeo Abe Training of Support Vector Machines with Mahalanobis Kernels , 2005, ICANN.

[9]  Long Quan,et al.  Data-dependent kernels for high-dimensional data classification , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[10]  Pedro E. López-de-Teruel,et al.  Nonlinear kernel-based statistical pattern analysis , 2001, IEEE Trans. Neural Networks.

[11]  Ivor W. Tsang,et al.  Learning the Kernel in Mahalanobis One-Class Support Vector Machines , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[12]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[13]  Robert P. W. Duin,et al.  Support vector domain description , 1999, Pattern Recognit. Lett..

[14]  Erkki Oja,et al.  Artificial Neural Networks: Formal Models and Their Applications - ICANN 2005, 15th International Conference, Warsaw, Poland, September 11-15, 2005, Proceedings, Part II , 2005, International Conference on Artificial Neural Networks.

[15]  Johan Löfberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004 .

[16]  Donald Goldfarb,et al.  Second-order cone programming , 2003, Math. Program..

[17]  Michael I. Jordan,et al.  Robust Novelty Detection with Single-Class MPM , 2002, NIPS.

[18]  David M. J. Tax,et al.  Kernel Whitening for One-Class Classification , 2003, Int. J. Pattern Recognit. Artif. Intell..

[19]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .