Solving one-class problem with outlier examples by SVM

Support Vector Data Description (SVDD) is an important algorithm for data description problem. SVDD uses only positive examples to learn a predictor whether an example is positive or negative. When a fraction of negative examples are available, the performance of SVDD is expected to be improved. SVDD-neg, as an extension of SVDD, learns a predictor with positive examples and a fraction negative ones. However, the performance of SVDD-neg becomes worse than SVDD in some cases when some negative examples are available. In this paper, a new algorithm "SVM-SVDD" is proposed, in which both Support Vector Machine (SVM) and SVDD are used to solve data description problem with negative examples. The experimental results illustrate that SVM-SVDD outperforms SVDD-neg on both training time and accuracy.

[1]  Feiping Nie,et al.  Multiple rank multi-linear SVM for matrix data classification , 2014, Pattern Recognit..

[2]  Nello Cristianini,et al.  Controlling the Sensitivity of Support Vector Machines , 1999 .

[3]  Michael Brady,et al.  Novelty detection for the identification of masses in mammograms , 1995 .

[4]  Feiping Nie,et al.  Multiple view semi-supervised dimensionality reduction , 2010, Pattern Recognit..

[5]  Seiji Yamada,et al.  Non-Relevance Feedback Document Retrieval based on One Class SVM and SVDD , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[6]  Long Cheng,et al.  Recurrent Neural Network for Non-Smooth Convex Optimization Problems With Application to the Identification of Genetic Regulatory Networks , 2011, IEEE Transactions on Neural Networks.

[7]  Hanseok Ko,et al.  Face detection using support vector domain description in color images , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[8]  Robert P. W. Duin,et al.  Support Vector Data Description , 2004, Machine Learning.

[9]  Sang-Woong Lee,et al.  Low resolution face recognition based on support vector data description , 2006, Pattern Recognit..

[10]  Long Cheng,et al.  Relaxation Labeling using an improved Hopfield neural network , 2006 .

[11]  Don R. Hush,et al.  A Classification Framework for Anomaly Detection , 2005, J. Mach. Learn. Res..

[12]  Giles M. Foody,et al.  Sanchez-Hernandez, Carolina and Boyd, Doreen S. and Foody, Giles M. (2007) One-class classification for monitoring a specific land cover class: SVDD classification of fenland. IEEE Transactions on , 2016 .

[13]  Jun Wang,et al.  Analysis and Design of a $k$ -Winners-Take-All Model With a Single State Variable and the Heaviside Step Activation Function , 2010, IEEE Transactions on Neural Networks.

[14]  Hui Luo,et al.  A SVDD approach of fuzzy classification for analog circuit fault diagnosis with FWT as preprocessor , 2011, Expert Syst. Appl..

[15]  Xiaolin Hu,et al.  An Improved Dual Neural Network for Solving a Class of Quadratic Programming Problems and Its $k$-Winners-Take-All Application , 2008, IEEE Transactions on Neural Networks.

[16]  M. M. Moya,et al.  One-class classifier networks for target recognition applications , 1993 .

[17]  Long Cheng,et al.  A Delayed Projection Neural Network for Solving Linear Variational Inequalities , 2009, IEEE Transactions on Neural Networks.

[18]  Yi Wu,et al.  Stable local dimensionality reduction approaches , 2009, Pattern Recognit..

[19]  Jun Wang,et al.  A Novel Recurrent Neural Network for Solving Nonlinear Optimization Problems With Inequality Constraints , 2008, IEEE Transactions on Neural Networks.

[20]  Long Cheng,et al.  A Neutral-Type Delayed Projection Neural Network for Solving Nonlinear Variational Inequalities , 2008, IEEE Transactions on Circuits and Systems II: Express Briefs.

[21]  Long Cheng,et al.  Solving linear variational inequalities by projection neural network with time-varying delays , 2009 .

[22]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[23]  Andrew Chan,et al.  An SVDD-Based Algorithm for Target Detection in Hyperspectral Imagery , 2011, IEEE Geoscience and Remote Sensing Letters.

[24]  Lucas C. Parra,et al.  Statistical Independence and Novelty Detection with Information Preserving Nonlinear Maps , 1996, Neural Computation.

[25]  Jun Wang,et al.  A recurrent neural network for solving nonlinear convex programs subject to linear constraints , 2005, IEEE Transactions on Neural Networks.

[26]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .