Ramp Loss based robust one-class SVM

A new method is proposed to reduce outliers' influence on OCSVM model.Ramp Loss function is introduced into OCSVM optimization.An iterative algorithm is proposed to solve this new OCSVM optimization.The outliers are first identified and then removed from the training set. One-class SVM (OCSVM) is widely adopted in one-class classification (OCC) fields. However, outliers in the training set negatively influence the classification surface of OCSVM, degrading its performance. To solve this problem, a novel method is proposed in this paper. This proposed method introduces Ramp Loss function into OCSVM optimization, so as to reduce outliers' influence. Then the outliers are identified and removed from the training set. The final classification surface is obtained on the remaining training samples. Various experiments verify the effectiveness of this proposed method.

[1]  Yong Shi,et al.  Robust twin support vector machine for pattern classification , 2013, Pattern Recognit..

[2]  Yang Zhang,et al.  Probabilistic Novelty Detection With Support Vector Machines , 2014, IEEE Transactions on Reliability.

[3]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[4]  C. Lee Giles,et al.  Nonconvex Online Support Vector Machines , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Wei Hu,et al.  Raw Wind Data Preprocessing: A Data-Mining Approach , 2015, IEEE Transactions on Sustainable Energy.

[6]  Peter W. Tse,et al.  Anomaly Detection Through a Bayesian Support Vector Machine , 2010, IEEE Transactions on Reliability.

[7]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[8]  Xiaomu Song,et al.  A SVM-based quantitative fMRI method for resting-state functional network detection. , 2014, Magnetic resonance imaging.

[9]  Vassilia Karathanassi,et al.  Estimation of the Number of Endmembers Using Robust Outlier Detection Method , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  Chen Jing,et al.  Fault detection based on a robust one class support vector machine , 2014, Neurocomputing.

[11]  Chun-Rong Huang,et al.  Video Saliency Map Detection by Dominant Camera Motion Removal , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[14]  Jason Weston,et al.  Trading convexity for scalability , 2006, ICML.

[15]  Dick den Hertog,et al.  Interior Point Approach to Linear, Quadratic and Convex Programming: Algorithms and Complexity , 1994 .

[16]  Johan A. K. Suykens,et al.  Ramp loss linear programming support vector machine , 2014, J. Mach. Learn. Res..

[17]  Robert P. W. Duin,et al.  Data description in subspaces , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[18]  Adriano Lorena Inácio de Oliveira,et al.  One-Class Classification based on searching for the problem features limits , 2014, Expert Syst. Appl..

[19]  O. Kalinina,et al.  Detection of atypical genes in virus families using a one-class SVM , 2014, BMC Genomics.

[20]  Christian Callegari,et al.  Improving PCA‐based anomaly detection by using multiple time scale analysis and Kullback–Leibler divergence , 2014, Int. J. Commun. Syst..

[21]  Qian Du,et al.  Collaborative Representation for Hyperspectral Anomaly Detection , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Hans-Peter Kriegel,et al.  LOF: identifying density-based local outliers , 2000, SIGMOD 2000.

[23]  Alan L. Yuille,et al.  The Concave-Convex Procedure , 2003, Neural Computation.

[24]  Anastasios Tefas,et al.  Using robust dispersion estimation in support vector machines , 2013, Pattern Recognit..

[25]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[26]  Yashwant Prasad Singh,et al.  ONE-CLASS SUPPORT VECTOR MACHINES APPROACH TO ANOMALY DETECTION , 2013, Appl. Artif. Intell..

[27]  Shehroz S. Khan,et al.  X-Factor HMMs for Detecting Falls in the Absence of Fall-Specific Training Data , 2014, IWAAL.

[28]  Hava T. Siegelmann,et al.  Support Vector Clustering , 2002, J. Mach. Learn. Res..

[29]  Yufeng Liu,et al.  Robust Truncated Hinge Loss Support Vector Machines , 2007 .

[30]  Slim Abdennadher,et al.  Enhancing one-class support vector machines for unsupervised anomaly detection , 2013, ODD '13.

[31]  Stan Matwin,et al.  Addressing the Curse of Imbalanced Training Sets: One-Sided Selection , 1997, ICML.