Clustering via fuzzy one-class quadratic surface support vector machine

This paper proposes a soft clustering algorithm based on a fuzzy one-class kernel-free quadratic surface support vector machine model. One main advantage of our new model is that it directly uses a quadratic function for clustering instead of the kernel function. Thus, we can avoid the difficult task of finding a proper kernel function and corresponding parameters. Besides, for handling data sets with a large amount of outliers and noise, we introduce the Fisher discriminant analysis to consider minimizing the within-class scatter. Our experimental results on some artificial and real-world data sets demonstrate that the proposed algorithm outperforms Bicego’s benchmark algorithm in terms of the clustering accuracy and efficiency. Moreover, this proposed algorithm is also shown to be very competitive with several state-of-the-art clustering methods.

[1]  Issam Dagher,et al.  Quadratic kernel-free non-linear support vector machine , 2008, J. Glob. Optim..

[2]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2004 .

[3]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[4]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[5]  T. Kohonen Self-organized formation of topographically correct feature maps , 1982 .

[6]  Jian Luo,et al.  Soft Quadratic Surface Support Vector Machine for Binary Classification , 2016, Asia Pac. J. Oper. Res..

[7]  Sheng-De Wang,et al.  Fuzzy support vector machines , 2002, IEEE Trans. Neural Networks.

[8]  Francesco Camastra,et al.  A Novel Kernel Method for Clustering , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Kin Keung Lai,et al.  Credit Scoring Models with AUC Maximization Based on Weighted SVM , 2009, Int. J. Inf. Technol. Decis. Mak..

[10]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[11]  Witold Pedrycz,et al.  Entropic One-Class Classifiers , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Mário A. T. Figueiredo,et al.  Soft clustering using weighted one-class support vector machines , 2009, Pattern Recognit..

[13]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[14]  Hua Yu,et al.  Quadratic kernel-free least squares support vector machine for target diseases classification , 2015, Journal of Combinatorial Optimization.

[15]  Jun Yang,et al.  Improved traffic detection with support vector machine based on restricted Boltzmann machine , 2017, Soft Comput..

[16]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[17]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Bartosz Krawczyk,et al.  One-class classifiers with incremental learning and forgetting for data streams with concept drift , 2015, Soft Comput..

[19]  Shu-Cherng Fang,et al.  FUZZY QUADRATIC SURFACE SUPPORT VECTOR MACHINE BASED ON FISHER DISCRIMINANT ANALYSIS , 2015 .

[20]  Mohammad Saraee,et al.  Simulated annealing least squares twin support vector machine (SA-LSTSVM) for pattern classification , 2017, Soft Comput..

[21]  G. Baudat,et al.  Generalized Discriminant Analysis Using a Kernel Approach , 2000, Neural Computation.

[22]  F. Tay,et al.  Application of support vector machines in financial time series forecasting , 2001 .

[23]  Mangui Liang,et al.  Fuzzy support vector machine based on within-class scatter for classification problems with outliers or noises , 2013, Neurocomputing.

[24]  Bartosz Krawczyk,et al.  Clustering-based ensembles for one-class classification , 2014, Inf. Sci..

[25]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[26]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[27]  Thomas Martinetz,et al.  'Neural-gas' network for vector quantization and its application to time-series prediction , 1993, IEEE Trans. Neural Networks.